|
database
newsgroups
|
|||||||||||||||||||||||
|
|||||||||||||||||||||||
|
I have around 400 different Select -- Insert queries getting data from 200+
tbles. Data in each table can vary from 1 million to 3 million. All the data is being inserted in the same table. What's the best way to do this? Insert statement obviously wouldn't work. Is there a way I can use all the queries inside one DTS package? XXX,
BPC out and BCP or BULK INSERT in might be a faster option. Also, do you need to bring over all of the records or can you restrict the data being transfered i.e., date range? One other thing, you might consider a data archival policy and indexing strategies to make your queries run faster. HTH Jerry Show quote "XXX" <s*@nomail.com> wrote in message news:OXyD%23P6vFHA.2792@tk2msftngp13.phx.gbl... >I have around 400 different Select -- Insert queries getting data from 200+ >tbles. Data in each table can vary from 1 million to 3 million. All the >data is being inserted in the same table. > > What's the best way to do this? Insert statement obviously wouldn't work. > Is there a way I can use all the queries inside one DTS package? > No, I have a client who does registeration and Profile building in
PepopleSoft. They are building a new system, where data from several tables (200) gets merged into 3 tables. I have to get the initial load before the new system goes live, after that this will be done differently (through PeopleSoft). To answer your question all the data needs to be pulled out. I was hoping there was something easier than BCP.... Show quote "Jerry Spivey" <jspi***@vestas-awt.com> wrote in message news:eyU93T6vFHA.708@TK2MSFTNGP10.phx.gbl... > XXX, > > BPC out and BCP or BULK INSERT in might be a faster option. Also, do you > need to bring over all of the records or can you restrict the data being > transfered i.e., date range? One other thing, you might consider a data > archival policy and indexing strategies to make your queries run faster. > > HTH > > Jerry > "XXX" <s*@nomail.com> wrote in message > news:OXyD%23P6vFHA.2792@tk2msftngp13.phx.gbl... >>I have around 400 different Select -- Insert queries getting data from >>200+ tbles. Data in each table can vary from 1 million to 3 million. All >>the data is being inserted in the same table. >> >> What's the best way to do this? Insert statement obviously wouldn't work. >> Is there a way I can use all the queries inside one DTS package? >> > > Before you do the initial loads be sure to increase the transaction log
space and max setting. You might also want to begin with a small load and monitor the t-log usage using DBCC SQLPERF(LOGSPACE) to ensure adequate log space. Be sure to perform a backup and shrink the t-log when the loads are complete (or as you increment the loads if needed). HTH Jerry Show quote "XXX" <s*@nomail.com> wrote in message news:upR0zk6vFHA.464@TK2MSFTNGP15.phx.gbl... > No, I have a client who does registeration and Profile building in > PepopleSoft. > > They are building a new system, where data from several tables (200) gets > merged into 3 tables. I have to get the initial load before the new system > goes live, after that this will be done differently (through PeopleSoft). > > To answer your question all the data needs to be pulled out. I was hoping > there was something easier than BCP.... > > "Jerry Spivey" <jspi***@vestas-awt.com> wrote in message > news:eyU93T6vFHA.708@TK2MSFTNGP10.phx.gbl... >> XXX, >> >> BPC out and BCP or BULK INSERT in might be a faster option. Also, do you >> need to bring over all of the records or can you restrict the data being >> transfered i.e., date range? One other thing, you might consider a data >> archival policy and indexing strategies to make your queries run faster. >> >> HTH >> >> Jerry >> "XXX" <s*@nomail.com> wrote in message >> news:OXyD%23P6vFHA.2792@tk2msftngp13.phx.gbl... >>>I have around 400 different Select -- Insert queries getting data from >>>200+ tbles. Data in each table can vary from 1 million to 3 million. All >>>the data is being inserted in the same table. >>> >>> What's the best way to do this? Insert statement obviously wouldn't >>> work. Is there a way I can use all the queries inside one DTS package? >>> >> >> > >  |
|||||||||||||||||||||||
Other interesting topics