Re: Needed: An Efficient, reliable and smart way to copy data from one DB to another


"Thomas Kellerer" <WVIJEVPANEHT@xxxxxxxxxxxxx> wrote in message
news:3ujjr5F112vd0U1@xxxxxxxxxxxxxxxxx
> Ted Byers wrote on 23.11.2005 06:20:
>> Ok, I have a prototype running, or I should say crawling, to copy data
>> from an MS Access database over to an MySQL database. I'd already set up
>> the tables and indeces, and was using a Java program to select all of the
>> contents from each table in the Access DB and insert each row from the
>> resulset into the MySQL. The largest table has about 7700 rows and a
>> couple
>
> Must be something with the network. I have a program that does essentially
> the same, and I can copy 10.000 records in about 30 seconds from
> PostgreSQL (8.1) to MySQL (5.0) both located on the same machine.
>
> As I don't think my program does anything magic in terms of performance,
> I'd suspect that you have a network issue here.
>
> Another thing to check is maybe the indexes you have defined on the target
> table. Maybe they are slowing down inserts. Try to drop them before
> copying the data, and re-create them afterwards.
>
Hi Thomas

Thanks. You may be on to something. This is happening with both databases
on the same machine, one with plenty of ram and disk space, and a 3.4 GHz
P-IV. But the database does involve a number of indeces, including a
couple complex foreign indeces.

Cheers,

Ted

--
R.E. (Ted) Byers, Ph.D., Ed.D.
R & D Decision Support Solutions
http://www.randddecisionsupportsolutions.com/
Healthy Living Through Informed Decision Making


.