Re: Data transfer performance issue


"Del Murray" <Del.Murray@xxxxxxxxxxxxxx> wrote:
One of your big problems may be in not committing the data to the DB on a
frequent basis and allowing the datasets to become very memory intensive.
Use transactions and committ records about every 20 or so and see if it
speeds up.

Also, why delete when you can just update ???

If there are lots of indexes, try building a temp dataset on Oracle with no
indexes and then loading your table from that dataset. Sometimes loading
withing the context of the tables could be more efficient.

You will have to play with this from many angles since you cant use 3rd
party data.

Are you recasting data ?? that could be expensive also.


I have tried simply loading to a flat (non-indexed) table and
it takes roughly the same kind of time to load.
I'm committing fairly frequently every 100 recs

I was starting to investigate whether or not I could write a Stored
procedure to accept arrays then I could bulk insert using Forall
and bulk collect mechanisms, but I can't find any examples and to
be honest I don't know if D5 supports it so I'm a bit stuck
really !!
.