Read from database, write to another database, simultaneously

From: "Sean Davis" <seandavi@xxxxxxxxx>
Date: 10 Jan 2007 14:37:29 -0800

I am working on a simple script to read from one database (oracle) and
write to another (postgresql). I retrieve the data from oracle in
chunks and drop the data to postgresql continuously. The author of one
of the python database clients mentioned that using one thread to
retrieve the data from the oracle database and another to insert the
data into postgresql with something like a pipe between the two threads
might make sense, keeping both IO streams busy. Any hints on how to
get started?

Thanks,
Sean

.

Follow-Ups:
- Re: Read from database, write to another database, simultaneously
  - From: Bjoern Schliessmann

Prev by Date: Re: Problem installing cElementTree on Python 2.5
Next by Date: Re: where to find the spec of format in PyObject_CallMethod
Previous by thread: Python 2.5 install on Gentoo Linux: failed dmb and _tkinter
Next by thread: Re: Read from database, write to another database, simultaneously
Index(es):
- Date
- Thread

Relevant Pages

Re: VW --> Bianary file into CLOB or BLOB
... In fact the remaining poblem I have is not in transferring the BLOB to the database as I manage this on both PostgreSQL, Oracle and ODBC following the documentation. ...
(comp.lang.smalltalk)
Good DBA Book
... I'm sure this question has been asked a hundred times, but after looking into google for a few hours, I have so many books, I really don't know which one is right. ... like Oracle Essentials from O'Reilly. ... With all the step required, and if possible, example code and script, what is involved in a production database. ... The course will explain how to use PostgreSQL, ...
(comp.databases.oracle.server)
Re: Oracle 10g RAC performance
... a lot of companies selling junk to clean up their schemas and their ... to switch to another database. ... PostgreSQL as I believe that it will present a serious challenge to ... Oracle very soon. ...
(comp.databases.oracle.server)
Re: Read from database, write to another database, simultaneously
... database performed in parallel with an insert on the other database. ... The machine running the script is distinct from the Oracle machine ... which is distinct from the Postgresql machine. ... A Queue isn't quite right as it stands, ...
(comp.lang.python)
Re: Limiting Large Result Sets
... Oracle 9i - Database ... Windows XP - OS ... I want to retrieve about 30 rows at a time. ...
(comp.lang.java.databases)