Re: perl dbi memory error?

I am using mysql database.

Re: perl dbi memory error?





Thread Previous








From:
John Scoles

Date:
April 16, 2007 04:35

Subject:
Re: perl dbi memory error?




Sort answer "Yes with a But.."
Long answer "No with a Maybe.."
I guess it would depend on the DBD client you are using. Some are more
capable than others. For example with DBD::Oracle you can create a cursor
on the server sideg and then get that in clumps.

Give us the exact DBD clients you are using and I am sure one of out here
can give you a number of examples.

cheers
----- Original Message -----
From: "ravi kumar"
To:
Sent: Monday, April 16, 2007 5:16 AM
Subject: perl dbi memory error?


Hai,

I am using perl DBI module for fetching data from database.



My database table contains almost >70 million entries.

I am fetching the data using following steps

1. $dbh->DBI->connect(...);

2.
$sth = $dbh->prepare("Select * from $TABLE") //which contains more
than >70 million entries

3. $dbh->execute

4. $sth->fetchrow_array , to fetch data




My question is because of the large data (>70 million entries) , any
memory error like memory out of error comes (because i observed at
some instance memory utilization > 70 %).



Basically i want to know , the fetch command gets from db one row at a
time or it gets from the memory

Any
better approach to make it use less memory . I tried by reading entries
in chunks of(10,000) , memory is low but speed is slow...

Thanks for your help

Thanks,
N Ravi


__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com





Thread Previous








perl dbi memory error?
by ravi kumar
Re: perl dbi memory error?
by Robert Roggenbuck
Re: perl dbi memory error?
by John Scoles



__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com