perl dbi memory error?

Hai,

I am using perl DBI module for fetching data from database.



My database table contains almost >70 million entries.

I am fetching the data using following steps

1. $dbh->DBI->connect(...);

2.
$sth = $dbh->prepare("Select * from $TABLE") //which contains more
than >70 million entries

3. $dbh->execute

4. $sth->fetchrow_array , to fetch data




My question is because of the large data (>70 million entries) , any
memory error like memory out of error comes (because i observed at
some instance memory utilization > 70 %).



Basically i want to know , the fetch command gets from db one row at a time or it gets from the memory

Any
better approach to make it use less memory . I tried by reading entries
in chunks of(10,000) , memory is low but speed is slow...

Thanks for your help

Thanks,
N Ravi


__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com

Relevant Pages

  • Re: Database suggestion
    ... ...will INSERT new entries and UPDATE existing entries in one swoop. ... in relation to the joint database. ... you can do the same thing with your current array in memory style using the same syntax: ...
    (comp.lang.php)
  • Re: Multiple Record Inputs with one Form
    ... For intCount = 1 To Me! ... the entries from the form inputed. ... "Jeff Boyce" wrote: ... database will let you do. ...
    (microsoft.public.access.formscoding)
  • Re: Commas in URLs?
    ... > entries are also commonly used for this purpose, ... > used bibliographic database app EndNote has a "URL" field in each entry. ... > the multiple keywords in EndNote Keywords field, ... > delimiter for individual keywords in that field is the comma. ...
    (comp.infosystems.www.authoring.html)
  • Re: Multiple Record Inputs with one Form
    ... Dim strSQL As String ... Lets say we start out with two entries. ... "Jeff Boyce" wrote: ... database will let you do. ...
    (microsoft.public.access.formscoding)
  • Re: Performance problem on import
    ... I am attempting to do a mass import of data to this database using a C++ program and the ... mutiple insert commands on both child tables ... until I get to about 50 or so entries in the master table. ... I see delays of 2 or 3 seconds on every insert command. ...
    (microsoft.public.access.externaldata)