out of memory



Hi,

I want to parse large log file (in GBs)

and I am readin 2-3 such files in hash array.

But since it will very big hash array it is going out of memory.

what are the other approach I can take.


Example code:

open ($INFO, '<', $file) or die "Cannot open $file :$!\n";
while (<$INFO>)
{
(undef, undef, undef, $time, $cli_ip, $ser_ip, undef, $id,
undef) = split('\|');
push @{$time_table{"$cli_ip|$id"}}, $time;
}
close $INFO;


In above code $file is very big in size(in Gbs); so I am getting out
of memory !

.



Relevant Pages

  • out of memory
    ... I want to parse large log file (in GBs) ... and I am readin 2-3 such files in hash array. ... But since it will very big hash array it is going out of memory. ...
    (comp.lang.perl.misc)
  • Re: out of memory
    ... I want to parse large log file (in GBs) ... and I am readin 2-3 such files in hash array. ... But since it will very big hash array it is going out of memory. ... Petr Vileta, Czech republic ...
    (comp.lang.perl.misc)
  • Re: out of memory
    ... But since it will very big hash array it is going out of memory. ... - to a "real" database in a proper relational structure, ... a timestamp, you could convert that timestamp into something else ...
    (comp.lang.perl.misc)
  • Re: Missing Memory
    ... Do you mean 40 GBs hard disk space, not memory? ...
    (microsoft.public.windowsxp.help_and_support)
  • Re: Vista Complete PC Backup (0x80780048) Not Enough Space?
    ... you install new update, do a system restore or maybe even install ... Overall- I am a big fan of Vista. ... I have Vista Ultimate 64-bit with 8 GBs of memory. ...
    (microsoft.public.windows.vista.file_management)