Working with very large text files



Hi,
I'm working on a server which writes text to large log files. The
problem is that these files are 1 GB and when I open them with perl,
perl tries to load the entire file into the memory and fails when XP is
out of memory.

I only need to use the text written in the last 5 minutes, which
shouldn't take more then a couple of megs, but since I'm using XP, I
can't use `tail`.

What code doesn't make perl load the entire file into the memory?

.



Relevant Pages

  • Re: Working with very large text files
    ... > I'm working on a server which writes text to large log files. ... > perl tries to load the entire file into the memory and fails when XP is ...
    (perl.beginners)
  • Memory leak, DBI 1.55 + DBD::ODBC 1.13 + MS SQL 2000
    ... Recently I have bumped into a memory leak happening in DBI. ... My Perl build config: ... ActivePerl Build 819 ... 28671 Define PERL_NO_DEV_RANDOM on Windows ...
    (perl.dbi.users)
  • Re: why the perl docs suck
    ... allocate new memory, copy then free old? ... Perl getting to that complex computation. ... >> the granularity of a Perl push statment. ... >> you don't know that memory allocation is not contiguous! ...
    (comp.lang.perl.misc)
  • Re: Multiple "MY" Same Variable - Release Bytes?
    ... Perl do not truly release more memory ... > bytes but rather make that malloc (memory allotment) available for ... arenas, ...
    (comp.lang.perl.misc)
  • Re: Linked lists
    ... Does perl have this concept? ... Linked list helps in good memory management. ... In C you need linked lists because it is expensive and cumbersome to ... collection is called Reference Counting. ...
    (perl.beginners)