How to solve memory problems while running a script parsing huge data
From: david (removethisdavid.petruescu_at_windspring.com)
Date: 07/13/04
- Next message: Lee W: "Re: Perl module PDF::API2"
- Previous message: Howard: "Win32::Perm Usage for special permissions"
- Next in thread: david: "Re: How to solve memory problems while running a script parsing huge data"
- Reply: david: "Re: How to solve memory problems while running a script parsing huge data"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Date: Tue, 13 Jul 2004 12:23:08 -0700
Hi,
I am working on writing a PERL script that reads millions of records into
buffers, parse them and write into Excel Spreadsheets.
I am facing memory problems due to this. Though I issue write statements and
"flush" statements in the middle of the program, my script doesn't actually
do the same till it reaches the end. Till then all the memory used by the
buffers is still in use.
Could anyone suggest how to deal with this issue? It will be great if I can
actually write into the spread*** as soon as I issue the write command
instead of saving it till the end; and also if I can flush the memory right
when I issue the command to flush.
Thanks,
David
- Next message: Lee W: "Re: Perl module PDF::API2"
- Previous message: Howard: "Win32::Perm Usage for special permissions"
- Next in thread: david: "Re: How to solve memory problems while running a script parsing huge data"
- Reply: david: "Re: How to solve memory problems while running a script parsing huge data"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]