How to solve memory problems while running a script parsing huge data

From: david (removethisdavid.petruescu_at_windspring.com)
Date: 07/13/04


Date: Tue, 13 Jul 2004 12:23:08 -0700

Hi,
I am working on writing a PERL script that reads millions of records into
buffers, parse them and write into Excel Spreadsheets.

I am facing memory problems due to this. Though I issue write statements and
"flush" statements in the middle of the program, my script doesn't actually
do the same till it reaches the end. Till then all the memory used by the
buffers is still in use.

Could anyone suggest how to deal with this issue? It will be great if I can
actually write into the spread*** as soon as I issue the write command
instead of saving it till the end; and also if I can flush the memory right
when I issue the command to flush.

Thanks,
David