Re: diff says memory exhausted need help with perl



On Mar 28, 6:54 pm, lawre...@xxxxxxxxx (Lawrence Statton) wrote:
If you're using Gnu diff (i.e. the diff that comes with most Linuces)
--speed-large-files might help you, without having to jump through a
perl hoop.

--L

Problems:
1) it runs out of memory 8Gig of files with 2GB RAM
2) it assumes a number of lines (3999) because it doesn't know if it
will
find a difference in one line or a million lines.
(2b: this goes against the *nix pipe concept because it then pushes
this
unwieldy block to the next pipe 'cut' rather than gracefully streaming
from pipe to pipe.)
3) The heiristic approach is an imprecise solution to an exact
problem.
It doesn't work perfectly every time.

For most files the simple bash scripts a clean, self-documenting and
fine.
It's natural in perl.
I'm battling syntax and trying to avoid physical RAM issues entirely.

Thanks

.



Relevant Pages

  • Re: diff says memory exhausted need help with perl
    ... perl hoop. ... unwieldy block to the next pipe 'cut' rather than gracefully streaming ... I'm battling syntax and trying to avoid physical RAM issues entirely. ... both files are sorted the problem reduces enormously, and using diff is ...
    (perl.beginners)
  • Re: Request for VICE team
    ... there was a standard "pipe" into the virtual machine's RAM... ... COM interface, or ..well, a pipe... ... Then we could hook external apps ...
    (comp.emulators.cbm)
  • Re: Request for VICE team
    ... there was a standard "pipe" into the virtual machine's RAM... ... COM interface, or ..well, a pipe... ... This is almost what I have done for debugging OpenCBM with VICE. ...
    (comp.emulators.cbm)
  • Request for VICE team
    ... Here's a request for the VICE team... ... there was a standard "pipe" into the virtual machine's RAM... ... into the machines RAM for interesting interfacing projects. ...
    (comp.emulators.cbm)