Re: Massive sort among dozens of files
- From: user923005 <dcorbit@xxxxxxxxx>
- Date: Thu, 28 Jun 2007 15:24:24 -0700
On Jun 28, 2:54 am, Fred <hn.ft.p...@xxxxxxxxx> wrote:
Hi, all:
I've got a problem, there are about 50 files with total size
of 5GB, every of them has a size of about 100MB. Each file contains
thousands of lines of data. I need to sort the data in those files by
lexicon order, and write them to a set of files. The memory is limited
to 1.5GB. What is the fastest way to perform it? Thanks for help.
What is your sort key? Is it the entire line (as a character string)
or something else?
.
- References:
- Massive sort among dozens of files
- From: Fred
- Massive sort among dozens of files
- Prev by Date: Re: The software I wish I had
- Next by Date: Re: Efficient Vector Comparison
- Previous by thread: Re: Massive sort among dozens of files
- Index(es):