Re: Fortran Unzip and C#
- From: e p chandler <epc8@xxxxxxxx>
- Date: Mon, 13 Oct 2008 10:55:58 -0700 (PDT)
On Oct 13, 1:26 am, hel...@xxxxxxxxxxxxxxxxxxxxxxxx (Phillip Helbig---
remove CLOTHES to reply) wrote:
In article
<5f71dead-d152-42d2-8bc5-a790e46d7...@xxxxxxxxxxxxxxxxxxxxxxxxxxxx>,
william <huxian...@xxxxxxxxx> writes:
I want to thank you all for the suggestions.
What I want to achieve is to write an efficient program to deal with
large files, say over 10 gigabytes (zipped file) each. The program
also need to handle at least 3 or 4 files of such size (unzipped size
around 90 gigabytes each). I also want to point out that each zip file
contains only one .txt file.
What versions of zip and unzip are you using? Unless you have
essentially the newest version, there are various documented limits
around 2--4 GB. It IS possible to exceed these limits, but the
resulting ZIP file might be corrupt.
There is a BETA of unzip 6.0d which does handle such large files.
see www DOT willus DOT com/archive/zip64beta/
I wrote a text file containing the integers from 1 to 1,000,000,000 in
I10.10 format.
This occupied 12,000,000,000 bytes. I zipped it using Windows Explorer
(right click...) to
a.zip, a file of 2,338,005,542 bytes.
Unzip 5.x from Info-Zip failed, but 6.0d did work.
The following test program:
character*80 s
integer i
i=0
do
read(*,'(a)',iostat=ierr) s
if (ierr /= 0) exit
i = i + 1
if (i == 10000000) then
write(*,'(a)') trim(s)
i = 0
end if
end do
end
compiled with g95 to a.exe
invoked with
unzip -p a.zip | a.exe
took approx. 10 minutes & 40 seconds to read though the test file on
my system.
- e
-- e-mail: epc8 at juno dot com
.
- Follow-Ups:
- Re: Fortran Unzip and C#
- From: william
- Re: Fortran Unzip and C#
- References:
- Fortran Unzip and C#
- From: william
- Re: Fortran Unzip and C#
- From: Sebastian Gallinat
- Re: Fortran Unzip and C#
- From: william
- RE: Fortran Unzip and C#
- From: meek
- Re: Fortran Unzip and C#
- From: Richard Maine
- Re: Fortran Unzip and C#
- From: Terence
- Re: Fortran Unzip and C#
- From: Gary Scott
- Re: Fortran Unzip and C#
- From: Richard Maine
- Re: Fortran Unzip and C#
- From: Gary Scott
- Re: Fortran Unzip and C#
- From: glen herrmannsfeldt
- Re: Fortran Unzip and C#
- From: Phillip Helbig---remove CLOTHES to reply
- Fortran Unzip and C#
- Prev by Date: Re: difference between g77 and gfortran
- Next by Date: Re: Fortran Unzip and C#
- Previous by thread: Re: Fortran Unzip and C#
- Next by thread: Re: Fortran Unzip and C#
- Index(es):
Relevant Pages
|