Re: Most efficient way to write a large matrix to disk
- From: glen herrmannsfeldt <gah@xxxxxxxxxxxxxxxx>
- Date: Tue, 26 Aug 2008 10:53:03 -0800
Arjan wrote:
Without any intent of being rude (this is a serious
consideration): when you're handling such large matrices,
isn't it time to ask yourself the question: "Are all the
data that I want to store still meaningful?"
Nobody is able to grasp the significance of 10000*10000
numbers up to the last double precision digit behind the comma.
That would be true for printing them out, but not always
for intermediate storage. For most large matrix calculations
you need double precision to get any significance at all
in the result. (and likely more than double)
Maybe this is the time to cut out the relevant part
of your matrix and just save that?
Is your matrix sparse? Is the condition number very large?
In these cases (and probably many others) you can
significantly reduce the size of the data to store!
Certainly worth thinking about, but often you want
to write it out so you can decide later how much is
relevant.
-- glen
.
- References:
- Prev by Date: Re: Implementing JAVA interfaces in FORTRAN 20xx
- Next by Date: Re: busting sp datatypes
- Previous by thread: Re: Most efficient way to write a large matrix to disk
- Next by thread: Re: Most efficient way to write a large matrix to disk
- Index(es):
Relevant Pages
|