How to handle huge array in java?

From: Wei (wei_zhao2000_at_hotmail.com)
Date: 11/25/03

  • Next message: Harald Hein: "Re: How to handle huge array in java?"
    Date: 25 Nov 2003 12:23:30 -0800
    
    

    Hi,

    I have a java program which needs to manipulate a big 3D float array
    (40x3000x3000). By definition, it'll use 40x3000x3000x4=1.4GB memory,
    and my pc has only 512MB physical RAM and I set 2GB page memory.

    I tried the following steps:
    1. run java with option -Xmx1440m, but it seems doing Garbage
    collection when it used up physical ram, and cpu usage drops to <7%,
    memory usage also drops to <100MB. It seems hanging there forever.
    2. added -Xnoclassgc (trying to disable garbage collection), but no help.
    3. I thought about reducing the array size by using short instead of
    float, but it's not acurate enough.

    While I'm working on new algorithm to reduce the size of the array,
    it may not be available soon. Can anyone suggest me how to handle the
    big array with my current PC setting?

    Thanks a lot,

    Wei


  • Next message: Harald Hein: "Re: How to handle huge array in java?"

    Relevant Pages

    • Re: How to handle huge array in java?
      ... >I have a java program which needs to manipulate a big 3D float array ... some data structure that keeps only part of the array in memory while ...
      (comp.lang.java.programmer)
    • Re: How to handle huge array in java?
      ... >I have a java program which needs to manipulate a big 3D float array ... some data structure that keeps only part of the array in memory while ...
      (comp.lang.java.help)
    • How to handle huge array in java?
      ... I have a java program which needs to manipulate a big 3D float array ... physical RAM and I set 2GB page memory. ... I thought about reducing the array size by using short instead of float, ...
      (comp.lang.java.programmer)
    • How to handle huge array in java?
      ... I have a java program which needs to manipulate a big 3D float array ... and my pc has only 512MB physical RAM and I set 2GB page memory. ...
      (comp.lang.java.programmer)
    • How to handle huge array in java?
      ... I have a java program which needs to manipulate a big 3D float array ... physical RAM and I set 2GB page memory. ... I thought about reducing the array size by using short instead of float, ...
      (comp.lang.java.help)