Re: using mmap on large (> 2 Gig) files

myeates@xxxxxxxxxxxx schrieb:
Anyone ever done this? It looks like Python2.4 won't take a length arg
2 Gig since its not seen as an int.

What architecture are you on? On a 32-bit architecture, it's likely
impossible to map in 2GiB, anyway (since it likely won't fit into the
available address space).

On a 64-bit architecture, this is a known limitation of Python 2.4:
you can't have containers with more than 2Gi items. This limitation
was removed in Python 2.5, so I recommend to upgrade. Notice that
the code has seen little testing, due to lack of proper hardware,
so I shall suggest that you review the mmap code first before using
it (or just test it out and report bugs as you find them).

Regards,
Martin
.

Relevant Pages

  • Re: using mmap on large (> 2 Gig) files
    ... compiling Python 2.5 on Solaris 10 on an x86 is no walk in the ... On a 32-bit architecture, it's likely ... this is a known limitation of Python 2.4: ... so I shall suggest that you review the mmap code first before using ...
    (comp.lang.python)
  • Re: Allocating kernel memory
    ... > Linux kernel uses are not the same thing. ... That is not a limitation in Linux. ... AMD64 is the only x86 compatible architecture without ... dual Xeon IBM servers, ...
    (comp.os.linux.development.system)
  • Re: Why C Is Not My Favourite Programming Language
    ... And the number of modules in Python 2.4's Global Module Index is 362. ... The PDP architecture ideals ... fflushcan't be used to flush the contents of standard ... But it's not foolish that in ksh if you refer to an array name ...
    (comp.lang.c)
  • [Full-Disclosure] [SECURITY] [DSA 159-2] New Python packages fix problem introduced by security fix
    ... Zack Weinberg fixed this in the Python source. ... current stable distribution it has been fixed in version ... Debian GNU/Linux 2.2 alias potato ... Alpha architecture: ...
    (Full-Disclosure)
  • Re: web crawler in python or C?
    ... Choose Python by default. ... architecture is about partitioning systems into ... Any or all of these hints may be irrelevant to a specific category of ... applications, but then, so can the hint about algorithms be. ...
    (comp.lang.python)