Re: High memory or huge(?) lists

Thanks for the reply,
I am not using [array get] anywhere, some lrange sometimes to
reconstruct lists. I was afraid of that reply using sqlite I haven't
experienced that yet (I mean working with database connection under
tcl) but could be a solution indeed... the thing is that my list were
initially only maximum 5 results (and not a 1000) and we decided to
extend the results ;-) so trying to apply and tune the scripts to that
request.

I never used Metakit I'll have a look at it.

Jeannot

On 7 fév, 11:17, schlenk <schl...@xxxxxxxxxxxxxxxx> wrote:
Jeannot wrote:
Hi @ll,

I am working with a lot of data stored in one array and I encounter
this message:
"Not enough memory to allocate list
abort"
I am working on a high memory machine running Linux and Tcl8.5 (64 Go
and may have access to even bigger) so memory should not be the
problem altough I am investing this also...

Could be the case if you do an [array get] somewhere, which tries to
create tons of objects and a huge list for your arrays. But might have
other causes.

I think it might be an idea to use a :memory: based sqlite database or
something like Metakit for your data, usually much better for managing
huge structures of stuff than doing similar things via arrays when you
have a ton of data.

Michael

.

Relevant Pages

  • Re: Fast linked list
    ... > amounts of memory rather than huge chunks of it. ... random insertions into a vector/dynamic array are not as slow ... to cause a cache miss. ... some hard numbers on speed differences between lists and arrays. ...
    (microsoft.public.vc.mfc)
  • Re: Fast linked list
    ... > amounts of memory rather than huge chunks of it. ... random insertions into a vector/dynamic array are not as slow ... to cause a cache miss. ... some hard numbers on speed differences between lists and arrays. ...
    (microsoft.public.vc.language)
  • Re: In-place algorithm
    ... Nobody has been talking about sorting an array. ... this has been about sorting lists from the ... memory is required. ...
    (comp.programming)
  • Re: Array of pointers/references to another array
    ... to maintain copies of the array, sorted in a few different ways. ... working on Windows Mobile so memory is a constraint. ... Listis a reference type - just keep a reference to the object. ... the different copies *are* different lists. ...
    (microsoft.public.dotnet.languages.csharp)
  • Re: High Memory Consumption of Classes and Arrays
    ... The idea with the struct does not ... My structure has a lot of lists instead. ... So lets say we will have a million instances of the list class (or array ... This memory consumption is verified by the task manager so ...
    (microsoft.public.dotnet.framework.performance)