Re: File/data structure information



Dave wrote:
I have been Googling to find information about the pros and cons of different file and data structures within a file incl. databases). Would a appreciate a pointer to either some online documents or a good primer text. I don't have any specific questions and the information needs to be language and operating system agnostic.

The applications are for storing/finding strings, strings within strings, numerical data, etc. In other words, very general.

Just about any data structure you put in RAM can also be put inside
a file. Well, any, really. B-trees can go in files or in RAM, and
so can hash tables, and so can arrays with fixed-size elements, and
so can just about any other data structure you can think of, like
linked lists, PATRICIA trees, hashes, or whatever.

The only big difference is that access within a file is slower,
especially when moving from one part of a file to another, so
maintaining locality of reference is extra important if you are
concerned about performance. That concern exists (in modern
computers) with RAM too, because of the various levels of caches,
but it's more important with disks.

Of course, I'm assuming here that your files are on disk. They
might not be. In the old days, it would have been quite possibly
they were on tape. In current times, it's quite possible they're
on a flash, which doesn't have significant seek time, but which
does have slow writes.

- Logan
.



Relevant Pages

  • Re: argv vs objv
    ... In order to prevent TCL having to convert your data structures to/from ... strings all the time when calling the commands in question? ...
    (comp.lang.tcl)
  • File/data structure information
    ... I have been Googling to find information about the pros and cons of different file and data structures within a file incl. ... databases). ... The applications are for storing/finding strings, strings within strings, numerical data, etc. ...
    (comp.programming)
  • Re: Efficiency in Java
    ... Write the _correct_ code first, profile, identify the speed related ... If data structures are immutable, ... programs fast by using different data structures? ... e.g. using an array of strings instead of vector of objects and then ...
    (comp.lang.java.programmer)
  • Re: File/data structure information
    ... Dave wrote: ... different file and data structures within a file incl. ... The applications are for storing/finding strings, strings within strings, numerical data, etc. ...
    (comp.programming)
  • Re: Trying to design low level hard disk manipulation program
    ... with file compression is that a write in the middle of the file ... block mappings and meta data structures. ... I.e., the eventual limit is the sequential bandwidth of the log disks, which at, say, 40 MB/sec works out to tens of thousands of updates per second before any serious 'bogging down' occurs. ...
    (comp.arch)