Save Binary data.

Hello All.
I have a program that downloads 'gigabytes' of Axis NetCam photos per day.
Right now, I set up the process to put the images into a queue, and every 30
or so seconds, 'pop' them from the queue and save them to disc. I save
them as individual files.

I think that I'd like to modify it to save into one file 100-200 images,
so that I don't have directories with 50,000-90,000 frames before handing
that off to a DivX Encoder.

I don't know if I need to use something like cPickle, or maybe just save
them as a binary data file (which would be a temp file until later in the
day when I open it to begin the encoding process.)

Can someone please help me with some direction?


Thank you!
Dave



.

Relevant Pages

  • Re: Saturday afternoon, 8/22/9
    ... seemed fast at the time -- backing up four gigabytes would have taken ... The images sent back from Jupiter by the Galileo probe, ... antenna didn't open, were sent even slower than *that*. ...
    (rec.arts.sf.fandom)
  • Re: Best database for implementing a cache
    ... However i need to limit the size of the cache so that it may not grow ... metric for evicting existing stored images. ... simply rebuilding meta data at startup (list all files on disk ... with a file and the priority queue will implement file aviction ...
    (comp.lang.java.programmer)
  • Re: serious problem need help.
    ... I receive XML files with images included in the file. ... You could then have a cron script run once a minute or ... to try and clear out the queue. ...
    (comp.lang.php)
  • Queue limitations?
    ... the images are not appearing in the consumer thread....maybe 1 in 3 ... before passing it to Queue and then decompress it in the consumer ... def SetQueue: ...
    (comp.lang.python)
  • Re: total eclipse from Turkey
    ... It's just so nice to come home and not queue for anything;-) ... I never expected the total eclipse to have such a ... profound effect on me. ... the images to come... ...
    (uk.sci.astronomy)