Datalogging storage question

From: matt laver (matthew.laver_at_NOSPAMstcenergy.com)
Date: 01/19/04 

Date: Mon, 19 Jan 2004 11:37:56 +0000

Hello,

I am currently writing a datalogging application and am now wondering
how to handle the data storage. My application could be logging data as
frequent as every second for long durations (many months). It could also
have multiple channels of data being logged at the same time, each
labeled with a datetime stamp.

The application is not client/server but will have new data that needs
writing to a persistent store while a user examines historic data at the
same time.

I want the application to be a single install so using a database server
like SQL Server, MySQL, etc is out of the question.

I could roll my own data storage file format, however I'm concerned
about the time taken to do this as my application is multithreaded so
could cause headaches when I have multiple writes, etc.

At the moment I am thinking about using Turbopowers FlashFiler as it can
compile into my application and will allow me to use SQL statements to
harvest historic data for reports.

Does anyone have any advise or better suggestions?

Thanks

Matt

Relevant Pages

  • Re: vb.net dataTbl can DTS read?
    ... then using ADO to read/write the data to Sql Server. ... like what DTS does with Text Files, MS Access data, etc. ... Right now I am experimenting with writing the data from ...
    (microsoft.public.sqlserver.dts)
  • Re: SQL Server 50% slower running on SAN
    ... than 3 hours when writing to the SAN. ... What takes 3 hours on the SAN is accomplished ... Network Interface counter is very low for SQL Server ... Burkhard ...
    (microsoft.public.sqlserver.server)
  • Re: Control storage of Data
    ... I am aware of the facts your writing about, ... binary data" information directly from the SQL Server ... How to control that formatting depends on ... >usually determined by your Windows Control Panel settings. ...
    (microsoft.public.sqlserver.server)
  • Re: Import problems on Windows Server
    ... XP is fine, so is Vista, like you I use them day in day out, around 12 hours a day myself too - laptops and the desktop i'm writing this on. ... I use SQL Server on XP and Vista for writing and demo'ing stuff, I get no problems doing this, and I push the cpu, disks etc... ... Buffalo isn't MS, I do like the direction MS are taking with software certification - driver signing, Vista/ Windows 2003 certified etc... ... The newer features are there because customers and folk in the community like me asked for them, they aren't creating features to catch up with oracle, stability is there, give it another 3 - 4 years and measure the two database products and their positions - it will be very interesting, I know I chose the correct product when I moved away from DB2 and could do oracle or SQL Server. ...
    (comp.databases.oracle.server)
  • Re: SQL Server 2000 speed problems
    ... SQL Server MVP ... > CREATE TABLE Control ... > Every second the database gets updated with a timestamp and 50 new values. ... ' Perform the actual writing to the database through the batch of SQL ...
    (microsoft.public.sqlserver.programming)