Load huge xml file

Hello,

I'm looking for solution/strategy how load big xml file ( 100 MB).
In simplification my xml look like:

<root>
<element1>...</element1>
<element1>...</element1>
<element2>...</element2>
<element2>...</element2>
</root>

One element's <element1> ... </element1> size is from few bytes to 5 MB
and has another elements itd.
After load entire element I can process it - load to DB.
Elements are quite complicated I have XSD for entire XML.


At this moment I'm thinking about two steps:

1. Parse xml using Stax, after read entire element rewrite to temorary file.
2. Load temporary file with one element using Xstream/JAXB

I would like avoid load all into memory because size of XML file can increase in future.
What do You think about this ?

Thanks in advance
zibi
.

Relevant Pages

  • Re: xmlfile load failed
    ... according to my xmlfile load function (it ... If you know the XML file ... and if you are running under VS then the current working directory is the ... it is not clear why you are casting this HRESULT to a bool and then doing the remarkably ...
    (microsoft.public.vc.mfc)
  • DataSet to Dataview to Dataset to XML!
    ... Load records in a DataSet: ... 2)Generate a DataView form table inside dataset and order it (i must ... Now i need convert data to XML, but not only one XML file, N XML ...
    (microsoft.public.dotnet.framework.adonet)
  • SQL Table to DataSet to Dataview, to DataSet to XML!
    ... Load records in a DataSet: ... 2)Generate a DataView form table inside dataset and order it (i must ... Now i need convert data to XML, but not only one XML file, N XML ...
    (microsoft.public.dotnet.framework.adonet)
  • Re: Load huge xml file
    ... I'm looking for solution/strategy how load big xml file. ... and has another elements itd. ... I would like avoid load all into memory because size of XML file can increase in future. ...
    (comp.lang.java.programmer)
  • Re: SQL Table to DataSet to Dataview, to DataSet to XML!
    ... If this is server side only it could be also a SQL Server job. ... I tryed to order before load table in DataSet, ... > 3) Now i need convert data to XML, but not only one XML file, N XML ...
    (microsoft.public.dotnet.framework.adonet)