We had similar a problem where we had to parse 1 GB XML files.Better transform to array like json and write a custom search API using lucene.
On Thu, May 21, 2009 at 8:12 PM, Sudarsan, Sithu D. < sithu.sudar...@fda.hhs.gov> wrote: > > Hi, > > While trying to parse xml documents of about 50MB size, we run into > OutOfMemoryError due to java heap space. Increasing JVM to use close 2GB > (that is the max), does not help. Is there any API that could be used to > handle such large single xml files? > > If Lucene is not the right place, please let me know alternate places to > look for, > > Thanks in advance, > Sithu D Sudarsan > sithu.sudar...@fda.hhs.gov > sdsudar...@ualr.edu > > > > -- Thanks, Prasanna
