I agree with both Paul and Larry! Another good reason for having a pull parser (or in general a streaming parser) is that it increases it's reusability for clients which can operate in a streaming fashion. This isn't OJ (at least currently), but I have other applications for which this was a necessity. At one point I actually rewrote the Shapefile parser to be streaming as well...
Paul Austin wrote: > Hi Larry, > > You are correct that the resulting data set will take up a lot of memory > at the end, the advantage with the pull parser is that you don't take up > a whole bunch of extra memory for the XML DOM structures which typically > get loaded into memory for the whole document. So with the pull parser > there is little memory overhead where as for DOM you have probably at > least 2x memory required to load if not more > > Paul > > Larry Becker wrote: > >> It isn't the parser that takes up the memory except temporarily), but >> the memory resident dataset after loading. This will still limit the >> size. >> >> Larry >> >> On 8/30/07, Sunburned Surveyor <[EMAIL PROTECTED]> wrote: >> >> >>> Yup. It makes you wonder why they didn't use pull parsers from the >>> very beginning, doesn't it. >>> >>> SS >>> >>> On 8/30/07, Paul Austin <[EMAIL PROTECTED]> wrote: >>> >>> >>>> Agreed the pull parser is the only way to go for large XML files >>>> >>>> Paul >>>> >>>> Sunburned Surveyor wrote: >>>> >>>> >>>>> Martin, >>>>> >>>>> If we decide to support a restricted form of GML 2 we could build our >>>>> reader and writer on top of the XML Pull Parser from Sun. This would >>>>> help us to avoid memory problems when reading in large files. >>>>> >>>>> https://sjsxp.dev.java.net/ >>>>> >>>>> Just a thought. >>>>> >>>>> The Sunburned Surveyor >>>>> >>>>> ------------------------------------------------------------------------- >>>>> This SF.net email is sponsored by: Splunk Inc. >>>>> Still grepping through log files to find problems? Stop. >>>>> Now Search log events and configuration files using AJAX and a browser. >>>>> Download your FREE copy of Splunk now >> http://get.splunk.com/ >>>>> _______________________________________________ >>>>> Jump-pilot-devel mailing list >>>>> Jump-pilot-devel@lists.sourceforge.net >>>>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel >>>>> >>>>> >>>>> >>>> ------------------------------------------------------------------------- >>>> This SF.net email is sponsored by: Splunk Inc. >>>> Still grepping through log files to find problems? Stop. >>>> Now Search log events and configuration files using AJAX and a browser. >>>> Download your FREE copy of Splunk now >> http://get.splunk.com/ >>>> _______________________________________________ >>>> Jump-pilot-devel mailing list >>>> Jump-pilot-devel@lists.sourceforge.net >>>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel >>>> >>>> >>>> >>> ------------------------------------------------------------------------- >>> This SF.net email is sponsored by: Splunk Inc. >>> Still grepping through log files to find problems? Stop. >>> Now Search log events and configuration files using AJAX and a browser. >>> Download your FREE copy of Splunk now >> http://get.splunk.com/ >>> _______________________________________________ >>> Jump-pilot-devel mailing list >>> Jump-pilot-devel@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel >>> >>> >>> >> >> > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a browser. > Download your FREE copy of Splunk now >> http://get.splunk.com/ > _______________________________________________ > Jump-pilot-devel mailing list > Jump-pilot-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel > > -- Martin Davis Senior Technical Architect Refractions Research, Inc. (250) 383-3022 ------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ Jump-pilot-devel mailing list Jump-pilot-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
