Feature Requests item #3203852, was opened at 2011-03-08 23:58
Message generated for change (Settings changed) made by michaudm
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=679909&aid=3203852&group_id=118054
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: File/Data IO
Group: None
>Status: Closed
>Resolution: Fixed
Priority: 3
Private: No
Submitted By: michael michaud (michaudm)
Assigned to: Nobody/Anonymous (nobody)
Summary: jml writer performance
Initial Comment:
I have a single layer single feature of 4 000 000 points.
I started OpenJUMP with -Xmx=1500M
My features takes about 190 MB in memory
It takes about 1 second to save it in a shapefile
It ends with the following messsage after 12 sec if I stry to save it as a JUMP
GML (*.jml) file :
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Unknown Source)
at java.lang.AbstractStringBuilder.expandCapacity(Unknown Source)
at java.lang.AbstractStringBuilder.append(Unknown Source)
at java.lang.StringBuffer.append(Unknown Source)
at
com.vividsolutions.jump.io.GMLGeometryWriter.startLine(GMLGeometryWriter.java:164)
at
com.vividsolutions.jump.io.GMLGeometryWriter.write(GMLGeometryWriter.java:293)
at
com.vividsolutions.jump.io.GMLGeometryWriter.writeLineString(GMLGeometryWriter.java:208)
at
com.vividsolutions.jump.io.GMLGeometryWriter.writeGeometry(GMLGeometryWriter.java:147)
at
com.vividsolutions.jump.io.GMLGeometryWriter.write(GMLGeometryWriter.java:130)
at
com.vividsolutions.jump.io.GMLGeometryWriter.write(GMLGeometryWriter.java:112)
at
com.vividsolutions.jump.io.GMLWriter.evaluateToken(GMLWriter.java:297)
at com.vividsolutions.jump.io.GMLWriter.write(GMLWriter.java:192)
at com.vividsolutions.jump.io.GMLWriter.write(GMLWriter.java:159)
at com.vividsolutions.jump.io.JMLWriter.write(JMLWriter.java:97)
at
com.vividsolutions.jump.io.datasource.ReaderWriterFileDataSource$1.executeUpdate(ReaderWriterFileDataSource.java:72)
at
com.vividsolutions.jump.workbench.datasource.AbstractSaveDatasetAsPlugIn.run(AbstractSaveDatasetAsPlugIn.java:33)
at
com.vividsolutions.jump.workbench.ui.task.TaskMonitorManager$TaskWrapper.run(TaskMonitorManager.java:151)
at java.lang.Thread.run(Unknown Source)
----------------------------------------------------------------------
>Comment By: michael michaud (michaudm)
Date: 2012-04-27 12:14
Message:
Geometries are now directly written into the Buffered writer instead of
producing a complete Geometry String before being flushed into the writer.
Could write Martin's dataset (200Mo shapefile, 1,7Go jml, largest geometry
> 1 000 000 coordinates)
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=679909&aid=3203852&group_id=118054
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Jump-pilot-devel mailing list
Jump-pilot-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
