Hello,
I will have a look at it and make some tests.
Nicolas
On Wed, 20 Feb 2019 at 17:14, <edgar.sol...@web.de> wrote:
> hmmm
>
> GeometryColumn gc = dsm.getGeometryColumn(query.getDatasetName(),
> query.getGeometryAttributeName());
> if (gc.isIndexed()) {
>
> gc is return as Null here. dunno why, but Nico should know :).. ede
>
>
> On 19.02.2019 21:08, Rahkonen Jukka (MML) wrote:
> > Hi,
> >
> > In r6130 the building of layer list from Geopackage datastore works
> (thanks Nicolas) and parsing fields with the date/datetime data is very
> fast (thanks Ede).
> > There seems to be still something wrong with adding Geopackage tables
> into map through the layer list. Error gives a hint that building spatial
> index query fails but the same error happens also if I drop the spatial
> index from the geopackage db.
> >
> > java.lang.NullPointerException
> > at
> com.vividsolutions.jump.datastore.spatialite.SpatialiteSQLBuilder.buildSpatialIndexFilter(SpatialiteSQLBuilder.java:157)
> > at
> com.vividsolutions.jump.datastore.spatialite.SpatialiteSQLBuilder.buildBoxFilter(SpatialiteSQLBuilder.java:116)
> > at
> com.vividsolutions.jump.datastore.spatialite.SpatialiteSQLBuilder.getSQL(SpatialiteSQLBuilder.java:39)
> > at
> com.vividsolutions.jump.workbench.ui.plugin.datastore.DataStoreDataSource.createFeatureCollection(DataStoreDataSource.java:165)
> > at
> com.vividsolutions.jump.workbench.ui.plugin.datastore.DataStoreDataSource$1.executeQuery(DataStoreDataSource.java:101)
> > at
> com.vividsolutions.jump.workbench.ui.plugin.datastore.DataStoreDataSource$1.executeQuery(DataStoreDataSource.java:112)
> > at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.executeQuery(AddDataStoreLayerWizard.java:175)
> > at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.load(AddDataStoreLayerWizard.java:164)
> > at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.createLayer(AddDataStoreLayerWizard.java:138)
> > at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.createLayers(AddDataStoreLayerWizard.java:156)
> > at
> org.openjump.core.ui.plugin.datastore.AddDataStoreLayerWizard.run(AddDataStoreLayerWizard.java:71)
> > at
> org.openjump.core.ui.plugin.file.OpenWizardPlugIn.run(OpenWizardPlugIn.java:110)
> > at
> com.vividsolutions.jump.workbench.ui.task.TaskMonitorManager$TaskWrapper.run(TaskMonitorManager.java:151)
> >
> > -Jukka-
> >
> > -----Alkuperäinen viesti-----
> > Lähettäjä: edgar.sol...@web.de <edgar.sol...@web.de>
> > Lähetetty: tiistai 19. helmikuuta 2019 17.27
> > Vastaanottaja: Rahkonen Jukka (MML) <jukka.rahko...@maanmittauslaitos.fi>;
> jump devel <jump-pilot-devel@lists.sourceforge.net>; Nicolas Ribot <
> nicolas.ri...@gmail.com>
> > Aihe: Re: VS: [JPP-Devel] Slow parsing of date field from Spatialite
> database
> >
> > Jukka,
> >
> > i locally reverted Nico's last change to have the datastore tables
> listed and work on the date/time slowness. OJ r6129 should fix the slow
> date issue with the datastore functionality in OJ CORE.
> > when Nico fixes the table listing issue you should be able to double
> check it.
> >
> > DB Query extension is a somewhat harder nut to crack as i would have to
> setup the external extension sources to patch them. do you think it is
> worth the effort or urgently needed?
> >
> > ..ede
> >
> > On 19.02.2019 13:44, Rahkonen Jukka (MML) wrote:
> >> Hi,
> >>
> >> Here you can get a gpkg that works with DB Query
> http://latuviitta.org/downloads/stones.gpkg. As I told, DB Query can't
> read random_points.gpkg but the standard Run datastore query tool has no
> problem with that.
> >> Advice for reading gpkg can be found from the attached document.
> >>
> >> OJ build 5966 can build the layer list for the gpkg datastore, but
> build 5977 can't so something has happened in between.
> >>
> >>
> >> -Jukka-
> >>
> >>
> >> -----Alkuperäinen viesti-----
> >> Lähettäjä: edgar.sol...@web.de <edgar.sol...@web.de>
> >> Lähetetty: tiistai 19. helmikuuta 2019 13.54
> >> Vastaanottaja: Rahkonen Jukka (MML)
> >> <jukka.rahko...@maanmittauslaitos.fi>
> >> Aihe: Re: [JPP-Devel] Slow parsing of date field from Spatialite
> >> database
> >>
> >> hey Jukka,
> >>
> >> not familiar with the drivers. could you give a short step-by-step for
> both (Run Datastore Query, DB Query) ?
> >>
> >> thanks.. ede
> >>
> >> On 17.02.2019 22:07, Rahkonen Jukka (MML) wrote:
> >>> Hi,
> >>>
> >>> Test geopackage finally ready here
> >>> http://latuviitta.org/downloads/random_points.gpkg. It contains
> >>> random_points: 105000 points with a date column
> >>> random_points_without_date : same points but date column dropped
> >>>
> >>> Data were created with the OpenJUMP Bean tools and GDAL. Observations:
> >>> 1) GeoPackage does not work with OpenJDK 13. Connection to SQLite is
> OK but selecting spatial data fails. Use JRE 8 instead for these tests.
> >>> 2) When I create a new spatialite connection into gpkg file OpenJUMP
> >>> creates the connection but it does not find spatial tables and
> >>> adding data to the map is not possible through the Add data... route
> >>> 3) Run datastore query, however, does work. The test will be simply
> >>> to run select * from random_points; select * from
> >>> random_points_without_date;
> >>>
> >>> The first query creates a map in 30 seconds, the second one in one
> second. Tested with OJ Plus snapshot without Spatialite binaries.
> >>>
> >>> -Jukka-
> >>>
> >>>
> >>>
> >>> -----Alkuperäinen viesti-----
> >>> Lähettäjä: Rahkonen Jukka (MML)
> >>> Lähetetty: sunnuntai 17. helmikuuta 2019 14.26
> >>> Vastaanottaja: 'Edgar Soldin' <ed...@soldin.de>
> >>> Aihe: Re: [JPP-Devel] Slow parsing of date field from Spatialite
> >>> database
> >>>
> >>> Hi Ede,
> >>>
> >>> Thanks for reminding, I will have a look at tis today.
> >>>
> >>> BTW I faced a total dead end today when trying to start OJ. It
> >>> stopped on this line (here captured from a successful start) Loading
> >>> Plugin
> >>> org.openjump.core.ui.plugin.file.SaveLayersWithoutDataSourcePlugIn
> >>> took 5.53s
> >>>
> >>> I could not even kill the JDK process from Windows 10 control panel.
> Same happened with OpenJDK 13 and Oracle JRE 1.8. After rebooting my
> computer this issue went away.
> >>>
> >>> -Jukka-
> >>>
> >>> -----Alkuperäinen viesti-----
> >>> Lähettäjä: Edgar Soldin <ed...@soldin.de>
> >>> Lähetetty: sunnuntai 17. helmikuuta 2019 14.08
> >>> Vastaanottaja: Rahkonen Jukka (MML)
> >>> <jukka.rahko...@maanmittauslaitos.fi>
> >>> Aihe: Fwd: [JPP-Devel] Slow parsing of date field from Spatialite
> >>> database
> >>>
> >>>
> >>> see below.. ede
> >>>
> >>> -------- Forwarded Message --------
> >>> Subject: Re: [JPP-Devel] Slow parsing of date field from Spatialite
> >>> database
> >>> Date: Tue, 22 Jan 2019 12:06:20 +0100
> >>> From: edgar.sol...@web.de
> >>> Reply-To: OpenJump develop and use
> >>> <jump-pilot-devel@lists.sourceforge.net>
> >>> To: OpenJump develop and use
> >>> <jump-pilot-devel@lists.sourceforge.net>,
> >>> Rahkonen Jukka (MML) <jukka.rahko...@maanmittauslaitos.fi>
> >>>
> >>> hey Jukka,
> >>>
> >>> just came across this mail. is this still an issue? can you provide me
> w/ a sample dataset?
> >>>
> >>> ..ede
> >>>
> >>> On 07.08.2017 09:46, edgar.sol...@web.de wrote:
> >>>> probably exactly the same issue of realtime date parsing during
> loading like w/ JML there. maybe i can speed up the parser, by meorizing
> the successful pattern and trying that first on the next value. currently
> it looks like it is bruteforcing the same pattern order over & over agn.
> >>>>
> >>>> ..ede
> >>>>
> >>>> On 8/6/2017 21:51, Rahkonen Jukka (MML) wrote:
> >>>>> Hi,
> >>>>>
> >>>>> There seems to be some inefficiency in parsing date field from
> Spatialite database by using the Run database query tool.
> >>>>> Reading 8 million points with one DATE field takes 15 minutes with
> my computer. If I do not select the DATE field it takes only 35 seconds to
> get all the data.
> >>>>>
> >>>>> DB Query plugin cannot parse DATE fields at all so I could not make
> a proper comparison. Query without DATE field took 3 times more time with
> DB Query.
> >>>>>
> >>>>> -Jukka Rahkonen-
> >>>>> -------------------------------------------------------------------
> >>>>> -
> >>>>> -
> >>>>> --------- Check out the vibrant tech community on one of the
> >>>>> world's most engaging tech sites, Slashdot.org!
> >>>>> http://sdm.link/slashdot
> >>>>> _______________________________________________
> >>>>> Jump-pilot-devel mailing list
> >>>>> Jump-pilot-devel@lists.sourceforge.net
> >>>>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
> >>>>>
> >>>>
> >>>>
> >>>> --------------------------------------------------------------------
> >>>> -
> >>>> -
> >>>> -------- Check out the vibrant tech community on one of the world's
> >>>> most engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> >>>> _______________________________________________
> >>>> Jump-pilot-devel mailing list
> >>>> Jump-pilot-devel@lists.sourceforge.net
> >>>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
> >>>>
> >>>
> >>
> >
> >
> > _______________________________________________
> > Jump-pilot-devel mailing list
> > Jump-pilot-devel@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
> >
>
>
_______________________________________________
Jump-pilot-devel mailing list
Jump-pilot-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
