Jukka, i locally reverted Nico's last change to have the datastore tables listed and work on the date/time slowness. OJ r6129 should fix the slow date issue with the datastore functionality in OJ CORE. when Nico fixes the table listing issue you should be able to double check it.
DB Query extension is a somewhat harder nut to crack as i would have to setup the external extension sources to patch them. do you think it is worth the effort or urgently needed? ..ede On 19.02.2019 13:44, Rahkonen Jukka (MML) wrote: > Hi, > > Here you can get a gpkg that works with DB Query > http://latuviitta.org/downloads/stones.gpkg. As I told, DB Query can't read > random_points.gpkg but the standard Run datastore query tool has no problem > with that. > Advice for reading gpkg can be found from the attached document. > > OJ build 5966 can build the layer list for the gpkg datastore, but build 5977 > can't so something has happened in between. > > > -Jukka- > > > -----Alkuperäinen viesti----- > Lähettäjä: edgar.sol...@web.de <edgar.sol...@web.de> > Lähetetty: tiistai 19. helmikuuta 2019 13.54 > Vastaanottaja: Rahkonen Jukka (MML) <jukka.rahko...@maanmittauslaitos.fi> > Aihe: Re: [JPP-Devel] Slow parsing of date field from Spatialite database > > hey Jukka, > > not familiar with the drivers. could you give a short step-by-step for both > (Run Datastore Query, DB Query) ? > > thanks.. ede > > On 17.02.2019 22:07, Rahkonen Jukka (MML) wrote: >> Hi, >> >> Test geopackage finally ready here >> http://latuviitta.org/downloads/random_points.gpkg. It contains >> random_points: 105000 points with a date column >> random_points_without_date : same points but date column dropped >> >> Data were created with the OpenJUMP Bean tools and GDAL. Observations: >> 1) GeoPackage does not work with OpenJDK 13. Connection to SQLite is OK but >> selecting spatial data fails. Use JRE 8 instead for these tests. >> 2) When I create a new spatialite connection into gpkg file OpenJUMP >> creates the connection but it does not find spatial tables and adding >> data to the map is not possible through the Add data... route >> 3) Run datastore query, however, does work. The test will be simply to >> run select * from random_points; select * from >> random_points_without_date; >> >> The first query creates a map in 30 seconds, the second one in one second. >> Tested with OJ Plus snapshot without Spatialite binaries. >> >> -Jukka- >> >> >> >> -----Alkuperäinen viesti----- >> Lähettäjä: Rahkonen Jukka (MML) >> Lähetetty: sunnuntai 17. helmikuuta 2019 14.26 >> Vastaanottaja: 'Edgar Soldin' <ed...@soldin.de> >> Aihe: Re: [JPP-Devel] Slow parsing of date field from Spatialite >> database >> >> Hi Ede, >> >> Thanks for reminding, I will have a look at tis today. >> >> BTW I faced a total dead end today when trying to start OJ. It stopped >> on this line (here captured from a successful start) Loading Plugin >> org.openjump.core.ui.plugin.file.SaveLayersWithoutDataSourcePlugIn >> took 5.53s >> >> I could not even kill the JDK process from Windows 10 control panel. Same >> happened with OpenJDK 13 and Oracle JRE 1.8. After rebooting my computer >> this issue went away. >> >> -Jukka- >> >> -----Alkuperäinen viesti----- >> Lähettäjä: Edgar Soldin <ed...@soldin.de> >> Lähetetty: sunnuntai 17. helmikuuta 2019 14.08 >> Vastaanottaja: Rahkonen Jukka (MML) >> <jukka.rahko...@maanmittauslaitos.fi> >> Aihe: Fwd: [JPP-Devel] Slow parsing of date field from Spatialite >> database >> >> >> see below.. ede >> >> -------- Forwarded Message -------- >> Subject: Re: [JPP-Devel] Slow parsing of date field from Spatialite >> database >> Date: Tue, 22 Jan 2019 12:06:20 +0100 >> From: edgar.sol...@web.de >> Reply-To: OpenJump develop and use >> <jump-pilot-devel@lists.sourceforge.net> >> To: OpenJump develop and use <jump-pilot-devel@lists.sourceforge.net>, >> Rahkonen Jukka (MML) <jukka.rahko...@maanmittauslaitos.fi> >> >> hey Jukka, >> >> just came across this mail. is this still an issue? can you provide me w/ a >> sample dataset? >> >> ..ede >> >> On 07.08.2017 09:46, edgar.sol...@web.de wrote: >>> probably exactly the same issue of realtime date parsing during loading >>> like w/ JML there. maybe i can speed up the parser, by meorizing the >>> successful pattern and trying that first on the next value. currently it >>> looks like it is bruteforcing the same pattern order over & over agn. >>> >>> ..ede >>> >>> On 8/6/2017 21:51, Rahkonen Jukka (MML) wrote: >>>> Hi, >>>> >>>> There seems to be some inefficiency in parsing date field from Spatialite >>>> database by using the Run database query tool. >>>> Reading 8 million points with one DATE field takes 15 minutes with my >>>> computer. If I do not select the DATE field it takes only 35 seconds to >>>> get all the data. >>>> >>>> DB Query plugin cannot parse DATE fields at all so I could not make a >>>> proper comparison. Query without DATE field took 3 times more time with DB >>>> Query. >>>> >>>> -Jukka Rahkonen- >>>> -------------------------------------------------------------------- >>>> - >>>> --------- Check out the vibrant tech community on one of the world's >>>> most engaging tech sites, Slashdot.org! http://sdm.link/slashdot >>>> _______________________________________________ >>>> Jump-pilot-devel mailing list >>>> Jump-pilot-devel@lists.sourceforge.net >>>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel >>>> >>> >>> >>> --------------------------------------------------------------------- >>> - >>> -------- Check out the vibrant tech community on one of the world's >>> most engaging tech sites, Slashdot.org! http://sdm.link/slashdot >>> _______________________________________________ >>> Jump-pilot-devel mailing list >>> Jump-pilot-devel@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel >>> >> > _______________________________________________ Jump-pilot-devel mailing list Jump-pilot-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
