ok, got it. SHP reader does not seem to use lazy date parsing via
FlexibleDateParser. converting your set to JML and tryinf to save that involves
FlexibleDateParser and shows the symptoms you observed.
..ede
On 18.08.2020 20:24, ede wrote:
> sorry Mike, can't reproduce it.
>
> actually writing is magnitudes faster than reading on my laptop. see
>
> [INFO] 20:05:45.910 Reading 'test_date.shp' took 6.64s.
> [INFO] 20:05:47.011 Done. Current committed
> memory:plugin.AbstractPlugIn.executing = Executing199 MB
> [INFO] 20:05:47.013 Activating Select Features Tool
> ...
> [INFO] 20:06:09.648 Executing Save Dataset As (testing)
> [INFO] 20:06:26.760 Activating Select Features Tool
> [INFO] 20:06:27.881 Writing 'test_date-out.shp' took 0.93s.
> [INFO] 20:06:27.891 Done. Current committed
> memory:plugin.AbstractPlugIn.executing = Executing227 MB
>
> i also added a debug breakpoint at
> com.vividsolutions.jump.util.FlexibleDateParser.parse(String s, boolean
> lenient) and it isn't even called during saving as SHP.
>
> ..ede
>
> On 17.08.2020 21:15, michael michaud wrote:
>> Here is a dataset of 100 000 features including datetimes. It takes nearly 1
>> minute to save as shapefile (less than 2 seconds to read it).
>>
>>
>> Attachments:
>>
>> -
>> [test_date.zip](https://sourceforge.net/p/jump-pilot/bugs/_discuss/thread/62e6f051ce/89eb/attachment/test_date.zip)
>> (1.6 MB; application/x-zip-compressed)
>>
>>
>> ---
>>
>> ** [bugs:#497] Shapefile export slowed down because of FlexibleDateParser**
>>
>> **Status:** open
>> **Created:** Mon Aug 17, 2020 11:47 AM UTC by michael michaud
>> **Last Updated:** Mon Aug 17, 2020 04:38 PM UTC
>> **Owner:** michael michaud
>>
>>
>> Exporting a big dataset to shapefile (1 300 000 objets - around 225+115 Mb)
>> with version 1.15 lasted more than 20 minutes.
>> Most of the time is used by FlexibleDateParser.parse().
>>
>>
>> ---
>>
>> Sent from sourceforge.net because you indicated interest in
>> <https://sourceforge.net/p/jump-pilot/bugs/497/>
>>
>>
>>
>> To unsubscribe from further messages, please visit
>> <https://sourceforge.net/auth/subscriptions/>
>>
>
>
>
> ---
>
> ** [bugs:#497] Shapefile export slowed down because of FlexibleDateParser**
>
> **Status:** open
> **Created:** Mon Aug 17, 2020 11:47 AM UTC by michael michaud
> **Last Updated:** Mon Aug 17, 2020 07:15 PM UTC
> **Owner:** michael michaud
>
>
> Exporting a big dataset to shapefile (1 300 000 objets - around 225+115 Mb)
> with version 1.15 lasted more than 20 minutes.
> Most of the time is used by FlexibleDateParser.parse().
>
>
> ---
>
> Sent from sourceforge.net because you indicated interest in
> <https://sourceforge.net/p/jump-pilot/bugs/497/>
>
>
>
> To unsubscribe from further messages, please visit
> <https://sourceforge.net/auth/subscriptions/>
>
---
** [bugs:#497] Shapefile export slowed down because of FlexibleDateParser**
**Status:** open
**Created:** Mon Aug 17, 2020 11:47 AM UTC by michael michaud
**Last Updated:** Mon Aug 17, 2020 07:15 PM UTC
**Owner:** michael michaud
Exporting a big dataset to shapefile (1 300 000 objets - around 225+115 Mb)
with version 1.15 lasted more than 20 minutes.
Most of the time is used by FlexibleDateParser.parse().
---
Sent from sourceforge.net because jump-pilot-devel@lists.sourceforge.net is
subscribed to https://sourceforge.net/p/jump-pilot/bugs/
To unsubscribe from further messages, a project admin can change settings at
https://sourceforge.net/p/jump-pilot/admin/bugs/options. Or, if this is a
mailing list, you can unsubscribe from the mailing list.
_______________________________________________
Jump-pilot-devel mailing list
Jump-pilot-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/jump-pilot-devel
