Re: Timestamp Based Incremental Reading in Iceberg ...

2020-09-09 Thread Ryan Blue
Hi everyone, I'm putting this on the agenda for today's Iceberg sync. Also, I want to point out John's recent PR that added a way to inject a Clock that is used for timestamp generation: https://github.com/apache/iceberg/pull/1389 That fits nicely with the requirements here and would be an easy w

Re: Timestamp Based Incremental Reading in Iceberg ...

2020-09-09 Thread Peter Vary
Quick question below about the proposed usage of the timestamp: > On Sep 9, 2020, at 7:24 AM, Miao Wang wrote: > > +1 Openlnx’s comment on implementation. > > Only if we have an external timing synchronization service and enforce all > clients using the service, timestamps of different client