Hi everyone,
I just update the Iceberg sync doc
<https://docs.google.com/document/d/1YuGhUdukLP5gGiqCbk0A5_Wifqe2CZWgOd3TbhY3UQg/edit#heading=h.u83a18ycylzz>
with my notes. Feel free to add corrections or additional context!
There was quite a bit of discussion, so I want to highlight a few things
that we talked about for more discussion on the dev list:
1. 0.10.0 blocker issues
- Java 11 flaky tests (Fixed in PR #1446
<https://github.com/apache/iceberg/pull/1446>)
- Flink checkpoint Java serialization errors (PR #1438
<https://github.com/apache/iceberg/issues/1438>)
- Probably will *not* wait for Hive projection
- Please bring up any other blockers!
2. The general consensus was that adding a time offset parameter (PR #1368
<https://github.com/apache/iceberg/pull/1368>) is not a good solution.
Instead we should consider using hourly partitioning or adding custom
partition functions.
3. We discussed trying to make snapshot timestamps monotonically
increasing, but though that it was probably not worth pursuing (already
mentioned on the dev list thread).
rb
--
Ryan Blue
Software Engineer
Netflix
