Re: Proposal: Z-Ordering in Iceberg

2021-07-22 Thread Russell Spitzer
Yep! We discussed this yesterday. The general plan going forward will be Phase 1: Merge Sort based compaction Allow compaction/rewrite of data files using a space filling curve based sort. No planning or persisting of metrics. Phase 2: Support for Transforms with multiple arguments and possible

Re: Proposal: Z-Ordering in Iceberg

2021-07-22 Thread Piotr Findeisen
Hi Bhavyam, Has this been discussed on the sync? Ryan, will it be making into the table metadata spec? Best, PF On Wed, Jul 21, 2021 at 1:50 PM Bhavyam Kamal wrote: > Hi Everyone, > > I would like to discuss and get feedback on the following proposal for > Z-Ordering in the Iceberg Sync today:

Proposal: Z-Ordering in Iceberg

2021-07-21 Thread Bhavyam Kamal
Hi Everyone, I would like to discuss and get feedback on the following proposal for Z-Ordering in the Iceberg Sync today: https://docs.google.com/document/d/1UfGxaB7qlrGzzMk9pBm03oKPOkm-jk-NQVQQvHP-0Bc/edit?usp=sharing Please let me know if you have any thoughts or suggestions by adding comments