Re: [DISCUSS] Changes for row-level deletes

2020-05-07 Thread Ryan Murray
fwiw i agree with Gautam on the changes. Keeping complexity down and easing transition to V2 should be a goal for this work. Is there a list of items that need to be finished for V2 schema/row level deletes to be ready? I would love to help but am not sure what is missing/in-progress. Best, Ryan

Re: [DISCUSS] Changes for row-level deletes

2020-05-07 Thread Anton Okolnychyi
I am going to write down a short doc with the current idea on how to do job planning based on what we discussed yesterday. In addition, I would like to cover how minor/major compaction can look like. I want this to be quite detailed and focus on the implementation so that we can review this prop

[ANNOUNCE] Apache Iceberg release 0.8.0-incubating

2020-05-07 Thread Ryan Blue
I'm pleased to announce the release of Apache Iceberg 0.8.0-incubating! Apache Iceberg is an open table format for huge analytic datasets. Iceberg delivers high query performance for tables with tens of petabytes of data, along with atomic commits, concurrent writes, and SQL-compatible table evolu

Re: [ANNOUNCE] Apache Iceberg release 0.8.0-incubating

2020-05-07 Thread Anton Okolnychyi
This is great! Thanks Ryan for preparing the release and everyone for the contributions! - Anton > On 7 May 2020, at 15:15, Ryan Blue wrote: > > I'm pleased to announce the release of Apache Iceberg 0.8.0-incubating! > > Apache Iceberg is an open table format for huge analytic datasets. Icebe

Iceberg community sync notes - 6 May 2020

2020-05-07 Thread Ryan Blue
Hi everyone, here are my notes from the sync last night. Feel free to add clarifications or corrections. If you’d like to be added to the invite, just send me an email and I’ll add you. Everyone is welcome. *Topics*: - 0.8.0 release update: it’s released! - Will update the ASF site and a