Re: Iceberg V2 Spec

Thanks for the great work from Ryan, I would be glad to be the reviewer ! On Sat, Sep 19, 2020 at 7:37 AM Ryan Blue wrote: > I'm working on an update to the spec. We've completed the Java library > implementation end-to-end, so now we have working code that will be > released in 0.10.0. Next st

Re: Iceberg V2 Spec

I'm working on an update to the spec. We've completed the Java library implementation end-to-end, so now we have working code that will be released in 0.10.0. Next step is the spec update to document everything now that we're confident that it works as expected. Look for a PR in the next few days.

Re: Iceberg V2 Spec

I want to follow up on this. Is there an official consolidated design doc/proposal (even wip) on V2 spec? I saw Streaming CDC in Iceberg in a few update emails related, but it only covers

Re: Iceberg V2 Spec

Sounds good to me. Thanks. On Fri, Jul 3, 2020 at 12:58 AM Ryan Blue wrote: > I'd like to get 0.9.0 out as soon as possible. I expect to get an early RC > out next week, once we have more tests committed. That way, people can > start trying it out and reporting back where it doesn't work. > > I

Re: Iceberg V2 Spec

I'd like to get 0.9.0 out as soon as possible. I expect to get an early RC out next week, once we have more tests committed. That way, people can start trying it out and reporting back where it doesn't work. I'd rather not block 0.9.0 to wait on Flink connector components. There's still a lot of w

Re: Iceberg V2 Spec

Hi Ryan: Just curious when do we plan to release 0.9.0 ? I expect that the flink connector could be included in release 0.9.0. Thanks. On Thu, Jul 2, 2020 at 12:14 AM Ryan Blue wrote: > Hi Chen, > > Right now, the main parts of the v2 spec are the addition of sequence > numbers and delete fil

Re: Iceberg V2 Spec

Hi Chen, Right now, the main parts of the v2 spec are the addition of sequence numbers and delete files. We're also making some other requirements more strict, but those are mainly cleaning up problems and not related to row-level deletes. Upserts would be encoded as a delete and an insert. Delet