CDC with "copy on write"

2020-12-18 Thread Ashish Mehta
Hi, We have been working to support Row-level updates to our data ingestion pipeline using Spark on Batch API (no streaming use case for now). Currently, we are looking to adhere to the "copy on write" implementation of DELETE, MERGE INTO (WIP via #1947). For us, our main use case is primary key

Re: What's the time to expose iceberg format v2 to end users ?

2020-12-18 Thread OpenInx
Thanks Yan for the document, I will take a look at it, and see what I can do. On Fri, Dec 18, 2020 at 3:38 AM Yan Yan wrote: > Hi OpenInx, > > Thanks for bringing this up. I am currently working on Format v2 blocking > tasks, and am maintaining a full list of blocking tasks with their > descrip