upsert base on copy on write mode

2020-02-26 Thread Junjie Chen
Hi devs We are working on row level delete milestone for upsert feature in merge on read mode. In the meantime, I think it may be useful to have a copy on write implementation. For example, we can implement upsert with spark, so that we can finalize the common APIs that upsert may need and also we

Re: File leaking in RemoveSnapshots!

2020-02-26 Thread OpenInx
Hi Ashish It's indeed a bug for my understanding, I read your idea about the transaction hook. removing the data & manifest file of expired snapshots should happen after writing version-hint file (otherwise there will be some readers accessing snapshots which we are deleting data files). so the h