Duplicate data issue PR

2024-11-11 Thread Jason Fine
appen very often to most users since it requires a very specific rewrite order to occur, it is still a correctness issue and I feel it's important to solve. Would someone be able to help me advance this? If there are any outstanding issues or questions I'm happy to address them. --

Re: [DISCUSS] - Deprecate Equality Deletes

2024-10-31 Thread Jason Fine
but > then add what I believe is an unacceptable level of complexity to the read > side. > > > > Because of this I suggest we deprecate Equality Deletes in V3 and slate > them for full removal from the Iceberg Spec in V4. > > > > I know this is a big change and com

Re: clarification on changelog behavior for equality deletes

2024-08-21 Thread Jason Fine
plied to DF1, and we only consider any additional rows that get > deleted when ED2 is applied.) > > I lean towards (a), as I think it is more reflective of net changes. > I am interested to hear what folks think. > > Thank you, > Wing Yew > > > -- *Jason Fine* Chief Software Architect ja...@upsolver.com | www.upsolver.com

Proposed new StreamingUpdate API

2023-12-17 Thread Jason Fine
ailed explanation in the PR. The performance improvement is very significant for certain producer patterns. Looking forward to hearing the community's opinion on this. Let me know what you think of the approach and whether or not you think this can potentially make it into 1.5. Thanks, -- *Jason F