Re: Iceberg engine version maintenance lifecycle

2022-01-08 Thread Kyle Bendickson
Thank you Jack for your thoughts. I'm very much in agreement with you. I'd like to discuss the beta version further. Ideally, to me, the beta version is the minimum change set to work as-is with that version of the system. We would ideally create a beta that ignores new features, optimizations,

Re: Time-sliced incremental scan

2022-01-08 Thread Kyle Bendickson
Thank you Ryan for summarizing that so well. I'm in agreement that it's too convenient to simply ignore due to those caveats, though they are admittedly potentially large caveats. However, some people don't interact with their table that way and I see discussion around ways to implement increment