orlp commented on PR #221: URL: https://github.com/apache/parquet-format/pull/221#issuecomment-2943518298
> I don't see adopting total ordering as a one way door, we can always add a nan count mechanism later. I do see it as a one-way door because no vendor is going to adopt a new ordering later if it means all readers which do not (yet) support the new ordering will downgrade from "suboptimal pruning" (the new status quo if this is adopted) to "no pruning" (the current status quo). We realistically speaking only have one chance to go from the status quo to a good solution, adopting a suboptimal solution now will likely leave us in a local maximum for the remainder of Parquet's lifetime. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
