orlp commented on PR #514: URL: https://github.com/apache/parquet-format/pull/514#issuecomment-3175042352
Please correct me if I'm wrong, but this PR summarized is: 1. Specify a new IEEE 754 total ordering for sorting information. 2. If this ordering is used, the NaN count is mandatory. 3. If this ordering is used, the min/max statistics must ignore NaNs if there are non-NaN values, and if not use IEEE 754 total ordering to write the min/max NaN value. If so, then my concerns around NaN poisoning the statistics are resolved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
