ashokraminedi commented on issue #20003: URL: https://github.com/apache/hudi/issues/20003#issuecomment-5818974646
@voonhous My initial view is that `true` would be the better default: Trino’s current Hudi connector uses it, so keeping it would avoid changing standalone Hudi catalog behavior when Trino switches to `hudi-trino`. It would also match the lakehouse catalog. Before proposing the default change, I’d like to check whether `false` protects against a Hudi-specific correctness issue. My plan is to: - Inspect an existing COW fixture for Parquet column and offset indexes spanning multiple data pages. - Run selective matching and nonmatching queries against a COW base file with the setting on and off, comparing both results with known expected rows. - Where the page ranges permit skipping, compare pages or bytes read by the same query in both modes. Would this give us enough evidence to decide the default? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
