parthchandra commented on PR #1619: URL: https://github.com/apache/datafusion-comet/pull/1619#issuecomment-2784879863
> I don't see where PARQUET_FILTER_PUSHDOWN_ENABLED is used at all Nvm. It is used to decide whether to pass in the predicates to the batch reader which uses it to filter out row groups. Note that the behavior of the native code must match this exactly especially for row index generation. So if we want to have a Comet config then it must the same value as the Spark config which makes it redundant. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
