XiangpengHao commented on issue #17599: URL: https://github.com/apache/datafusion/issues/17599#issuecomment-3316349756
my understanding of this issue is to cache filtered data to avoid re-computation (filter, shredding, etc), and it makes sense. it's somewhat similar to predicate cache, which cache to avoid decoding and decompression, but not filtering or any predicates. If shredding happens in DF (not in parquet decoder), then predicate cache won't help; but otherwise it's possible that predicate cache can cache the shredded data to avoid re-computation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
