zhuqi-lucas commented on PR #13933: URL: https://github.com/apache/datafusion/pull/13933#issuecomment-2564681235
Hi @ozankabak , thank you for review, we can propagate source ordering with: 1. Create external table with order 2. Create a parquet read with list options to setting the order But when we write a parquet file with order and the table without order(when creating), we can't propagate the order to the table, we need to write the order to parquet metadata. And when we scan table without sort option setting, we can get the metadata for optimization. For the Statistics to store the info, do you mean we can just load the metadata order to somewhere else? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
