Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-16 Thread via GitHub
huaxingao commented on PR #1723: URL: https://github.com/apache/datafusion-comet/pull/1723#issuecomment-2887151838 We actually don't need this PR any more. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-16 Thread via GitHub
huaxingao closed pull request #1723: fix: Support Schema Evolution in iceberg URL: https://github.com/apache/datafusion-comet/pull/1723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-16 Thread via GitHub
comphead commented on PR #1723: URL: https://github.com/apache/datafusion-comet/pull/1723#issuecomment-2887069661 are we good to merge this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-13 Thread via GitHub
huaxingao commented on PR #1723: URL: https://github.com/apache/datafusion-comet/pull/1723#issuecomment-2876826410 > The config CometConf.COMET_SCHEMA_EVOLUTION_ENABLED is valid for Parquet files as well so removing it is not correct imo. I have added back `COMET_SCHEMA_EVOLUTION_ENA

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-12 Thread via GitHub
huaxingao closed pull request #1723: fix: Support Schema Evolution in iceberg URL: https://github.com/apache/datafusion-comet/pull/1723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-12 Thread via GitHub
huaxingao closed pull request #1723: fix: Support Schema Evolution in iceberg URL: https://github.com/apache/datafusion-comet/pull/1723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-09 Thread via GitHub
parthchandra commented on PR #1723: URL: https://github.com/apache/datafusion-comet/pull/1723#issuecomment-2867573764 One set of Spark Sql test failures in native_iceberg_compat is exactly because this schema evolution/type promotion check is not being performed correctly (or not being per

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-09 Thread via GitHub
parthchandra commented on PR #1723: URL: https://github.com/apache/datafusion-comet/pull/1723#issuecomment-2867552108 The config `CometConf.COMET_SCHEMA_EVOLUTION_ENABLED` is valid for Parquet files as well so removing it is not correct imo. Also, `ScanRule` is called at planning time wh

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-08 Thread via GitHub
codecov-commenter commented on PR #1723: URL: https://github.com/apache/datafusion-comet/pull/1723#issuecomment-2864777078 ## [Codecov](https://app.codecov.io/gh/apache/datafusion-comet/pull/1723?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_ca

Re: [PR] fix: Support Schema Evolution in iceberg [datafusion-comet]

2025-05-08 Thread via GitHub
huaxingao commented on code in PR #1723: URL: https://github.com/apache/datafusion-comet/pull/1723#discussion_r2080636065 ## common/src/main/java/org/apache/comet/parquet/Utils.java: ## @@ -28,33 +28,33 @@ public class Utils { - /** This method is called from Apache Iceber