suxiaogang223 opened a new pull request, #66010:
URL: https://github.com/apache/doris/pull/66010
### What problem does this PR solve?
Issue Number: None
Related PR: #62821, #65583
Problem Summary: branch-4.0 only backported the Paimon side of the external
partition metadata fixes. Hive-style scans, Hudi, Iceberg, and file load paths
could still lose explicit NULL semantics or rely on physical file columns that
are absent from migrated partitioned files. Iceberg also attached partition
metadata only when runtime partition pruning was enabled and did not safely
account for mixed transforms or partition evolution. This change adds common
path partition parsing with aligned null flags, applies it to external scans
and load paths, and sends stable Iceberg identity partition metadata for every
split while respecting branch-4.0 scan-level slot constraints.
### Release note
Fix partition-column materialization and NULL handling for Hive, Hudi,
Iceberg, and file load paths on branch-4.0.
### Check List (For Author)
- Test: Unit Test
- ./run-fe-ut.sh --run
org.apache.doris.datasource.FilePartitionUtilsTest,org.apache.doris.datasource.hive.source.HiveScanNodeTest,org.apache.doris.datasource.iceberg.IcebergUtilsTest,org.apache.doris.datasource.iceberg.source.IcebergScanNodeTest,org.apache.doris.datasource.paimon.source.PaimonScanNodeTest
- Behavior changed: Yes. External partition metadata and NULL values are
materialized consistently per split.
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
