Gabriel39 opened a new pull request, #66446: URL: https://github.com/apache/doris/pull/66446
### What changed - Preserve consecutive projected shredded Variant batches during indexed exchange gathers. - Keep the existing identical-schema append fast path and use an ordered segmented state only for incompatible partial schemas. - Merge homogeneous leaves as typed columns and normalize only heterogeneous physical leaf identities to logical Variant scalars. - Keep complete shredded states on the existing canonical validation path. ### Root cause An exchange channel can buffer selections from multiple scanner blocks. After the first projected shredded batch was adopted, the next indexed insertion forced the destination to encode. A leaf-only projection has no complete root metadata/value pair, so it cannot reconstruct the logical Variant. Different files can also shred the same path with incompatible physical types, which prevents the existing exact-schema append from handling the batch. ### Impact Projected Variant leaves can now cross exchange boundaries without premature root reconstruction. Non-Variant columns, complete Variant states, and compatible shredded schemas retain their existing paths. ### Validation - `VariantColumnReaderTest.*:ColumnVariantV2Test.*`: 69 tests passed. - `VariantElementV2EncodedTest.*:VariantElementV2TypedTest.*`: 7 tests passed. - Added regression coverage for consecutive same-schema gathers, conflicting leaf types, reordering, and filtering. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
