eldenmoon opened a new pull request, #61383: URL: https://github.com/apache/doris/pull/61383
Build a NestedGroup streaming write plan from input rowset metadata and use it to initialize root, regular subcolumn and nested-group writers during compaction, so Variant data can be written chunk by chunk instead of being fully materialized first. Refactor shared subcolumn writer helpers, allow the NestedGroup provider to consume prebuilt groups or a streaming plan, and skip sparse/doc path-stat collection for nested-group variant columns. Add tests for streaming plan construction and array subcolumn writes across multiple batches. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
