bobhan1 opened a new pull request, #70745: URL: https://github.com/apache/doris/pull/70745
### What problem does this PR solve? Backport #70350 and its GCC unity build fix #70736 to `branch-4.2` as separate commits. Compaction compresses eligible row-ID mappings in bounded source blocks when the estimated dense matrix exceeds 500 MiB. The backport uses 4.2's contiguous segment IDs for delete bitmap conversion and finalizes the map after all segment groups have merged. Cluster-key MoW continues to use the dense matrix for the output rowset's internal delete bitmap. CLucene and index compaction debug dumps also use the dense layout. ### Release note Eligible MoW and Duplicate Key SNII compactions now compress large row-ID mappings. The dynamic `compressed_rowid_conversion_threshold_bytes` setting controls the threshold, and `enable_compressed_rowid_conversion` controls whether eligible mappings use compression. ### Testing - `git diff --check upstream/branch-4.2...HEAD` passed. - Targeted BE unit tests are building locally. The filter covers the row-ID map, SNII consumers, and 4.2's grouped compaction and cluster-key MoW paths. ### AI Disclosure OpenAI Codex adapted the backport, resolved conflicts, and prepared this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
