mrhhsg opened a new pull request, #70768:
URL: https://github.com/apache/doris/pull/70768

   ## Summary
   
   Backport the runtime-filter ownership fixes from #68684 and #70661 to 
branch-4.1. A producer wrapper can be consumed directly by a local target while 
its filter is also merged for another target. Reusing that wrapper in the 
merger lets later merges change a filter that the direct consumer is already 
probing.
   
   - Deep-copy the first merger input and the mutable IN, Bloom, and MinMax 
filter state. Copy an incoming Bloom filter before adding IN values during an 
IN-to-Bloom transition.
   - Count an input and mark the merged filter ready only after copying or 
merging succeeds, so a failed input cannot cause a partial filter to be 
published.
   - Preserve the existing local, broadcast, and remote delivery paths. Adapt 
the ownership and failed-merge unit tests to the branch-4.1 interfaces.
   
   ## Validation
   
   - `BUILD_TYPE=ASAN ./run-be-ut.sh --run -j 16 
--filter='RuntimeFilterMergerTest.*:RuntimeFilterProducerTest.*:RuntimeFilterWrapperTest.*'`
 — 44/44 passed.
   - `BUILD_TYPE=ASAN ./run-be-ut.sh --run -j 16 
--filter='*RuntimeFilter*:*BloomFilter*:*MinMax*:*SyncSize*-TableReaderTest.CountStarFallbackKeepsLateRuntimeFilterCarrierValues'`
 — 291/291 passed.
   - `./build.sh --be -j 32` — passed.
   - `(cd fe && mvn -o -pl fe-core -am -DskipTests validate)` — passed.
   - `doris-local-regression run -d query_p0/runtimefilterV2 -s rfv2` — 1/1 
suite passed on a single-FE/single-BE cluster.
   - Changed C++ files passed `clang-format --dry-run --Werror`; repository 
format check and `git diff --check` passed.
   
   Multi-BE RPC, mixed-version operation, and production Bloom-copy performance 
have not been validated locally.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to