Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/23803 )
Change subject: IMPALA-14638: Schedule union of iceberg metadata scanner to coordinator ...................................................................... IMPALA-14638: Schedule union of iceberg metadata scanner to coordinator On clusters with dedicated coordinators and executors the Iceberg metadata scanner fragment(s) must be scheduled to coordinators. IMPALA-12809 ensured this for most plans, but if the Iceberg metadata scanner is part of a union of unpartitioned fragments a new fragment is created for the union that subsumes existing fragments and loses the coordinatorOnly flag. Fixes cases where a multi-fragment plan includes a union of iceberg metadata scans by setting coordinatorOnly on the new union fragment. Adds new planner and runtime tests for this case. Change-Id: If2f19945037b4a7a6433cd9c6e7e2b352fae7356 Reviewed-on: http://gerrit.cloudera.org:8080/23803 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M fe/src/main/java/org/apache/impala/planner/DistributedPlanner.java M testdata/workloads/functional-planner/queries/PlannerTest/iceberg-metadata-table-joined-with-regular-table.test M tests/custom_cluster/test_coordinators.py 3 files changed, 110 insertions(+), 1 deletion(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/23803 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: If2f19945037b4a7a6433cd9c6e7e2b352fae7356 Gerrit-Change-Number: 23803 Gerrit-PatchSet: 5 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Daniel Becker <[email protected]> Gerrit-Reviewer: Gabor Kaszab <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]> Gerrit-Reviewer: Peter Rozsa <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Tamas Mate <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
