Peter Rozsa has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/22761


Change subject: IMPALA-13932: Add file path and position-based duplicate check 
for IcebergMergeNode
......................................................................

IMPALA-13932: Add file path and position-based duplicate check for
IcebergMergeNode

IcebergMergeNode's duplicate checking mechanism was based on comparing
pointers of the target table's rows. This mechanism results in
false positives if a new row batch reused the memory of the previous row
batch provided for the merge node. This change adds an additional check
that validates the file position and file path as well.

Change-Id: I71b47414321675958c05438ef3aeeb5df0128033
---
M be/src/exec/iceberg-merge-node.cc
M be/src/exec/iceberg-merge-node.h
M fe/src/main/java/org/apache/impala/analysis/IcebergMergeImpl.java
M 
testdata/workloads/functional-planner/queries/PlannerTest/iceberg-merge-insert-only.test
4 files changed, 73 insertions(+), 24 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/61/22761/1
--
To view, visit http://gerrit.cloudera.org:8080/22761
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I71b47414321675958c05438ef3aeeb5df0128033
Gerrit-Change-Number: 22761
Gerrit-PatchSet: 1
Gerrit-Owner: Peter Rozsa <pro...@cloudera.com>

Reply via email to