Joe McDonnell has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/21729 )

Change subject: IMPALA-13185: Include runtime filter source in key
......................................................................


Patch Set 2:

(1 comment)

http://gerrit.cloudera.org:8080/#/c/21729/2/fe/src/main/java/org/apache/impala/planner/PlanNode.java
File fe/src/main/java/org/apache/impala/planner/PlanNode.java:

http://gerrit.cloudera.org:8080/#/c/21729/2/fe/src/main/java/org/apache/impala/planner/PlanNode.java@1353
PS2, Line 1353:       PlanNode build = filter.getSrc().getBuildNode();
> I think this works now, but not sure it will with https://gerrit.cloudera.o
I think finding the source this way is right, and I think the Calcite planner 
will still work with this. We can try it out.

One thing we do need to deal with is that the runtime filter has a source 
expression and target expression. For example, if there is a join on a more 
complex condition like:

select count(*) from functional.alltypes a, functional.alltypes b where a.id + 
1 = b.id * 2;

I think we need the source expression and target expression in the hash to help 
us keep that distinct from:

select count(*) from functional.alltypes a, functional.alltypes b where a.id + 
2 = b.id * 2;

We can walk through the toThrift() functions for runtime filters to see if 
there are any other fields that are interesting.



--
To view, visit http://gerrit.cloudera.org:8080/21729
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I0077964be5acdb588d76251a6a39e57a0f42bb5a
Gerrit-Change-Number: 21729
Gerrit-PatchSet: 2
Gerrit-Owner: Michael Smith <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Kurt Deschler <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>
Gerrit-Reviewer: Steve Carlin <[email protected]>
Gerrit-Reviewer: Yida Wu <[email protected]>
Gerrit-Comment-Date: Wed, 28 Aug 2024 23:47:03 +0000
Gerrit-HasComments: Yes

Reply via email to