Steve Carlin has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/22409 )
Change subject: IMPALA-13042: Calcite Planner; Enable partition pruning ...................................................................... IMPALA-13042: Calcite Planner; Enable partition pruning Enables partition pruning in the HdfsScan RelNode. The PrunedPartitionHelper is used to separate the conjuncts and is a wrapper around the HdfsPartitionPruner. There are tests that currently exist in the Impala test framework that check the runtime profile for the number of files read from the table scan which are fixed with this commit. One small modification was made to the "preserveRootTypes" parameter in HdfsPartitionPruner. When it was set to false, the Calcite planner failed in one place. It makes sense for the main code line that the root type should not change, and this was tested on a full Jenkins run. Change-Id: I8c698b857555baeae347835b4a6b39d035f12405 Reviewed-on: http://gerrit.cloudera.org:8080/22409 Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Reviewed-by: Steve Carlin <scar...@cloudera.com> --- M fe/src/main/java/org/apache/impala/planner/HdfsPartitionFilter.java M fe/src/main/java/org/apache/impala/planner/HdfsPartitionPruner.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaHdfsScanRel.java A java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/util/PrunedPartitionHelper.java 4 files changed, 113 insertions(+), 9 deletions(-) Approvals: Impala Public Jenkins: Verified Steve Carlin: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/22409 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I8c698b857555baeae347835b4a6b39d035f12405 Gerrit-Change-Number: 22409 Gerrit-PatchSet: 8 Gerrit-Owner: Steve Carlin <scar...@cloudera.com> Gerrit-Reviewer: Aman Sinha <amsi...@cloudera.com> Gerrit-Reviewer: Anonymous Coward (816) Gerrit-Reviewer: Fang-Yu Rao <fangyu....@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Joe McDonnell <joemcdonn...@cloudera.com> Gerrit-Reviewer: Michael Smith <michael.sm...@cloudera.com> Gerrit-Reviewer: Riza Suminto <riza.sumi...@cloudera.com> Gerrit-Reviewer: Steve Carlin <scar...@cloudera.com>
