This is an automated email from the ASF dual-hosted git repository.
stigahuang pushed a change to branch branch-3.4.2
in repository https://gitbox.apache.org/repos/asf/impala.git
from d491e325f IMPALA-12755: Disable snapshots from cdh.rcs.releases.repo
new 821031018 IMPALA-9952: Fix page index filtering for empty pages
new d7209700b IMPALA-9572: Fix DCHECK in nested Parquet scanning
new 96ed0cf8f IMPALA-10257: Relax check for page filtering
new 4b7fc7773 IMPALA-10310: Fix couldn't skip rows in parquet file on
NextRowGroup
new ee9c20f93 IMPALA-5476: Fix catalogd restart brings stale metadata
new 2963b29a3 IMPALA-12565: Fix crash triggered by calling pmod() UDF
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/exec/parquet/hdfs-parquet-scanner.cc | 66 +++++++++----
be/src/exec/parquet/hdfs-parquet-scanner.h | 17 +++-
be/src/exec/parquet/parquet-column-readers.cc | 3 +-
be/src/exec/parquet/parquet-common-test.cc | 10 +-
be/src/exec/parquet/parquet-common.cc | 46 +++++++--
be/src/exprs/math-functions-ir.cc | 4 +-
be/src/service/impala-server.cc | 59 +++++++++---
be/src/util/mem-util.h | 9 +-
testdata/data/README | 32 +++++++
testdata/data/alltypes_empty_pages.parquet | Bin 0 -> 22929 bytes
testdata/data/alltypes_invalid_pages.parquet | Bin 0 -> 25288 bytes
.../data/customer_multiblock_page_index.parquet | Bin 0 -> 451607 bytes
.../functional-query/queries/QueryTest/exprs.test | 8 ++
.../QueryTest/nested-types-parquet-page-index.test | 47 ++++++++++
.../queries/QueryTest/parquet-page-index.test | 99 ++++++++++++++++++++
tests/custom_cluster/test_restart_services.py | 104 +++++++++++++++++++++
tests/query_test/test_parquet_stats.py | 26 ++++--
17 files changed, 469 insertions(+), 61 deletions(-)
create mode 100644 testdata/data/alltypes_empty_pages.parquet
create mode 100644 testdata/data/alltypes_invalid_pages.parquet
create mode 100644 testdata/data/customer_multiblock_page_index.parquet
