Hello Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24059
to look at the new patch set (#3).
Change subject: IMPALA-14700: Add support for Parquet LZ4_RAW compression
......................................................................
IMPALA-14700: Add support for Parquet LZ4_RAW compression
This change requires a Parquet Version higher than the current
one (1.12.3), because of the LZ4_RAW Thrift enum value.
For that reason, APACHE_PARQUET_VERSION is increased to 1.15.2 in this
patch, and is always used instead of CDP_PARQUET_VERSION.
Parquet deprecated LZ4 compression, and added a new one, LZ4_RAW.
This patch adds support for LZ4_RAW. It uses Lz4Compressor
(Corresponding to THdfsCompression::LZ4).
Testing:
Tested manually with an existing Parquet file with LZ4_RAW compression:
1. "CREATE TABLE <table> LIKE PARQUET <file> STORED AS PARQUET"
query works properly
2. Impala shows the rows properly with a select query after manually
replacing the parquet file in HDFS for the table created in 1,
and refreshing the table.
Change-Id: I22ee4e5bf9abec37be941c1dca8019a563343d34
---
M be/src/exec/parquet/parquet-common.cc
M be/src/exec/parquet/parquet-metadata-utils.cc
M be/src/util/codec.cc
M be/src/util/codec.h
M bin/impala-config.sh
M common/thrift/parquet.thrift
6 files changed, 21 insertions(+), 16 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/59/24059/3
--
To view, visit http://gerrit.cloudera.org:8080/24059
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I22ee4e5bf9abec37be941c1dca8019a563343d34
Gerrit-Change-Number: 24059
Gerrit-PatchSet: 3
Gerrit-Owner: Balazs Hevele <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
