Re: Write a parquet file with delta encoding enable

2020-03-23 Thread Wes McKinney
These encodings are not available for use in the Parquet C++ library yet -- partially implemented but not thoroughly tested or exposed in the public API -- so it's not possible to generate them from Python. I don't know about Java, you may want to ask on the Parquet mailing list On Mon, Mar 23, 20

Write a parquet file with delta encoding enable

2020-03-23 Thread Omega Gamage
I was trying to write a parquet file with delta encoding. This page , states that parquet supports three types of delta encodings: (DELTA_BINARY_PACKED, DELTA_LENGTH_BYTE_ARRAY, DELTA_BYTE_ARRAY). Since spark, pyspark or pyarr