RE: Encoded data retrieved when reading Parquet file

Solved this issue. Thank You On 2022/10/19 05:26:51 Nipuna Shantha wrote:> Hi all,> > I am writing to a parquet file using Impala version 3.4.0 and try to read> same parquet file from Spark 3.3.0 to a DataFrame.> > var df = spark.read.parquet(parquet_file_name)> > But when I show the DataFrame it h

Encoded data retrieved when reading Parquet file

Hi all, I am writing to a parquet file using Impala version 3.4.0 and try to read same parquet file from Spark 3.3.0 to a DataFrame. var df = spark.read.parquet(parquet_file_name) But when I show the DataFrame it has some encoded values for string data type as below. For string "TAX" it shows [