Re: How to Keep Null values in Parquet

Hello Soumya, Thanks for quick response, I haven't tried. I am doing now and see. On Thu, Nov 22, 2018 at 8:13 AM Soumya D. Sanyal wrote: > Hi Chetan, > > Have you tried casting the null values/columns to a supported type — e.g. > `StringType`, `IntegerType`, etc? > > See also https://issues.a

Re: How to Keep Null values in Parquet

Hi Chetan, Have you tried casting the null values/columns to a supported type — e.g. `StringType`, `IntegerType`, etc? See also https://issues.apache.org/jira/browse/SPARK-10943 . — Soumya > On Nov 21, 2018, at 9:29 PM, Chetan Khatri > wro

How to Keep Null values in Parquet

Hello Spark Users, I have a Dataframe with some of Null Values, When I am writing to parquet it is failing with below error: Caused by: java.lang.RuntimeException: Unsupported data type NullType. at scala.sys.package$.error(package.scala:27) at org.apache.spark.sql.execution.data