Hi
Please also consider the other 2 alternatives for statically typed Datasets
of Avro objects
https://github.com/apache/spark/pull/24299
and https://github.com/apache/spark/pull/24367
kind regards
-Taoufik
On Thu, May 16, 2019 at 9:59 PM Aleksander Eskilson
wrote:
> Hi all,
>
> There's bee
Hi all,
There's been longstanding demand for statically typed Datasets of Avro.
Functionality from the now-deprecated Databricks Spark-Avro project was
folded into Spark, but can still only provide DataFrames over Avro data. As
is discussed in the PR below, there are still drawbacks from not havin
