You can try passing in an explicit encoder:
org.apache.spark.sql.Encoders.kryo[Set[com.wix.accord.Violation]]
Although this might only be available in spark 2, i don't remember top of
my head...
On Wed, Jun 8, 2016 at 11:57 PM, Koert Kuipers wrote:
> Sets are not supported. you basically need t
Sets are not supported. you basically need to stick to products (tuples,
case classes), Seq and Map (and in spark 2 also Option).
Or you can need to resort to the kryo-based encoder.
On Wed, Jun 8, 2016 at 3:45 PM, Peter Halliday wrote:
> I have some code that was producing OOM during shuffle a
I have some code that was producing OOM during shuffle and was RDD. So, upon
direction by a member of Databricks I started covering to Datasets. However,
when we did we are getting an error that seems to be not liking something
within one of our case classes.
Peter Halliday
[2016-06-08 19:1
