CompileException with Maps in Spark 2.1.0

2017-01-06 Thread nils.grabbert
Hi all, the following code will run with Spark 2.0.2 but not with Spark 2.1.0: // case class Data(id: Int, param: Map[String, InnerData]) case class InnerData(name: String, value: Int) import spark.implicits._ val e= Data(1, Map("key" -> InnerData("name", 123))) val data = Seq(e) val

CompileException with Maps in Spark 2.1.0

2017-01-06 Thread Nils Grabbert
Hi all, the following code will run with Spark 2.0.2 but not with Spark 2.1.0: // case class Data(id: Int, param: Map[String, InnerData]) case class InnerData(name: String, value: Int) import spark.implicits._ val e= Data(1, Map("key" -> InnerData("name", 123))) val data = Seq(e) val d=