Spark 2.0 on HDP

Hi Has anyone tried running Spark 2.0 on HDP. I have managed to get around the issues with the timeline service (by turning it off), but now am stuck when the YARN cannot find org.apache.spark.deploy.yarn.ExecutorLauncher. Error: Could not find or load main class org.apache.spark.deploy.yarn.Exec

Spark 2.0 Aggregator with complex types

Hi Guys I have got the Aggregator in Spark 2.0 working for case classes and primitive types and some complex types like Seq[], but when I use Maps or multi-dimensional arrays I get an exception at runtime. Is this supported or I am doing something wrong? Here is a code snippet and a stack trace. T