Re: ClassCastException in driver program

2015-09-08 Thread Jeff Jones
jars list. Unfortunately the actual error got masked by the one I sent below. Jeff From: Shixiong Zhu Date: Sunday, September 6, 2015 at 9:02 AM To: Jeff Jones Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" Subject: Re: ClassCastException in driver program Looks there a

Re: ClassCastException in driver program

2015-09-07 Thread Shixiong Zhu
BTW, did you already update your standalone cluster to use the same Spark package? Best Regards, Shixiong Zhu 2015-09-07 0:02 GMT+08:00 Shixiong Zhu : > Looks there are some circular references in SQL making the immutable List > serialization fail in 2.11. > > In 2.11, Scala immutable List uses

Re: ClassCastException in driver program

2015-09-06 Thread Shixiong Zhu
Looks there are some circular references in SQL making the immutable List serialization fail in 2.11. In 2.11, Scala immutable List uses writeReplace()/readResolve() which don't play nicely with circular references. Here is an example to reproduce this issue in 2.11.6: class Foo extends Seriali