Re: Broadcast big dataset

2016-09-28 Thread WangJianfei
First thank you very much! My executor memeory is also 4G, but my spark version is 1.5. Does spark version make a trouble? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Broadcast-big-dataset-tp19127p19143.html Sent from the Apache Spark

Re: Broadcast big dataset

2016-09-28 Thread Andrew Duffy
tream.java:1706) My configuration is 4G memory in driver. Any advice is appreciated. Thank you! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Broadcast-big-dataset-tp19127.html Sent from the Apache Spark Developers List mailing list a

Broadcast big dataset

2016-09-28 Thread WangJianfei
java.io.ObjectInputStream.readArray(ObjectInputStream.java:1706) My configuration is 4G memory in driver. Any advice is appreciated. Thank you! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Broadcast-big-dataset-tp19127.html Sent from the Apache Spark Developers List mailing