Re: Got NotSerializableException when access broadcast variable

2014-08-20 Thread tianyi
eption.md > > Are you using the HiveContext within a tranformation that is called on an > RDD? That will definitely create a problem. > > -Vida > > > > > > On Wed, Aug 20, 2014 at 1:20 AM, tianyi wrote: > Thanks for help. > > I run this script

Re: Got NotSerializableException when access broadcast variable

2014-08-20 Thread tianyi
Thanks for help. I run this script again with "bin/spark-shell --conf spark.serializer=org.apache.spark.serializer.KryoSerializer” in the console, I can see: scala> sc.getConf.getAll.foreach(println) (spark.tachyonStore.folderName,spark-eaabe986-03cb-41bd-bde5-993c7db3f048) (spark.driver.host,1