--
> *发件人:* "Akhil Das";;
> *发送时间:* 2014年12月9日(星期二) 下午3:42
> *收件人:* "十六夜涙";
> *抄送:* "user";
> *主题:* Re: spark broadcast unavailable
>
> You cannot pass the sc object (*val b = Utils.load(sc,ip_lib_path)*)
> inside a map function and
roadcast value
unavaible.
-- 原始邮件 --
发件人: "Akhil Das";;
发送时间: 2014年12月9日(星期二) 下午3:42
收件人: "十六夜涙";
抄送: "user";
主题: Re: spark broadcast unavailable
You cannot pass the sc object (val b = Utils.load(sc,ip_lib_path)) inside a map
function and that&#x
You cannot pass the sc object (*val b = Utils.load(sc,ip_lib_path)*) inside
a map function and that's why the Serialization exception is popping up(
since sc is not serializable). You can try tachyon's cache if you want to
persist the data in memory kind of forever.
Thanks
Best Regards
On Tue, De
Hi allIn my spark application,I load a csv file and map the datas to a Map
vairable for later uses on driver node ,then broadcast it,every thing works
fine untill the exception java.io.FileNotFoundException occurs.the console log
information shows me the broadcast unavailable,I googled this
