Re: Setup an huge Unserializable Object in a mapper

2014-09-23 Thread matthes
-user-list.1001560.n3.nabble.com/Setup-an-huge-Unserializable-Object-in-a-mapper-tp14817p14916.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org

Re: Setup an huge Unserializable Object in a mapper

2014-09-23 Thread matthes
InputStreamReader(fileSystem.open(path } } } -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Setup-an-huge-Unserializable-Object-in-a-mapper-tp14817p14899.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Setup an huge Unserializable Object in a mapper

2014-09-22 Thread Sean Owen
lue.exposureCnt = value.totalCnt > } > > (key, value) > } > }.reduceByKey{ (x,y) => x.add(y); x}.cache() > > Best, > > Matthias > > > > > -- > View this message in context: > http://apache-spark-user-lis

Setup an huge Unserializable Object in a mapper

2014-09-22 Thread matthes
uceByKey{ (x,y) => x.add(y); x}.cache() Best, Matthias -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Setup-an-huge-Unserializable-Object-in-a-mapper-tp14817.html Sent from the Apache Spark User List maili