Re: reduceByKey issue in example wordcount (scala)

2014-04-18 Thread Ian Bonnycastle
he ClassNotFoundException error. So, in the future, always "sbt/sbt package" before doing an "sbt/sbt run". Thank you for all your help, Marcelo. Ian On Mon, Apr 14, 2014 at 2:59 PM, Ian Bonnycastle wrote: > Hi Marcelo, > > Changing it to null didn't make any di

Re: reduceByKey issue in example wordcount (scala)

2014-04-14 Thread Ian Bonnycastle
ting to all the nodes properly. But why reduceByKey is the only method affected is beyond me. Ian On Mon, Apr 14, 2014 at 2:45 PM, Marcelo Vanzin wrote: > Hi Ian, > > On Mon, Apr 14, 2014 at 11:30 AM, Ian Bonnycastle > wrote: > > val sc = new SparkContext("

Re: reduceByKey issue in example wordcount (scala)

2014-04-14 Thread Ian Bonnycastle
, Marcelo Vanzin wrote: > Hi Ian, > > When you run your packaged application, are you adding its jar file to > the SparkContext (by calling the addJar() method)? > > That will distribute the code to all the worker nodes. The failure > you're seeing seems to indicate t

reduceByKey issue in example wordcount (scala)

2014-04-14 Thread Ian Bonnycastle
Good afternoon, I'm attempting to get the wordcount example working, and I keep getting an error in the "reduceByKey(_ + _)" call. I've scoured the mailing lists, and haven't been able to find a sure fire solution, unless I'm missing something big. I did find something close, but it didn't appear