Re: Running spark examples/scala scripts

2014-03-19 Thread Mayur Rustagi
You have to pick the right client version for your Hadoop. So basically its going to be your hadoop version. Map of hadoop versions to cdh & hortonworks is given on spark website. Regards Mayur Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi

Re: Running spark examples/scala scripts

2014-03-18 Thread Pariksheet Barapatre
:-) Thanks for suggestion. I was actually asking how to run spark scripts as a standalone App. I am able to run Java code and Python code as standalone app. one more doubt, documentation says - to read HDFS file, we need to add dependency org.apache.hadoop hadoop-client 1.0.1 How to know HDFS

Re: Running spark examples/scala scripts

2014-03-18 Thread Mayur Rustagi
print out the last line & run it outside on the shell :) Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Tue, Mar 18, 2014 at 2:37 AM, Pariksheet Barapatre wrote: > Hello all, > > I am trying to run shipped in example wi

Running spark examples/scala scripts

2014-03-17 Thread Pariksheet Barapatre
Hello all, I am trying to run shipped in example with spark i.e. in example directory. [cloudera@aster2 examples]$ ls bagel ExceptionHandlingTest.scala HdfsTest2.scala LocalKMeans.scala MultiBroadcastTest.scala SparkHdfsLR.scala SparkPi.scala BroadcastTest.scala