saveAsTextFile() part- files are missing

2015-05-21 Thread rroxanaioana
Hello! I just started with Spark. I have an application which counts words in a file (1 MB file). The file is stored locally. I loaded the file using native code and then created the RDD from it. JavaRDD rddFromFile = context.parallelize(myFile, 2);

Accessing Spark Web UI from another place than where the job actually ran

2015-07-09 Thread rroxanaioana
I have a spark cluster with 1 master 9nodes.I am running in standalone-mode. I do not have access to a web browser from any of the nodes in the cluster (I am connecting to the nodes through ssh --it is a grid5000 cluster). I was wondering, is there any possibility to access Spark Web UI in this c