I am trying to read file from HDFS on Spark Shell and getting error as below.
When i create first RDD it works fine but when i try to do count on that
RDD, it trows me some connection error. I have single node hdfs setup and on
the same machine, i have spark running. Please help. When i run "jps"
c
There are couple of issues here which i was able to find out.
1: We should not use web port which we use to access the web UI. I was usong
that initially so it was not working.
2: All request should go to Name node and not anything else.
3: By replacing localhost:9000 in the above request, it