Have you followed this?
http://spark.apache.org/docs/latest/spark-standalone.html
It sounds more like your master is not connected to any executor. Hence,
no resources are available.
Am 04.09.16 um 05:34 schrieb kant kodali:
I don't think my driver program which is running on my local machine
I don't think my driver program which is running on my local machine can
connect to worker/executor machine because spark UI lists private ip's for
worker machine but I can connect to master from the driver because of this
setting export SPARK_PUBLIC_DNS="52.44.36.224". really not sure how to fix t
Hi Guys,
I am running my driver program on my local machine and my spark cluster is on
AWS. The big question is I don't know what are the right settings to get around
this public and private ip thing on AWS? my spark-env.sh currently has the the
following lines
export SPARK_PUBLIC_DNS="52.44.36.2