Reynold
thanks for the reply. It's true, this is more to Yarn communication
than Spark.
But this is a general enough problem for all the YARN_CLUSTER mode
application. I thought
just to reach out to the community.
If we choose to using Akka solution, then this is related to Spark, as
there i
This isn't exactly about Spark itself, more about how an application on
YARN/Mesos can communicate with another one.
How about your application launch program just takes in a parameter (or env
variable or command line argument) for the IP address of your client
application, and just send updates?