Sorry, I don't have experience with YARN.
I checked the YARN page
http://spark.apache.org/docs/latest/running-on-yarn.html
And for configuration, it refers to
http://spark.apache.org/docs/latest/configuration.html " Most of the
configs are the same for Spark on YARN as for other deployment modes.
See theconfiguration page
<http://spark.apache.org/docs/latest/configuration.html>for more
information on those. These are configs that are specific to Spark on YARN."
And in Networking, there's spark.driver.port.
Don't know if it's helpful.
Larry
On 7/31/14, 6:17 PM, Konstantin Kudryavtsev wrote:
Hi Larry,
I'm afraid this is standalone mode, I'm interesting in YARN
Also, I don't see port-in-trouble 33007which i believe related to Akka
Thank you,
Konstantin Kudryavtsev
On Thu, Jul 31, 2014 at 1:11 PM, Larry Xiao <xia...@sjtu.edu.cn
<mailto:xia...@sjtu.edu.cn>> wrote:
Hi Konstantin,
I think you can find it at
https://spark.apache.org/docs/latest/spark-standalone.html#configuring-ports-for-network-security
and you can specify port for master or worker at conf/spark-env.sh
Larry
On 7/31/14, 6:04 PM, Konstantin Kudryavtsev wrote:
Hi there,
I'm trying to run Spark on YARN cluster and face with issued that
some ports are closed, particularly port 33007 (I suppose it's
used by Akka)
Could you please provide me with a list of all ports required for
Spark?
Also, is it possible to set up these ports?
Thank you in advance,
Konstantin Kudryavtsev
