FYI, I just filed https://issues.apache.org/jira/browse/SPARK-15974.
Mingyu
From: Mingyu Kim
Date: Tuesday, June 14, 2016 at 2:13 PM
To: Steve Loughran
Cc: "dev@spark.apache.org" , Matt Cheah
Subject: Re: Utilizing YARN AM RPC port field
Thanks for the pointers, Stev
there are no objections, I can file a bug and find time to tackle it myself.
Mingyu
From: Steve Loughran
Date: Tuesday, June 14, 2016 at 4:55 AM
To: Mingyu Kim
Cc: "dev@spark.apache.org" , Matt Cheah
Subject: Re: Utilizing YARN AM RPC port field
On 14 Jun 2016, at 01:
On 14 Jun 2016, at 01:30, Mingyu Kim
mailto:m...@palantir.com>> wrote:
Hi all,
YARN provides a way for AppilcationMaster to register a RPC port so that a
client outside the YARN cluster can reach the application for any RPCs, but
Spark’s YARN AMs simply register a dummy port number of 0. (See
Hi all,
YARN provides a way for AppilcationMaster to register a RPC port so that a
client outside the YARN cluster can reach the application for any RPCs, but
Spark’s YARN AMs simply register a dummy port number of 0. (See
https://github.com/apache/spark/blob/master/yarn/src/main/scala/org/a
