Re: Running spark-submit from a remote machine using a YARN application

2014-12-14 Thread Tobias Pfeiffer
Hi, On Fri, Dec 12, 2014 at 7:01 AM, ryaminal wrote: > > Now our solution is to make a very simply YARN application which execustes > as its command "spark-submit --master yarn-cluster > s3n://application/jar.jar > ...". This seemed so simple and elegant, but it has some weird issues. We > get "N

Running spark-submit from a remote machine using a YARN application

2014-12-11 Thread ryaminal
... Has anyone had this problem or know a solution? We would be happy to post our very simple code for creating the YARN application. Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-spark-submit-from-a-remote-machine-using-a-YARN-applicati