Change for submitting to yarn in 1.3.1

2015-05-10 Thread Ron's Yahoo!
Hi, I used to submit my Spark yarn applications by using org.apache.spark.yarn.deploy.Client api so I can get the application id after I submit it. The following is the code that I have, but after upgrading to 1.3.1, the yarn Client class was made into a private class. Is there a particular r

More productive compilation of spark code base

2014-08-11 Thread Ron's Yahoo!
Hi, I’ve been able to get things compiled on my environment, but I’m noticing that it’s been quite difficult in IntelliJ. It always recompiles everything when I try to run one test like BroadcastTest, for example, despite having compiled make-distribution previously. In eclipse, I have no such

Re: Jira tickets for starter tasks

2014-08-29 Thread Ron's Yahoo!
Hi Josh, Can you add me as well? Thanks, Ron On Aug 28, 2014, at 3:56 PM, Josh Rosen wrote: > A JIRA admin needs to add you to the ‘’Contributors” role group in order to > allow you to assign issues to yourself. I’ve added this email address to > that group, so you should be set! > > - Jo