Sure, will look into the tests. Thanks you so much for your time!
[image: --] Tariq, Mohammad [image: https://]about.me/mti <https://about.me/mti?promo=email_sig&utm_source=email_sig&utm_medium=external_link&utm_campaign=chrome_ext> [image: http://] Tariq, Mohammad about.me/mti [image: http://] <http://about.me/mti> On Fri, Nov 11, 2016 at 4:35 AM, Marcelo Vanzin <van...@cloudera.com> wrote: > Sorry, it's kinda hard to give any more feedback from just the info you > provided. > > I'd start with some working code like this from Spark's own unit tests: > https://github.com/apache/spark/blob/a8ea4da8d04c1ed621a96668118f20 > 739145edd2/yarn/src/test/scala/org/apache/spark/deploy/ > yarn/YarnClusterSuite.scala#L164 > > > On Thu, Nov 10, 2016 at 3:00 PM, Mohammad Tariq <donta...@gmail.com> > wrote: > >> All I want to do is submit a job, and keep on getting states as soon as >> it changes, and come out once the job is over. I'm sorry to be a pest of >> questions. Kind of having a bit of tough time making this work. >> >> >> [image: --] >> >> Tariq, Mohammad >> [image: https://]about.me/mti >> >> <https://about.me/mti?promo=email_sig&utm_source=email_sig&utm_medium=external_link&utm_campaign=chrome_ext> >> >> >> >> >> [image: http://] >> >> Tariq, Mohammad >> about.me/mti >> [image: http://] >> <http://about.me/mti> >> >> >> On Fri, Nov 11, 2016 at 4:27 AM, Mohammad Tariq <donta...@gmail.com> >> wrote: >> >>> Yeah, that definitely makes sense. I was just trying to make it work >>> somehow. The problem is that it's not at all calling the listeners, hence >>> i'm unable to do anything. Just wanted to cross check it by looping inside. >>> But I get the point. thank you for that! >>> >>> I'm on YARN(cluster mode). >>> >>> >>> [image: --] >>> >>> Tariq, Mohammad >>> [image: https://]about.me/mti >>> >>> <https://about.me/mti?promo=email_sig&utm_source=email_sig&utm_medium=external_link&utm_campaign=chrome_ext> >>> >>> >>> >>> >>> [image: http://] >>> >>> Tariq, Mohammad >>> about.me/mti >>> [image: http://] >>> <http://about.me/mti> >>> >>> >>> On Fri, Nov 11, 2016 at 4:19 AM, Marcelo Vanzin <van...@cloudera.com> >>> wrote: >>> >>>> On Thu, Nov 10, 2016 at 2:43 PM, Mohammad Tariq <donta...@gmail.com> >>>> wrote: >>>> > @Override >>>> > public void stateChanged(SparkAppHandle handle) { >>>> > System.out.println("Spark App Id [" + handle.getAppId() + "]. >>>> State [" + handle.getState() + "]"); >>>> > while(!handle.getState().isFinal()) { >>>> >>>> You shouldn't loop in an event handler. That's not really how >>>> listeners work. Instead, use the event handler to update some local >>>> state, or signal some thread that's waiting for the state change. >>>> >>>> Also be aware that handles currently only work in local and yarn >>>> modes; the state updates haven't been hooked up to standalone mode >>>> (maybe for client mode, but definitely not cluster) nor mesos. >>>> >>>> -- >>>> Marcelo >>>> >>> >>> >> > > > -- > Marcelo >
