This is master log. There's no worker registration info in the log. That means the worker may not start properly. Please check the log file with apache.spark.deploy.worker in file name.
On Tue, Sep 1, 2015 at 2:55 PM, Madawa Soysa <[email protected]> wrote: > I cannot see anything abnormal in logs. What would be the reason for not > availability of executors? > > On 1 September 2015 at 12:24, Madawa Soysa <[email protected]> > wrote: > >> Following are the logs available. Please find the attached. >> >> On 1 September 2015 at 12:18, Jeff Zhang <[email protected]> wrote: >> >>> It's in SPARK_HOME/logs >>> >>> Or you can check the spark web ui. http://[master-machine]:8080 >>> >>> >>> On Tue, Sep 1, 2015 at 2:44 PM, Madawa Soysa <[email protected]> >>> wrote: >>> >>>> How do I check worker logs? SPARK_HOME/work folder does not exist. I am >>>> using the spark standalone mode. >>>> >>>> On 1 September 2015 at 12:05, Jeff Zhang <[email protected]> wrote: >>>> >>>>> No executors ? Please check the worker logs if you are using spark >>>>> standalone mode. >>>>> >>>>> On Tue, Sep 1, 2015 at 2:17 PM, Madawa Soysa <[email protected]> >>>>> wrote: >>>>> >>>>>> Hi All, >>>>>> >>>>>> I have successfully submitted some jobs to spark master. But the jobs >>>>>> won't progress and not finishing. Please see the attached screenshot. >>>>>> These >>>>>> are fairly very small jobs and this shouldn't take more than a minute to >>>>>> finish. >>>>>> >>>>>> I'm new to spark and any help would be appreciated. >>>>>> >>>>>> Thanks, >>>>>> Madawa. >>>>>> >>>>>> >>>>>> --------------------------------------------------------------------- >>>>>> To unsubscribe, e-mail: [email protected] >>>>>> For additional commands, e-mail: [email protected] >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Best Regards >>>>> >>>>> Jeff Zhang >>>>> >>>> >>>> >>>> >>>> -- >>>> >>>> *_________________________________**Madawa Soysa* >>>> >>>> Undergraduate, >>>> >>>> Department of Computer Science and Engineering, >>>> >>>> University of Moratuwa. >>>> >>>> >>>> Mobile: +94 71 461 6050 <%2B94%2075%20812%200726> | Email: >>>> [email protected] >>>> LinkedIn <http://lk.linkedin.com/in/madawasoysa> | Twitter >>>> <https://twitter.com/madawa_rc> | Tumblr <http://madawas.tumblr.com/> >>>> >>> >>> >>> >>> -- >>> Best Regards >>> >>> Jeff Zhang >>> >> >> >> >> -- >> >> *_________________________________**Madawa Soysa* >> >> Undergraduate, >> >> Department of Computer Science and Engineering, >> >> University of Moratuwa. >> >> >> Mobile: +94 71 461 6050 <%2B94%2075%20812%200726> | Email: >> [email protected] >> LinkedIn <http://lk.linkedin.com/in/madawasoysa> | Twitter >> <https://twitter.com/madawa_rc> | Tumblr <http://madawas.tumblr.com/> >> > > > > -- > > *_________________________________**Madawa Soysa* > > Undergraduate, > > Department of Computer Science and Engineering, > > University of Moratuwa. > > > Mobile: +94 71 461 6050 <%2B94%2075%20812%200726> | Email: > [email protected] > LinkedIn <http://lk.linkedin.com/in/madawasoysa> | Twitter > <https://twitter.com/madawa_rc> | Tumblr <http://madawas.tumblr.com/> > -- Best Regards Jeff Zhang
