RE: Enable Parsing Failed or Incompleted jobs on HistoryServer (YARN mode)

2014-07-07 Thread Andrew Lee
re digging. Thanks. Date: Thu, 3 Jul 2014 06:56:46 -0400 Subject: Re: Enable Parsing Failed or Incompleted jobs on HistoryServer (YARN mode) From: suren.hira...@velos.io To: user@spark.apache.org I've had some odd behavior with jobs showing up in the history server in 1.0.0. Failed jobs do

Re: Enable Parsing Failed or Incompleted jobs on HistoryServer (YARN mode)

2014-07-03 Thread Surendranauth Hiraman
I've had some odd behavior with jobs showing up in the history server in 1.0.0. Failed jobs do show up but it seems they can show up minutes or hours later. I see in the history server logs messages about bad task ids. But then eventually the jobs show up. This might be your situation. Anecdotall

Enable Parsing Failed or Incompleted jobs on HistoryServer (YARN mode)

2014-07-02 Thread Andrew Lee
Hi All, I have HistoryServer up and running, and it is great. Is it possible to also enable HsitoryServer to parse failed jobs event by default as well? I get "No Completed Applications Found" if job fails. =Event Log Location: hdfs:///user/test01/spark/logs/No Completed Applications Foun