Re: spark eventLog and history server

2015-06-09 Thread Richard Marscher
Hi, I don't have a complete answer to your questions but: "Removing the suffix does not solve the problem" -> unfortunately this is true, the master web UI only tries to build out a Spark UI from the event logs once, at the time the context is closed. If the event logs are in-progress at this tim

spark eventLog and history server

2015-06-08 Thread Du Li
Event log is enabled in my spark streaming app. My code runs in standalone mode and the spark version is 1.3.1. I periodically stop and restart the streaming context by calling ssc.stop(). However, from the web UI, when clicking on a past job, it says the job is still in progress and does not sh