Thank you Tathagata, It is great to know about this issue, but our problem is a little bit different. We have 3 nodes in our Spark cluster, and when the Zookeeper leader dies, the Master Spark gets shut down, and remains down, but a new master gets elected and loads the UI. I think if the problem was the eventlogging, the new master would have failed as well. Or maybe i am wrong
On Tue, Jun 23, 2015 at 3:00 AM, Tathagata Das <t...@databricks.com> wrote: > Maybe this is a known issue with spark streaming and master web ui. > Disable event logging, and it should be fine. > > https://issues.apache.org/jira/browse/SPARK-6270 > > On Mon, Jun 22, 2015 at 8:54 AM, scar scar <scar0...@gmail.com> wrote: > >> Sorry I was on vacation for a few days. Yes, it is on. This is what I >> have in the logs: >> >> 15/06/22 10:44:00 INFO ClientCnxn: Unable to read additional data from >> server sessionid 0x14dd82e22f70ef1, likely server has closed socket, >> closing socket connection and attempting reconnect >> 15/06/22 10:44:00 INFO ClientCnxn: Unable to read additional data from >> server sessionid 0x24dc5a319b40090, likely server has closed socket, >> closing socket connection and attempting reconnect >> 15/06/22 10:44:01 INFO ConnectionStateManager: State change: SUSPENDED >> 15/06/22 10:44:01 INFO ConnectionStateManager: State change: SUSPENDED >> 15/06/22 10:44:01 WARN ConnectionStateManager: There are no >> ConnectionStateListeners registered. >> 15/06/22 10:44:01 INFO ZooKeeperLeaderElectionAgent: We have lost >> leadership >> 15/06/22 10:44:01 ERROR Master: Leadership has been revoked -- master >> shutting down. >> >> >> On Thu, Jun 11, 2015 at 8:59 PM, Tathagata Das <t...@databricks.com> >> wrote: >> >>> Do you have the event logging enabled? >>> >>> TD >>> >>> On Thu, Jun 11, 2015 at 11:24 AM, scar0909 <scar0...@gmail.com> wrote: >>> >>>> I have the same problem. i realized that the master spark becomes >>>> unresponsive when we kill the leader zookeeper (of course i assigned the >>>> leader election task to the zookeeper). please let me know if you have >>>> any >>>> devlepments. >>>> >>>> >>>> >>>> -- >>>> View this message in context: >>>> http://apache-spark-user-list.1001560.n3.nabble.com/Shutdown-with-streaming-driver-running-in-cluster-broke-master-web-UI-permanently-tp4149p23284.html >>>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>>> >>>> --------------------------------------------------------------------- >>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>>> For additional commands, e-mail: user-h...@spark.apache.org >>>> >>>> >>> >> >
