Re: Shutdown with streaming driver running in cluster broke master web UI permanently

2015-06-23 Thread scar scar
Thank you Tathagata, It is great to know about this issue, but our problem is a little bit different. We have 3 nodes in our Spark cluster, and when the Zookeeper leader dies, the Master Spark gets shut down, and remains down, but a new master gets elected and loads the UI. I think if the problem

Re: Shutdown with streaming driver running in cluster broke master web UI permanently

2015-06-23 Thread Tathagata Das
Maybe this is a known issue with spark streaming and master web ui. Disable event logging, and it should be fine. https://issues.apache.org/jira/browse/SPARK-6270 On Mon, Jun 22, 2015 at 8:54 AM, scar scar wrote: > Sorry I was on vacation for a few days. Yes, it is on. This is what I have > in

Re: Shutdown with streaming driver running in cluster broke master web UI permanently

2015-06-22 Thread scar scar
Sorry I was on vacation for a few days. Yes, it is on. This is what I have in the logs: 15/06/22 10:44:00 INFO ClientCnxn: Unable to read additional data from server sessionid 0x14dd82e22f70ef1, likely server has closed socket, closing socket connection and attempting reconnect 15/06/22 10:44:00 I

Re: Shutdown with streaming driver running in cluster broke master web UI permanently

2015-06-11 Thread Tathagata Das
Do you have the event logging enabled? TD On Thu, Jun 11, 2015 at 11:24 AM, scar0909 wrote: > I have the same problem. i realized that the master spark becomes > unresponsive when we kill the leader zookeeper (of course i assigned the > leader election task to the zookeeper). please let me know

Re: Shutdown with streaming driver running in cluster broke master web UI permanently

2015-06-11 Thread scar0909
I have the same problem. i realized that the master spark becomes unresponsive when we kill the leader zookeeper (of course i assigned the leader election task to the zookeeper). please let me know if you have any devlepments. -- View this message in context: http://apache-spark-user-list.10015