Re: Cascading failures on running out of disk space

2015-06-08 Thread Jananee S
Thanks Jason. We did run out of disk space and noticed IOExceptions too. No, the broker did not shut itself down. Is there some configuration that would enable this for one or all brokers? That would be a better scenario to be in. Right now, we have setup some alerts when disk space goes beyond a

Re: Cascading failures on running out of disk space

2015-06-01 Thread Jason Rosenberg
Hi Jananee, Do you for sure that you ran out of disk space completely? Did you see an IOExceptions failing to write? Normally, when that happens, the broker is supposed to immediately shut itself down. Did the one broker shut itself down? The NotLeaderForPartitionException's are normal when par