Kafka 0.11 broker running out of file descriptors

2017-09-15 Thread Lukas Lalinsky
Hello, I'm dealing with a strange issue in production and I'm running out of options what to do about it. It's a 3 node cluster running Kafka 0.11.0.1 with most topics having replication factor of 2. At some point, the broker that is about do die shrinks ISR for a few partitions just to itself:

Kafka 0.11 broker running out of file descriptors

2017-09-15 Thread Lukas Lalinsky
Hello, I'm dealing with a strange issue in production and I'm running out of options what to do about it. It's a 3 node cluster running Kafka 0.11.0.1 with most topics having replication factor of 2. At some point, the broker that is about do die shrinks ISR for a few partitions just to itself: