Re: Brokers is down by “java.io.IOException: Too many open files”

I’ve seen where setting network configurations within the OS can help mitigate some of the “Too many open files” issue as well. Try changing the following items on the OS to try to have used network connections close as quickly as possible in order to keep file handle use down: sysctl -w

Re: Brokers is down by “java.io.IOException: Too many open files”

Hi Caleb, We already set the number of max open files to 100,000 before this error happened. Normally, the file description is about 20,000, but in some time, it suddenly jump to so many count. This is our monitor about Kafka FD info: 2017-05-17-05:04:19 FD_total_num:19261 FD_p

Re: Brokers is down by “java.io.IOException: Too many open files”

If you're using a systemd based OS you'll actually need to set it in the unit file. LimitNOFILE=10 https://kafka.apache.org/documentation/#upgrade_10_1_breaking contains some changes re file handles as well. __ Sam Pegler PRODUCTION ENGINEER T. +44(0) 07 562 867 486

Re: Brokers is down by “java.io.IOException: Too many open files”

You need to up your OS open file limits, something like this should work: # /etc/security/limits.conf * - nofile 65536 On Fri, May 12, 2017 at 6:34 PM, Yang Cui wrote: > Our Kafka cluster is broken down by the problem “java.io.IOException: Too > many open files” three times in 3 weeks. > >

Brokers is down by “java.io.IOException: Too many open files”

Our Kafka cluster is broken down by the problem “java.io.IOException: Too many open files” three times in 3 weeks. We encounter these problem on both 0.9.0.1 and 0.10.2.1 version. The error is like: java.io.IOException: Too many open files at sun.nio.ch.ServerSocketChannelImpl.accept0