Hi Jun,
That was the problem. It was actually the Ubuntu upstart job over writing
the limit. Thank you very much for your help.
Paul Lung
On 7/9/14, 1:58 PM, "Jun Rao" wrote:
>Is it possible your container wrapper somehow overrides the file handler
>limit?
>
>Thanks,
>
>Jun
>
>
>On Wed, Jul 9,
Is it possible your container wrapper somehow overrides the file handler
limit?
Thanks,
Jun
On Wed, Jul 9, 2014 at 9:59 AM, Lung, Paul wrote:
> Yup. In fact, I just ran the test program again while the Kafak broker is
> still running, using the same user of course. I was able to get up to 10K
I don't know if that is your problem, but I had this output when my brokers
couldn't talk to each others...
The zookeeper were using the FQDN but my brokers didn't know the FQDN of
the other brokers...
If you look at you brokers info in zk (get /brokers/ids/#ID_OF_BROKER) can
you ping/connect to
I have the same problem. I didn't dig deeper but I saw this happen when I
launch kafka in daemon mode. I found the daemon mode is just launch kafka
with nohup. Not quite clear why this happen.
On Wed, Jul 9, 2014 at 9:59 AM, Lung, Paul wrote:
> Yup. In fact, I just ran the test program again wh
Yup. In fact, I just ran the test program again while the Kafak broker is
still running, using the same user of course. I was able to get up to 10K
connections with the test program. The test program uses the same java NIO
library that the broker does. So the machine is capable of handling that
man
Does your test program run as the same user as Kafka broker?
Thanks,
Jun
On Tue, Jul 8, 2014 at 1:42 PM, Lung, Paul wrote:
> Hi Guys,
>
> I’m seeing the following errors from the 0.8.1.1 broker. This occurs most
> often on the Controller machine. Then the controller process crashes, and
> the
Hit the send button too fast. I verified the number of open file
descriptors from the broker by using ³sudo lsof -p², and by using ³sudo ls
-l /proc//fd | wc -l².
Paul
On 7/8/14, 1:42 PM, "Lung, Paul" wrote:
>Hi Guys,
>
>I¹m seeing the following errors from the 0.8.1.1 broker. This occurs most
Hi Guys,
I’m seeing the following errors from the 0.8.1.1 broker. This occurs most often
on the Controller machine. Then the controller process crashes, and the
controller bounces to other machines, which causes those machines to crash.
Looking at the file descriptors being held by the process,
