Re: Issue adding server (0.10.0.0)

2016-09-05 Thread Wannes De Smet
Hi all We keep having this issue. After increasing the fetch threads, we cleared the entire cluster, upgraded to 0.10.0.1, started all nodes, and all was well. We cannot reduce the fetch size, as it is equal to our max.message.size. Increasing the number of replica threads to a higher count increa

Re: Issue adding server (0.10.0.0)

2016-08-17 Thread Jun Rao
Jarko, Do you have many topic partitions? Currently, if #partitions * fetched_bytes in the response exceeds 2GB, we will get an integer overflow and weird things can happen. We are trying to address this better in KIP-74. If this is the issue, for now, you can try reducing the fetch size or increa

Issue adding server (0.10.0.0)

2016-08-17 Thread J Mes
Hello, I have a cluster of 3 nodes running kafka v.0.10.0.0. This cluster was starter about a week ago with no data, no issues starting up. Today we noticed 1 of the servers in the cluster did not work anymore, we checked and indeed the server was not working anymore and all data was old. We re