Re: Steadily increasing open file descriptors on one node a cluster

2018-07-11 Thread Michael Rauter
Furher investigations: I have compared open files/connections of the different nodes. Same count in real open files (data dir files) and established connections on all nodes. But the affected node has a lot of "CLOSE_WAIT" connections (many thousends) to IPs of external clients (no specific ip)

Steadily increasing open file descriptors on one node a cluster

2018-07-10 Thread Michael Rauter
Hi, I’m running a Kafka cluster with many topics and constant input of data. The cluster is running for over one year but now (since 2 weeks) there is one node where I see a steady increase of open file descriptors of the Kafka server process. All other nodes have a constant number of this metri

Re: ACL with SSL is not working

2017-05-19 Thread Michael Rauter
Hi, with SSL client authentication the user identifier is the dname of the certificate in your case “CN=Bob,O=FB,OU=MA,L=MP,ST=CA,C=US” for example when you want to set an ACL rule (read and write for topic TOPICNAME from every host): $ kafka-acls --authorizer-properties zookeeper.connect=zo

Re: Kafka Upgrade 0.10.2.0 to 0.10.2.1 partitionRecordsOrFail

2017-05-19 Thread Michael Rauter
d 0.10.2.1). partitionRecordsOrFail was added in 0.10.2.1 and the class from the older jar was loaded instead. Can you give a little more details regarding the Kafka package you are using and how you upgraded it? Ismael On Fri, May 19, 2017 at 3:54 PM, Michael Rauter wrote:

Kafka Upgrade 0.10.2.0 to 0.10.2.1 partitionRecordsOrFail

2017-05-19 Thread Michael Rauter
I try to do a rolling upgrade a kafka cluster from 0.10.2.0 to 0.10.2.1. But after upgrade the first node to 0.10.2.1 I get: [2017-05-19 16:02:03,941] ERROR [KafkaApi-3] Error when handling request {acks=-1,timeout=3,topic_data=[{topic=topic data=[{partition=4,record_set=[(offset=0,record=R