TLS Communication in With Zookeeper Cluster

2019-07-29 Thread Nayak, Soumya R.
Hi Team, Is there any way mutual TLS communication set up can be done with zookeeper. If any references, can you please let me know. I am trying to set up a Zookeeper cluster (3 Zookeepers) and Kafka cluster (4 Kafka Brokers) using docker images in Azure Ubuntu VM servers. Also, there is a n

Re: TLS Communication in With Zookeeper Cluster

2019-07-29 Thread Harsha
Here is the guide https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide you need zookeeper 3.5 or higher for TLS. On Mon, Jul 29, 2019, at 1:21 AM, Nayak, Soumya R. wrote: > Hi Team, > > Is there any way mutual TLS communication set up can be done with > zookeeper. If a

Re: TLS Communication in With Zookeeper Cluster

2019-07-29 Thread Martin Gainty
MG>below From: Nayak, Soumya R. Sent: Monday, July 29, 2019 4:20 AM To: users@kafka.apache.org Subject: TLS Communication in With Zookeeper Cluster Hi Team, Is there any way mutual TLS communication set up can be done with zookeeper. If any references, can yo

Re: Print RocksDb Stats

2019-07-29 Thread Bruno Cadonna
Hi Muhammed, RocksDB is not an in-memory store. If you use only InMemoryKeyValueStore, you are not using any RocksDB. Best, Bruno On Wed, Jul 17, 2019 at 3:26 PM Muhammed Ashik wrote: > > Hi I'm trying to log the rocksdb stats with the below code, but not > observing any logs.. > I'm enabling t

Kafka stops on cleaner-offset-checkpoint not found

2019-07-29 Thread Archit kumar
I am stuck at this and hopeless. I have asked same question here : https://stackoverflow.com/questions/57247237/error-failed-to-access-checkpoint-file-cleaner-offset-checkpoint-in-dir-tmp-kaf But I dint get any response yet. Cold you please help me to resolve this. [2019-07-28 04:11:14,310] ERRO

Smoothly expanding log.dirs

2019-07-29 Thread Will Weber
Hey all! I was wondering how you all might recommend expanding your log.dirs settings safely. Specifically, when you add new entries to your log.dirs setting on your brokers, and execute a rolling restart to have the brokers take the new configuration, how do you spread out your partitions into t

Partition assignment in kafka streams

2019-07-29 Thread Navneeth Krishnan
Hi, I'm using the processor topology for my use case and I would like to get the partitions assigned to a particular stream instance. I looked at the addSouce function but I don't see a way to add a callback to get notified when partition assignment or reassignment happens. Please advise. Thank y

Re: Partition assignment in kafka streams

2019-07-29 Thread Navneeth Krishnan
Hi All, The main reason for knowing the partitions is to have a localized routing based on partitions assigned to set a stream tasks. This would really help in my use case. Thanks On Mon, Jul 29, 2019 at 8:58 PM Navneeth Krishnan wrote: > Hi, > > I'm using the processor topology for my use cas