Re: Random continuous TimeoutException with Topic not present on one KafkaProducer out of many in multithreaded env

2022-06-06 Thread Luke Chen
Hi Deepak, So, if you change the value in max.block.ms to default 1 minute, does the timeout exception still exist? I think the timeoutException is complaining the 250ms is not a good configuration for your environment. Thank you. Luke On Tue, Jun 7, 2022 at 11:23 AM Deepak Jain wrote: > Hi, >

Kafka Authentication + Authorization

2022-06-06 Thread rohit garg
Dear Users, Few questions regarding authentication 1- in case of implementation of SASL/SCRAM without SSL with below param listeners=SASL_PLAINTEXT://apache-kafka.abc.com:9090 security.inter.broker.protocol=SASL_PLAINTEXT sasl.mechanism.inter.broker.protocol=SCRAM-SHA-256 sasl.enabled.mechanisms

RE: Random continuous TimeoutException with Topic not present on one KafkaProducer out of many in multithreaded env

2022-06-06 Thread Deepak Jain
Hi, Thanks for the quick reply. We are already using the config max.block.ms (alongwith with other recommended config like request.timeout.ms and others). Although the value we are using is very less at 250 ms but since we have 5 different KafkaProducer running in each individual thread out of

Kafka MirrorMaker2 with different version

2022-06-06 Thread Doug Whitfield
Is it possible to run https://github.com/apache/kafka/tree/2.5.0/connect/mirror with Kafka 2.6? It does not seem like the best idea, but we are in a situation where that may need to happen, if possible. Thanks! This e-mail may contain information that is privileged or confidential. If you are

RE: SASL authentication between Kafka and Zookeeper

2022-06-06 Thread Ivanov, Evgeny
Hi, here you are /app/zookeeper/apache-zookeeper-3.8.0-bin /app/kafka/kafka_2.13-3.1.0 Best regards, Evgeny Business Application Support VTB Capital Telephone.: +7 (495) 960 (ext.264423) Mobile: +7 (916) 091-8939 -Original Message- From: Francois Papon Sent: 6 июня 2022 г. 14:44

Re: Random continuous TimeoutException with Topic not present on one KafkaProducer out of many in multithreaded env

2022-06-06 Thread 张晓寅
maybe you can add producer "max.block.ms" config,but you should test your broker look up some logs about leader change ,producer performance,like traffic ,produce "buffer" and "batch.size" On Mon, Jun 6, 2022 at 6:53 PM Deepak Jain wrote: > Hello All, > > Please help me out in this regard as th

Re: SASL authentication between Kafka and Zookeeper

2022-06-06 Thread Francois Papon
Hi, Wich version of Kafka/Zookeeper are you using? On 06/06/2022 12:11, Ivanov, Evgeny wrote: Hi François, yes, I did (for both Client and Server), but no luck: [2022-06-06 13:06:11,348] INFO Client will use DIGEST-MD5 as SASL mechanism. (org.apache.zookeeper.client.ZooKeeperSaslClient)

RE: Random continuous TimeoutException with Topic not present on one KafkaProducer out of many in multithreaded env

2022-06-06 Thread Deepak Jain
Hello All, Please help me out in this regard as the Customer has reported this on their production environment and waiting for our reply ASAP. Regards, Deepak From: Deepak Jain Sent: 02 June 2022 20:53 To: 'users@kafka.apache.org' Cc: 'Luke Chen' ; Alap Patwardhan ; Bhushan Patil Subject: Ra

RE: SASL authentication between Kafka and Zookeeper

2022-06-06 Thread Ivanov, Evgeny
Hi François, yes, I did (for both Client and Server), but no luck: [2022-06-06 13:06:11,348] INFO Client will use DIGEST-MD5 as SASL mechanism. (org.apache.zookeeper.client.ZooKeeperSaslClient) [2022-06-06 13:06:11,348] ERROR Exception while trying to create SASL client. (org.apache.zookee

Re: SASL authentication between Kafka and Zookeeper

2022-06-06 Thread fpapon
Hi, Did you tried to use? org.apache.zookeeper.server.auth.DigestLoginModule instead of org.apache.kafka.common.security.plain.PlainLoginModule Regards, François On 06/06/2022 11:27, Ivanov, Evgeny wrote: org.apache.kafka.common.security.plain.PlainLoginModule required -- -- François

SASL authentication between Kafka and Zookeeper

2022-06-06 Thread Ivanov, Evgeny
Hi all, could you please advise correct configuration settings (jaas and config files) to enable SASL authentication between Kafka and Zookeeper ? Here is the error I get: [2022-06-06 10:54:30,348] ERROR SASL authentication failed using login context 'Client'. (org.apache.zookeeper.client.ZooK