Re: Kafka 2.7.1 Rebalance failed DisconnectException

Depending on your original version, you may have to consult the upgrade guide. https://kafka.apache.org/27/documentation.html#upgrade Didn't see important compatibility settings like: [image: image.png] Perhaps you are not doing it correctly. [image: Confluent] Wu Sh

Re: Apache Kafka 2.8.0 and Zookeeper

Kafka 2.8 supports ZooKeeper 3.4.10 through 3.5.9 (3.5.9 recommended). According to https://docs.confluent.io/platform/current/installation/versions-interoperability.html Note that Confluent Platform 6.2.x is compatible of Kafka 2.8, and Confluent Platform 6.2.x supports ZooKeeper 3.4.10 ~ 3.5.9.

Re: Two doubts about the use of kafka

1. Use something like zk-1:2181:/kafka-root, zk-2:2181:/kafka-root,... 2. You may checkout the jmx monitoring stack using Prometheus and Grafana here . [image: Confluent] Wu Shilin Solution Architect +6581007012 Fo

Re: consumer group exit :explanation

There might be many causes, but from broker's point of view: This consumer is dead. Consumers are considered dead when one of the following happended: 1. didn't send out heartbeat for session.timeout.ms(defaults to 10 seconds) period of time. (Consumers sent heart beat ever heartbeat.interval.ms)

Re: Advertised.listeners to be used behind VIP Load Balancer

Kafka clients need to be able to differentiate the different brokers, and have explicit control which broker to connect to. Why? Each partition resides in a specific broker, and the client needs to connect to the partition leader to perform read & writes, if they are all under the same virtual ip,

Re: kafka partition_assignment_strategy

On which messages goes to which partition, it is decided by producer, so using round robin assignor doesn't help here in theory. And for producer, according to https://kafka.apache.org/documentation/ - The DefaultPartitioner now uses a sticky partitioning strategy. This means that records

Re: ssl.client.auth=required (MTLS issue)

This looks like a. list of trusted root certs to me. Did you configure the ssl keystore, trust store correctly? did you use truststore as key store? for example? [image: Confluent] Wu Shilin Solution Architect +6581007012 Follow us: [image: Blog]

Re: Question about Kafka ACL

You should investigate why person-b can create user and grant ACLs. Here might be some good reading on ACL related setup: https://docs.confluent.io/platform/current/kafka/authorization.html [image: Confluent] Wu Shilin Solution Architect +6581007012 Follow us: [image:

Re: Kafka 2.8.0 installation guide and pre-requisite details

Does this help? https://kafka.apache.org/documentation/#upgrade Since your version is somewhat old, you may have to follow the complete upgrade process, which could be painful. Alternatively, if you can setup a concurrently running new cluster in 2.8 and slowly move workload over, it might be eas

Re: vulnerabilities

I will try to report this as well. Thanks for pointing it out! [image: Confluent] Wu Shilin Solution Architect +6581007012 Follow us: [image: Blog]

Re: Mtls not working

nException: SSL handshake > failed > Caused by: javax.net.ssl.SSLException: Unsupported record version > Unknown-211.79 > > > On Thu, Jun 24, 2021, 17:59 Shilin Wu wrote: > > > You need to make sure the following one by one... Or you can post the > > message of error h

Re: Mtls not working

e] <https://youtube.com/confluent> [image: Kafka Summit] <https://www.kafka-summit.org/> On Thu, Jun 24, 2021 at 8:26 PM Anjali Sharma wrote: > Thanks for this but we are trying to do this on command line but getting > this bad certificate error > > On Thu, Jun 24,

Re: Mtls not working

/> On Thu, Jun 24, 2021 at 8:17 PM Anjali Sharma wrote: > Had added those configuration but still seeing only junk certificates from > client side ? Any idea how to solve? > > > Thanks > Anjali > > On Thu, Jun 24, 2021, 17:44 Shilin Wu wrote

Re: Mtls not working

present on > the client side for mtls as in what all configuration are needed that side? > > Thanks > > On Thu, Jun 24, 2021, 07:51 Shilin Wu wrote: > > > A few things to check: > > > > 1. Client trust store need to trust the server cert's issuer cert (AKA > the &g

Re: Mtls not working

A few things to check: 1. Client trust store need to trust the server cert's issuer cert (AKA the CA cert) 2. The client must have a keystore that can be trusted by server's trust store. 3. The server needs to be accessed either via FQDN, or one of the SAN address. If you are doing self sign, you

Re: Kafkabroker log swap writing error

Is the kafka for testing purposes? Although it is cross platform, the best is still under linux so that os buffer & cache can be efficient. If you can, you could try to run under WSL2. See a tech blog here: https://www.confluent.io/blog/set-up-and-run-kafka-on-windows-linux-wsl-2/ Lastly, if you

Re: How to reduce the latency to interact with a topic?

Summary of Configurations for Optimizing Latency Producer - linger.ms=0 (default 0) - compression.type=none (default none, meaning no compression) - acks=1 (default 1) Consumer - fetch.min.bytes=1 (default 1) [image: Confluent] Wu Shilin Solution Architect

Re: Is bootstrap.servers resolved only once?

Łowicki wrote: > On Mon, May 17, 2021 at 2:25 PM Shilin Wu > wrote: > > > Bootstrap servers are just used for initial connection, clients will get > > all server metadata from one of the bootstrap servers to discover the > full > > cluster membership (which may change dy

Re: Is bootstrap.servers resolved only once?

Bootstrap servers are just used for initial connection, clients will get all server metadata from one of the bootstrap servers to discover the full cluster membership (which may change dynamically), this list does not have to contain the full set of servers (you may want more than one, though, in c