Re: Imbalance in Commit Messages Across __consumer_offsets Topic Partitions

2023-05-09 Thread Fares Oueslati
Hello Richard, Thank you for your answer. Upon examining the `__consumer_offsets` topic, it seems that all commit messages for a given consumer `group.id` go to the same partition. So, there's nothing much to do if we have a dominant consumer group reading from all topics. The only solution woul

RE: CVEs related to Kafka

2023-05-09 Thread Sahil Sharma D
Gentle reminder-2 ! -Original Message- From: Sahil Sharma D Sent: 03 May 2023 04:34 PM To: users@kafka.apache.org Subject: RE: CVEs related to Kafka Gentle reminder! From: Sahil Sharma D Sent: 03 May 2023 08:57 AM To: 'users@kafka.apache.org' Subject: RE: CVEs related to Kafka Importa

consume data exception

2023-05-09 Thread 王江欢
hi, I encountered the error in the figure when I consumed the data from kafka. Does anyone know the reason? Can this problem be resolved using a configuration item?

Kafka containers getting auto-deleted on RHEL OS.

2023-05-09 Thread Smit Shanischara
Hello, Hope you are doing good. There are some issues we are experiencing while using Kafka in our environments. I will explain the scenario of the issues below for better understanding. We are setting up Kafka using a Docker compose file (running this docker compose on a server with RHEL ope

Re: CVEs related to Kafka

2023-05-09 Thread Tauzell, Dave
Consider purchasing support from Confluent to get this sort of request answered quickly. From: Sahil Sharma D Date: Tuesday, May 9, 2023 at 12:40 PM To: users@kafka.apache.org Subject: [EXTERNAL] RE: CVEs related to Kafka Gentle reminder-2 ! -Original Message- From: Sahil Sharma D Se

User = partitions

2023-05-09 Thread влад тасканов
Hi. I recently start­ed studying kafka and raised a question. Is it possible for each user to make a separate queue? as I understand it, there is a broker with different topics, and each topic had the number of partitions = the number of use­rs. if yes, you can link to an example or explanation

Kafka Consumer Lag Monitoring

2023-05-09 Thread Akshay Kumar
Hello team, I am using Zookeeper less Kafka (Kafka Kraft - version 3.3.1). I wanted to monitor consumer lag, so I was using Burrow for that, but I am unable to use Burrow without Zookeeper. Does Burror work without Zookeeper? Or what is the better or best way to monitor consumer lag and lag hist

Re: Imbalance in Commit Messages Across __consumer_offsets Topic Partitions

2023-05-09 Thread Alexandre Dupriez
Hi Fares, What is the rate of offset commits for the group? How often do you need to commit offsets for consumers in this group? Thanks, Alexandre Le mar. 9 mai 2023 à 18:34, Fares Oueslati a écrit : > > Hello Richard, > > Thank you for your answer. > > Upon examining the `__consumer_offsets` t

RE: Kafka Consumer Lag Monitoring

2023-05-09 Thread raph
There is a lot of kakfa lag prometheus exporter. You could give a try at mine (named yakle working fine in production since years)But others does the job as well.Sent from my Galaxy Original message From: Akshay Kumar Date: 5/9/23 20:14 (GMT+01:00) To: users@kafka.apache.org

Re: Kafka Consumer Lag Monitoring

2023-05-09 Thread Santhosh Kumar
Hi Akshay Burrow is a popular open-source tool for monitoring the consumer lag in Apache Kafka. However, Burrow depends on ZooKeeper to access the Kafka metadata and track the consumer lag. Therefore, it is not possible to use Burrow without ZooKeeper. Since you are using Kafka version 3.3.1, you

Re: Kafka Consumer Lag Monitoring

2023-05-09 Thread Akshay Kumar
Hello team, JMX might not help as Kafka JMX doesn't provide Kafka.consumer Mbeans. However, this Mbean is provided by consumer application. So I am trying to fetch JMX data from the consumer application with the help of Zabbix, but I'm unable to fetch proper data. JMX keys tried - - jmx.d

Re: User = partitions

2023-05-09 Thread Brebner, Paul
Hi – as each topic can have 1 or more consumers (depending on the number of partitions), it’s certainly possible to have a 1-1 relationship between topics and consumers. The downside of this is typically that if the single consumer fails (and you don’t have some automatic approach to restart it

RE: CVEs related to Kafka

2023-05-09 Thread Sahil Sharma D
Hi team, By when we can expect reply reg this, any idea? Regards, Sahil -Original Message- From: Tauzell, Dave Sent: 09 May 2023 11:29 PM To: users@kafka.apache.org Subject: Re: CVEs related to Kafka Consider purchasing support from Confluent to get this sort of request answered quic

Re: CVEs related to Kafka

2023-05-09 Thread Luke Chen
Hi Sahil, > in which version of Kafka these will be fixed https://issues.apache.org/jira/browse/KAFKA-14320 https://issues.apache.org/jira/browse/KAFKA-14107 https://issues.apache.org/jira/browse/KAFKA-14256 Maybe you can try to search the JIRA first next time. :) Thank you. Luke On Wed, May 1