Re: [EXTERNAL] Re: UNKNOWN_PRODUCER_ID

@Matthias I will raise with the team that possible workaround meanwhile upgrading. Thanks Jose Manuel Vega Monroy Java Developer / Software Developer Engineer in Test Direct: +0035 0 2008038 (Ext. 8038) Email: jose.mon...@willi

Broker Interceptors

Hi Kafka community, I am hoping to get some feedback and thoughts about broker interceptors. KIP-42 Added Producer and Consumer interceptors which have provided Kafka users the ability to collect client side metrics and trace the path of individual messages end-to-end. This KIP also mentioned

Re: Broker Interceptors

Hi Tom, On Mon, 2 Dec 2019 at 09:41, Thomas Aley wrote: > Hi Kafka community, > > I am hoping to get some feedback and thoughts about broker interceptors. > > KIP-42 Added Producer and Consumer interceptors which have provided Kafka > users the ability to collect client side metrics and trace th

Re: [ANNOUNCE] Apache Kafka 2.2.2

Hi, May I know how would this version be different from the later versions 2.3.0, 2.3.1. I'm looking to upgrade my current Kafka 2.1.0, so can you please let me know what differences it would make for upgrading to 2.2.2 or 2.3.1? Thanks, Vinay On Monday, December 2, 2019, Vahid Hashemian wrote:

Re: [ANNOUNCE] Apache Kafka 2.2.2

2.2.2 is a bugfix release, it contains some of the fixes from 2.3.0/1, but does not backport new features. You can go to https://kafka.apache.org/downloads and check the release notes of 2.3.0/1 to see what new features and improvements you'd be missing if you didn't upgrade directly to those versi

Number of leader partitions per broker

Hello, Is it possible to calculate the number of partitions for which one broker is a leader, using existing Kafka metrics? Regards, Rodoljub

Broker data size

Hi everyone, I want to calculate the total amount of data per broker (sum of sizes of all partitions on the broker). How can I do that using existing metrics? Best regards, Rodoljub

kafka-consumer-groups timeout when setting an offset to a specific datetime

Hi everyone, we use kafka 2.3.0 from the confluent-kafka-2.11 Debian package on Debian 10. When we want to set an offset of a consumer to a datetime, we get a timeout error even if we use the timeout switch of the kafka-consumer-groups script: > kafka-consumer-groups --bootstrap-server localhos

Re: Number of leader partitions per broker

Rodoljub, On Mon, 2 Dec 2019 at 14:52, Rodoljub Radivojevic < rodoljub.radivoje...@instana.com> wrote: > Hello, > > Is it possible to calculate the number of partitions for which one broker > is a leader, using existing Kafka metrics? > > Regards, > Rodoljub > Does the below answer your question

Re: Broker data size

Hi, On Mon, 2 Dec 2019 at 14:59, Rodoljub Radivojevic < rodoljub.radivoje...@instana.com> wrote: > Hi everyone, > > I want to calculate the total amount of data per broker (sum of sizes of > all partitions on the broker). > How can I do that using existing metrics? > > Why would require a kafka

Re: Number of leader partitions per broker

kafka.server:name=LeaderCount,type=ReplicaManager metric provide leader count on each broker. $>bean kafka.server:name=LeaderCount,type=ReplicaManager $> $>get Value #mbean = kafka.server:name=LeaderCount,type=ReplicaManager: Value = 450; On Mon, Dec 2, 2019 at 8:55 PM M. Manna wrote: > Rodol

Re: Reducing streams startup bandwidth usage

Hi Alessandro, I'm sorry to hear that. The restore process only takes one factor into account: the current offset position of the changelog topic is stored in a local file alongside the state stores. On startup, the app checks if the recorded position lags the latest offset in the changelog. I

KafkaStreams internal producer order guarantee

Hi everyone In light of the discussions about order guarantee in Kafka, I am struggling to understand how that affects KafkaStreams internal *KafkaProducer*. In the official documentation, this section ( https://docs.confluent.io/current/streams/concepts.html#out-of-order-handling) enumerates 2 cau

Re: [VOTE] 2.4.0 RC2

Hi all, I ran the following: $ git clone https://github.com/elalonde/kafka $ ./kafka/bin/verifykafka-rc.sh 2.4.0 https://home.apache.org/~manikumar/kafka-2.4.0-rc2 - All sha1, sha256 and md5 sums look go