Offsets/Lags for global state stores not shown

Hello Am I doing something wrong or is it by design that global state stores and their consumers do not show up under the consumer-groups? With the consumer group command (and in control center as well) I don't get any output for the group: ./kafka-consumer-groups --bootstrap-server broker:9092 --

Replica Fetcher errors for Deleted topics

Hi, We are seeing a weird behavior for deleted topics on our cluster. Broker logs have following messages, the cluster appears to be healthy except for these messages. ERROR [ReplicaFetcher replicaId=1, leaderId=5, fetcherId=0] Error for partition deleted-topic-20 to broker 5:org.apache.kafka.com

Kafka Streams Session store performance degradation from 0.10.2.1 to 0.11.0.3

I have a Kafka Streams app that I'm trying to upgrade from 0.10.2.1 to 0.11.0.3 but when I do I notice that CPU goes way up and consumption goes down. A thread profile indicates that the most expensive task is during our aggregation, fetching from the cache. Thread profile with caching: https://im

Re: Offsets/Lags for global state stores not shown

The topics of global stores are not included by design. The "problem" is, that each instance needs to consume *all* topic-partitions from and thus topis, we thus they cannot be include into the consumer group that would assign each partition to exactly one instance. Hence, an additional consumer i

Re: Kafka Streams Session store performance degradation from 0.10.2.1 to 0.11.0.3

Not sure atm why you see a performance degradation. Would need to dig into the details. However, did you consider to upgrade to 2.0 instead or 0.11? Also note that we added a new operator `suppress()` in upcoming 2.1 release, that allows you to do rate control without caching: https://cwiki.apach

Re: [VOTE] 2.1.0 RC0

Hey Satish, Yes! We will have another RC to include e.g. https://github.com/apache/kafka/pull/5857. Thanks, Dong On Mon, Nov 5, 2018 at 8:14 PM Satish Duggana wrote: > Hi Dong, > Is there a RC1 planned with configs documentation fixes and > https://github.com/apache/kafka/pull/5857 ? > > Thank

Tentative release date for KAFKA-7280 and its possible workaround

Hi,I am using Kafka 1.1.0 java client and my brokers are also on the same version. I am running into the same issue as reported in [KAFKA-7280] ConcurrentModificationException in FetchSessionHandler in heartbeat thread - ASF JIRA.  | | | | [KAFKA-7280] ConcurrentModificationException in Fet

Re: Replica Fetcher errors for Deleted topics

Rolling restart fixed the problem in my case. On Tue, Nov 6, 2018 at 3:54 PM Avinash Shahdadpuri wrote: > Hi, > > We are seeing a weird behavior for deleted topics on our cluster. Broker > logs have following messages, the cluster appears to be healthy except for > these messages. > > ERROR [Rep

Re: Kafka ingestion data not equally distribute among brokers

Hi Manoj, I am new on Kafka, is it something mentioned on this site? https://kafka.apache.org/0100/javadoc/org/apache/kafka/streams/state/KeyValueStore.html Where can we set the key and value in Kafka? Thanks! - Original Message - From: "Manoj Khangaonkar" To: "users" Sent: Tuesday,