Retrieving a specific message for re-delivery without moving head using seek()

Hello, I am using Kafka in plain producer-consumer style. I have a daily exchange of about 1 million messages avg 50kb size per message. I am still using 0.10.2.1 Whilst I am relying on Kafka's stability under a 9-node configuration - I would like to build some internal process which can keep my

Kafka using existing certificate authority.

I am trying to set up apache kafka using an existing certificate authority, and I cannot find any documentation related to this option. also is there an ssl setting to use a different type of keystore then jks? Please respond as soon as anyone can. Thank you. -- Shawn P. Raymond I RHCSA, CI

Commit in Kafka streams reduces throughput

Hi All, I am using processor API in Kafka Streams and I am using context.commit in process method of Processor Interface. When I am using commit then my application throughput is about 2k/min and when I removes commit then it increases to 4k/min. Two questions I have: 1. I need to know how commit

Kafka bug ISR expands/shrinks "Count" JMX attribute doesn't work as expected

Problems are: * JMX attribute: `kafka.server` Is always 0 for `Count` and all other attributes. If I shutdown any broker I would expect that this would increase. * JMX attribute: `kafka.server` Have random behavior sometimes on shutting down broker it increases and on starting it also incr

UnknownProducerIdException in Kafka streams when enabling exactly once

After enabling exactly once processing on a Kafka streams application, the following error appears in the logs: ERROR o.a.k.s.p.internals.StreamTask - task [0_0] Failed to close producer due to the following error: org.apache.kafka.streams.errors.StreamsException: task [0_0] Abort sending since

Possible to Disable Offset Checkpointing for an In-Memory Global Store?

I have a custom in-memory state store which I’d like to configure as a global store for my Kafka Streams application. However, even though my state store is not persistent (i.e. the implementation of StateStore.persistent() returns false) it appears that the GlobalStateManager still continues t

Re: Kafka bug ISR expands/shrinks "Count" JMX attribute doesn't work as expected

How are you checking these metrics? They are per leader. That is, if broker A is the leader for topic partition topic-0 and broker B is a follower, then shutting down broker B should cause the IsrShrinksPerSec for broker A to be updated. You would also something like the following in the server.log

Re: Kafka using existing certificate authority.

MG>below From: Shawn Raymond Sent: Tuesday, April 17, 2018 10:25 AM To: users@kafka.apache.org Subject: Kafka using existing certificate authority. I am trying to set up apache kafka using an existing certificate authority, and I cannot find any documentation rel