Re: kafka cluster size planning

Why do you need that many partitions or topics — what’s the business use case. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital business technology platforms. On Dec 10, 2018, 12:09 PM -0500,

Re: KTable.suppress(Suppressed.untilWindowCloses) does not suppress some non-final results when the kafka streams process is restarted

Hello Peter, Thanks for filing this report, I've looked into the source code and I think I may spotted an edge case to your observations. To validate if my suspicion is correct, could you try modifying your DSL code a little bit, to use a very large suppression buffer size --- BTW the StrictBuffer

Re: Cannot read messages using a specific group

Hi Ryanne, Here is the output of the command: bin/kafka-consumer-groups --bootstrap-server server --describe --group group_name Error: Executing consumer group command failed due to The consumer group command timed out while waiting for group to initialize The group_name consumer group is not ru

Re: High end-to-end latency with processing.guarantee=exactly_once

The problem is repartitions topics: Kafka Streams considers those topics as transient and purges consumed data aggressively (cf https://issues.apache.org/jira/browse/KAFKA-6150) resulting in lost producer state for those topics :( -Matthias On 12/20/18 3:18 AM, Dmitry Minkovsky wrote: > Also, I

Re: Cannot read messages using a specific group

The new consumer was reading from latest. What is interesting is that the consumer group that is stuck cannot be reset by the CLI (to either latest or earliest) and is still not working way past the retention period of all the topics (from the consumers with latest or earliest auto.offset.reset).

How to find client.id according to connection id

Hi, I have a connection id from broker in this format $localHost:$localPort-$remoteHost:$remotePort , how can I find the related client.id ?