Sending messages within ProducerInterceptor callback?

2020-10-28 Thread Ross Black
Hi, I could not find any documentation or posts about the behaviour of a ProducerInterceptor if the callback '*onSend*' is used to send additional events to Kafka, so I was hoping somebody here could help me understand its behaviour. I would like to send a subset of outgoing messages (being sent

Mechanism similar to __consumer_offsets but for consumer.endOffsets

2020-10-28 Thread Michał Łowicki
Hey, Is there any way to continuously get end offsets for all partitions from the topic or across the whole cluster as with consumer offsets? Periodic polling consumer.endOffsets

Re: Kafka Streams application stuck rebalancing on startup

2020-10-28 Thread Alex Jablonski
This block: @EmbeddedKafka( topics = { "WordCounts", "WordsForNumbers", "OutputTopic" } ) starts up an embedded Kafka in the test and creates the 3 topics (2 input and 1 output). By default it creates them with 2 partitions each, but changing to 1 partition didn't

Re: Kafka Streams application stuck rebalancing on startup

2020-10-28 Thread Sophie Blee-Goldman
Yeah there's definitely something weird going on (assuming this is the full logs over that time period). The last thing we see logged from the StreamThread is this message from around the start of the task assignment process: 2020-10-28 12:22:37.879 DEBUG 27226 --- [-StreamThread-1] o.a.k.s.p.i.St

Re: Kafka Streams RocksDB high CPU usage

2020-10-28 Thread Nicolas Carlot
Looks like IO issues. RocksDB is intended to run on SDD drives, much slower on HDD. Le mar. 27 oct. 2020 à 22:00, Giselle Van Dongen a écrit : > Hi all, > > We have a Kafka Streams application which is showing high CPU usage. When > profiling the application we see that many of the hotspots are

Re: Client session timed out

2020-10-28 Thread Praveen Kumar K S
Hello All, Please provide some inputs and help to resolve this issue. I have cross verified and it is not a DNS issue. Not sure why we are facing this issue. Should I report a bug for this ? Please let me know. Regards, Praveen Kumar K S On Tue, Oct 27, 2020 at 8:41 PM Sabina Marx wrote: > D