Re: Kafka Streams - Java StreamException - Serdes issue

Hi Bill, Thanks so much for your help but unfortunately i did not work, I had the same error trace. I found where the issue was: groupByKey, as described here So adding the *Grouped.wi

Partition Strategy in Kafka Stream

Hi Which partition strategy Kafka stream uses? Can we change the partition strategy in Kafka Stream as we can change in normal Kafka Consumer streamsConfiguration.put(ConsumerConfig.PARTITION_ASSIGNMENT_STRATEGY_CONFIG,Collections.singletonList(ColombiaStrictStickyAssignor.class)); so not chang

Re: Streaming Data

+1 for looking into Kafka Streams. You can build and maintain state within your app, and expose it on a REST endpoint for your node/react app to query. There's an example of this here: https://github.com/confluentinc/kafka-streams-examples/blob/5.2.1-post/src/main/java/io/confluent/examples/streams

Re: Streaming Data

Hi All, thanks for the recommendations. I really like staying close to the Apache.org product line - so I will likely go the route that puts kafka streams or spark into play. On Wed, Apr 10, 2019 at 11:45 AM Robin Moffatt wrote: > +1 for looking into Kafka Streams. You can build and maintain st

Producer data drop prevention

Good day, Could you please share experience on how do you tackle a problem with lost/not sent messages from Producer in case when you have to send 100%+ data? I.e. I've implemented similar thing to https://stackoverflow.com/a/4419, from simple tests it works fine. But does this callback guara

stale RocksDB store files are not getting cleaned up

Hi all, I have a problem with my kafka-streams (2.1.1) application. Sorry for being vague, but I couldn‘t find more information than the following: Most of the times my services are running just fine, but sometimes (I cannot put my finger on a precise trigger) the .sst files of more or less rando

Re: Partition Strategy in Kafka Stream

Hi Neeraj, I have a couple of questions, are you trying to adjust the partition assignment of records consumed by streams? In that case, you can assign a custom partition assignor for the producer sending records to the topic feeding the streams application. If you are trying to do custom partit

stale RocksDB store files are not getting cleaned up

Hi all, I have a problem with my kafka-streams (2.1.1) application. Sorry for being vague, but I couldn‘t find more information than the following: Most of the times my services are running just fine, but sometimes (I cannot put my finger on a precise trigger) the .sst files of more or less rando

murmur3 in kafka

Hi, Is murmur3 supported in any version of librdkafka? Thanks & Regards, Rakesh K R

Re: Kafka SASL auth setup error: Connection to node 0 (localhost/127.0.0.1:9092) terminated during authentication

So you mean three sections, namely KafkaServer, KafkaClient and Client needs to be kept inside a file and passed to broker. And section Server needs to be passed to zookeeper? I did exactly that, even copied your config. It still isn't working. On Wed, Apr 10, 2019 at 7:07 AM 1095193...@qq.com <10

Re: Partition Strategy in Kafka Stream

Hi Bill Thanks for replying. We have a 5 node cluster of KStream which is reading from a Topic A. In node 1 consumer we are reading partitions from 1 to 50 of Topic A using KStream and aggregating the records and saving in the local state store (Rocks DB). In case node 1 goes down these 50 parti