MQTT broker data validation against Schema Registry

2024-05-29 Thread Perez
Hi Team, I have a requirement where I want MQTT broker to validate the records as per the schema registered in the registry and if it matches then write to the kafka topic or park it in a separate kafka topic. So I was wondering if I can do something like this part of the code with any of the MQT

Kafka throughput calculation

2024-12-02 Thread Perez
Hi Team, I would need help with this. https://stackoverflow.com/questions/79233264/kafka-throughput-calculation Any suggestions? TIA.

Aggregation operations and Joins not working as I would expect.

2017-06-22 Thread Daniel Del Castillo Perez
Hi all, I’m playing with Kafka Streams 0.10.2.1 and I’m having some issues here which I hope you can help me to clarify/understand. In a hypothetical scenario, I have 2 source streams – clicks and orders – which I’m trying to join to match determine from which page the purchase has been made.

Re: Aggregation operations and Joins not working as I would expect.

2017-06-23 Thread Daniel Del Castillo Perez
esses later, >you will get the result you expect. > >see: >https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Streams+Join+Seman >tics > > > >-Matthias > > >On 6/22/17 10:26 AM, Daniel Del Castillo Perez wrote: >> Hi all, >> >> I¹m pl

Fwd: Fwd: suddenly kafka cluster shutdown

2017-11-28 Thread Jose Raul Perez Rodriguez
Hi kafka user and devs, I have a kafka cluster on AWS EMR instances using de zookeeper that cames with EMR, The problem is that after some days running and working good, the cluster shutdown, every node shutdown showing logs messages like the one below. That is happening in the las two month 3

[GroupCoordinatorNotAvailableException] consumer error on poll request

2016-04-26 Thread Jose Raul Perez Rodriguez
Hello, I am using KafkaProducer and KafkaConsumer, version 0.90, in java, the producer works good (the Console Consumer provided in samples receives the producer data). But in the configured KafkaConsumer I got the /org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException/**error

How to add (intercept?) messages in the broker before and after they are serialized?

2020-04-22 Thread del Castillo Perez, Daniel
Hello there, I'm facing a challenge at the moment where I need to somehow extend the brokers so I can make decisions on the messages (whether they should be discarded or not) on the server side. I've read the documentation but I haven't seen a way of doing this so I'm starting to look into the cod