Kafka Streams - Out of Order Handling

2021-03-03 Thread Marcus Horsley-Rai
Hi All, Just to give a bit of context; I have an application which is SNMP polling a network. Each collector agent works on a 1 minute schedule, polling device(s) and posting results to a Kafka topic. The time a given collector publishes data can vary within a minute, but it should never overlap w

Mirror Maker for Avro Messages (with schema registry)

2021-03-03 Thread Adithya Tirumale
Hi, We have a use case where we need to maintain a replicated/cloned kafka cluster in a lower environment mirroring the production kafka cluster. The messages in kafka are a mix of JSON and AVRO messages. The schemas for the avro messages are registered using schema registry. Using Mirror make