Hello, I am building a kafka stream application consuming a log compacted topic of 12 partitions. Each message has a String key and a json body, the json body contains a date field. I have made a custom Transformer in my topology that consumes this stream, immediately forward the document where the date is in the past and keep in the state the documents where the date is in the future. Then with a Ponctuator, I am looking to the state and eventually forwarding documents when the date is changing. The current key I use for my state is the date, and it is not related to the message key. Is it problematic ? I would like to avoid repartitioning by date because it would be unbalanced
Best, Vincent