Hi,
we come across a mysterious behavior with Kafka streams clients.
After writing about 40000 messages to a topic, they are suddenly no
longer available and the topic is empty. The client is still alive.
We use the following defaults as properties for the topic
- retention.ms=129600000 # 1.5 days
Other properties are kafka defaults
Changing the retention time property to
- retention.ms=-1
(infinite) the behavior doesn't occur.
Actually we are running the cluster in version 2.7.0 but this happened
also in 2.4.x
The behavior isn't always consistent. In 2.4.x it was possible that the
behavior occurred with some topics and not with others.
Thanks for any advice that could help us to solve the problem.
Günter