I'm using kafka 1.1.1 and idempotent producer. UnknownProducerIdException occurs particular topics when it is a low traffic situation such as under 10 logs per day. Increasing the retention of the topics reduce the frequency of occurrence.
ERROR [ReplicaManager broker=1] Error processing append operation on partition topic-9 (kafka.server.ReplicaManager) org.apache.kafka.common.errors.UnknownProducerIdException: Found no record of producerId=65002 on the broker. It is possible that the last message with the producerId=65002 has been removed due to hitting the retention limit.
