I have suddenly starting having issues where when I am producing data I occasionally get "NotLeaderForPartitionException: This server is not the leader for that topic-partition". I am using Kafka 2.10-0.8.2.1 with the new Producer class and no retries. If I add retries to the Producer properties I am ending up with duplicates on the consumer side.
Any idea what can be the cause of the NotLeaderForPartitionException? Thanks.