Kafka Cluster - Partition offset reset to 0. How is this possible?

Under what circumstance will a Kafka Partition (not consumer) lose its offset, and reset to 0? We are running Kafka 0.10.2.1 We have a Kafka topic with 8 evenly distributed partitions. Each partition's offset is relatively in line with each other. Partition Latest Offset Leader Replicas In Sync R

KafkaConsumer (0.11) assign then poll - doesn't return results for all assigned TopicPartitions

I want to manually fetch messages from all partitions of a topic. I'm doing this by: 1. Create a list of TopicPartition - one for each partition of my topic 2. Create KafkConsumer, and call .assign(myTopicPartitionsList) 3. For Each TopicPartition, seek to the offset I want to read But when I ca

Kafka Reassignment - traffic is different for the same type of reassignment

Hello everyone, I have a question about how reassignments work. When I issue a reassignment for similar topicpartitions, the throughput between the reassignments is very different even though all settings are similar. There is a huge difference on when the partitions finish their reassignment.