Hello, We are using Kafka 0.9 version and are having large number of messages pushed to specific partition within a kafka topic. And there are multiple such partitions within this topic. We have one consumer assigned per partition within this topic, and we are maintaining offset manually within the topic-partition in an outside datastore. I wanted to know if we start getting really large number of messages in a topic-partition, is it possible to have consumer dealing with a topic-partition to be multi-threaded. Because it might not be possible that a consumer instance assigned to a partition is able to finish processing all the records in the time-span we want it finish. Is it possible to have such kind of multi-threaded consumer with a partition. Is it recommended? Also if the answer is YES, then how multiple threads can do offset management, because all these threads are dealing with messages within the same partition. Any sample snippet available?
Please note: I am asking about "*consumer dealing with a single partition within a topic*", I am *not *looking at the consumer group for a topic across partitions in it.
