Re: Pooling Kafka Java Consumers

2016-11-16 Thread Guozhang Wang
This seems workable to me. But how about just using a single consumer and re-assigning topic-partitions on-the-fly then? Guozhang On Mon, Nov 14, 2016 at 12:17 AM, Enrico Olivelli wrote: > Hi, > I'm using Java Consumer API (latest version, 0.10.1.0), I store > consumed offsets offline, that is

Pooling Kafka Java Consumers

2016-11-14 Thread Enrico Olivelli
Hi, I'm using Java Consumer API (latest version, 0.10.1.0), I store consumed offsets offline, that is that I do not use kafka builtin offset storage nor consumer groups. I need to read data from different topics, but from one topic at once, I would like to pool my consumers (using something like A