It's possible to support multi-fetchers per broker in the consumer. Could you file a jira to track that? However, typically the bottleneck is not in the fetcher, but in decompression, decoding and application logic during the consumption.
Thanks, Jun On Mon, Dec 16, 2013 at 7:33 AM, Evelina <stepanova....@gmail.com> wrote: > Hi folks! > > I'm trying High-Level Consumer and wondering why it uses only 1 fetcher > per broker? > Why can't it be scaled on partition basis? > > I even see the parameter '/numFetchers/' in /AbstractFetcherManager/ but > it explicitly set to 1 in /ConsumerFetcherManager/. > > -- > Very Best Regards, > Evelina > > >
