Re: all task managers reading from all kafka partitions

2017-11-18 Thread r. r.
eekend! -Robert > Оригинално писмо >От: Gary Yao g...@data-artisans.com >Относно: Re: all task managers reading from all kafka partitions >До: "r. r." >Изпратено на: 18.11.2017 11:28 > >

Re: all task managers reading from all kafka partitions

2017-11-18 Thread Gary Yao
oncurency in one JVM. > > Thanks! > > > > > > > > > Оригинално писмо > > >От: Gary Yao g...@data-artisans.com > > >Относно: Re: all task managers reading from all kafka partitions > > >До: "r. r." > > >Из

Re: all task managers reading from all kafka partitions

2017-11-17 Thread r. r.
hanks! > Оригинално писмо >От: Gary Yao g...@data-artisans.com >Относно: Re: all task managers reading from all kafka partitions >До: "r. r." >Изпратено на: 17.11.2017 22:58 > > > > >

Re: all task managers reading from all kafka partitions

2017-11-17 Thread Gary Yao
00,765 WARN >> org.apache.kafka.clients.consumer.ConsumerConfig - The >> configuration 'topic' was supplied but isn't a known config. >> >> taskmanager_3 | 2017-11-17 18:29:00,765 INFO >> org.apache.kafka.common.utils.AppInfoPar

Re: all task managers reading from all kafka partitions

2017-11-17 Thread r. r.
s, the console-consumers from localhost > Оригинално писмо >От: Gary Yao g...@data-artisans.com >Относно: Re: all task managers reading from all kafka partitions >До: "r. r." >Изпратено на: 17.11.2017 20:

all task managers reading from all kafka partitions

2017-11-17 Thread r. r.
Hi I have this strange problem: 4 task managers each with one task slot, attaching to the same Kafka topic which has 10 partitions. When I post a single message to the Kafka topic it seems that all 4 consumers fetch the message and start processing (confirmed by TM logs). If I run kafka-consum