RE: Flink kafka consumer that read from two partitions in local mode

2017-09-26 Thread Tzu-Li (Gordon) Tai
and regards, Tovi   From: Sofer, Tovi [ICG-IT] Sent: יום ב 25 ספטמבר 2017 17:18 To: 'Tzu-Li (Gordon) Tai'; Fabian Hueske Cc: user Subject: RE: Flink kafka consumer that read from two partitions in local mode   Hi Gordon,   Thanks for your assistance.   · We are run

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-26 Thread Sofer, Tovi
Hueske Cc: user Subject: RE: Flink kafka consumer that read from two partitions in local mode Hi Gordon, Thanks for your assistance. · We are running flink currently in local mode(MiniCluster), using flink 1.3.2 and flink-connector-kafka-0.10_2.10. · In Consumer log I see 1

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-25 Thread Sofer, Tovi
Producer (2/2) to produce into default topic fix Thanks, Tovi From: Tzu-Li (Gordon) Tai [mailto:tzuli...@apache.org] Sent: יום ב 25 ספטמבר 2017 15:06 To: Sofer, Tovi [ICG-IT]; Fabian Hueske Cc: user Subject: RE: Flink kafka consumer that read from two partitions in local mode Hi Tovi, Your

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-25 Thread Tzu-Li (Gordon) Tai
t: Re: Flink kafka consumer that read from two partitions in local mode   Hi Tovi, your code looks OK to me. Maybe Gordon (in CC) has an idea what is going wrong. Just a side note: you don't need to set the parallelism to 2 to read from two partitions. A single consumer instance reads can

RE: Flink kafka consumer that read from two partitions in local mode

2017-09-24 Thread Sofer, Tovi
(Gordon) Tai Subject: Re: Flink kafka consumer that read from two partitions in local mode Hi Tovi, your code looks OK to me. Maybe Gordon (in CC) has an idea what is going wrong. Just a side note: you don't need to set the parallelism to 2 to read from two partitions. A single consumer ins

Re: Flink kafka consumer that read from two partitions in local mode

2017-09-19 Thread Fabian Hueske
Hi Tovi, your code looks OK to me. Maybe Gordon (in CC) has an idea what is going wrong. Just a side note: you don't need to set the parallelism to 2 to read from two partitions. A single consumer instance reads can read from multiple partitions. Best, Fabian 2017-09-19 17:02 GMT+02:00 Sofer, To

Flink kafka consumer that read from two partitions in local mode

2017-09-19 Thread Sofer, Tovi
Hi, I am trying to setup FlinkKafkaConsumer which reads from two partitions in local mode, using setParallelism=2. The producer writes to two partition (as it is shown in metrics report). But the consumer seems to read always from one partition only. Am I missing something in partition configura