[jira] [Created] (FLINK-6520) FlinkKafkaConsumer09+ does not overwrite props to not auto commit offsets when commit mode is OffsetCommitMode.ON_CHECKPOINTS

2017-05-10 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-6520: -- Summary: FlinkKafkaConsumer09+ does not overwrite props to not auto commit offsets when commit mode is OffsetCommitMode.ON_CHECKPOINTS Key: FLINK-6520 URL: https

[jira] [Created] (FLINK-6366) KafkaConsumer is not closed in FlinkKafkaConsumer09

2017-04-24 Thread Fang Yong (JIRA)
Fang Yong created FLINK-6366: Summary: KafkaConsumer is not closed in FlinkKafkaConsumer09 Key: FLINK-6366 URL: https://issues.apache.org/jira/browse/FLINK-6366 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-01 Thread Sudhanshu Sekhar Lenka (JIRA)
Sudhanshu Sekhar Lenka created FLINK-4722: - Summary: Consumer group concept not working properly with FlinkKafkaConsumer09 Key: FLINK-4722 URL: https://issues.apache.org/jira/browse/FLINK-4722

Re: FlinkKafkaConsumer09

2016-07-29 Thread Maximilian Michels
gt;> > >> > On 28.07.2016 10:39, Maximilian Michels wrote: >> >> Hi Kevin, >> >> >> >> You need to use properties.setProperty("auto.offset.reset", >> >> "smallest") for Kafka 9 to start from the smallest offset

Re: FlinkKafkaConsumer09

2016-07-29 Thread 戴資力
erties.setProperty("auto.offset.reset", > >> "earliest") to achieve the same behavior. > >> > >> Kafka keeps track of the offsets per group id. If you have already > >> read from a topic with a certain group id and want to restart

Re: FlinkKafkaConsumer09

2016-07-29 Thread Maximilian Michels
from the >> smallest offset available, you need to generate a unique group id. >> >> Cheers, >> Max >> >> On Thu, Jul 28, 2016 at 10:14 AM, Kevin Jacobs > wrote: >>> Hi, >>> >>> I am currently facing strange behaviour of the FlinkKa

Re: FlinkKafkaConsumer09

2016-07-28 Thread Tai Gordon
Cheers, > Max > > On Thu, Jul 28, 2016 at 10:14 AM, Kevin Jacobs wrote: >> Hi, >> >> I am currently facing strange behaviour of the FlinkKafkaConsumer09 class. I >> am using Flink 1.0.3. >> >> These are my properties: >> >> val

Re: FlinkKafkaConsumer09

2016-07-28 Thread Kevin Jacobs
2016 at 10:14 AM, Kevin Jacobs wrote: Hi, I am currently facing strange behaviour of the FlinkKafkaConsumer09 class. I am using Flink 1.0.3. These are my properties: val properties = new Properties() properties.setProperty("bootstrap.servers", config.urlKafka) properties.setProperty("gro

Re: FlinkKafkaConsumer09

2016-07-28 Thread Maximilian Michels
t; I am currently facing strange behaviour of the FlinkKafkaConsumer09 class. I > am using Flink 1.0.3. > > These are my properties: > > val properties = new Properties() > properties.setProperty("bootstrap.servers", config.urlKafka) > properties.setProperty("group.id",

Re: FlinkKafkaConsumer09

2016-07-28 Thread Tai Gordon
offsets can be found. Currently, if Flink’s checkpointing isn’t enabled, FlinkKafkaConsumer09 will periodically commit offsets back to Kafka brokers. So, it could be that you’re actually using those offsets as the actual starting points. Perhaps you can try using a new groupId and see if the behaviour

FlinkKafkaConsumer09

2016-07-28 Thread Kevin Jacobs
Hi, I am currently facing strange behaviour of the FlinkKafkaConsumer09 class. I am using Flink 1.0.3. These are my properties: val properties = new Properties() properties.setProperty("bootstrap.servers", config.urlKafka) properties.setProperty("group.id&q

[jira] [Created] (FLINK-3542) FlinkKafkaConsumer09 cannot handle changing number of partitions

2016-02-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3542: Summary: FlinkKafkaConsumer09 cannot handle changing number of partitions Key: FLINK-3542 URL: https://issues.apache.org/jira/browse/FLINK-3542 Project: Flink

[jira] [Created] (FLINK-3541) Clean up workaround in FlinkKafkaConsumer09

2016-02-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3541: Summary: Clean up workaround in FlinkKafkaConsumer09 Key: FLINK-3541 URL: https://issues.apache.org/jira/browse/FLINK-3541 Project: Flink Issue Type