Re: Consumer offsets not visible in Kafka

2018-04-19 Thread Kien Truong
Hi, That tool only shows active consumer-groups that make use of the automatic partitions assignment API. Flink use the manual partitions assignment API, so it will now show up there. The best way to monitor kafka offset with Flink is using Flink's own metrics system. Otherwise, you can

Consumer offsets not visible in Kafka

2018-04-19 Thread Bernd.Winterstein
Hi We are using Kafka 0.11 consumers with Flink 1.4 and Confluence Kafka 4.0.0. Checkpointing is enabled and enableCommitOnCheckpoints ist set to true. However there are no offsets from Flink jobs visible in Kafka when checking with the kafka-consumer-groups tool. Any ideas Regards Bernd