consumer versions to Flink
>>> metrics as well.
>>>
>>> - Gordon
>>>
>>> [1] https://issues.apache.org/jira/browse/FLINK-6109
>>>
>>>
>>> On 19 April 2017 at 5:11:11 AM, sandeep6 (vr1meghash...@gmail.com)
>>> wrote:
>>>
>>> Is this fixed now? If not, is there any way to monitor kafka offset that
>>> is
>>> being processed by Flink? This should be a use case for everyone who uses
>>> Flink with Kafka.
>>>
>>>
>>>
>>> --
>>> View this message in context: http://apache-flink-user-maili
>>> ng-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer-
>>> Behaviour-tp8257p12663.html
>>> Sent from the Apache Flink User Mailing List archive. mailing list
>>> archive at Nabble.com.
>>>
>>>
>>
Hi All,
Sorry for the miscommunication. I'm not using 0.8. I'm using latest
available flink-kafka client. I don't see my app registered as a consumer
group. I wanted to know if there is a way to monitor Kafka offsets.
Thanks,
Sandeep
On Apr 23, 2017 9:38 AM, "Stephan Ewen" wrote:
> Since it is
owse/FLINK-6109
>
>
> On 19 April 2017 at 5:11:11 AM, sandeep6 (vr1meghash...@gmail.com) wrote:
>
> Is this fixed now? If not, is there any way to monitor kafka offset that is
> being processed by Flink? This should be a use case for everyone who uses
> Flink with Kafka.
>
&
ed by Flink? This should be a use case for everyone who uses
Flink with Kafka.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer-Behaviour-tp8257p12663.html
Sent from the Apache Flink User Mailing List archive. mailing list ar
e who uses
Flink with Kafka.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer-Behaviour-tp8257p12663.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at
Nabble.com.
Is this fixed now? If not, is there any way to monitor kafka offset that is
being processed by Flink? This should be a use case for everyone who uses
Flink with Kafka.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer
per
>
> --describe --group starts pulling offset results for me.
>
> I think this needs to be corrected in the application: to check and create
> "/consumers//owners/" if it does not exist.
>
> Regards,
> Anchit
>
>
>
> --
> View this message in c
g-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer-Behaviour-tp8257p9499.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at
Nabble.com.
Hi!
There was an issue in the Kafka 0.9 consumer in Flink concerning
checkpoints. It was relevant mostly for lower-throughput topics /
partitions.
It is fixed in the 1.1.3 release. Can you try out the release candidate and
see if that solves your problem?
See here for details on the release candi
completing.
[Checkpoint Timer] org.apache.flink.runtime.checkpoint.CheckpointCoordinator
- Triggering checkpoint 39 @ 1474313973640
--
Ankit
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer-Behaviour-tp8257p9300.html
Sent from
--
> View this message in context: http://apache-flink-user-
> mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer-Behaviour-
> tp8257p8375.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>
use is the number
of records read shown in the flink-UI and the last offset in kafka.
Thanks,
Prabhu
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-Consumer-Behaviour-tp8257p8375.html
Sent from the Apache Flink User Mailing
Hi!
I have not used the Kafka Offset Checker before, maybe someone who worked
with that can chime in.
Greetings,
Stephan
On Wed, Aug 3, 2016 at 4:59 PM, Janardhan Reddy wrote:
> I can see that offsets are stored in zookeeper and are not returned when i
> query through kafka offset checker.
>
I can see that offsets are stored in zookeeper and are not returned when i
query through kafka offset checker.
Can you please tell me how to monitor kafka flink consumer lag for 0.8
flink kafka consumer.
On Wed, Aug 3, 2016 at 3:29 PM, Stephan Ewen wrote:
> Hi!
>
> Just check in the code. The 0
Hi!
Just check in the code. The 0.8 FlinkKafkaConsumer should always commit
offsets, regardless of whether checkpointing is enables. The 0.9
FlinkKafkaConsumer actually does not do any periodic offset committing when
checkpointing is disabled.
Greetings,
Stephan
On Wed, Aug 3, 2016 at 7:36 AM, J
Checkpointing wasn't enabled in the streaming job, but the offsets should
have been committed to zookeeper.
But we don't see the offsets being written to zookeeper.
On Tue, Aug 2, 2016 at 7:41 PM, Till Rohrmann wrote:
> Hi Janardhan,
>
> Flink should commit the current offsets to Zookeeper when
Hi Janardhan,
Flink should commit the current offsets to Zookeeper whenever a checkpoint
has been completed. In case that you disabled checkpointing, then the
offsets will be periodically committed to ZooKeeper. The default value is
60s.
Could it be that there wasn't yet a completed checkpoint? W
Hi,
When the run the following command i am getting that no topic is available
for that consumer group. i am suing
flink-connector-kafka-0.8_${scala.version}(2.11).
./bin/kafka-consumer-groups.sh --zookeeper <> --group <> --describe
No topic available for consumer group provided
Does the kafk
18 matches
Mail list logo
