Friday, October 11, 2019 5:50
To: Yun Tang mailto:myas...@live.com>>
Cc: Congxian Qiu mailto:qcx978132...@gmail.com>>;
theo.diefent...@scoop-software.de<mailto:theo.diefent...@scoop-software.de>
mailto:theo.diefent...@scoop-software.de>>;
user mailto:user@flink.apache.o
>> *Sent:* Friday, October 11, 2019 5:50
>> *To:* Yun Tang
>> *Cc:* Congxian Qiu ;
>> theo.diefent...@scoop-software.de ;
>> user
>> *Subject:* Re: Flink restoring a job from a checkpoint
>>
>> Sorry for the dumb question but let's suppose t
ongxian Qiu ;
> theo.diefent...@scoop-software.de ;
> user
> *Subject:* Re: Flink restoring a job from a checkpoint
>
> Sorry for the dumb question but let's suppose to not use retained
> checkpoint and my job processed billions of messages from Kafka. Then a
> problematic me
your job
from kafka offset before that problematic message.
Best
Yun Tang
From: Flavio Pompermaier
Sent: Friday, October 11, 2019 5:50
To: Yun Tang
Cc: Congxian Qiu ; theo.diefent...@scoop-software.de
; user
Subject: Re: Flink restoring a job from a checkpoint
s totally fine. Ignoring savepoints and don't
> retaining checkpoints saves overhead and configuration burdens and works
> nicely as long as you don't have any state in your pipeline.
>
> You should however be certain that nobody in your team will add something
> with state late
not use this?
Best
Yun Tang
From: Congxian Qiu
Sent: Thursday, October 10, 2019 11:52
To: theo.diefent...@scoop-software.de
Cc: user
Subject: Re: Flink restoring a job from a checkpoint
Hi Vishwas
Sorry for the confusing, what Theo said previous is the meaning I
state in your pipeline.
>
> You should however be certain that nobody in your team will add something
> with state later on and forgets to think about the missing state...
>
> Best regards
> Theo
>
>
>
>
> Ursprüngliche Nachricht
> Betreff: Re
blog/kafka-flink-a-practical-how-to
[3]
https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/checkpoints.html#resuming-from-a-retained-checkpoint
Best
Yun Tang
From: Vishwas Siravara <vsirav...@gmail.com>
Sent: Wednesday, October 9, 2019 0:54
To: user <user@flink.apac
, better to resume from last
>>> checkpoint [3]
>>>
>>> [1]
>>> https://www.slideshare.net/robertmetzger1/clickthrough-example-for-flinks-kafkaconsumer-checkpointing
>>> [2] https://www.ververica.com/blog/kafka-flink-a-practical-how-to
>>> [
Tang
From: Congxian Qiu
Sent: Wednesday, October 9, 2019 10:06:12 AM
To: Vishwas Siravara
Cc: Yun Tang ; user
Subject: Re: Flink restoring a job from a checkpoint
Hi Vishwas
Currently, Flink can only restore retained checkpoint or savepoint with
parameter `-s`
slideshare.net/robertmetzger1/clickthrough-example-for-flinks-kafkaconsumer-checkpointing
>> [2] https://www.ververica.com/blog/kafka-flink-a-practical-how-to
>> [3]
>> https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/checkpoints.html#resuming-from-a-retained-ch
he.org/projects/flink/flink-docs-stable/ops/state/checkpoints.html#resuming-from-a-retained-checkpoint
>
>
> Best
> Yun Tang
>
>
> --
> *From:* Vishwas Siravara
> *Sent:* Wednesday, October 9, 2019 0:54
> *To:* user
> *Subject:* Flink res
table/ops/state/checkpoints.html#resuming-from-a-retained-checkpoint
Best
Yun Tang
From: Vishwas Siravara
Sent: Wednesday, October 9, 2019 0:54
To: user
Subject: Flink restoring a job from a checkpoint
Hi guys,
I have a flink streaming job which streams from a kafka sour
Hi guys,
I have a flink streaming job which streams from a kafka source. There is no
state in the job, just a simple filter , map and write to a kafka sink.
Suppose I stop my job and then submit the job again to the cluster with the
same consumer group, will the job restore automatically from the l
14 matches
Mail list logo
