ity) why would you want to have everything in a single
> file?
>
>
>
> Sincere greetings
>
>
>
> Thias
>
>
>
>
>
> *From:* Talat Uyarer
> *Sent:* Thursday, February 2, 2023 5:57 PM
> *To:* Schwalbe Matthias
> *Cc:* Kishore Pola ; weijie gu
single file?
Sincere greetings
Thias
From: Talat Uyarer
Sent: Thursday, February 2, 2023 5:57 PM
To: Schwalbe Matthias
Cc: Kishore Pola ; weijie guo
; user@flink.apache.org
Subject: Re: Reducing Checkpoint Count for Chain Operator
⚠EXTERNAL MESSAGE – CAUTION: Think Before You Click ⚠
Hi
t 7
>
>
>
> Hope we shed a little light on this
>
>
>
> Best regards
>
>
>
> Thias
>
>
>
>
>
>
>
> *From:* Kishore Pola
> *Sent:* Thursday, February 2, 2023 4:12 AM
> *To:* weijie guo ; Talat Uyarer <
> tuya...@paloaltonetwor
only one checkpoint (multiple files)
not 7
Hope we shed a little light on this
Best regards
Thias
From: Kishore Pola
Sent: Thursday, February 2, 2023 4:12 AM
To: weijie guo ; Talat Uyarer
Cc: user@flink.apache.org
Subject: Re: Reducing Checkpoint Count for Chain Operator
Hi Weijie,
In our
?
Thanks,
Kishore
From: weijie guo
Sent: Wednesday, February 1, 2023 6:59 PM
To: Talat Uyarer
Cc: user@flink.apache.org
Subject: Re: Reducing Checkpoint Count for Chain Operator
Hi Talat,
In Flink, a checkpoint barrier will be injected from source, and then pass
Hi Talat,
In Flink, a checkpoint barrier will be injected from source, and then pass
through all operators in turn. Each stateful operator will do checkpoint in
this process, the state is managed at operator granularity, not operator
chain. So what is the significance of checkpoint based on the gr
Hi Weijie,
Thanks for replying back.
Our job is a streaming job. The OperatorChain contains all operators that
are executed as one chain within a single StreamTask. But each
operator creates their own checkpoint at checkpointing time . Rather than
creating a checkpoint per operator in checkpoint
Hi Talat,
Can you elaborate on what it means to create one checkpoint object per
chain operator more than all operators? If you mean to do checkpoint
independently for each task, this is not supported.
Best regards,
Weijie
Talat Uyarer via user 于2023年2月1日周三 15:34写道：
> Hi,
>
> We have a job
Hi,
We have a job that is reading from kafka and writing some endpoints. The
job does not have any shuffling steps. I implement it with multiple
steps. Flink chained those operators in one operator in submission time.
However I see all operators are doing checkpointing.
Is there any way to crea
