Re: Setting different timeouts for savepoints and checkpoints

2021-01-18 Thread Rex Fenley
seems like they should have completely separate >> > configurable timeouts. >> > >> > Thanks! >> > >> > >> > On Sat, Jan 16, 2021 at 2:43 PM Khachatryan Roman >> > mailto:khachatryan.ro...@gmail.com>> >> wrote: >>

Re: Setting different timeouts for savepoints and checkpoints

2021-01-18 Thread Rex Fenley
ail.com>> > wrote: > > > > Hi Rex, > > > > Unfortunately not: the same timeout value is used both for > > savepoints and checkpoints. > > > > Regards, > > Roman > > > > > > On Sat, Jan 16, 2021 at 9:42

Re: Setting different timeouts for savepoints and checkpoints

2021-01-18 Thread Yun Tang
From: Timo Walther Sent: Monday, January 18, 2021 17:28 To: user@flink.apache.org Subject: Re: Setting different timeouts for savepoints and checkpoints Hi Rex, feel free to open an issue for this. I could also imagine that checkpoints and savepoints will further divert from each other

Re: Setting different timeouts for savepoints and checkpoints

2021-01-18 Thread Timo Walther
mailto:khachatryan.ro...@gmail.com>> wrote: Hi Rex, Unfortunately not: the same timeout value is used both for savepoints and checkpoints. Regards, Roman On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley mailto:r...@remind101.com>> wrote: Hello, I'm wonde

Re: Setting different timeouts for savepoints and checkpoints

2021-01-16 Thread Rex Fenley
, 2021 at 2:43 PM Khachatryan Roman < khachatryan.ro...@gmail.com> wrote: > Hi Rex, > > Unfortunately not: the same timeout value is used both for savepoints and > checkpoints. > > Regards, > Roman > > > On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley wrote: > >

Re: Setting different timeouts for savepoints and checkpoints

2021-01-16 Thread Khachatryan Roman
Hi Rex, Unfortunately not: the same timeout value is used both for savepoints and checkpoints. Regards, Roman On Sat, Jan 16, 2021 at 9:42 AM Rex Fenley wrote: > Hello, > > I'm wondering if there's a way to set different timeouts for savepoints > and checkpoints. Our

Setting different timeouts for savepoints and checkpoints

2021-01-16 Thread Rex Fenley
Hello, I'm wondering if there's a way to set different timeouts for savepoints and checkpoints. Our savepoints can take a number of hours to complete, whereas incremental checkpoints at their slowest take around 10 min. We'd like to timeout a checkpoint on a significantly smaller

Re: Savepoints and checkpoints

2019-11-21 Thread Congxian Qiu
t; > [3] > https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/savepoints.html#what-happens-if-i-delete-an-operator-that-has-state-from-my-job > > > > Best > > Yun Tang > > > > > > *From: *"min....@ubs.com" > *Date: *Thursday, November 21, 201

Re: Savepoints and checkpoints

2019-11-21 Thread Yun Tang
/flink/flink-docs-stable/ops/state/savepoints.html#what-happens-if-i-delete-an-operator-that-has-state-from-my-job Best Yun Tang From: "min@ubs.com" Date: Thursday, November 21, 2019 at 5:19 PM To: "user@flink.apache.org" Subject: Savepoints and checkpoints Hi, Are

Savepoints and checkpoints

2019-11-21 Thread min.tan
Hi, Are Flink savepoints and checkpoitns still vlaid after some data entity changes e.g. Kafka topic name changes? I expect the answer is "No"? Similarly, are Flink savepoints and checkpoitns still valid after some job graph changes e.g. one stateful operator splits into two? I expect the answer