Re: reactive mode and back pressure

2021-05-17 Thread Xintong Song
; Does reactive mode need checkpoint for re-scheduling ? > > Thanks, > Alexey > > -- > *From:* Xintong Song > *Sent:* Sunday, May 16, 2021 7:30:15 PM > *To:* Flink User Mail List > *Subject:* Re: reactive mode and back pressure > > Hi Alexey,

Re: reactive mode and back pressure

2021-05-16 Thread Alexey Trenikhun
Hi Xintong, Does reactive mode need checkpoint for re-scheduling ? Thanks, Alexey From: Xintong Song Sent: Sunday, May 16, 2021 7:30:15 PM To: Flink User Mail List Subject: Re: reactive mode and back pressure Hi Alexey, I don't think the new reactive

Re: reactive mode and back pressure

2021-05-16 Thread Arvid Heise
Hi Alexey, Flink supports rescaling from a normal checkpoint if you are not changing your application too much. So if normal checkpointing works, you can just use that for rescaling by using Retained Checkpoints and supply the path on resume at the place where you supplied the savepoint path befor

Re: reactive mode and back pressure

2021-05-16 Thread Xintong Song
Hi Alexey, I don't think the new reactive mode makes any changes to the checkpoint/savepoint mechanism, at least not at the moment. However, you might want to take a look at the unaligned checkpoint [1]. The unaligned checkpoint is designed to be tolerant with back pressure. AFAIK, this can work

reactive mode and back pressure

2021-05-14 Thread Alexey Trenikhun
Hello, Is new reactive mode can operate under back pressure? Old manual rescaling via taking savepoint didn't work with system under back pressure, since it was practically impossible to take savepoint, so wondering is reactive mode expected to be better in this regards ? Thanks, Alexey