Re: Large backpressure and slow checkpoints in StateFun

30日 下午 2:29:19 主题: Large backpressure and slow checkpoints in StateFun Hi, I am running some benchmarks using StateFun and have encountered a problem with backpressure and slow checkpoints that I can't figure out the reason for, and was hoping that someone might have an idea of what i

Large backpressure and slow checkpoints in StateFun

Hi, I am running some benchmarks using StateFun and have encountered a problem with backpressure and slow checkpoints that I can't figure out the reason for, and was hoping that someone might have an idea of what is causing it. My setup is the following: I am running the Shopping

Re: slow checkpoints

Hi Yubraj, So the frequent job failure is the root reason, you need to fix it. Yes, when too many messages are squashed into the message system. If the messages can not be consumed normally, there would exist catchup consuming which will cause your streaming system more pressure than usual. Best,

Re: slow checkpoints

@Congxian , back pressure is due to job failure , some times job can fail and we need to catch up . Thanks Yubraj Singh [image: Mailtrack] Sender notified by Mailtrack

Re: slow checkpoints

Hi Currently, checkpoint may be faile in high back pressure scenario, because the barrier alignment can't be done in expected time, you should fix the back pressure problem first. There is a FLIP[1] that wants to fix this issue. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-76%3A+Una

slow checkpoints

Hi all , I am facing one issue , when i have high back pressure my checkpoints start failing . please let me know how to deal with this kind of situations . Thanks Yubraj Singh . [image: Mailtrack]

Re: Very slow checkpoints occasionally occur

Hi, Looking at the numbers, it seems to me that checkpoint execution (the times of the sync and async part) are always reasonable fast once they are executed on the task, but there are changes in the alignment time and the time from triggering a checkpoint to executing a checkpoint. As you are