We've tried using iterations feature and in case of significant load the
job sometimes stalls and stops processing events due to high back pressure
both in tasks that produces records for iteration and all the other inputs
to this task. It looks like a back pressure loop the task can't handle all
the incoming records, iteration sink loops back into this task and also
gets back pressured. This is basically a "back pressure loop" which causes
a complete job stoppage.

Is there a way to mitigate this (to guarantee such issue does not occur)?

Reply via email to