Tzu-Li (Gordon) Tai created FLINK-20574:
-------------------------------------------
Summary: Throttle number of remote invocation requests on startup
or restores with large backlogs
Key: FLINK-20574
URL: https://issues.apache.org/jira/browse/FLINK-20574
Project: Flink
Issue Type: Improvement
Components: Stateful Functions
Reporter: Tzu-Li (Gordon) Tai
Assignee: Tzu-Li (Gordon) Tai
Fix For: statefun-2.3.0
On startup or restores, the {{RequestReplyFunction}} may heavily load the
remote functions with multiple concurrent invocation requests if there is a
large backlog of restored or historical events to process through.
The new protocol introduced by FLINK-20265 emphasizes this much more due to the
nature of extra invocation roundtrips if the function has state declarations
(i.e., the first hoard of concurrent invocations would all fail with an
{{IncompleteInvocationContext}} and requires invocation patching + state
registrations).
We should think about how to apply throttling to mitigate these scenarios.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
