Keith Lee created FLINK-36939:
---------------------------------
Summary: High CPU Utilization with Flink Kinesis EFO Consumer
Key: FLINK-36939
URL: https://issues.apache.org/jira/browse/FLINK-36939
Project: Flink
Issue Type: Bug
Components: Connectors / Kinesis
Affects Versions: 1.20.0
Reporter: Keith Lee
Observation: When EFO is enabled, the CPU usage spikes and stays elevated,
regardless of record volume. If we switch back to the standard polling consumer
(disabling EFO), CPU utilization returns to normal levels.
Profiling Results: Local profiling and flamegraphs suggest the connector may be
engaged in a busy-wait loop, continuously parking and un-parking threads even
when no data is available. This behavior consumes CPU cycles unnecessarily.
Performance Impact: While the job still processes records correctly when they
arrive, the high baseline CPU consumption is concerning. It wastes resources
and triggers unnecessary scaling, which doesn’t resolve the issue since new
instances also experience the same CPU pattern.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
