Bowen Li created FLINK-7524: ------------------------------- Summary: Task "xxx" did not react to cancelling signal, but is stuck in method Key: FLINK-7524 URL: https://issues.apache.org/jira/browse/FLINK-7524 Project: Flink Issue Type: Bug Affects Versions: 1.3.0 Reporter: Bowen Li
Hi, I observed the following errors in taskmanager.log {code:java} 2017-08-25 17:03:40,141 WARN org.apache.flink.runtime.taskmanager.Task - Task 'TriggerWindow(SlidingEventTimeWindows(259200000, 3600000), AggregatingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.TupleSerializer@f65b6aa2, aggFunction=com.streamingApp$MyAggregateFunction@1f193686}, EventTimeTrigger(), WindowedStream.aggregate(WindowedStream.java:858)) -> Sink: prod_item (2/6)' did not react to cancelling signal, but is stuck in method: org.apache.flink.util.AbstractCloseableRegistry.unregisterClosable(AbstractCloseableRegistry.java:84) org.apache.flink.runtime.state.StateSnapshotContextSynchronousImpl.closeAndUnregisterStream(StateSnapshotContextSynchronousImpl.java:137) org.apache.flink.runtime.state.StateSnapshotContextSynchronousImpl.close(StateSnapshotContextSynchronousImpl.java:147) org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:399) org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.checkpointStreamOperator(StreamTask.java:1157) org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.executeCheckpointing(StreamTask.java:1089) org.apache.flink.streaming.runtime.tasks.StreamTask.checkpointState(StreamTask.java:653) org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:589) org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:542) org.apache.flink.streaming.runtime.io.BarrierBuffer.notifyCheckpoint(BarrierBuffer.java:378) org.apache.flink.streaming.runtime.io.BarrierBuffer.processBarrier(BarrierBuffer.java:281) org.apache.flink.streaming.runtime.io.BarrierBuffer.getNextNonBlocked(BarrierBuffer.java:183) org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:213) org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:69) org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:262) org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) java.lang.Thread.run(Thread.java:748) ... 2017-08-25 17:05:10,139 INFO org.apache.flink.runtime.taskmanager.Task - Notifying TaskManager about fatal error. Task 'TriggerWindow(SlidingEventTimeWindows(259200000, 3600000), AggregatingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.TupleSerializer@f65b6aa2, aggFunction=com.streamingApp$MyAggregateFunction@1f193686}, EventTimeTrigger(), WindowedStream.aggregate(WindowedStream.java:858)) -> Sink: prod_item (2/6)' did not react to cancelling signal in the last 30 seconds, but is stuck in method: org.apache.flink.util.AbstractCloseableRegistry.unregisterClosable(AbstractCloseableRegistry.java:84) org.apache.flink.runtime.state.StateSnapshotContextSynchronousImpl.closeAndUnregisterStream(StateSnapshotContextSynchronousImpl.java:137) org.apache.flink.runtime.state.StateSnapshotContextSynchronousImpl.close(StateSnapshotContextSynchronousImpl.java:147) org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:399) org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.checkpointStreamOperator(StreamTask.java:1157) org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.executeCheckpointing(StreamTask.java:1089) org.apache.flink.streaming.runtime.tasks.StreamTask.checkpointState(StreamTask.java:653) org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:589) org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:542) org.apache.flink.streaming.runtime.io.BarrierBuffer.notifyCheckpoint(BarrierBuffer.java:378) org.apache.flink.streaming.runtime.io.BarrierBuffer.processBarrier(BarrierBuffer.java:281) org.apache.flink.streaming.runtime.io.BarrierBuffer.getNextNonBlocked(BarrierBuffer.java:183) org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:213) org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:69) org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:262) org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) java.lang.Thread.run(Thread.java:748) . 2017-08-25 17:05:10,140 ERROR org.apache.flink.yarn.YarnTaskManager - ============================================================== ====================== FATAL ======================= ============================================================== A fatal error occurred, forcing the TaskManager to shut down: Task 'TriggerWindow(SlidingEventTimeWindows(259200000, 3600000), AggregatingStateDescriptor{serializer=org.apache.flink.api.java.typeutils.runtime.TupleSerializer@f65b6aa2, aggFunction=com.streamingApp$MyAggregateFunction@1f193686}, EventTimeTrigger(), WindowedStream.aggregate(WindowedStream.java:858)) -> Sink: prod_item (2/6)' did not react to cancelling signal in the last 30 seconds, but is stuck in method: org.apache.flink.util.AbstractCloseableRegistry.unregisterClosable(AbstractCloseableRegistry.java:84) org.apache.flink.runtime.state.StateSnapshotContextSynchronousImpl.closeAndUnregisterStream(StateSnapshotContextSynchronousImpl.java:137) org.apache.flink.runtime.state.StateSnapshotContextSynchronousImpl.close(StateSnapshotContextSynchronousImpl.java:147) org.apache.flink.streaming.api.operators.AbstractStreamOperator.snapshotState(AbstractStreamOperator.java:399) org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.checkpointStreamOperator(StreamTask.java:1157) org.apache.flink.streaming.runtime.tasks.StreamTask$CheckpointingOperation.executeCheckpointing(StreamTask.java:1089) org.apache.flink.streaming.runtime.tasks.StreamTask.checkpointState(StreamTask.java:653) org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:589) org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointOnBarrier(StreamTask.java:542) org.apache.flink.streaming.runtime.io.BarrierBuffer.notifyCheckpoint(BarrierBuffer.java:378) org.apache.flink.streaming.runtime.io.BarrierBuffer.processBarrier(BarrierBuffer.java:281) org.apache.flink.streaming.runtime.io.BarrierBuffer.getNextNonBlocked(BarrierBuffer.java:183) org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:213) org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:69) org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:262) org.apache.flink.runtime.taskmanager.Task.run(Task.java:702) java.lang.Thread.run(Thread.java:748) {code} Why is the task stucked? -- This message was sent by Atlassian JIRA (v6.4.14#64029)