[ https://issues.apache.org/jira/browse/FLINK-25939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Flink Jira Bot updated FLINK-25939: ----------------------------------- Labels: auto-deprioritized-critical stale-major test-stability (was: auto-deprioritized-critical test-stability) I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Major but is unassigned and neither itself nor its Sub-Tasks have been updated for 60 days. I have gone ahead and added a "stale-major" to the issue". If this ticket is a Major, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized. > PyFlink YARN per-job on Docker test fails on AZP because it could not acquire > all required slots > ------------------------------------------------------------------------------------------------ > > Key: FLINK-25939 > URL: https://issues.apache.org/jira/browse/FLINK-25939 > Project: Flink > Issue Type: Bug > Components: API / Python, Deployment / YARN > Affects Versions: 1.14.3 > Reporter: Till Rohrmann > Priority: Major > Labels: auto-deprioritized-critical, stale-major, test-stability > > The test {{PyFlink YARN per-job on Docker test}} fails on AZP with: > {code} > 2022-02-03T03:32:41.0643749Z Feb 03 03:32:40 2022-02-03 03:31:12,281 INFO > org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: > Values(tuples=[[{ 1 }, { 2 }, { 3 }]]) -> Calc(select=[f0]) -> > PythonCalc(select=[add_one(f0) AS a]) -> Sink: Collect table sink (1/1) > (1c3df1a51de35e44664305a57f4047a7) switched from SCHEDULED to FAILED on > [unassigned resource]. > 2022-02-03T03:32:41.0645152Z Feb 03 03:32:40 > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:41.0647529Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0648830Z Feb 03 03:32:40 at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > ~[?:1.8.0_312] > 2022-02-03T03:32:41.0649605Z Feb 03 03:32:40 at > java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_312] > 2022-02-03T03:32:41.0651215Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0652935Z Feb 03 03:32:40 at > org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0654715Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0656399Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0657987Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0659528Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0661186Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0662745Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0664203Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse(PartialFunction.scala:123) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0665591Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0667179Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0668708Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0670130Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0671634Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0672985Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive(Actor.scala:537) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0674418Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive$(Actor.scala:535) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0675750Z Feb 03 03:32:40 at > akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0677255Z Feb 03 03:32:40 at > akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0678551Z Feb 03 03:32:40 at > akka.actor.ActorCell.invoke(ActorCell.scala:548) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0679842Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0681294Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.run(Mailbox.scala:231) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0682558Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.exec(Mailbox.scala:243) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0683425Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_312] > 2022-02-03T03:32:41.0684358Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) > [?:1.8.0_312] > 2022-02-03T03:32:41.0685141Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) > [?:1.8.0_312] > 2022-02-03T03:32:41.0685923Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) > [?:1.8.0_312] > 2022-02-03T03:32:41.0812000Z Feb 03 03:32:40 Caused by: > java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms > 2022-02-03T03:32:41.0812688Z Feb 03 03:32:40 ... 29 more > 2022-02-03T03:32:41.0813995Z Feb 03 03:32:40 2022-02-03 03:31:12,401 INFO > org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding > the results produced by task execution 1c3df1a51de35e44664305a57f4047a7. > 2022-02-03T03:32:41.0815641Z Feb 03 03:32:40 2022-02-03 03:31:12,674 INFO > org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy > [] - Calculating tasks to restart to recover the failed task > cbc357ccb763df2852fee8c4fc7d55f2_0. > 2022-02-03T03:32:41.0817969Z Feb 03 03:32:40 2022-02-03 03:31:12,676 INFO > org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy > [] - 1 tasks should be restarted to recover the failed task > cbc357ccb763df2852fee8c4fc7d55f2_0. > 2022-02-03T03:32:41.0819677Z Feb 03 03:32:40 2022-02-03 03:31:12,679 INFO > org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect > (1470f23d8978792b87cf1e0a7989cf4b) switched from state RUNNING to FAILING. > 2022-02-03T03:32:41.0820634Z Feb 03 03:32:40 > org.apache.flink.runtime.JobException: Recovery is suppressed by > NoRestartBackoffTimeStrategy > 2022-02-03T03:32:41.0822394Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0824213Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0825865Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0827486Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0828989Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0830658Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0832414Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:51) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0834279Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(DefaultExecutionGraph.java:1473) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0835811Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1133) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0837154Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1073) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0838502Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.markFailed(Execution.java:912) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0839878Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.ExecutionVertex.markFailed(ExecutionVertex.java:474) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0841375Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultExecutionVertexOperations.markFailed(DefaultExecutionVertexOperations.java:41) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0843077Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskDeploymentFailure(DefaultScheduler.java:609) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0844689Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignAllResourcesAndRegisterProducedPartitions$6(DefaultScheduler.java:481) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0845789Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) > ~[?:1.8.0_312] > 2022-02-03T03:32:41.0846607Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) > ~[?:1.8.0_312] > 2022-02-03T03:32:41.0847784Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) > ~[?:1.8.0_312] > 2022-02-03T03:32:41.0848646Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) > ~[?:1.8.0_312] > 2022-02-03T03:32:41.0849992Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SharedSlot.cancelLogicalSlotRequest(SharedSlot.java:222) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0851564Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.cancelLogicalSlotRequest(SlotSharingExecutionSlotAllocator.java:164) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0853362Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SharingPhysicalSlotRequestBulk.cancel(SharingPhysicalSlotRequestBulk.java:86) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0854985Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkWithTimestamp.cancel(PhysicalSlotRequestBulkWithTimestamp.java:66) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0856804Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:91) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0857996Z Feb 03 03:32:40 at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > ~[?:1.8.0_312] > 2022-02-03T03:32:41.0858751Z Feb 03 03:32:40 at > java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_312] > 2022-02-03T03:32:41.0860070Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0861689Z Feb 03 03:32:40 at > org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0863267Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0864782Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0866340Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0867890Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0869308Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0871044Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0872567Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse(PartialFunction.scala:123) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0873915Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0875297Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0876673Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:41.0878291Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0874317Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0876269Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive(Actor.scala:537) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0878138Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive$(Actor.scala:535) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0880639Z Feb 03 03:32:40 at > akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0882451Z Feb 03 03:32:40 at > akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0883813Z Feb 03 03:32:40 at > akka.actor.ActorCell.invoke(ActorCell.scala:548) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0885111Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0886384Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.run(Mailbox.scala:231) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0889089Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.exec(Mailbox.scala:243) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0889987Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_312] > 2022-02-03T03:32:42.0890746Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) > [?:1.8.0_312] > 2022-02-03T03:32:42.0891536Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) > [?:1.8.0_312] > 2022-02-03T03:32:42.0892314Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) > [?:1.8.0_312] > 2022-02-03T03:32:42.0893460Z Feb 03 03:32:40 Caused by: > java.util.concurrent.CompletionException: > java.util.concurrent.CompletionException: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.0895114Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignResource$8(DefaultScheduler.java:539) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0895907Z Feb 03 03:32:40 ... 37 more > 2022-02-03T03:32:42.0896751Z Feb 03 03:32:40 Caused by: > java.util.concurrent.CompletionException: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.0897825Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0898678Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0899517Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0900348Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0900965Z Feb 03 03:32:40 ... 35 more > 2022-02-03T03:32:42.0901701Z Feb 03 03:32:40 Caused by: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.0903725Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0904705Z Feb 03 03:32:40 ... 28 more > 2022-02-03T03:32:42.0905236Z Feb 03 03:32:40 Caused by: > java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms > 2022-02-03T03:32:42.0906727Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0907904Z Feb 03 03:32:40 ... 28 more > 2022-02-03T03:32:42.0909017Z Feb 03 03:32:40 2022-02-03 03:31:12,746 INFO > org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect > (1470f23d8978792b87cf1e0a7989cf4b) switched from state FAILING to FAILED. > 2022-02-03T03:32:42.0909961Z Feb 03 03:32:40 > org.apache.flink.runtime.JobException: Recovery is suppressed by > NoRestartBackoffTimeStrategy > 2022-02-03T03:32:42.0911298Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0912971Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0914486Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0915939Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0917435Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0919572Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0921312Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:51) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0923653Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(DefaultExecutionGraph.java:1473) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0925197Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1133) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0926561Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1073) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0968725Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.markFailed(Execution.java:912) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0971868Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.ExecutionVertex.markFailed(ExecutionVertex.java:474) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0973945Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultExecutionVertexOperations.markFailed(DefaultExecutionVertexOperations.java:41) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0975545Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskDeploymentFailure(DefaultScheduler.java:609) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0977473Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignAllResourcesAndRegisterProducedPartitions$6(DefaultScheduler.java:481) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0978571Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0979408Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0980248Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0981102Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0983039Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SharedSlot.cancelLogicalSlotRequest(SharedSlot.java:222) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0984643Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.cancelLogicalSlotRequest(SlotSharingExecutionSlotAllocator.java:164) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0986246Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SharingPhysicalSlotRequestBulk.cancel(SharingPhysicalSlotRequestBulk.java:86) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0987851Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkWithTimestamp.cancel(PhysicalSlotRequestBulkWithTimestamp.java:66) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0989679Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:91) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0990867Z Feb 03 03:32:40 at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.0991627Z Feb 03 03:32:40 at > java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_312] > 2022-02-03T03:32:42.0995734Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0997413Z Feb 03 03:32:40 at > org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.0998994Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1000526Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1002104Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1003637Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) > ~[flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1005327Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1006945Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1008360Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse(PartialFunction.scala:123) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1009995Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1011366Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1012739Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1014111Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1016155Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1017625Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive(Actor.scala:537) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1018908Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive$(Actor.scala:535) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1020228Z Feb 03 03:32:40 at > akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1021568Z Feb 03 03:32:40 at > akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1023116Z Feb 03 03:32:40 at > akka.actor.ActorCell.invoke(ActorCell.scala:548) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1024539Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1025823Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.run(Mailbox.scala:231) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1027438Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.exec(Mailbox.scala:243) > [flink-rpc-akka_92d95797-5383-46fa-abb4-628d6de63216.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1028318Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_312] > 2022-02-03T03:32:42.1029075Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) > [?:1.8.0_312] > 2022-02-03T03:32:42.1029854Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) > [?:1.8.0_312] > 2022-02-03T03:32:42.1030634Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) > [?:1.8.0_312] > 2022-02-03T03:32:42.1031786Z Feb 03 03:32:40 Caused by: > java.util.concurrent.CompletionException: > java.util.concurrent.CompletionException: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.1033432Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignResource$8(DefaultScheduler.java:539) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1034219Z Feb 03 03:32:40 ... 37 more > 2022-02-03T03:32:42.1035064Z Feb 03 03:32:40 Caused by: > java.util.concurrent.CompletionException: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.1036140Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.1037454Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.1038362Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.1039401Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) > ~[?:1.8.0_312] > 2022-02-03T03:32:42.1040013Z Feb 03 03:32:40 ... 35 more > 2022-02-03T03:32:42.1040747Z Feb 03 03:32:40 Caused by: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.1042570Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1043691Z Feb 03 03:32:40 ... 28 more > 2022-02-03T03:32:42.1044225Z Feb 03 03:32:40 Caused by: > java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms > 2022-02-03T03:32:42.1045743Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) > ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT] > 2022-02-03T03:32:42.1046739Z Feb 03 03:32:40 ... 28 more > 2022-02-03T03:32:42.1048415Z Feb 03 03:32:40 2022-02-03 03:31:12,865 INFO > org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping > checkpoint coordinator for job 1470f23d8978792b87cf1e0a7989cf4b. > 2022-02-03T03:32:42.1049876Z Feb 03 03:32:40 2022-02-03 03:31:13,384 INFO > org.apache.flink.runtime.dispatcher.MiniDispatcher [] - Job > 1470f23d8978792b87cf1e0a7989cf4b reached terminal state FAILED. > 2022-02-03T03:32:42.1050779Z Feb 03 03:32:40 > org.apache.flink.runtime.JobException: Recovery is suppressed by > NoRestartBackoffTimeStrategy > 2022-02-03T03:32:42.1051644Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138) > 2022-02-03T03:32:42.1052703Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82) > 2022-02-03T03:32:42.1053672Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:252) > 2022-02-03T03:32:42.1054545Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:242) > 2022-02-03T03:32:42.1055456Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:233) > 2022-02-03T03:32:42.1056359Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:684) > 2022-02-03T03:32:42.1057371Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:51) > 2022-02-03T03:32:42.1058972Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(DefaultExecutionGraph.java:1473) > 2022-02-03T03:32:42.1059968Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1133) > 2022-02-03T03:32:42.1060759Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1073) > 2022-02-03T03:32:42.1061537Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.Execution.markFailed(Execution.java:912) > 2022-02-03T03:32:42.1062343Z Feb 03 03:32:40 at > org.apache.flink.runtime.executiongraph.ExecutionVertex.markFailed(ExecutionVertex.java:474) > 2022-02-03T03:32:42.1063258Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultExecutionVertexOperations.markFailed(DefaultExecutionVertexOperations.java:41) > 2022-02-03T03:32:42.1064216Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskDeploymentFailure(DefaultScheduler.java:609) > 2022-02-03T03:32:42.1065421Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignAllResourcesAndRegisterProducedPartitions$6(DefaultScheduler.java:481) > 2022-02-03T03:32:42.1066331Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) > 2022-02-03T03:32:42.1067090Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) > 2022-02-03T03:32:42.1067870Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) > 2022-02-03T03:32:42.1068664Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) > 2022-02-03T03:32:42.1081893Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SharedSlot.cancelLogicalSlotRequest(SharedSlot.java:222) > 2022-02-03T03:32:42.1084266Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.cancelLogicalSlotRequest(SlotSharingExecutionSlotAllocator.java:164) > 2022-02-03T03:32:42.1085364Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.SharingPhysicalSlotRequestBulk.cancel(SharingPhysicalSlotRequestBulk.java:86) > 2022-02-03T03:32:42.1556816Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkWithTimestamp.cancel(PhysicalSlotRequestBulkWithTimestamp.java:66) > 2022-02-03T03:32:42.1567351Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:91) > 2022-02-03T03:32:42.1576329Z Feb 03 03:32:40 at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > 2022-02-03T03:32:42.1582529Z Feb 03 03:32:40 at > java.util.concurrent.FutureTask.run(FutureTask.java:266) > 2022-02-03T03:32:42.1589395Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) > 2022-02-03T03:32:42.1596634Z Feb 03 03:32:40 at > org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) > 2022-02-03T03:32:42.1602522Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) > 2022-02-03T03:32:42.1607553Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) > 2022-02-03T03:32:42.1612919Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78) > 2022-02-03T03:32:42.1617901Z Feb 03 03:32:40 at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) > 2022-02-03T03:32:42.1623062Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) > 2022-02-03T03:32:42.1627158Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) > 2022-02-03T03:32:42.1631148Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse(PartialFunction.scala:123) > 2022-02-03T03:32:42.1635328Z Feb 03 03:32:40 at > scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) > 2022-02-03T03:32:42.1639444Z Feb 03 03:32:40 at > akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) > 2022-02-03T03:32:42.1643612Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) > 2022-02-03T03:32:42.1657446Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > 2022-02-03T03:32:42.1658994Z Feb 03 03:32:40 at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) > 2022-02-03T03:32:42.1659681Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive(Actor.scala:537) > 2022-02-03T03:32:42.1660291Z Feb 03 03:32:40 at > akka.actor.Actor.aroundReceive$(Actor.scala:535) > 2022-02-03T03:32:42.1660957Z Feb 03 03:32:40 at > akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) > 2022-02-03T03:32:42.1661614Z Feb 03 03:32:40 at > akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) > 2022-02-03T03:32:42.1662248Z Feb 03 03:32:40 at > akka.actor.ActorCell.invoke(ActorCell.scala:548) > 2022-02-03T03:32:42.1663139Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) > 2022-02-03T03:32:42.1663761Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.run(Mailbox.scala:231) > 2022-02-03T03:32:42.1664352Z Feb 03 03:32:40 at > akka.dispatch.Mailbox.exec(Mailbox.scala:243) > 2022-02-03T03:32:42.1664977Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) > 2022-02-03T03:32:42.1665699Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) > 2022-02-03T03:32:42.1666428Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) > 2022-02-03T03:32:42.1667159Z Feb 03 03:32:40 at > java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) > 2022-02-03T03:32:42.1668399Z Feb 03 03:32:40 Caused by: > java.util.concurrent.CompletionException: > java.util.concurrent.CompletionException: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.1670724Z Feb 03 03:32:40 at > org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignResource$8(DefaultScheduler.java:539) > 2022-02-03T03:32:42.1671459Z Feb 03 03:32:40 ... 37 more > 2022-02-03T03:32:42.1672305Z Feb 03 03:32:40 Caused by: > java.util.concurrent.CompletionException: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.1673741Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) > 2022-02-03T03:32:42.1674562Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) > 2022-02-03T03:32:42.1675339Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607) > 2022-02-03T03:32:42.1676113Z Feb 03 03:32:40 at > java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591) > 2022-02-03T03:32:42.1676704Z Feb 03 03:32:40 ... 35 more > 2022-02-03T03:32:42.1677453Z Feb 03 03:32:40 Caused by: > org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: > Slot request bulk is not fulfillable! Could not allocate the required slot > within slot request timeout > 2022-02-03T03:32:42.1678660Z Feb 03 03:32:40 at > org.apache.flink.runtime.jobmaster.slotpool.PhysicalSlotRequestBulkCheckerImpl.lambda$schedulePendingRequestBulkWithTimestampCheck$0(PhysicalSlotRequestBulkCheckerImpl.java:86) > 2022-02-03T03:32:42.1679863Z Feb 03 03:32:40 ... 28 more > 2022-02-03T03:32:42.1680414Z Feb 03 03:32:40 Caused by: > java.util.concurrent.TimeoutException: Timeout has occurred: 120000 ms > 2022-02-03T03:32:42.1680932Z Feb 03 03:32:40 ... 29 more > {code} > https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=30660&view=logs&j=68a897ab-3047-5660-245a-cce8f83859f6&t=89ed5489-a970-5ff2-67f7-d7391de0165f&l=25597 -- This message was sent by Atlassian Jira (v8.20.10#820010)