Hi All,
I am running a job in flink and somehow the job is failing and the task
manager is getting out of the pool unknowingly.
Also some heartbeat timeout exceptions are coming.
Thanks,
Saksham
2020-11-24 11:07:44,594 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2020-11-24 11:07:44,597 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
Preconfiguration:
2020-11-24 11:07:44,597 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
JM_RESOURCE_PARAMS extraction logs:
jvm_params: -Xmx7328287936 -Xms7328287936 -XX:MaxMetaspaceSize=268435456
logs: WARNING: sun.reflect.Reflection.getCallerClass is not supported. This
will impact performance.
INFO [] - Loading configuration property: jobmanager.rpc.address,
flink-jobmanager
INFO [] - Loading configuration property: taskmanager.numberOfTaskSlots, 5
INFO [] - Loading configuration property: blob.server.port, 6124
INFO [] - Loading configuration property: jobmanager.rpc.port, 6123
INFO [] - Loading configuration property: taskmanager.rpc.port, 6122
INFO [] - Loading configuration property: queryable-state.proxy.ports, 6125
INFO [] - Loading configuration property: jobmanager.memory.process.size, 8192m
INFO [] - Loading configuration property: taskmanager.memory.process.size,
8192m
INFO [] - Loading configuration property: heartbeat.timeout, 120000
INFO [] - Loading configuration property: parallelism.default, 2
INFO [] - Final Master Memory configuration:
INFO [] - Total Process Memory: 8.000gb (8589934592 bytes)
INFO [] - Total Flink Memory: 6.950gb (7462505664 bytes)
INFO [] - JVM Heap: 6.825gb (7328287936 bytes)
INFO [] - Off-heap: 128.000mb (134217728 bytes)
INFO [] - JVM Metaspace: 256.000mb (268435456 bytes)
INFO [] - JVM Overhead: 819.200mb (858993472 bytes)
2020-11-24 11:07:44,598 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2020-11-24 11:07:44,598 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
StandaloneSessionClusterEntrypoint (Version: 1.11.2, Scala: 2.11, Rev:fe36135,
Date:2020-09-09T16:19:03+02:00)
2020-11-24 11:07:44,598 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current
user: flink
2020-11-24 11:07:44,599 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current
Hadoop/Kerberos user: <no hadoop dependency found>
2020-11-24 11:07:44,599 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK
64-Bit Server VM - Oracle Corporation - 11/11.0.8+10
2020-11-24 11:07:44,599 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap
size: 6757 MiBytes
2020-11-24 11:07:44,599 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME:
/usr/local/openjdk-11
2020-11-24 11:07:44,599 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - No Hadoop
Dependency available
2020-11-24 11:07:44,600 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
2020-11-24 11:07:44,600 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xmx7328287936
2020-11-24 11:07:44,600 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xms7328287936
2020-11-24 11:07:44,600 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:MaxMetaspaceSize=268435456
2020-11-24 11:07:44,600 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog.file=/opt/flink/log/flink--standalonesession-0-flink-jobmanager-54b576864c-ww8m2.log
2020-11-24 11:07:44,600 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
2020-11-24 11:07:44,601 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
2020-11-24 11:07:44,601 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
2020-11-24 11:07:44,601 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program
Arguments:
2020-11-24 11:07:44,601 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--configDir
2020-11-24 11:07:44,601 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
/opt/flink/conf
2020-11-24 11:07:44,601 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--executionMode
2020-11-24 11:07:44,601 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - cluster
2020-11-24 11:07:44,602 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath:
/opt/flink/lib/ST4-4.0.8.jar:/opt/flink/lib/antlr-runtime-3.5.2.jar:/opt/flink/lib/antlr4-4.2.2.jar:/opt/flink/lib/antlr4-annotations-4.2.2.jar:/opt/flink/lib/antlr4-runtime-4.2.2.jar:/opt/flink/lib/bson-3.11.2.jar:/opt/flink/lib/cglib-nodep-2.2.2.jar:/opt/flink/lib/chill-java-0.7.6.jar:/opt/flink/lib/chill_2.11-0.7.6.jar:/opt/flink/lib/commons-cli-1.3.1.jar:/opt/flink/lib/commons-collections-3.2.2.jar:/opt/flink/lib/commons-compiler-3.0.9.jar:/opt/flink/lib/commons-compress-1.18.jar:/opt/flink/lib/commons-io-2.4.jar:/opt/flink/lib/commons-lang3-3.9.jar:/opt/flink/lib/commons-math3-3.5.jar:/opt/flink/lib/commons-math3-3.6.1.jar:/opt/flink/lib/config-1.3.3.jar:/opt/flink/lib/eclipse-collections-9.2.0.jar:/opt/flink/lib/eclipse-collections-api-9.2.0.jar:/opt/flink/lib/flink-csv-1.11.2.jar:/opt/flink/lib/flink-json-1.11.2.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.11-1.11.2.jar:/opt/flink/lib/flink-table_2.11-1.11.2.jar:/opt/flink/lib/force-shading-1.10.0.jar:/opt/flink/lib/freemarker-2.3.30.jar:/opt/flink/lib/function-aggregator-1.0.jar:/opt/flink/lib/function-case-processor-1.0.jar:/opt/flink/lib/function-common-1.0.jar:/opt/flink/lib/function-error-group-1.0.jar:/opt/flink/lib/function-file-reader-1.0.jar:/opt/flink/lib/function-mongo-writer-1.0.jar:/opt/flink/lib/function-reconciliation-1.0.jar:/opt/flink/lib/function-source-reader-1.0.jar:/opt/flink/lib/function-source-writer-1.0.jar:/opt/flink/lib/function-stop-job-1.0.jar:/opt/flink/lib/function-tag-1.0.jar:/opt/flink/lib/function-validation-1.0.jar:/opt/flink/lib/grizzled-slf4j_2.11-1.3.2.jar:/opt/flink/lib/hazelcast-4.0.1.jar:/opt/flink/lib/jackson-annotations-2.10.3.jar:/opt/flink/lib/jackson-core-2.10.3.jar:/opt/flink/lib/jackson-databind-2.10.3.jar:/opt/flink/lib/jakarta.annotation-api-1.3.5.jar:/opt/flink/lib/javapoet-1.11.1.jar:/opt/flink/lib/javassist-3.24.0-GA.jar:/opt/flink/lib/javax.annotation-api-1.3.2.jar:/opt/flink/lib/json-simple-1.1.jar:/opt/flink/lib/jsr305-1.3.9.jar:/opt/flink/lib/jul-to-slf4j-1.7.30.jar:/opt/flink/lib/kryo-2.24.0.jar:/opt/flink/lib/log4j-1.2-api-2.12.1.jar:/opt/flink/lib/log4j-1.2.17.jar:/opt/flink/lib/log4j-api-2.12.1.jar:/opt/flink/lib/log4j-core-2.12.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.12.1.jar:/opt/flink/lib/logback-core-1.2.3.jar:/opt/flink/lib/lz4-java-1.5.0.jar:/opt/flink/lib/minlog-1.2.jar:/opt/flink/lib/mongo-java-driver-3.11.2.jar:/opt/flink/lib/mongodb-driver-3.11.2.jar:/opt/flink/lib/mongodb-driver-core-3.11.2.jar:/opt/flink/lib/morphia-1.3.2.jar:/opt/flink/lib/objenesis-2.1.jar:/opt/flink/lib/org.abego.treelayout.core-1.0.1.jar:/opt/flink/lib/proxytoys-1.0.jar:/opt/flink/lib/reactive-streams-1.0.3.jar:/opt/flink/lib/scopt_2.11-3.5.0.jar:/opt/flink/lib/slf4j-api-1.7.30.jar:/opt/flink/lib/snakeyaml-1.25.jar:/opt/flink/lib/snappy-java-1.1.4.jar:/opt/flink/lib/spring-aop-5.2.5.RELEASE.jar:/opt/flink/lib/spring-beans-5.2.5.RELEASE.jar:/opt/flink/lib/spring-boot-2.2.6.RELEASE.jar:/opt/flink/lib/spring-boot-autoconfigure-2.2.6.RELEASE.jar:/opt/flink/lib/spring-boot-starter-2.2.6.RELEASE.jar:/opt/flink/lib/spring-boot-starter-data-mongodb-2.2.6.RELEASE.jar:/opt/flink/lib/spring-boot-starter-logging-2.2.6.RELEASE.jar:/opt/flink/lib/spring-context-5.2.5.RELEASE.jar:/opt/flink/lib/spring-core-5.2.5.RELEASE.jar:/opt/flink/lib/spring-data-commons-2.2.6.RELEASE.jar:/opt/flink/lib/spring-data-mongodb-2.2.6.RELEASE.jar:/opt/flink/lib/spring-expression-5.2.5.RELEASE.jar:/opt/flink/lib/spring-jcl-5.2.5.RELEASE.jar:/opt/flink/lib/spring-jdbc-5.2.5.RELEASE.jar:/opt/flink/lib/spring-tx-5.2.5.RELEASE.jar:/opt/flink/lib/spring-web-5.2.5.RELEASE.jar:/opt/flink/lib/ssl-config-core_2.11-0.3.7.jar:/opt/flink/lib/toolset-code-generator-common-1.0.jar:/opt/flink/lib/toolset-code-generator-compiler-1.0.jar:/opt/flink/lib/toolset-code-generator-java-model-1.0.jar:/opt/flink/lib/toolset-excel-code-generator-1.0.jar:/opt/flink/lib/toolset-excel-parser-1.0.jar:/opt/flink/lib/toolset-flat-file-reader-1.0.jar:/opt/flink/lib/toolset-schema-1.0.jar:/opt/flink/lib/workflow-function-api-1.0.jar:/opt/flink/lib/workflow-runtime-common-1.0.jar:/opt/flink/lib/workflow-runtime-dynamic-1.0.jar:/opt/flink/lib/workflow-runtime-flink-1.0.jar:/opt/flink/lib/flink-dist_2.11-1.11.2.jar:::
2020-11-24 11:07:44,604 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
2020-11-24 11:07:44,605 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered
UNIX signal handlers for [TERM, HUP, INT]
2020-11-24 11:07:44,619 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.address, flink-jobmanager
2020-11-24 11:07:44,619 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 5
2020-11-24 11:07:44,619 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: blob.server.port, 6124
2020-11-24 11:07:44,620 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.port, 6123
2020-11-24 11:07:44,620 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.rpc.port, 6122
2020-11-24 11:07:44,620 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: queryable-state.proxy.ports, 6125
2020-11-24 11:07:44,620 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.memory.process.size, 8192m
2020-11-24 11:07:44,620 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 8192m
2020-11-24 11:07:44,621 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: heartbeat.timeout, 120000
2020-11-24 11:07:44,621 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 2
2020-11-24 11:07:44,630 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
StandaloneSessionClusterEntrypoint.
2020-11-24 11:07:44,679 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
default filesystem.
2020-11-24 11:07:44,682 INFO org.apache.flink.core.fs.FileSystem
[] - Hadoop is not in the classpath/dependencies. The extended set
of supported File Systems via Hadoop is not available.
2020-11-24 11:07:44,734 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
security context.
2020-11-24 11:07:44,747 INFO
org.apache.flink.runtime.security.modules.HadoopModuleFactory [] - Cannot
create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-11-24 11:07:44,755 INFO
org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file
will be created as /tmp/jaas-11075277216013415416.conf.
2020-11-24 11:07:44,766 INFO
org.apache.flink.runtime.security.contexts.HadoopSecurityContextFactory [] -
Cannot install HadoopSecurityContext because Hadoop cannot be found in the
Classpath.
2020-11-24 11:07:44,767 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing
cluster services.
2020-11-24 11:07:44,796 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address flink-jobmanager:6123, bind address
0.0.0.0:6123.
2020-11-24 11:07:45,321 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2020-11-24 11:07:45,343 INFO akka.remote.Remoting
[] - Starting remoting
2020-11-24 11:07:45,479 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink@flink-jobmanager:6123]
2020-11-24 11:07:45,816 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink@flink-jobmanager:6123
2020-11-24 11:07:45,844 INFO org.apache.flink.configuration.Configuration
[] - Config uses fallback configuration key 'jobmanager.rpc.address'
instead of key 'rest.address'
2020-11-24 11:07:45,853 INFO org.apache.flink.runtime.blob.BlobServer
[] - Created BLOB server storage directory
/tmp/blobStore-526341e5-9cca-48c7-8fb2-399f2521f3cc
2020-11-24 11:07:45,857 INFO org.apache.flink.runtime.blob.BlobServer
[] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests:
50 - max backlog: 1000
2020-11-24 11:07:45,868 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics
reporter configured, no metrics will be exposed/reported.
2020-11-24 11:07:45,872 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address flink-jobmanager:0, bind address 0.0.0.0:0.
2020-11-24 11:07:45,888 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2020-11-24 11:07:45,892 INFO akka.remote.Remoting
[] - Starting remoting
2020-11-24 11:07:45,900 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink-metrics@flink-jobmanager:43077]
2020-11-24 11:07:45,958 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink-metrics@flink-jobmanager:43077
2020-11-24 11:07:45,971 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService .
2020-11-24 11:07:45,992 INFO
org.apache.flink.runtime.dispatcher.FileArchivedExecutionGraphStore [] -
Initializing FileArchivedExecutionGraphStore: Storage directory
/tmp/executionGraphStore-7d96c0fd-c510-44f9-bf30-68919f2b75c7, expiration time
3600000, maximum cache size 52428800 bytes.
2020-11-24 11:07:46,038 INFO org.apache.flink.configuration.Configuration
[] - Config uses fallback configuration key 'jobmanager.rpc.address'
instead of key 'rest.address'
2020-11-24 11:07:46,039 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Upload
directory /tmp/flink-web-8fbfb57b-db2a-47d4-8027-4de937afc750/flink-web-upload
does not exist.
2020-11-24 11:07:46,040 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Created
directory /tmp/flink-web-8fbfb57b-db2a-47d4-8027-4de937afc750/flink-web-upload
for file uploads.
2020-11-24 11:07:46,042 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Starting rest
endpoint.
2020-11-24 11:07:46,352 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component log file:
/opt/flink/log/flink--standalonesession-0-flink-jobmanager-54b576864c-ww8m2.log
2020-11-24 11:07:46,352 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component stdout file:
/opt/flink/log/flink--standalonesession-0-flink-jobmanager-54b576864c-ww8m2.out
2020-11-24 11:07:46,538 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Rest endpoint
listening at flink-jobmanager:8081
2020-11-24 11:07:46,539 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] -
http://flink-jobmanager:8081 was granted leadership with
leaderSessionID=00000000-0000-0000-0000-000000000000
2020-11-24 11:07:46,541 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Web frontend
listening at http://flink-jobmanager:8081.
2020-11-24 11:07:46,569 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at
akka://flink/user/rpc/resourcemanager_0 .
2020-11-24 11:07:46,600 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Start SessionDispatcherLeaderProcess.
2020-11-24 11:07:46,615 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
ResourceManager
akka.tcp://flink@flink-jobmanager:6123/user/rpc/resourcemanager_0 was granted
leadership with fencing token 00000000000000000000000000000000
2020-11-24 11:07:46,619 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl [] -
Starting the SlotManager.
2020-11-24 11:07:46,643 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Recover all persisted job graphs.
2020-11-24 11:07:46,644 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Successfully recovered 0 persisted job graphs.
2020-11-24 11:07:46,654 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/rpc/dispatcher_1 .
2020-11-24 11:07:48,578 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering TaskManager with ResourceID f0dc0ae680e65a97341be79d865f0c03
(akka.tcp://flink@10.40.0.2:6122/user/rpc/taskmanager_0) at ResourceManager
2020-11-24 11:11:00,066 INFO org.apache.flink.client.ClientUtils
[] - Starting program (detached: true)
2020-11-24 11:11:00,649 INFO
org.springframework.context.annotation.ConfigurationClassEnhancer [] - @Bean
method Configuration.propertySourcesPlaceholderConfigurer is non-static and
returns an object assignable to Spring's BeanFactoryPostProcessor interface.
This will result in a failure to process annotations such as @Autowired,
@Resource and @PostConstruct within the method's declaring @Configuration
class. Add the 'static' modifier to this method to avoid these container
lifecycle issues; see @Bean javadoc for complete details.
2020-11-24 11:11:01,186 INFO org.mongodb.driver.cluster
[] - Cluster created with settings {hosts=[172.31.35.211:27017],
mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms',
maxWaitQueueSize=500}
2020-11-24 11:11:01,187 INFO org.mongodb.driver.cluster
[] - Adding discovered server 172.31.35.211:27017 to client view of
cluster
2020-11-24 11:11:01,216 INFO org.mongodb.driver.cluster
[] - Cluster created with settings {hosts=[172.31.35.211:27017],
mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms',
maxWaitQueueSize=500}
2020-11-24 11:11:01,216 INFO org.mongodb.driver.cluster
[] - Adding discovered server 172.31.35.211:27017 to client view of
cluster
2020-11-24 11:11:01,218 INFO org.mongodb.driver.cluster
[] - Cluster created with settings {hosts=[172.31.35.211:27017],
mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms',
maxWaitQueueSize=500}
2020-11-24 11:11:01,218 INFO org.mongodb.driver.cluster
[] - Adding discovered server 172.31.35.211:27017 to client view of
cluster
2020-11-24 11:11:01,223 INFO org.mongodb.driver.cluster
[] - Cluster created with settings {hosts=[172.31.35.211:27017],
mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms',
maxWaitQueueSize=500}
2020-11-24 11:11:01,223 INFO org.mongodb.driver.cluster
[] - Adding discovered server 172.31.35.211:27017 to client view of
cluster
2020-11-24 11:11:01,224 INFO org.mongodb.driver.cluster
[] - Cluster created with settings {hosts=[172.31.35.211:27017],
mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms',
maxWaitQueueSize=500}
2020-11-24 11:11:01,225 INFO org.mongodb.driver.cluster
[] - Adding discovered server 172.31.35.211:27017 to client view of
cluster
2020-11-24 11:11:01,229 INFO org.mongodb.driver.cluster
[] - Cluster created with settings {hosts=[172.31.35.211:27017],
mode=MULTIPLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms',
maxWaitQueueSize=500}
2020-11-24 11:11:01,229 INFO org.mongodb.driver.cluster
[] - Adding discovered server 172.31.35.211:27017 to client view of
cluster
2020-11-24 11:11:01,248 INFO org.mongodb.driver.connection
[] - Opened connection [connectionId{localValue:3,
serverValue:7474}] to 172.31.35.211:27017
2020-11-24 11:11:01,249 INFO org.mongodb.driver.connection
[] - Opened connection [connectionId{localValue:1,
serverValue:7472}] to 172.31.35.211:27017
2020-11-24 11:11:01,249 INFO org.mongodb.driver.connection
[] - Opened connection [connectionId{localValue:4,
serverValue:7475}] to 172.31.35.211:27017
2020-11-24 11:11:01,248 INFO org.mongodb.driver.connection
[] - Opened connection [connectionId{localValue:2,
serverValue:7473}] to 172.31.35.211:27017
2020-11-24 11:11:01,250 INFO org.mongodb.driver.connection
[] - Opened connection [connectionId{localValue:5,
serverValue:7476}] to 172.31.35.211:27017
2020-11-24 11:11:01,251 INFO org.mongodb.driver.connection
[] - Opened connection [connectionId{localValue:6,
serverValue:7477}] to 172.31.35.211:27017
2020-11-24 11:11:01,254 INFO org.mongodb.driver.cluster
[] - Monitor thread successfully connected to server with
description ServerDescription{address=172.31.35.211:27017, type=SHARD_ROUTER,
state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 4, 0]},
minWireVersion=0, maxWireVersion=9, maxDocumentSize=16777216,
logicalSessionTimeoutMinutes=30, roundTripTimeNanos=2638130}
2020-11-24 11:11:01,254 INFO org.mongodb.driver.cluster
[] - Monitor thread successfully connected to server with
description ServerDescription{address=172.31.35.211:27017, type=SHARD_ROUTER,
state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 4, 0]},
minWireVersion=0, maxWireVersion=9, maxDocumentSize=16777216,
logicalSessionTimeoutMinutes=30, roundTripTimeNanos=4780379}
2020-11-24 11:11:01,255 INFO org.mongodb.driver.cluster
[] - Monitor thread successfully connected to server with
description ServerDescription{address=172.31.35.211:27017, type=SHARD_ROUTER,
state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 4, 0]},
minWireVersion=0, maxWireVersion=9, maxDocumentSize=16777216,
logicalSessionTimeoutMinutes=30, roundTripTimeNanos=5808176}
2020-11-24 11:11:01,256 INFO org.mongodb.driver.cluster
[] - Monitor thread successfully connected to server with
description ServerDescription{address=172.31.35.211:27017, type=SHARD_ROUTER,
state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 4, 0]},
minWireVersion=0, maxWireVersion=9, maxDocumentSize=16777216,
logicalSessionTimeoutMinutes=30, roundTripTimeNanos=6027409}
2020-11-24 11:11:01,256 INFO org.mongodb.driver.cluster
[] - Monitor thread successfully connected to server with
description ServerDescription{address=172.31.35.211:27017, type=SHARD_ROUTER,
state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 4, 0]},
minWireVersion=0, maxWireVersion=9, maxDocumentSize=16777216,
logicalSessionTimeoutMinutes=30, roundTripTimeNanos=1397129}
2020-11-24 11:11:01,258 INFO org.mongodb.driver.cluster
[] - Discovered cluster type of SHARDED
2020-11-24 11:11:01,258 INFO org.mongodb.driver.cluster
[] - Discovered cluster type of SHARDED
2020-11-24 11:11:01,259 INFO org.mongodb.driver.cluster
[] - Discovered cluster type of SHARDED
2020-11-24 11:11:01,259 INFO org.mongodb.driver.cluster
[] - Discovered cluster type of SHARDED
2020-11-24 11:11:01,259 INFO org.mongodb.driver.cluster
[] - Discovered cluster type of SHARDED
2020-11-24 11:11:01,261 INFO org.mongodb.driver.cluster
[] - Monitor thread successfully connected to server with
description ServerDescription{address=172.31.35.211:27017, type=SHARD_ROUTER,
state=CONNECTED, ok=true, version=ServerVersion{versionList=[4, 4, 0]},
minWireVersion=0, maxWireVersion=9, maxDocumentSize=16777216,
logicalSessionTimeoutMinutes=30, roundTripTimeNanos=12011758}
2020-11-24 11:11:01,262 INFO org.mongodb.driver.cluster
[] - Discovered cluster type of SHARDED
2020-11-24 11:11:01,902 INFO org.mongodb.driver.connection
[] - Opened connection [connectionId{localValue:7,
serverValue:7478}] to 172.31.35.211:27017
2020-11-24 11:11:02,023 INFO
com.opus.optimus.toolset.batch.workflow.executor.WorkflowExecutor [] -
jobParams: {}
2020-11-24 11:11:02,264 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a getter for field values
2020-11-24 11:11:02,265 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a setter for field values
2020-11-24 11:11:02,265 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - Class class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext cannot be
used as a POJO type because not all fields are valid POJO fields, and must be
processed as GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
2020-11-24 11:11:02,305 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a getter for field values
2020-11-24 11:11:02,305 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a setter for field values
2020-11-24 11:11:02,305 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - Class class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext cannot be
used as a POJO type because not all fields are valid POJO fields, and must be
processed as GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
2020-11-24 11:11:02,308 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a getter for field values
2020-11-24 11:11:02,308 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a setter for field values
2020-11-24 11:11:02,308 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - Class class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext cannot be
used as a POJO type because not all fields are valid POJO fields, and must be
processed as GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
2020-11-24 11:11:02,339 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a getter for field values
2020-11-24 11:11:02,339 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a setter for field values
2020-11-24 11:11:02,339 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - Class class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext cannot be
used as a POJO type because not all fields are valid POJO fields, and must be
processed as GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
2020-11-24 11:11:02,341 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a getter for field values
2020-11-24 11:11:02,341 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext does not
contain a setter for field values
2020-11-24 11:11:02,341 INFO org.apache.flink.api.java.typeutils.TypeExtractor
[] - Class class
com.opus.optimus.toolset.batch.workflow.dynamic.IndexedMapContext cannot be
used as a POJO type because not all fields are valid POJO fields, and must be
processed as GenericType. Please read the Flink documentation on "Data Types &
Serialization" for details of the effect on performance.
2020-11-24 11:11:02,356 INFO org.apache.flink.api.java.utils.PlanGenerator
[] - The job has 2 registered types and 0 default Kryo serializers
2020-11-24 11:11:02,428 INFO org.apache.flink.api.java.utils.PlanGenerator
[] - The job has 2 registered types and 0 default Kryo serializers
2020-11-24 11:11:02,440 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.address, flink-jobmanager
2020-11-24 11:11:02,440 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 5
2020-11-24 11:11:02,440 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: blob.server.port, 6124
2020-11-24 11:11:02,440 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.port, 6123
2020-11-24 11:11:02,441 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.rpc.port, 6122
2020-11-24 11:11:02,441 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: queryable-state.proxy.ports, 6125
2020-11-24 11:11:02,441 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.memory.process.size, 8192m
2020-11-24 11:11:02,441 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 8192m
2020-11-24 11:11:02,441 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: heartbeat.timeout, 120000
2020-11-24 11:11:02,441 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 2
2020-11-24 11:11:02,588 INFO
org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] -
Job 8ad412c1db509137ea6271d65bcf8a0c is submitted.
2020-11-24 11:11:02,588 INFO
org.apache.flink.client.deployment.application.executors.EmbeddedExecutor [] -
Submitting Job with JobId=8ad412c1db509137ea6271d65bcf8a0c.
2020-11-24 11:11:02,600 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received
JobGraph submission 8ad412c1db509137ea6271d65bcf8a0c (Flink Java Job at Tue Nov
24 11:11:02 UTC 2020).
2020-11-24 11:11:02,601 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting
job 8ad412c1db509137ea6271d65bcf8a0c (Flink Java Job at Tue Nov 24 11:11:02 UTC
2020).
2020-11-24 11:11:02,622 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.jobmaster.JobMaster at
akka://flink/user/rpc/jobmanager_2 .
2020-11-24 11:11:02,629 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Initializing job Flink Java Job at Tue Nov 24 11:11:02 UTC 2020
(8ad412c1db509137ea6271d65bcf8a0c).
2020-11-24 11:11:02,642 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using restart back off time strategy
NoRestartBackoffTimeStrategy for Flink Java Job at Tue Nov 24 11:11:02 UTC 2020
(8ad412c1db509137ea6271d65bcf8a0c).
2020-11-24 11:11:02,676 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Running initialization on master for job Flink Java Job at Tue
Nov 24 11:11:02 UTC 2020 (8ad412c1db509137ea6271d65bcf8a0c).
2020-11-24 11:11:02,697 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Successfully ran initialization on master in 20 ms.
2020-11-24 11:11:02,714 INFO
org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built
2 pipelined regions in 1 ms
2020-11-24 11:11:02,719 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using failover strategy
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@3445dee2
for Flink Java Job at Tue Nov 24 11:11:02 UTC 2020
(8ad412c1db509137ea6271d65bcf8a0c).
2020-11-24 11:11:02,723 INFO
org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl [] - JobManager
runner for job Flink Java Job at Tue Nov 24 11:11:02 UTC 2020
(8ad412c1db509137ea6271d65bcf8a0c) was granted leadership with session id
00000000-0000-0000-0000-000000000000 at
akka.tcp://flink@flink-jobmanager:6123/user/rpc/jobmanager_2.
2020-11-24 11:11:02,726 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Starting execution of job Flink Java Job at Tue Nov 24 11:11:02
UTC 2020 (8ad412c1db509137ea6271d65bcf8a0c) under job master id
00000000000000000000000000000000.
2020-11-24 11:11:02,727 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Starting scheduling with scheduling strategy
[org.apache.flink.runtime.scheduler.strategy.LazyFromSourcesSchedulingStrategy]
2020-11-24 11:11:02,728 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink
Java Job at Tue Nov 24 11:11:02 UTC 2020 (8ad412c1db509137ea6271d65bcf8a0c)
switched from state CREATED to RUNNING.
2020-11-24 11:11:02,735 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSource
(at createStartStep(FlinkWorkflow.java:277)
(org.apache.flink.api.java.io.CollectionInputFormat)) (1/1)
(650cd4369210e30cb0348bd5417d6f74) switched from CREATED to SCHEDULED.
2020-11-24 11:11:02,747 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Cannot serve
slot request, no ResourceManager connected. Adding as pending request
[SlotRequestId{82b985068c2428b536cb5f50d3ca6833}]
2020-11-24 11:11:02,753 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Connecting to ResourceManager
akka.tcp://flink@flink-jobmanager:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
2020-11-24 11:11:02,757 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Resolved ResourceManager address, beginning registration
2020-11-24 11:11:02,759 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering job manager
00000000000000000000000000000...@akka.tcp://flink@flink-jobmanager:6123/user/rpc/jobmanager_2
for job 8ad412c1db509137ea6271d65bcf8a0c.
2020-11-24 11:11:02,767 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registered job manager
00000000000000000000000000000...@akka.tcp://flink@flink-jobmanager:6123/user/rpc/jobmanager_2
for job 8ad412c1db509137ea6271d65bcf8a0c.
2020-11-24 11:11:02,769 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - JobManager successfully registered at ResourceManager, leader
id: 00000000000000000000000000000000.
2020-11-24 11:11:02,769 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting
new slot [SlotRequestId{82b985068c2428b536cb5f50d3ca6833}] and profile
ResourceProfile{UNKNOWN} from resource manager.
2020-11-24 11:11:02,770 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Request
slot with profile ResourceProfile{UNKNOWN} for job
8ad412c1db509137ea6271d65bcf8a0c with allocation id
d63c9e53942586d70d54ebb89ddcf309.
2020-11-24 11:11:02,892 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSource
(at createStartStep(FlinkWorkflow.java:277)
(org.apache.flink.api.java.io.CollectionInputFormat)) (1/1)
(650cd4369210e30cb0348bd5417d6f74) switched from SCHEDULED to DEPLOYING.
2020-11-24 11:11:02,892 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
DataSource (at createStartStep(FlinkWorkflow.java:277)
(org.apache.flink.api.java.io.CollectionInputFormat)) (1/1) (attempt #0) to
f0dc0ae680e65a97341be79d865f0c03 @ ip-10-40-0-2.ap-south-1.compute.internal
(dataPort=39913)
2020-11-24 11:11:02,985 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSource
(at createStartStep(FlinkWorkflow.java:277)
(org.apache.flink.api.java.io.CollectionInputFormat)) (1/1)
(650cd4369210e30cb0348bd5417d6f74) switched from DEPLOYING to RUNNING.
2020-11-24 11:11:03,183 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSource
(at createStartStep(FlinkWorkflow.java:277)
(org.apache.flink.api.java.io.CollectionInputFormat)) (1/1)
(650cd4369210e30cb0348bd5417d6f74) switched from RUNNING to FINISHED.
2020-11-24 11:11:03,187 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceA) (1/1) (46d77b6ce1b7992fa9a972065a72c0ab) switched from CREATED to
SCHEDULED.
2020-11-24 11:11:03,191 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceA) (1/1) (46d77b6ce1b7992fa9a972065a72c0ab) switched from SCHEDULED to
DEPLOYING.
2020-11-24 11:11:03,191 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
FlatMap (sourceA) (1/1) (attempt #0) to f0dc0ae680e65a97341be79d865f0c03 @
ip-10-40-0-2.ap-south-1.compute.internal (dataPort=39913)
2020-11-24 11:11:03,192 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceB) (1/1) (1d344d1316a7a121033d94f3a376c30f) switched from CREATED to
SCHEDULED.
2020-11-24 11:11:03,194 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceB) (1/1) (1d344d1316a7a121033d94f3a376c30f) switched from SCHEDULED to
DEPLOYING.
2020-11-24 11:11:03,194 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
FlatMap (sourceB) (1/1) (attempt #0) to f0dc0ae680e65a97341be79d865f0c03 @
ip-10-40-0-2.ap-south-1.compute.internal (dataPort=39913)
2020-11-24 11:11:03,223 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceA) (1/1) (46d77b6ce1b7992fa9a972065a72c0ab) switched from DEPLOYING to
RUNNING.
2020-11-24 11:11:03,227 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceB) (1/1) (1d344d1316a7a121033d94f3a376c30f) switched from DEPLOYING to
RUNNING.
2020-11-24 11:11:05,609 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (1/5) (db5c99eaeb5df1dfce5a266516fa3dfb) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,611 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (1/5) (db5c99eaeb5df1dfce5a266516fa3dfb) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,611 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Map
(rule1KeyGenerator) (1/5) (attempt #0) to f0dc0ae680e65a97341be79d865f0c03 @
ip-10-40-0-2.ap-south-1.compute.internal (dataPort=39913)
2020-11-24 11:11:05,612 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (2/5) (83f31c7eaa4b5c9bb93e982e00105914) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,613 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting
new slot [SlotRequestId{433567b05ef49b58c58a27c7f9a2b7a5}] and profile
ResourceProfile{UNKNOWN} from resource manager.
2020-11-24 11:11:05,613 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (3/5) (b9334479591517775ad7c9a116d32eaf) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,616 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting
new slot [SlotRequestId{666284b164ccd871d44d217c19f0b769}] and profile
ResourceProfile{UNKNOWN} from resource manager.
2020-11-24 11:11:05,616 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (4/5) (db796330810cb08fd1d818435a94a06f) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,616 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting
new slot [SlotRequestId{86c991647a5e3f26234fe7d0e33a62ed}] and profile
ResourceProfile{UNKNOWN} from resource manager.
2020-11-24 11:11:05,617 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Request
slot with profile ResourceProfile{UNKNOWN} for job
8ad412c1db509137ea6271d65bcf8a0c with allocation id
07ccc7e2a3001da8e82cb4a04e281605.
2020-11-24 11:11:05,620 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (5/5) (0e488d85a305ad3dce7347c276355232) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,620 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Request
slot with profile ResourceProfile{UNKNOWN} for job
8ad412c1db509137ea6271d65bcf8a0c with allocation id
9795ed666dbecd804df7fd72c67f5c34.
2020-11-24 11:11:05,621 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Request
slot with profile ResourceProfile{UNKNOWN} for job
8ad412c1db509137ea6271d65bcf8a0c with allocation id
1e3baea17205bcb9c6e3e292784be8bc.
2020-11-24 11:11:05,622 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting
new slot [SlotRequestId{bb4df026fc953f113e8d74eb1c3579f1}] and profile
ResourceProfile{UNKNOWN} from resource manager.
2020-11-24 11:11:05,622 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Request
slot with profile ResourceProfile{UNKNOWN} for job
8ad412c1db509137ea6271d65bcf8a0c with allocation id
c3967c93abbc550b62009dc278f9527e.
2020-11-24 11:11:05,646 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (1/5) (db5c99eaeb5df1dfce5a266516fa3dfb) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,647 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (2/5) (83f31c7eaa4b5c9bb93e982e00105914) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,648 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Map
(rule1KeyGenerator) (2/5) (attempt #0) to f0dc0ae680e65a97341be79d865f0c03 @
ip-10-40-0-2.ap-south-1.compute.internal (dataPort=39913)
2020-11-24 11:11:05,648 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Received
repeated offer for slot [07ccc7e2a3001da8e82cb4a04e281605]. Ignoring.
2020-11-24 11:11:05,649 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (3/5) (b9334479591517775ad7c9a116d32eaf) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,649 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Map
(rule1KeyGenerator) (3/5) (attempt #0) to f0dc0ae680e65a97341be79d865f0c03 @
ip-10-40-0-2.ap-south-1.compute.internal (dataPort=39913)
2020-11-24 11:11:05,650 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (4/5) (db796330810cb08fd1d818435a94a06f) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,650 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Map
(rule1KeyGenerator) (4/5) (attempt #0) to f0dc0ae680e65a97341be79d865f0c03 @
ip-10-40-0-2.ap-south-1.compute.internal (dataPort=39913)
2020-11-24 11:11:05,650 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Received
repeated offer for slot [9795ed666dbecd804df7fd72c67f5c34]. Ignoring.
2020-11-24 11:11:05,650 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Received
repeated offer for slot [07ccc7e2a3001da8e82cb4a04e281605]. Ignoring.
2020-11-24 11:11:05,651 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Received
repeated offer for slot [1e3baea17205bcb9c6e3e292784be8bc]. Ignoring.
2020-11-24 11:11:05,651 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Received
repeated offer for slot [9795ed666dbecd804df7fd72c67f5c34]. Ignoring.
2020-11-24 11:11:05,651 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Received
repeated offer for slot [07ccc7e2a3001da8e82cb4a04e281605]. Ignoring.
2020-11-24 11:11:05,651 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (5/5) (0e488d85a305ad3dce7347c276355232) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,651 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Map
(rule1KeyGenerator) (5/5) (attempt #0) to f0dc0ae680e65a97341be79d865f0c03 @
ip-10-40-0-2.ap-south-1.compute.internal (dataPort=39913)
2020-11-24 11:11:05,668 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceA) (1/1) (46d77b6ce1b7992fa9a972065a72c0ab) switched from RUNNING to
FINISHED.
2020-11-24 11:11:05,699 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (2/5) (83f31c7eaa4b5c9bb93e982e00105914) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,699 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (3/5) (b9334479591517775ad7c9a116d32eaf) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,705 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (4/5) (db796330810cb08fd1d818435a94a06f) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,706 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (5/5) (0e488d85a305ad3dce7347c276355232) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,779 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (1/5) (18ec46f02a4f59973cdc7524cc35ef2e) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,780 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (1/5) (18ec46f02a4f59973cdc7524cc35ef2e) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,780 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
GroupReduce (rule1RuleExecutor) (1/5) (attempt #0) to
f0dc0ae680e65a97341be79d865f0c03 @ ip-10-40-0-2.ap-south-1.compute.internal
(dataPort=39913)
2020-11-24 11:11:05,781 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (2/5) (032149d549fd8c3c4dd389444ab51d56) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,782 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (2/5) (032149d549fd8c3c4dd389444ab51d56) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,782 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
GroupReduce (rule1RuleExecutor) (2/5) (attempt #0) to
f0dc0ae680e65a97341be79d865f0c03 @ ip-10-40-0-2.ap-south-1.compute.internal
(dataPort=39913)
2020-11-24 11:11:05,782 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (3/5) (9912011c711362501d72de7b0dcec302) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,783 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (3/5) (9912011c711362501d72de7b0dcec302) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,783 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
GroupReduce (rule1RuleExecutor) (3/5) (attempt #0) to
f0dc0ae680e65a97341be79d865f0c03 @ ip-10-40-0-2.ap-south-1.compute.internal
(dataPort=39913)
2020-11-24 11:11:05,783 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (4/5) (91a8870009cf37c43e450d99b6f782ce) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,783 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (4/5) (91a8870009cf37c43e450d99b6f782ce) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,783 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
GroupReduce (rule1RuleExecutor) (4/5) (attempt #0) to
f0dc0ae680e65a97341be79d865f0c03 @ ip-10-40-0-2.ap-south-1.compute.internal
(dataPort=39913)
2020-11-24 11:11:05,784 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (5/5) (e0013d25a6875fdab2b6161f743991c1) switched from
CREATED to SCHEDULED.
2020-11-24 11:11:05,784 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (5/5) (e0013d25a6875fdab2b6161f743991c1) switched from
SCHEDULED to DEPLOYING.
2020-11-24 11:11:05,784 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
GroupReduce (rule1RuleExecutor) (5/5) (attempt #0) to
f0dc0ae680e65a97341be79d865f0c03 @ ip-10-40-0-2.ap-south-1.compute.internal
(dataPort=39913)
2020-11-24 11:11:05,833 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (2/5) (032149d549fd8c3c4dd389444ab51d56) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,842 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (1/5) (18ec46f02a4f59973cdc7524cc35ef2e) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,844 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (3/5) (9912011c711362501d72de7b0dcec302) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,846 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (4/5) (91a8870009cf37c43e450d99b6f782ce) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:05,846 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (5/5) (e0013d25a6875fdab2b6161f743991c1) switched from
DEPLOYING to RUNNING.
2020-11-24 11:11:16,296 ERROR
org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler
[] - Failed to transfer file from TaskExecutor f0dc0ae680e65a97341be79d865f0c03.
java.util.concurrent.CompletionException: org.apache.flink.util.FlinkException:
The file STDOUT does not exist on the TaskExecutor.
at
org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$requestFileUploadByFilePath$25(TaskExecutor.java:1742)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source) ~[?:?]
at java.lang.Thread.run(Unknown Source) ~[?:?]
Caused by: org.apache.flink.util.FlinkException: The file STDOUT does not exist
on the TaskExecutor.
... 5 more
2020-11-24 11:11:16,304 ERROR
org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler
[] - Unhandled exception.
org.apache.flink.util.FlinkException: The file STDOUT does not exist on the
TaskExecutor.
at
org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$requestFileUploadByFilePath$25(TaskExecutor.java:1742)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source) ~[?:?]
at java.lang.Thread.run(Unknown Source) ~[?:?]
2020-11-24 11:11:28,088 ERROR
org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler
[] - Failed to transfer file from TaskExecutor f0dc0ae680e65a97341be79d865f0c03.
java.util.concurrent.CompletionException: org.apache.flink.util.FlinkException:
The file STDOUT does not exist on the TaskExecutor.
at
org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$requestFileUploadByFilePath$25(TaskExecutor.java:1742)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source) ~[?:?]
at java.lang.Thread.run(Unknown Source) ~[?:?]
Caused by: org.apache.flink.util.FlinkException: The file STDOUT does not exist
on the TaskExecutor.
... 5 more
2020-11-24 11:11:28,089 ERROR
org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerStdoutFileHandler
[] - Unhandled exception.
org.apache.flink.util.FlinkException: The file STDOUT does not exist on the
TaskExecutor.
at
org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$requestFileUploadByFilePath$25(TaskExecutor.java:1742)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
Source) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source) ~[?:?]
at java.lang.Thread.run(Unknown Source) ~[?:?]
2020-11-24 11:13:52,878 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (3/5) (b9334479591517775ad7c9a116d32eaf) switched from
RUNNING to FAILED on
org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot@6b346f09.
java.util.concurrent.TimeoutException: Heartbeat of TaskManager with id
f0dc0ae680e65a97341be79d865f0c03 timed out.
at
org.apache.flink.runtime.jobmaster.JobMaster$TaskManagerHeartbeatListener.notifyHeartbeatTimeout(JobMaster.java:1193)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.heartbeat.HeartbeatMonitorImpl.run(HeartbeatMonitorImpl.java:109)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown
Source) ~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:402)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:195)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.ActorCell.invoke(ActorCell.scala:561)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.run(Mailbox.scala:225)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
[flink-dist_2.11-1.11.2.jar:1.11.2]
2020-11-24 11:13:52,882 INFO
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy
[] - Calculating tasks to restart to recover the failed task
e3b138f8fed79e1a359834e45a54d7ed_2.
2020-11-24 11:13:52,883 INFO
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy
[] - 17 tasks should be restarted to recover the failed task
e3b138f8fed79e1a359834e45a54d7ed_2.
2020-11-24 11:13:52,884 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink
Java Job at Tue Nov 24 11:11:02 UTC 2020 (8ad412c1db509137ea6271d65bcf8a0c)
switched from state RUNNING to FAILING.
org.apache.flink.runtime.JobException: Recovery is suppressed by
NoRestartBackoffTimeStrategy
at
org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:116)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:78)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:192)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:185)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:179)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:503)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:49)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.ExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(ExecutionGraph.java:1710)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1287)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1255)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.Execution.fail(Execution.java:954)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot.signalPayloadRelease(SingleLogicalSlot.java:173)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot.release(SingleLogicalSlot.java:165)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager$SingleTaskSlot.release(SlotSharingManager.java:732)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager$MultiTaskSlot.release(SlotSharingManager.java:537)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.AllocatedSlot.releasePayload(AllocatedSlot.java:149)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl.releaseTaskManagerInternal(SlotPoolImpl.java:818)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl.releaseTaskManager(SlotPoolImpl.java:777)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.JobMaster.disconnectTaskManager(JobMaster.java:435)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.JobMaster$TaskManagerHeartbeatListener.notifyHeartbeatTimeout(JobMaster.java:1193)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.heartbeat.HeartbeatMonitorImpl.run(HeartbeatMonitorImpl.java:109)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown
Source) ~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:402)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:195)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.ActorCell.invoke(ActorCell.scala:561)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.run(Mailbox.scala:225)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
[flink-dist_2.11-1.11.2.jar:1.11.2]
Caused by: java.util.concurrent.TimeoutException: Heartbeat of TaskManager with
id f0dc0ae680e65a97341be79d865f0c03 timed out.
... 26 more
2020-11-24 11:13:52,889 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 650cd4369210e30cb0348bd5417d6f74.
2020-11-24 11:13:52,890 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 46d77b6ce1b7992fa9a972065a72c0ab.
2020-11-24 11:13:52,891 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceB) (1/1) (1d344d1316a7a121033d94f3a376c30f) switched from RUNNING to
CANCELING.
2020-11-24 11:13:52,893 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (1/5) (db5c99eaeb5df1dfce5a266516fa3dfb) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,893 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (2/5) (83f31c7eaa4b5c9bb93e982e00105914) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,893 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (4/5) (db796330810cb08fd1d818435a94a06f) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,893 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (5/5) (0e488d85a305ad3dce7347c276355232) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,894 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (1/5) (18ec46f02a4f59973cdc7524cc35ef2e) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,894 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (2/5) (032149d549fd8c3c4dd389444ab51d56) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,894 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (3/5) (9912011c711362501d72de7b0dcec302) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,894 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (4/5) (91a8870009cf37c43e450d99b6f782ce) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,894 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (5/5) (e0013d25a6875fdab2b6161f743991c1) switched from
RUNNING to CANCELING.
2020-11-24 11:13:52,895 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (1/5)
(11e651eff77b61e8907255a598e64bb2) switched from CREATED to CANCELING.
2020-11-24 11:13:52,895 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (1/5)
(11e651eff77b61e8907255a598e64bb2) switched from CANCELING to CANCELED.
2020-11-24 11:13:52,895 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 11e651eff77b61e8907255a598e64bb2.
2020-11-24 11:13:52,895 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (2/5)
(62edc71350f5be5b8b79029fa4a229e6) switched from CREATED to CANCELING.
2020-11-24 11:13:52,895 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (2/5)
(62edc71350f5be5b8b79029fa4a229e6) switched from CANCELING to CANCELED.
2020-11-24 11:13:52,896 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 62edc71350f5be5b8b79029fa4a229e6.
2020-11-24 11:13:52,896 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (3/5)
(1358cd65d4567ffed0cf1e42cbe6fffe) switched from CREATED to CANCELING.
2020-11-24 11:13:52,896 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (3/5)
(1358cd65d4567ffed0cf1e42cbe6fffe) switched from CANCELING to CANCELED.
2020-11-24 11:13:52,896 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 1358cd65d4567ffed0cf1e42cbe6fffe.
2020-11-24 11:13:52,896 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (4/5)
(646c89fca95f1d7cf61b11c0d072a30f) switched from CREATED to CANCELING.
2020-11-24 11:13:52,897 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (4/5)
(646c89fca95f1d7cf61b11c0d072a30f) switched from CANCELING to CANCELED.
2020-11-24 11:13:52,897 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 646c89fca95f1d7cf61b11c0d072a30f.
2020-11-24 11:13:52,897 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (5/5)
(76e99876139c6f23d3406abbe6d65f12) switched from CREATED to CANCELING.
2020-11-24 11:13:52,897 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - DataSink
(org.apache.flink.api.java.io.DiscardingOutputFormat@2ccff0d0) (5/5)
(76e99876139c6f23d3406abbe6d65f12) switched from CANCELING to CANCELED.
2020-11-24 11:13:52,897 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 76e99876139c6f23d3406abbe6d65f12.
2020-11-24 11:13:52,897 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution b9334479591517775ad7c9a116d32eaf.
2020-11-24 11:13:52,898 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution b9334479591517775ad7c9a116d32eaf.
2020-11-24 11:13:52,900 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (2/5) (032149d549fd8c3c4dd389444ab51d56) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,900 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 032149d549fd8c3c4dd389444ab51d56.
2020-11-24 11:13:52,900 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 032149d549fd8c3c4dd389444ab51d56.
2020-11-24 11:13:52,900 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (4/5) (db796330810cb08fd1d818435a94a06f) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,900 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution db796330810cb08fd1d818435a94a06f.
2020-11-24 11:13:52,900 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution db796330810cb08fd1d818435a94a06f.
2020-11-24 11:13:52,901 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (1/5) (18ec46f02a4f59973cdc7524cc35ef2e) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,901 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 18ec46f02a4f59973cdc7524cc35ef2e.
2020-11-24 11:13:52,901 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 18ec46f02a4f59973cdc7524cc35ef2e.
2020-11-24 11:13:52,901 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (1/5) (db5c99eaeb5df1dfce5a266516fa3dfb) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,901 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution db5c99eaeb5df1dfce5a266516fa3dfb.
2020-11-24 11:13:52,901 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution db5c99eaeb5df1dfce5a266516fa3dfb.
2020-11-24 11:13:52,902 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - FlatMap
(sourceB) (1/1) (1d344d1316a7a121033d94f3a376c30f) switched from CANCELING to
CANCELED.
2020-11-24 11:13:52,902 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 1d344d1316a7a121033d94f3a376c30f.
2020-11-24 11:13:52,902 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 1d344d1316a7a121033d94f3a376c30f.
2020-11-24 11:13:52,902 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (3/5) (9912011c711362501d72de7b0dcec302) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,902 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 9912011c711362501d72de7b0dcec302.
2020-11-24 11:13:52,902 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 9912011c711362501d72de7b0dcec302.
2020-11-24 11:13:52,904 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (5/5) (0e488d85a305ad3dce7347c276355232) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,904 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 0e488d85a305ad3dce7347c276355232.
2020-11-24 11:13:52,904 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 0e488d85a305ad3dce7347c276355232.
2020-11-24 11:13:52,904 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (5/5) (e0013d25a6875fdab2b6161f743991c1) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,904 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution e0013d25a6875fdab2b6161f743991c1.
2020-11-24 11:13:52,904 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution e0013d25a6875fdab2b6161f743991c1.
2020-11-24 11:13:52,905 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Map
(rule1KeyGenerator) (2/5) (83f31c7eaa4b5c9bb93e982e00105914) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,905 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 83f31c7eaa4b5c9bb93e982e00105914.
2020-11-24 11:13:52,905 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 83f31c7eaa4b5c9bb93e982e00105914.
2020-11-24 11:13:52,905 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - GroupReduce
(rule1RuleExecutor) (4/5) (91a8870009cf37c43e450d99b6f782ce) switched from
CANCELING to CANCELED.
2020-11-24 11:13:52,905 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 91a8870009cf37c43e450d99b6f782ce.
2020-11-24 11:13:52,906 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Discarding
the results produced by task execution 91a8870009cf37c43e450d99b6f782ce.
2020-11-24 11:13:52,906 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Flink
Java Job at Tue Nov 24 11:11:02 UTC 2020 (8ad412c1db509137ea6271d65bcf8a0c)
switched from state FAILING to FAILED.
org.apache.flink.runtime.JobException: Recovery is suppressed by
NoRestartBackoffTimeStrategy
at
org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:116)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:78)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:192)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:185)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:179)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:503)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:49)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.ExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(ExecutionGraph.java:1710)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1287)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1255)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.executiongraph.Execution.fail(Execution.java:954)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot.signalPayloadRelease(SingleLogicalSlot.java:173)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SingleLogicalSlot.release(SingleLogicalSlot.java:165)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager$SingleTaskSlot.release(SlotSharingManager.java:732)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotSharingManager$MultiTaskSlot.release(SlotSharingManager.java:537)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.AllocatedSlot.releasePayload(AllocatedSlot.java:149)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl.releaseTaskManagerInternal(SlotPoolImpl.java:818)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl.releaseTaskManager(SlotPoolImpl.java:777)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.JobMaster.disconnectTaskManager(JobMaster.java:435)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.jobmaster.JobMaster$TaskManagerHeartbeatListener.notifyHeartbeatTimeout(JobMaster.java:1193)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.heartbeat.HeartbeatMonitorImpl.run(HeartbeatMonitorImpl.java:109)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown
Source) ~[?:?]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:402)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:195)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
~[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.actor.ActorCell.invoke(ActorCell.scala:561)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.run(Mailbox.scala:225)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
[flink-dist_2.11-1.11.2.jar:1.11.2]
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
[flink-dist_2.11-1.11.2.jar:1.11.2]
Caused by: java.util.concurrent.TimeoutException: Heartbeat of TaskManager with
id f0dc0ae680e65a97341be79d865f0c03 timed out.
... 26 more
2020-11-24 11:13:52,910 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job
8ad412c1db509137ea6271d65bcf8a0c reached globally terminal state FAILED.
2020-11-24 11:13:52,921 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Stopping the JobMaster for job Flink Java Job at Tue Nov 24
11:11:02 UTC 2020(8ad412c1db509137ea6271d65bcf8a0c).
2020-11-24 11:13:52,922 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Suspending
SlotPool.
2020-11-24 11:13:52,923 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Close ResourceManager connection
b6d87228e6310b7c036a840a2abb97c4: JobManager is shutting down..
2020-11-24 11:13:52,923 INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Stopping
SlotPool.
2020-11-24 11:13:52,923 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Disconnect job manager
00000000000000000000000000000...@akka.tcp://flink@flink-jobmanager:6123/user/rpc/jobmanager_2
for job 8ad412c1db509137ea6271d65bcf8a0c from the resource manager.
2020-11-24 11:14:05,535 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - The
heartbeat of TaskManager with id f0dc0ae680e65a97341be79d865f0c03 timed out.
2020-11-24 11:14:05,535 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Closing
TaskExecutor connection f0dc0ae680e65a97341be79d865f0c03 because: The heartbeat
of TaskManager with id f0dc0ae680e65a97341be79d865f0c03 timed out.
