新建了flink cdc任务
测试doris的实时读写（读写都是doris），source和sink的配置都是按照官网配置的，目前现象是任务正常启动，数据同步成功，但是第一次同步成功后flink
cdc任务就开始关闭，日志显示正常流程关闭的，也不报错
2022-12-06 23:06:20,408 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.address, master
2022-12-06 23:06:20,414 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.port, 6123
2022-12-06 23:06:20,414 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.memory.process.size, 2048m
2022-12-06 23:06:20,414 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 4096m
2022-12-06 23:06:20,415 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 4
2022-12-06 23:06:20,415 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 2
2022-12-06 23:06:20,415 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.execution.failover-strategy, region
2022-12-06 23:06:20,415 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.port, 8082
2022-12-06 23:06:20,416 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.address, master
2022-12-06 23:06:20,416 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.bind-address, 0.0.0.0
2022-12-06 23:06:20,416 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: web.submit.enable, true
2022-12-06 23:06:20,416 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: io.tmp.dirs, /data/universe/tmp
2022-12-06 23:06:20,416 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: env.pid.dir, /data/universe/apache/flink/current/pids
2022-12-06 23:06:20,417 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.archive.fs.dir, hdfs:///flink/completed-jobs
2022-12-06 23:06:20,417 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.address, master
2022-12-06 23:06:20,417 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.port, 8083
2022-12-06 23:06:20,417 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.dir,
hdfs:///flink/completed-jobs
2022-12-06 23:06:20,417 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.refresh-interval, 10000
2022-12-06 23:06:20,417 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend, filesystem
2022-12-06 23:06:20,417 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend.fs.checkpointdir,
hdfs:///flink/flink-checkpoints
2022-12-06 23:06:20,418 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability, zookeeper
2022-12-06 23:06:20,418 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.storageDir, hdfs:///flink/ha/
2022-12-06 23:06:20,418 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.zookeeper.quorum,
worker1:2181,worker2:2181,worker3:2181
2022-12-06 23:06:20,418 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: classloader.check-leaked-classloader, false
2022-12-06 23:06:20,418 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: classloader.resolve-order, parent-first
2022-12-06 23:06:20,584 INFO
org.apache.flink.table.client.gateway.context.DefaultContext [] - Executor
config: {execution.savepoint.ignore-unclaimed-state=false,
execution.attached=true, execution.savepoint-restore-mode=NO_CLAIM,
execution.shutdown-on-attached-exit=false,
pipeline.jars=[file:/data/universe/apache/flink/flink-1.15.2/opt/flink-sql-client-1.15.2.jar,
file:/data/universe/apache/flink/flink-1.15.2/lib/flink-python_2.12-1.15.2.jar],
pipeline.classpaths=[], execution.target=remote}
2022-12-06 23:06:20,774 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:22,931 INFO org.apache.flink.table.client.cli.CliClient
[] - Command history file path: /home/universe/.flink-sql-history
2022-12-06 23:06:23,001 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:23,052 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:23,079 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:23,112 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:23,144 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:23,158 INFO org.apache.flink.table.client.cli.CliClient
[] - [34;1m[INFO] Executing SQL from file.[0m
Command history file path: /home/universe/.flink-sql-history
Flink SQL> [34;1m[INFO] Session property has been set.[0m
Flink SQL> [34;1m[INFO] Session property has been set.[0m
Flink SQL> [34;1m[INFO] Session property has been set.[0m
Flink SQL> [34;1m[INFO] Session property has been set.[0m
Flink SQL> [34;1m[INFO] Session property has been set.[0m
Flink SQL>
2022-12-06 23:06:23,284 INFO org.apache.flink.table.client.cli.CliClient
[] - Command history file path: /home/universe/.flink-sql-history
2022-12-06 23:06:23,907 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:25,963 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:26,014 INFO
org.apache.doris.flink.table.DorisDynamicTableSink [] - Send request
to Doris FE 'http://10.18.100.116:8003/api/testdb/flinkcdccopy/_schema' with
user 'root'.
2022-12-06 23:06:26,906 WARN org.apache.flink.configuration.Configuration
[] - Config uses deprecated configuration key
'state.backend.fs.checkpointdir' instead of proper key 'state.checkpoints.dir'
2022-12-06 23:06:27,141 INFO org.apache.flink.configuration.Configuration
[] - Config uses fallback configuration key 'rest.port' instead of
key 'rest.bind-port'
2022-12-06 23:06:27,145 WARN
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The
resource configuration option Key: 'taskmanager.memory.process.size' , default:
null (fallback keys: []) is set but it will have no effect for local execution,
only the following options matter for the resource configuration: [Key:
'taskmanager.memory.process.size' , default: null (fallback keys: []), Key:
'taskmanager.memory.flink.size' , default: null (fallback keys: []), Key:
'taskmanager.memory.framework.heap.size' , default: 128 mb (fallback keys: []),
Key: 'taskmanager.memory.framework.off-heap.size' , default: 128 mb (fallback
keys: []), Key: 'taskmanager.memory.jvm-metaspace.size' , default: 256 mb
(fallback keys: []), Key: 'taskmanager.memory.jvm-overhead.min' , default: 192
mb (fallback keys: []), Key: 'taskmanager.memory.jvm-overhead.max' , default: 1
gb (fallback keys: []), Key: 'taskmanager.memory.jvm-overhead.fraction' ,
default: 0.1 (fallback keys: [])]
2022-12-06 23:06:27,147 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The
configuration option taskmanager.cpu.cores required for local execution is not
set, setting it to the maximal possible value.
2022-12-06 23:06:27,147 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The
configuration option taskmanager.memory.task.heap.size required for local
execution is not set, setting it to the maximal possible value.
2022-12-06 23:06:27,147 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The
configuration option taskmanager.memory.task.off-heap.size required for local
execution is not set, setting it to the maximal possible value.
2022-12-06 23:06:27,147 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The
configuration option taskmanager.memory.network.min required for local
execution is not set, setting it to its default value 64 mb.
2022-12-06 23:06:27,147 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The
configuration option taskmanager.memory.network.max required for local
execution is not set, setting it to its default value 64 mb.
2022-12-06 23:06:27,147 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils [] - The
configuration option taskmanager.memory.managed.size required for local
execution is not set, setting it to its default value 128 mb.
2022-12-06 23:06:27,153 INFO org.apache.flink.runtime.minicluster.MiniCluster
[] - Starting Flink Mini Cluster
2022-12-06 23:06:27,162 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.address, master
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.port, 6123
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.memory.process.size, 2048m
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 4096m
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 4
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 2
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.execution.failover-strategy, region
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.port, 8082
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.address, master
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.bind-address, 0.0.0.0
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: web.submit.enable, true
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: io.tmp.dirs, /data/universe/tmp
2022-12-06 23:06:27,163 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: env.pid.dir, /data/universe/apache/flink/current/pids
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.archive.fs.dir, hdfs:///flink/completed-jobs
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.address, master
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.web.port, 8083
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.dir,
hdfs:///flink/completed-jobs
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: historyserver.archive.fs.refresh-interval, 10000
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend, filesystem
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: state.backend.fs.checkpointdir,
hdfs:///flink/flink-checkpoints
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability, zookeeper
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.storageDir, hdfs:///flink/ha/
2022-12-06 23:06:27,164 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: high-availability.zookeeper.quorum,
worker1:2181,worker2:2181,worker3:2181
2022-12-06 23:06:27,165 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: classloader.check-leaked-classloader, false
2022-12-06 23:06:27,165 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: classloader.resolve-order, parent-first
2022-12-06 23:06:27,512 INFO org.apache.flink.runtime.minicluster.MiniCluster
[] - Starting Metrics Registry
2022-12-06 23:06:27,628 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics
reporter configured, no metrics will be exposed/reported.
2022-12-06 23:06:27,628 INFO org.apache.flink.runtime.minicluster.MiniCluster
[] - Starting RPC Service(s)
2022-12-06 23:06:27,650 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start local actor system
2022-12-06 23:06:28,668 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2022-12-06 23:06:28,866 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka://flink
2022-12-06 23:06:28,895 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start local actor system
2022-12-06 23:06:28,916 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
2022-12-06 23:06:28,938 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka://flink-metrics
2022-12-06 23:06:28,959 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService .
2022-12-06 23:06:30,442 INFO org.apache.flink.runtime.blob.FileSystemBlobStore
[] - Creating highly available BLOB storage directory at
hdfs:/flink/ha/default/blob
2022-12-06 23:06:30,642 INFO org.apache.flink.runtime.util.ZooKeeperUtils
[] - Enforcing default ACL for ZK connections
2022-12-06 23:06:30,643 INFO org.apache.flink.runtime.util.ZooKeeperUtils
[] - Using '/flink/default' as Zookeeper namespace.
2022-12-06 23:06:30,750 INFO
org.apache.flink.shaded.curator5.org.apache.curator.framework.imps.CuratorFrameworkImpl
[] - Starting
2022-12-06 23:06:30,767 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:zookeeper.version=3.5.9-83df9301aa5c2a5d284a9940177808c01bc35cef,
built on 01/06/2021 20:03 GMT
2022-12-06 23:06:30,767 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:host.name=worker3
2022-12-06 23:06:30,767 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:java.version=1.8.0_181
2022-12-06 23:06:30,768 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:java.vendor=Oracle Corporation
2022-12-06 23:06:30,768 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:java.home=/usr/java/jdk1.8.0_181/jre
2022-12-06 23:06:30,768 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:java.class.path=/data/universe/apache/flink/flink-1.15.2/lib/calcite-core-1.31.0.jar:/data/universe/apache/flink/flink-1.15.2/lib/dlink-client-1.15-0.7.0.jar:/data/universe/apache/flink/flink-1.15.2/lib/dlink-client-base-0.7.0.jar:/data/universe/apache/flink/flink-1.15.2/lib/dlink-common-0.7.0.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-cep-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-connector-files-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-csv-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-doris-connector-1.15-1.2.0.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-json-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-python_2.12-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-scala_2.12-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-shaded-zookeeper-3.5.9.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-sql-connector-mysql-cdc-2.3.0.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-table-api-java-uber-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-table-planner-loader-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-table-runtime-1.15.2.jar:/data/universe/apache/flink/flink-1.15.2/lib/hadoop-mapreduce-client-common-3.3.4.jar:/data/universe/apache/flink/flink-1.15.2/lib/hadoop-mapreduce-client-core-3.3.4.jar:/data/universe/apache/flink/flink-1.15.2/lib/hadoop-mapreduce-client-jobclient-3.3.4.jar:/data/universe/apache/flink/flink-1.15.2/lib/hudi-flink1.15-bundle-0.12.1.jar:/data/universe/apache/flink/flink-1.15.2/lib/log4j-1.2-api-2.17.1.jar:/data/universe/apache/flink/flink-1.15.2/lib/log4j-api-2.17.1.jar:/data/universe/apache/flink/flink-1.15.2/lib/log4j-core-2.17.1.jar:/data/universe/apache/flink/flink-1.15.2/lib/log4j-slf4j-impl-2.17.1.jar:/data/universe/apache/flink/flink-1.15.2/lib/flink-dist-1.15.2.jar:/etc/hadoop/conf:/data/universe/apache/hadoop/current/share/hadoop/common/lib/nimbus-jose-jwt-9.8.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/snappy-java-1.1.8.2.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-configuration2-2.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jaxb-api-2.2.11.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/gson-2.8.9.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jersey-core-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-servlet-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-lang3-3.12.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/netty-3.10.6.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-server-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/audience-annotations-0.5.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jsp-api-2.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-io-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jsch-0.1.55.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerby-pkix-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/hadoop-auth-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/httpcore-4.4.13.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/animal-sniffer-annotations-1.17.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jakarta.activation-api-1.2.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/guava-27.0-jre.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/re2j-1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jersey-json-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/reload4j-1.2.22.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-simplekdc-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-server-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerby-xdr-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/zookeeper-3.5.6.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/httpclient-4.5.13.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-webapp-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-net-3.6.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-compress-1.21.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-text-1.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/curator-recipes-4.2.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/accessors-smart-2.4.7.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-security-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/dnsjava-2.1.7.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/avro-1.7.7.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jsr305-3.0.2.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-daemon-1.0.13.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-admin-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jersey-servlet-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-io-2.8.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-collections-3.2.2.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jersey-server-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-xml-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/curator-framework-4.2.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/stax2-api-4.2.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerby-config-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jackson-core-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerby-asn1-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-beanutils-1.9.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-codec-1.15.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-util-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-http-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jettison-1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jackson-annotations-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/token-provider-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-logging-1.1.3.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/slf4j-api-1.7.36.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/asm-5.0.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerby-util-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jul-to-slf4j-1.7.36.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/curator-client-4.2.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/paranamer-2.3.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/metrics-core-3.2.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-core-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/hadoop-annotations-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/woodstox-core-5.3.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-client-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/zookeeper-jute-3.5.6.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/hadoop-shaded-guava-1.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-identity-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-common-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/kerb-util-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/failureaccess-1.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-math3-3.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jackson-databind-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/checker-qual-2.5.2.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/commons-cli-1.2.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/json-smart-2.4.7.jar:/data/universe/apache/hadoop/current/share/hadoop/common/lib/jetty-util-ajax-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/common/hadoop-registry-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/hudi-hadoop-mr-bundle-0.12.0.jar:/data/universe/apache/hadoop/current/share/hadoop/common/hadoop-common-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/hadoop-common-3.3.4-tests.jar:/data/universe/apache/hadoop/current/share/hadoop/common/hadoop-nfs-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/common/hadoop-kms-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.77.Final-linux-x86_64.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-resolver-dns-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-dns-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/nimbus-jose-jwt-9.8.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/snappy-java-1.1.8.2.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-configuration2-2.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/gson-2.8.9.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-servlet-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-lang3-3.12.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-server-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/audience-annotations-0.5.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jackson-xc-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-io-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jcip-annotations-1.0-1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jsch-0.1.55.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerby-pkix-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/hadoop-auth-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/httpcore-4.4.13.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-resolver-dns-native-macos-4.1.77.Final-osx-aarch_64.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/okhttp-4.9.3.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/animal-sniffer-annotations-1.17.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jakarta.activation-api-1.2.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/guava-27.0-jre.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/re2j-1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/reload4j-1.2.22.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-server-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/zookeeper-3.5.6.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-rxtx-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-classes-epoll-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-redis-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/httpclient-4.5.13.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-webapp-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-handler-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-common-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-net-3.6.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-compress-1.21.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kotlin-stdlib-1.4.10.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-stomp-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kotlin-stdlib-common-1.4.10.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-text-1.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/curator-recipes-4.2.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-socks-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/accessors-smart-2.4.7.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-resolver-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-security-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-udt-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/avro-1.7.7.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-native-unix-common-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-smtp-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jersey-servlet-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-io-2.8.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-handler-proxy-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-collections-3.2.2.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/okio-2.8.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-xml-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-haproxy-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/curator-framework-4.2.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-mqtt-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/stax2-api-4.2.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-http2-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jackson-core-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerby-asn1-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-beanutils-1.9.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-codec-1.15.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-util-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-http-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jettison-1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jackson-annotations-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/token-provider-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-native-epoll-4.1.77.Final-linux-aarch_64.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-buffer-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/asm-5.0.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerby-util-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-sctp-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/curator-client-4.2.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-http-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/paranamer-2.3.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-classes-kqueue-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/hadoop-annotations-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/woodstox-core-5.3.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-memcache-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/hadoop-shaded-protobuf_3_7-1.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-resolver-dns-classes-macos-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/zookeeper-jute-3.5.6.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/hadoop-shaded-guava-1.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-native-kqueue-4.1.77.Final-osx-aarch_64.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-identity-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-all-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/kerb-util-1.0.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-resolver-dns-native-macos-4.1.77.Final-osx-x86_64.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-math3-3.1.1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jackson-databind-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-transport-native-kqueue-4.1.77.Final-osx-x86_64.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/netty-codec-xml-4.1.77.Final.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/json-smart-2.4.7.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/lib/jetty-util-ajax-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-client-3.3.4-tests.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-3.3.4-tests.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.4-tests.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.4-tests.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-nfs-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-client-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-httpfs-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-rbf-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/hdfs/hadoop-hdfs-native-client-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-nativetask-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.4-tests.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/guice-4.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jersey-guice-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/bcprov-jdk15on-1.60.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jetty-client-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/javax.inject-1.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/websocket-server-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/websocket-api-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/json-io-2.5.1.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jersey-client-1.19.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/websocket-client-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jackson-jaxrs-base-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/ehcache-3.3.1.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jna-5.2.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/websocket-servlet-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/javax.websocket-client-api-1.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/aopalliance-1.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/java-util-1.9.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/HikariCP-java7-2.4.12.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jetty-jndi-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/asm-tree-9.1.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/javax.websocket-api-1.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/bcpkix-jdk15on-1.60.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/swagger-annotations-1.5.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/javax-websocket-client-impl-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/metrics-core-3.2.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/asm-commons-9.1.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/objenesis-2.6.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jetty-annotations-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/fst-2.50.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/javax-websocket-server-impl-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jakarta.xml.bind-api-2.3.2.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/websocket-common-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-2.12.7.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/snakeyaml-1.26.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jline-3.9.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/jetty-plus-9.4.43.v20210629.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/lib/asm-analysis-9.1.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-registry-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-applications-mawo-core-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-services-api-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-router-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-client-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-common-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-common-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-server-tests-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-services-core-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/spark-3.3.0-yarn-shuffle.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-api-3.3.4.jar:/data/universe/apache/hadoop/current/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-3.3.4.jar:/etc/hadoop/conf::/etc/hbase/conf:/data/universe/apache/flink/flink-1.15.2/opt/flink-sql-client-1.15.2.jar
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:java.io.tmpdir=/tmp
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:java.compiler=<NA>
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:os.name=Linux
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:os.arch=amd64
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:os.version=3.10.0-957.el7.x86_64
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:user.name=universe
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:user.home=/home/universe
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:user.dir=/tmp/dolphinscheduler/exec/process/universe/7576386307104/7781909865248_37/79/80
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:os.memory.free=699MB
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:os.memory.max=7115MB
2022-12-06 23:06:30,769 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Client
environment:os.memory.total=749MB
2022-12-06 23:06:30,774 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] -
Initiating client connection,
connectString=worker1:2181,worker2:2181,worker3:2181 sessionTimeout=60000
watcher=org.apache.flink.shaded.curator5.org.apache.curator.ConnectionState@912a644
2022-12-06 23:06:30,784 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.common.X509Util [] -
Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable
client-initiated TLS renegotiation
2022-12-06 23:06:30,790 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ClientCnxnSocket [] -
jute.maxbuffer value is 4194304 Bytes
2022-12-06 23:06:30,799 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ClientCnxn [] -
zookeeper.request.timeout value is 0. feature enabled=
2022-12-06 23:06:30,811 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ClientCnxn [] - Opening
socket connection to server worker2/10.18.100.175:2181. Will not attempt to
authenticate using SASL (unknown error)
2022-12-06 23:06:30,811 INFO
org.apache.flink.shaded.curator5.org.apache.curator.framework.imps.CuratorFrameworkImpl
[] - Default schema
2022-12-06 23:06:30,813 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ClientCnxn [] - Socket
connection established, initiating session, client: /10.18.100.176:54958,
server: worker2/10.18.100.175:2181
2022-12-06 23:06:30,825 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ClientCnxn [] - Session
establishment complete on server worker2/10.18.100.175:2181, sessionid =
0x2005daed1826b0c, negotiated timeout = 40000
2022-12-06 23:06:30,833 INFO
org.apache.flink.shaded.curator5.org.apache.curator.framework.state.ConnectionStateManager
[] - State change: CONNECTED
2022-12-06 23:06:30,854 INFO
org.apache.flink.shaded.curator5.org.apache.curator.framework.imps.EnsembleTracker
[] - New config event received: {server.1=10.18.100.174:2888:3888:participant,
version=0, server.3=10.18.100.176:2888:3888:participant,
server.2=10.18.100.175:2888:3888:participant}
2022-12-06 23:06:30,864 INFO
org.apache.flink.shaded.curator5.org.apache.curator.framework.imps.EnsembleTracker
[] - New config event received: {server.1=10.18.100.174:2888:3888:participant,
version=0, server.3=10.18.100.176:2888:3888:participant,
server.2=10.18.100.175:2888:3888:participant}
2022-12-06 23:06:30,905 INFO org.apache.flink.runtime.blob.BlobServer
[] - Created BLOB server storage directory
/data/universe/tmp/minicluster_2a0fc1eb1f950cdfabba017f4552e561/blobStorage
2022-12-06 23:06:30,912 INFO org.apache.flink.runtime.blob.BlobServer
[] - Started BLOB server at 0.0.0.0:38732 - max concurrent requests:
50 - max backlog: 1000
2022-12-06 23:06:30,924 INFO org.apache.flink.runtime.blob.PermanentBlobCache
[] - Created BLOB cache storage directory
/data/universe/tmp/minicluster_2a0fc1eb1f950cdfabba017f4552e561/blobStorage
2022-12-06 23:06:30,928 INFO org.apache.flink.runtime.blob.TransientBlobCache
[] - Created BLOB cache storage directory
/data/universe/tmp/minicluster_2a0fc1eb1f950cdfabba017f4552e561/blobStorage
2022-12-06 23:06:30,931 INFO org.apache.flink.runtime.minicluster.MiniCluster
[] - Starting 1 TaskManager(s)
2022-12-06 23:06:30,937 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Starting
TaskManager with ResourceID: 441e1be7-5c74-47ab-ae8f-1091c44cf91c
2022-12-06 23:06:30,952 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerServices [] - Temporary
file directory '/data/universe/tmp': total 1007 GB, usable 900 GB (89.37%
usable)
2022-12-06 23:06:30,957 INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager [] - Created a new
FileChannelManager for spilling of task related data to disk (joins, sorting,
...). Used directories:
/data/universe/tmp/flink-io-ebb2114f-f5ea-4ab8-8064-3c80f9dcc1a6
2022-12-06 23:06:30,969 INFO
org.apache.flink.runtime.io.network.NettyShuffleServiceFactory [] - Created a
new FileChannelManager for storing result partitions of BLOCKING shuffles. Used
directories:
/data/universe/tmp/flink-netty-shuffle-7a887a2a-69d7-442f-b8b8-f41f0583e984
2022-12-06 23:06:31,027 INFO
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 64
MB for network buffer pool (number of memory segments: 2048, bytes per segment:
32768).
2022-12-06 23:06:31,047 INFO
org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Starting the
network environment and its components.
2022-12-06 23:06:31,050 INFO
org.apache.flink.runtime.taskexecutor.KvStateService [] - Starting the
kvState service and its components.
2022-12-06 23:06:31,068 INFO org.apache.flink.configuration.Configuration
[] - Config uses fallback configuration key 'akka.ask.timeout'
instead of key 'taskmanager.slot.timeout'
2022-12-06 23:06:31,086 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.taskexecutor.TaskExecutor at
akka://flink/user/rpc/taskmanager_0 .
2022-12-06 23:06:31,135 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:31,137 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job
leader service.
2022-12-06 23:06:31,139 INFO org.apache.flink.runtime.filecache.FileCache
[] - User file cache uses directory
/data/universe/tmp/flink-dist-cache-dc509fdf-5086-40fb-81c8-88a69376e08f
2022-12-06 23:06:31,172 INFO org.apache.flink.configuration.Configuration
[] - Config uses fallback configuration key 'rest.port' instead of
key 'rest.bind-port'
2022-12-06 23:06:31,175 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Starting rest
endpoint.
2022-12-06 23:06:31,338 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component log file:
/data/universe/apache/flink/flink-1.15.2/log/flink-universe-sql-client-worker3.log
2022-12-06 23:06:31,338 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component stdout file:
/data/universe/apache/flink/flink-1.15.2/log/flink-universe-sql-client-worker3.out
2022-12-06 23:06:31,718 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Rest endpoint
listening at master:8082
2022-12-06 23:06:31,721 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Starting DefaultLeaderElectionService with
org.apache.flink.runtime.leaderelection.MultipleComponentLeaderElectionDriverAdapter@6f986031.
2022-12-06 23:06:31,722 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Web frontend
listening at http://master:8082.
2022-12-06 23:06:31,722 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] -
http://master:8082 was granted leadership with
leaderSessionID=27807a79-67aa-45a3-a831-5a93525d2834
2022-12-06 23:06:31,748 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Starting DefaultLeaderElectionService with
org.apache.flink.runtime.leaderelection.MultipleComponentLeaderElectionDriverAdapter@3b7dd173.
2022-12-06 23:06:31,748 INFO
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] -
Starting resource manager service.
2022-12-06 23:06:31,749 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Starting DefaultLeaderElectionService with
org.apache.flink.runtime.leaderelection.MultipleComponentLeaderElectionDriverAdapter@7552f05b.
2022-12-06 23:06:31,749 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:31,749 INFO
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] -
DefaultDispatcherRunner was granted leadership with leader id
27807a79-67aa-45a3-a831-5a93525d2834. Creating new DispatcherLeaderProcess.
2022-12-06 23:06:31,749 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/dispatcher/connection_info'}.
2022-12-06 23:06:31,755 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:31,756 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/dispatcher/connection_info'}.
2022-12-06 23:06:31,756 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/rest_server/connection_info'}.
2022-12-06 23:06:31,756 INFO org.apache.flink.runtime.minicluster.MiniCluster
[] - Flink Mini Cluster started successfully
2022-12-06 23:06:31,780 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Start SessionDispatcherLeaderProcess.
2022-12-06 23:06:31,786 INFO
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] -
Resource manager service is granted leadership with session id
27807a79-67aa-45a3-a831-5a93525d2834.
2022-12-06 23:06:31,803 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Recover all persisted job graphs that are not finished, yet.
2022-12-06 23:06:31,808 INFO
org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Retrieved job
ids [] from ZooKeeperStateHandleStore{namespace='flink/default/jobgraphs'}
2022-12-06 23:06:31,809 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Successfully recovered 0 persisted job graphs.
2022-12-06 23:06:31,811 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at
akka://flink/user/rpc/resourcemanager_1 .
2022-12-06 23:06:31,839 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/rpc/dispatcher_2 .
2022-12-06 23:06:31,840 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Starting the resource manager.
2022-12-06 23:06:31,887 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to
ResourceManager
akka://flink/user/rpc/resourcemanager_1(a8315a93525d283427807a7967aa45a3).
2022-12-06 23:06:31,949 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Resolved
ResourceManager address, beginning registration
2022-12-06 23:06:31,961 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering TaskManager with ResourceID 441e1be7-5c74-47ab-ae8f-1091c44cf91c
(akka://flink/user/rpc/taskmanager_0) at ResourceManager
2022-12-06 23:06:31,964 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Successful
registration at resource manager akka://flink/user/rpc/resourcemanager_1 under
registration id 6f0fba3c919776a9321fba3d8e6e054e.
2022-12-06 23:06:43,218 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received
JobGraph submission 'insert-into_default_catalog.default_database.flinkcdccopy'
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:43,232 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting
job 'insert-into_default_catalog.default_database.flinkcdccopy'
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:43,301 INFO
org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Added
JobGraph(jobId: 9f706b9e244aaeeb12c953662f39e7d1) to
ZooKeeperStateHandleStore{namespace='flink/default/jobgraphs'}.
2022-12-06 23:06:43,317 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Starting DefaultLeaderElectionService with
org.apache.flink.runtime.leaderelection.MultipleComponentLeaderElectionDriverAdapter@659c196.
2022-12-06 23:06:43,343 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Starting RPC endpoint for
org.apache.flink.runtime.jobmaster.JobMaster at
akka://flink/user/rpc/jobmanager_3 .
2022-12-06 23:06:43,356 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Initializing job
'insert-into_default_catalog.default_database.flinkcdccopy'
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:43,405 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using restart back off time strategy
FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=2147483647,
backoffTimeMS=1000) for
insert-into_default_catalog.default_database.flinkcdccopy
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:43,463 INFO
org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStoreUtils [] -
Recovering checkpoints from
ZooKeeperStateHandleStore{namespace='flink/default/jobs/9f706b9e244aaeeb12c953662f39e7d1/checkpoints'}.
2022-12-06 23:06:43,476 INFO
org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStoreUtils [] -
Found 0 checkpoints in
ZooKeeperStateHandleStore{namespace='flink/default/jobs/9f706b9e244aaeeb12c953662f39e7d1/checkpoints'}.
2022-12-06 23:06:43,477 INFO
org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStoreUtils [] -
Trying to fetch 0 checkpoints from storage.
2022-12-06 23:06:43,482 INFO org.apache.flink.runtime.util.ZooKeeperUtils
[] - Initialized DefaultCompletedCheckpointStore in
'ZooKeeperStateHandleStore{namespace='flink/default/jobs/9f706b9e244aaeeb12c953662f39e7d1/checkpoints'}'
with /checkpoints.
2022-12-06 23:06:43,541 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Running initialization on master for job
insert-into_default_catalog.default_database.flinkcdccopy
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:43,542 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Successfully ran initialization on master in 0 ms.
2022-12-06 23:06:43,600 INFO
org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built
1 new pipelined regions in 4 ms, total 1 pipelined regions currently.
2022-12-06 23:06:43,604 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using job/cluster config to configure application-defined state
backend: org.apache.flink.runtime.state.hashmap.HashMapStateBackend@21f9fbd0
2022-12-06 23:06:43,604 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using application-defined state backend:
org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4116851a
2022-12-06 23:06:43,604 INFO org.apache.flink.runtime.state.StateBackendLoader
[] - State backend loader loads the state backend as
HashMapStateBackend
2022-12-06 23:06:43,606 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using job/cluster config to configure application-defined
checkpoint storage:
org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage@6a94a6d9
2022-12-06 23:06:43,692 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint
found during restore.
2022-12-06 23:06:43,704 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Using failover strategy
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@1cc736
for insert-into_default_catalog.default_database.flinkcdccopy
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:43,721 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:43,722 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Starting execution of job
'insert-into_default_catalog.default_database.flinkcdccopy'
(9f706b9e244aaeeb12c953662f39e7d1) under job master id
a8315a93525d283427807a7967aa45a3.
2022-12-06 23:06:43,726 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting
split enumerator for source Source: flinkcdc[1].
2022-12-06 23:06:43,731 INFO org.apache.doris.flink.source.DorisSource
[] - Send request to Doris FE
'http://10.18.100.116:8003/api/testdb/flinkcdc/_query_plan' with user 'root'.
2022-12-06 23:06:43,758 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Starting scheduling with scheduling strategy
[org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
2022-12-06 23:06:43,758 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job
insert-into_default_catalog.default_database.flinkcdccopy
(9f706b9e244aaeeb12c953662f39e7d1) switched from state CREATED to RUNNING.
2022-12-06 23:06:43,767 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer (1/1)
(61d13eea3924c393ddc45b98faf7eef1) switched from CREATED to SCHEDULED.
2022-12-06 23:06:43,802 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Connecting to ResourceManager
akka://flink/user/rpc/resourcemanager_1(a8315a93525d283427807a7967aa45a3)
2022-12-06 23:06:43,805 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Resolved ResourceManager address, beginning registration
2022-12-06 23:06:43,809 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/9f706b9e244aaeeb12c953662f39e7d1/connection_info'}.
2022-12-06 23:06:43,810 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering job manager
a8315a93525d283427807a7967aa45a3@akka://flink/user/rpc/jobmanager_3 for job
9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:43,819 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registered job manager
a8315a93525d283427807a7967aa45a3@akka://flink/user/rpc/jobmanager_3 for job
9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:43,822 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - JobManager successfully registered at ResourceManager, leader
id: a8315a93525d283427807a7967aa45a3.
2022-12-06 23:06:43,825 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Received resource requirements from job 9f706b9e244aaeeb12c953662f39e7d1:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=1}]
2022-12-06 23:06:43,831 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Receive slot
request a81ee3a4b29ae601faf5102447d1d305 for job
9f706b9e244aaeeb12c953662f39e7d1 from resource manager with leader id
a8315a93525d283427807a7967aa45a3.
2022-12-06 23:06:43,840 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Allocated
slot for a81ee3a4b29ae601faf5102447d1d305.
2022-12-06 23:06:43,842 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job
9f706b9e244aaeeb12c953662f39e7d1 for job leader monitoring.
2022-12-06 23:06:43,844 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Starting DefaultLeaderRetrievalService with
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/9f706b9e244aaeeb12c953662f39e7d1/connection_info'}.
2022-12-06 23:06:43,848 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to
register at job manager akka://flink/user/rpc/jobmanager_3 with leader id
27807a79-67aa-45a3-a831-5a93525d2834.
2022-12-06 23:06:43,850 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved
JobManager address, beginning registration
2022-12-06 23:06:43,858 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful
registration at job manager akka://flink/user/rpc/jobmanager_3 for job
9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:43,859 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Establish
JobManager connection for job 9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:43,864 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Offer
reserved slots to the leader of job 9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:43,876 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer (1/1)
(61d13eea3924c393ddc45b98faf7eef1) switched from SCHEDULED to DEPLOYING.
2022-12-06 23:06:43,876 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Source: flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer
(1/1) (attempt #0) with attempt id 61d13eea3924c393ddc45b98faf7eef1 and vertex
id cbc357ccb763df2852fee8c4fc7d55f2_0 to 441e1be7-5c74-47ab-ae8f-1091c44cf91c @
localhost (dataPort=-1) with allocation id a81ee3a4b29ae601faf5102447d1d305
2022-12-06 23:06:53,893 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
a81ee3a4b29ae601faf5102447d1d305.
2022-12-06 23:06:53,908 INFO
org.apache.flink.runtime.checkpoint.CheckpointFailureManager [] - Failed to
trigger checkpoint for job 9f706b9e244aaeeb12c953662f39e7d1 since Checkpoint
triggering task Source: flinkcdc[1] -> flinkcdccopy[2]: Writer ->
flinkcdccopy[2]: Committer (1/1) of job 9f706b9e244aaeeb12c953662f39e7d1 is not
being executed at the moment. Aborting checkpoint. Failure reason: Not all
required tasks are currently running..
2022-12-06 23:06:53,912 INFO
org.apache.flink.runtime.checkpoint.CheckpointFailureManager [] - Failed to
trigger checkpoint for job 9f706b9e244aaeeb12c953662f39e7d1 since Checkpoint
triggering task Source: flinkcdc[1] -> flinkcdccopy[2]: Writer ->
flinkcdccopy[2]: Committer (1/1) of job 9f706b9e244aaeeb12c953662f39e7d1 is not
being executed at the moment. Aborting checkpoint. Failure reason: Not all
required tasks are currently running..
2022-12-06 23:06:53,916 INFO
org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] -
StateChangelogStorageLoader initialized with shortcut names {memory,filesystem}.
2022-12-06 23:06:53,917 INFO
org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] -
Creating a changelog storage with name 'memory'.
2022-12-06 23:06:53,940 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task
Source: flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer
(1/1)#0 (61d13eea3924c393ddc45b98faf7eef1), deploy into slot with allocation id
a81ee3a4b29ae601faf5102447d1d305.
2022-12-06 23:06:53,941 INFO org.apache.flink.runtime.taskmanager.Task
[] - Source: flinkcdc[1] -> flinkcdccopy[2]: Writer ->
flinkcdccopy[2]: Committer (1/1)#0 (61d13eea3924c393ddc45b98faf7eef1) switched
from CREATED to DEPLOYING.
2022-12-06 23:06:53,946 INFO org.apache.flink.runtime.taskmanager.Task
[] - Loading JAR files for task Source: flinkcdc[1] ->
flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer (1/1)#0
(61d13eea3924c393ddc45b98faf7eef1) [DEPLOYING].
2022-12-06 23:06:53,947 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
a81ee3a4b29ae601faf5102447d1d305.
2022-12-06 23:06:53,987 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Using
job/cluster config to configure application-defined state backend:
org.apache.flink.runtime.state.hashmap.HashMapStateBackend@1a84370a
2022-12-06 23:06:53,987 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Using
application-defined state backend:
org.apache.flink.runtime.state.hashmap.HashMapStateBackend@353fb2d9
2022-12-06 23:06:53,987 INFO org.apache.flink.runtime.state.StateBackendLoader
[] - State backend loader loads the state backend as
HashMapStateBackend
2022-12-06 23:06:53,988 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Using
job/cluster config to configure application-defined checkpoint storage:
org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage@5a31b77a
2022-12-06 23:06:54,003 INFO org.apache.flink.runtime.taskmanager.Task
[] - Source: flinkcdc[1] -> flinkcdccopy[2]: Writer ->
flinkcdccopy[2]: Committer (1/1)#0 (61d13eea3924c393ddc45b98faf7eef1) switched
from DEPLOYING to INITIALIZING.
2022-12-06 23:06:54,005 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer (1/1)
(61d13eea3924c393ddc45b98faf7eef1) switched from DEPLOYING to INITIALIZING.
2022-12-06 23:06:54,177 INFO org.apache.doris.flink.sink.writer.DorisWriter
[] - restore checkpointId 0
2022-12-06 23:06:54,177 INFO org.apache.doris.flink.sink.writer.DorisWriter
[] - labelPrefix flink
2022-12-06 23:06:54,181 INFO org.apache.doris.flink.sink.writer.DorisWriter
[] - Send request to Doris FE
'http://10.18.100.116:8003/api/backends?is_alive=true' with user 'root'.
2022-12-06 23:06:54,194 INFO org.apache.doris.flink.sink.writer.DorisWriter
[] - Backend
Info:{"backends":[{"ip":"10.18.100.174","http_port":8004,"is_alive":true},{"ip":"10.18.100.175","http_port":8004,"is_alive":true},{"ip":"10.18.100.176","http_port":8004,"is_alive":true}]}
2022-12-06 23:06:54,210 INFO org.apache.doris.flink.sink.writer.RecordBuffer
[] - init RecordBuffer capacity 262144, count 3
2022-12-06 23:06:54,210 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - abort for
labelSuffix flink_0. start chkId 1.
2022-12-06 23:06:54,318 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - load Result {
"TxnId": 8058,
"Label": "flink_0_1",
"TwoPhaseCommit": "true",
"Status": "Success",
"Message": "OK",
"NumberTotalRows": 0,
"NumberLoadedRows": 0,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 0,
"LoadTimeMs": 25,
"BeginTxnTimeMs": 2,
"StreamLoadPutTimeMs": 5,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 3,
"CommitAndPublishTimeMs": 0
}
2022-12-06 23:06:54,324 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - abort 8058
for check label flink_0_1.
2022-12-06 23:06:54,340 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - abort for
labelSuffix flink_0 finished
2022-12-06 23:06:54,340 INFO org.apache.doris.flink.sink.writer.RecordBuffer
[] - start buffer data, read queue size 0, write queue size 3
2022-12-06 23:06:54,342 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - stream load
started for flink_0_1
2022-12-06 23:06:54,345 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - start execute
load
2022-12-06 23:06:54,357 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
Source: flinkcdc[1] registering reader for parallel task 0 @
2022-12-06 23:06:54,358 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
Source: flinkcdc[1] received split request from parallel task 0
2022-12-06 23:06:54,362 INFO org.apache.flink.runtime.taskmanager.Task
[] - Source: flinkcdc[1] -> flinkcdccopy[2]: Writer ->
flinkcdccopy[2]: Committer (1/1)#0 (61d13eea3924c393ddc45b98faf7eef1) switched
from INITIALIZING to RUNNING.
2022-12-06 23:06:54,364 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer (1/1)
(61d13eea3924c393ddc45b98faf7eef1) switched from INITIALIZING to RUNNING.
2022-12-06 23:06:54,368 INFO
org.apache.doris.flink.source.enumerator.DorisSourceEnumerator [] - Assigned
split to subtask 0 : DorisSourceSplit:
testdb.flinkcdc,be=10.18.100.174:9060,tablets=[19548]
2022-12-06 23:06:54,379 INFO
org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Adding
split(s) to reader: [DorisSourceSplit:
testdb.flinkcdc,be=10.18.100.174:9060,tablets=[19548]]
2022-12-06 23:06:54,386 INFO
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] -
Starting split fetcher 0
2022-12-06 23:06:54,458 INFO
org.apache.doris.shaded.org.apache.arrow.memory.BaseAllocator [] - Debug mode
disabled.
2022-12-06 23:06:54,462 INFO
org.apache.doris.shaded.org.apache.arrow.memory.DefaultAllocationManagerOption
[] - allocation manager type not specified, using netty as the default type
2022-12-06 23:06:54,464 INFO
org.apache.doris.shaded.org.apache.arrow.memory.CheckAllocator [] - Using
DefaultAllocationManager at memory/DefaultAllocationManagerFactory.class
2022-12-06 23:06:55,150 INFO org.apache.doris.flink.backend.BackendClient
[] - CloseScanner to Doris BE 'Doris BE{host='10.18.100.174',
port=9060}' success.
2022-12-06 23:06:55,151 INFO org.apache.doris.flink.backend.BackendClient
[] - Closed a connection to Doris BE{host='10.18.100.174',
port=9060}.
2022-12-06 23:06:55,152 INFO
org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Finished
reading split(s) [10.18.100.174:9060]
2022-12-06 23:06:55,152 INFO
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] -
Finished reading from splits [10.18.100.174:9060]
2022-12-06 23:06:55,153 INFO
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager [] -
Closing splitFetcher 0 because it is idle.
2022-12-06 23:06:55,153 INFO
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] -
Shutting down split fetcher 0
2022-12-06 23:06:55,153 INFO
org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher [] - Split
fetcher 0 exited.
2022-12-06 23:06:55,153 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
Source: flinkcdc[1] received split request from parallel task 0
2022-12-06 23:06:55,155 INFO
org.apache.doris.flink.source.enumerator.DorisSourceEnumerator [] - No more
splits available for subtask 0
2022-12-06 23:06:55,156 INFO
org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Reader
received NoMoreSplits event.
2022-12-06 23:06:55,160 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - stream load
stopped.
2022-12-06 23:06:55,419 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - load Result {
"TxnId": 8059,
"Label": "flink_0_1",
"TwoPhaseCommit": "true",
"Status": "Success",
"Message": "OK",
"NumberTotalRows": 9,
"NumberLoadedRows": 9,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 62,
"LoadTimeMs": 1070,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 2,
"ReadDataTimeMs": 0,
"WriteDataTimeMs": 1061,
"CommitAndPublishTimeMs": 0
}
2022-12-06 23:06:57,971 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 1 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1670339217931 for job
9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:58,015 INFO org.apache.doris.flink.sink.writer.RecordBuffer
[] - start buffer data, read queue size 0, write queue size 3
2022-12-06 23:06:58,015 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - stream load
started for flink_0_2
2022-12-06 23:06:58,015 INFO
org.apache.doris.flink.sink.writer.DorisStreamLoad [] - start execute
load
2022-12-06 23:06:58,182 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 1 for job 9f706b9e244aaeeb12c953662f39e7d1 (879 bytes,
checkpointDuration=201 ms, finalizationTime=50 ms).
2022-12-06 23:06:58,184 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking
checkpoint 1 as completed for source Source: flinkcdc[1].
2022-12-06 23:06:58,203 INFO
org.apache.doris.flink.sink.committer.DorisCommitter [] - load result {
"status": "Success",
"msg": "transaction [8059] commit successfully."
}
2022-12-06 23:06:58,211 INFO
org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing
Source Reader.
2022-12-06 23:06:58,214 INFO org.apache.flink.runtime.taskmanager.Task
[] - Source: flinkcdc[1] -> flinkcdccopy[2]: Writer ->
flinkcdccopy[2]: Committer (1/1)#0 (61d13eea3924c393ddc45b98faf7eef1) switched
from RUNNING to FINISHED.
2022-12-06 23:06:58,215 INFO org.apache.flink.runtime.taskmanager.Task
[] - Freeing task resources for Source: flinkcdc[1] ->
flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer (1/1)#0
(61d13eea3924c393ddc45b98faf7eef1).
2022-12-06 23:06:58,217 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] -
Un-registering task and sending final execution state FINISHED to JobManager
for task Source: flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]:
Committer (1/1)#0 61d13eea3924c393ddc45b98faf7eef1.
2022-12-06 23:06:58,221 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
flinkcdc[1] -> flinkcdccopy[2]: Writer -> flinkcdccopy[2]: Committer (1/1)
(61d13eea3924c393ddc45b98faf7eef1) switched from RUNNING to FINISHED.
2022-12-06 23:06:58,226 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job
insert-into_default_catalog.default_database.flinkcdccopy
(9f706b9e244aaeeb12c953662f39e7d1) switched from state RUNNING to FINISHED.
2022-12-06 23:06:58,227 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping
checkpoint coordinator for job 9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:58,227 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Clearing resource requirements of job 9f706b9e244aaeeb12c953662f39e7d1
2022-12-06 23:06:58,239 INFO org.apache.flink.runtime.minicluster.MiniCluster
[] - Shutting down Flink Mini Cluster
2022-12-06 23:06:58,239 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job
9f706b9e244aaeeb12c953662f39e7d1 reached terminal state FINISHED.
2022-12-06 23:06:58,240 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Stopping
TaskExecutor akka://flink/user/rpc/taskmanager_0.
2022-12-06 23:06:58,240 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close
ResourceManager connection 700a4a8b49d5526ccb1f95a669584293.
2022-12-06 23:06:58,243 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close
JobManager connection for job 9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:58,244 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Closing
TaskExecutor connection 441e1be7-5c74-47ab-ae8f-1091c44cf91c because: The
TaskExecutor is shutting down.
2022-12-06 23:06:58,252 INFO
org.apache.flink.runtime.state.TaskExecutorStateChangelogStoragesManager [] -
Shutting down TaskExecutorStateChangelogStoragesManager.
2022-12-06 23:06:58,253 INFO
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] -
Releasing slot [a81ee3a4b29ae601faf5102447d1d305].
2022-12-06 23:06:58,253 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{taskHeapMemory=256.000gb (274877906944 bytes),
taskOffHeapMemory=256.000gb (274877906944 bytes), managedMemory=32.000mb
(33554432 bytes), networkMemory=16.000mb (16777216 bytes)}, allocationId:
a81ee3a4b29ae601faf5102447d1d305, jobId: 9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:58,256 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Shutting down
rest endpoint.
2022-12-06 23:06:58,263 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job
leader service.
2022-12-06 23:06:58,263 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,263 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/9f706b9e244aaeeb12c953662f39e7d1/connection_info'}.
2022-12-06 23:06:58,276 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,277 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:58,277 INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] -
Shutting down TaskExecutorLocalStateStoresManager.
2022-12-06 23:06:58,288 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Removing
cache directory /tmp/flink-web-ui
2022-12-06 23:06:58,289 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Stopping DefaultLeaderElectionService.
2022-12-06 23:06:58,289 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
FileChannelManager removed spill file directory
/data/universe/tmp/flink-io-ebb2114f-f5ea-4ab8-8064-3c80f9dcc1a6
2022-12-06 23:06:58,289 INFO
org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Shutting down
the network environment and its components.
2022-12-06 23:06:58,293 INFO
org.apache.flink.runtime.io.disk.FileChannelManagerImpl [] -
FileChannelManager removed spill file directory
/data/universe/tmp/flink-netty-shuffle-7a887a2a-69d7-442f-b8b8-f41f0583e984
2022-12-06 23:06:58,293 INFO
org.apache.flink.runtime.taskexecutor.KvStateService [] - Shutting down
the kvState service and its components.
2022-12-06 23:06:58,293 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job
leader service.
2022-12-06 23:06:58,297 INFO org.apache.flink.runtime.filecache.FileCache
[] - removed file cache directory
/data/universe/tmp/flink-dist-cache-dc509fdf-5086-40fb-81c8-88a69376e08f
2022-12-06 23:06:58,311 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Stopped
TaskExecutor akka://flink/user/rpc/taskmanager_0.
2022-12-06 23:06:58,322 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Shut down
complete.
2022-12-06 23:06:58,324 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Shut
down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..
2022-12-06 23:06:58,325 INFO
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
[] - Closing components.
2022-12-06 23:06:58,325 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,325 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/dispatcher/connection_info'}.
2022-12-06 23:06:58,326 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,326 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:58,326 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Stopping DefaultLeaderElectionService.
2022-12-06 23:06:58,345 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Stopping SessionDispatcherLeaderProcess.
2022-12-06 23:06:58,345 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping
dispatcher akka://flink/user/rpc/dispatcher_2.
2022-12-06 23:06:58,346 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopping all
currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
2022-12-06 23:06:58,346 INFO
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] -
Stopping resource manager service.
2022-12-06 23:06:58,346 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Stopping DefaultLeaderElectionService.
2022-12-06 23:06:58,347 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Stopping the JobMaster for job
'insert-into_default_catalog.default_database.flinkcdccopy'
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:58,353 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Closing
SourceCoordinator for source Source: flinkcdc[1].
2022-12-06 23:06:58,354 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
coordinator for source Source: flinkcdc[1] closed.
2022-12-06 23:06:58,357 INFO
org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStore [] -
Shutting down
2022-12-06 23:06:58,360 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Closing the slot manager.
2022-12-06 23:06:58,361 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Suspending the slot manager.
2022-12-06 23:06:58,361 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,362 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/9f706b9e244aaeeb12c953662f39e7d1/connection_info'}.
2022-12-06 23:06:58,390 INFO
org.apache.flink.runtime.zookeeper.ZooKeeperStateHandleStore [] - Removing
/flink/default/jobs/9f706b9e244aaeeb12c953662f39e7d1/checkpoints from ZooKeeper
2022-12-06 23:06:58,395 INFO
org.apache.flink.runtime.checkpoint.ZooKeeperCheckpointIDCounter [] - Shutting
down.
2022-12-06 23:06:58,395 INFO
org.apache.flink.runtime.checkpoint.ZooKeeperCheckpointIDCounter [] - Removing
/checkpoint_id_counter from ZooKeeper
2022-12-06 23:06:58,414 INFO org.apache.flink.runtime.jobmaster.JobMaster
[] - Close ResourceManager connection
700a4a8b49d5526ccb1f95a669584293: Stopping JobMaster for job
'insert-into_default_catalog.default_database.flinkcdccopy'
(9f706b9e244aaeeb12c953662f39e7d1).
2022-12-06 23:06:58,416 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,416 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:58,418 INFO
org.apache.flink.runtime.leaderelection.DefaultLeaderElectionService [] -
Stopping DefaultLeaderElectionService.
2022-12-06 23:06:58,630 INFO org.apache.flink.runtime.history.FsJobArchivist
[] - Job 9f706b9e244aaeeb12c953662f39e7d1 has been archived at
hdfs:/flink/completed-jobs/9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:58,689 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job
9f706b9e244aaeeb12c953662f39e7d1 has been registered for cleanup in the
JobResultStore after reaching a terminal state.
2022-12-06 23:06:58,694 INFO
org.apache.flink.runtime.highavailability.zookeeper.ZooKeeperMultipleComponentLeaderElectionHaServices
[] - Clean up the high availability data for job
9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:58,700 INFO
org.apache.flink.runtime.highavailability.zookeeper.ZooKeeperMultipleComponentLeaderElectionHaServices
[] - Finished cleaning up the high availability data for job
9f706b9e244aaeeb12c953662f39e7d1.
2022-12-06 23:06:58,714 INFO
org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Removed job
graph 9f706b9e244aaeeb12c953662f39e7d1 from
ZooKeeperStateHandleStore{namespace='flink/default/jobgraphs'}.
2022-12-06 23:06:58,733 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Stopped
dispatcher akka://flink/user/rpc/dispatcher_2.
2022-12-06 23:06:58,734 INFO
org.apache.flink.runtime.jobmanager.DefaultJobGraphStore [] - Stopping
DefaultJobGraphStore.
2022-12-06 23:06:58,742 INFO
org.apache.flink.runtime.jobmanager.ZooKeeperJobGraphStoreWatcher [] - Stopping
ZooKeeperJobGraphStoreWatcher
2022-12-06 23:06:58,742 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,742 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/resource_manager/connection_info'}.
2022-12-06 23:06:58,743 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,743 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/dispatcher/connection_info'}.
2022-12-06 23:06:58,743 INFO
org.apache.flink.runtime.leaderretrieval.DefaultLeaderRetrievalService [] -
Stopping DefaultLeaderRetrievalService.
2022-12-06 23:06:58,744 INFO
org.apache.flink.runtime.leaderretrieval.ZooKeeperLeaderRetrievalDriver [] -
Closing
ZookeeperLeaderRetrievalDriver{connectionInformationPath='/rest_server/connection_info'}.
2022-12-06 23:06:58,745 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Stopping Akka RPC service.
2022-12-06 23:06:58,849 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Stopping Akka RPC service.
2022-12-06 23:06:58,850 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Stopped Akka RPC service.
2022-12-06 23:06:58,865 INFO org.apache.flink.runtime.blob.PermanentBlobCache
[] - Shutting down BLOB cache
2022-12-06 23:06:58,868 INFO org.apache.flink.runtime.blob.TransientBlobCache
[] - Shutting down BLOB cache
2022-12-06 23:06:58,871 INFO org.apache.flink.runtime.blob.BlobServer
[] - Stopped BLOB server at 0.0.0.0:38732
2022-12-06 23:06:58,871 INFO
org.apache.flink.runtime.highavailability.zookeeper.ZooKeeperMultipleComponentLeaderElectionHaServices
[] - Close and clean up all data for
ZooKeeperMultipleComponentLeaderElectionHaServices.
2022-12-06 23:06:58,905 INFO
org.apache.flink.runtime.leaderelection.DefaultMultipleComponentLeaderElectionService
[] - Closing DefaultMultipleComponentLeaderElectionService.
2022-12-06 23:06:58,905 INFO
org.apache.flink.runtime.leaderelection.ZooKeeperMultipleComponentLeaderElectionDriver
[] - Closing ZooKeeperMultipleComponentLeaderElectionDriver.
2022-12-06 23:06:58,908 INFO
org.apache.flink.shaded.curator5.org.apache.curator.framework.imps.CuratorFrameworkImpl
[] - backgroundOperationsLoop exiting
2022-12-06 23:06:59,015 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ZooKeeper [] - Session:
0x2005daed1826b0c closed
2022-12-06 23:06:59,015 INFO
org.apache.flink.shaded.zookeeper3.org.apache.zookeeper.ClientCnxn [] -
EventThread shut down for session: 0x2005daed1826b0c
2022-12-06 23:06:59,017 INFO
org.apache.flink.runtime.highavailability.zookeeper.ZooKeeperMultipleComponentLeaderElectionHaServices
[] - Finished cleaning up the high availability data.
2022-12-06 23:06:59,029 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
[] - Stopped Akka RPC service.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.org
