Alex Sorokoumov created FLINK-29850:
---------------------------------------
Summary: Flink Table Store quick start guide does not work
Key: FLINK-29850
URL: https://issues.apache.org/jira/browse/FLINK-29850
Project: Flink
Issue Type: Bug
Components: Table Store
Reporter: Alex Sorokoumov
Following instructions in
https://nightlies.apache.org/flink/flink-table-store-docs-master/docs/try-table-store/quick-start/
leads to empty results in {{word_count}} table.
Flink version 1.15.2, Flink Table Store version 0.2.1.
{noformat}
Flink SQL> show catalogs;
+-----------------+
| catalog name |
+-----------------+
| default_catalog |
+-----------------+
1 row in set
Flink SQL> CREATE CATALOG my_catalog WITH (
> 'type'='table-store',
> 'warehouse'='file:/tmp/table_store'
> );
>
[INFO] Execute statement succeed.
Flink SQL> USE CATALOG my_catalog;
> USE CATALOG my_catalog;
>
Flink SQL> USE CATALOG my_catalog;
>
[INFO] Execute statement succeed.
Flink SQL> CREATE TABLE word_count (
> word STRING PRIMARY KEY NOT ENFORCED,
> cnt BIGINT
> );
>
[INFO] Execute statement succeed.
Flink SQL> CREATE TEMPORARY TABLE word_table (
> word STRING
> ) WITH (
> 'connector' = 'datagen',
> 'fields.word.length' = '1'
> );
[INFO] Execute statement succeed.
Flink SQL> SET 'execution.checkpointing.interval' = '10 s';
>
[INFO] Session property has been set.
Flink SQL> INSERT INTO word_count SELECT word, COUNT(*) FROM word_table GROUP
BY word;
>
[INFO] Submitting SQL update statement to the cluster...
[INFO] SQL update statement has been successfully submitted to the cluster:
Job ID: 0c5f22c2ab3e83e1a1f9274818ff675b
Flink SQL> SET 'sql-client.execution.result-mode' = 'tableau';
>
[INFO] Session property has been set.
Flink SQL> RESET 'execution.checkpointing.interval';
>
[INFO] Session property has been reset.
Flink SQL> SET 'execution.runtime-mode' = 'batch';
>
[INFO] Session property has been set.
Flink SQL> SELECT * FROM word_count;
>
Empty set
{noformat}
Flink logs:
{noformat}
flink | Starting standalonesession as a console application on host
flink.
broker | [2022-11-02 14:07:17,045] INFO [Controller id=1] Processing
automatic preferred replica leader election (kafka.controller.KafkaController)
broker | [2022-11-02 14:07:17,046] TRACE [Controller id=1] Checking
need to trigger auto leader balancing (kafka.controller.KafkaController)
broker | [2022-11-02 14:07:17,050] DEBUG [Controller id=1] Topics not
in preferred replica for broker 1 Map() (kafka.controller.KafkaController)
broker | [2022-11-02 14:07:17,051] TRACE [Controller id=1] Leader
imbalance ratio for broker 1 is 0.0 (kafka.controller.KafkaController)
flink | 2022-11-02 14:07:17,745 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
flink | 2022-11-02 14:07:17,752 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
Preconfiguration:
flink | 2022-11-02 14:07:17,753 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
flink |
flink |
flink | RESOURCE_PARAMS extraction logs:
flink | jvm_params: -Xmx1073741824 -Xms1073741824
-XX:MaxMetaspaceSize=268435456
flink | dynamic_configs: -D jobmanager.memory.off-heap.size=134217728b
-D jobmanager.memory.jvm-overhead.min=201326592b -D
jobmanager.memory.jvm-metaspace.size=268435456b -D
jobmanager.memory.heap.size=1073741824b -D
jobmanager.memory.jvm-overhead.max=201326592b
flink | logs: INFO [] - Loading configuration property:
jobmanager.rpc.address, flink
flink | INFO [] - Loading configuration property:
jobmanager.rpc.port, 6123
flink | INFO [] - Loading configuration property:
jobmanager.bind-host, 0.0.0.0
flink | INFO [] - Loading configuration property:
jobmanager.memory.process.size, 1600m
flink | INFO [] - Loading configuration property:
taskmanager.bind-host, 0.0.0.0
flink | INFO [] - Loading configuration property:
taskmanager.memory.process.size, 1728m
flink | INFO [] - Loading configuration property:
taskmanager.numberOfTaskSlots, 1
flink | INFO [] - Loading configuration property:
parallelism.default, 1
flink | INFO [] - Loading configuration property:
jobmanager.execution.failover-strategy, region
flink | INFO [] - Loading configuration property: rest.address,
0.0.0.0
flink | INFO [] - Loading configuration property: rest.bind-address,
0.0.0.0
flink | INFO [] - Loading configuration property: blob.server.port,
6124
flink | INFO [] - Loading configuration property: query.server.port,
6125
flink | INFO [] - The derived from fraction jvm overhead memory
(160.000mb (167772162 bytes)) is less than its min value 192.000mb (201326592
bytes), min value will be used instead
flink | INFO [] - Final Master Memory configuration:
flink | INFO [] - Total Process Memory: 1.563gb (1677721600 bytes)
flink | INFO [] - Total Flink Memory: 1.125gb (1207959552 bytes)
flink | INFO [] - JVM Heap: 1024.000mb (1073741824
bytes)
flink | INFO [] - Off-heap: 128.000mb (134217728 bytes)
flink | INFO [] - JVM Metaspace: 256.000mb (268435456 bytes)
flink | INFO [] - JVM Overhead: 192.000mb (201326592 bytes)
flink |
flink | 2022-11-02 14:07:17,753 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
flink | 2022-11-02 14:07:17,754 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
StandaloneSessionClusterEntrypoint (Version: 1.15.2, Scala: 2.12, Rev:69e8126,
Date:2022-08-17T14:58:06+02:00)
flink | 2022-11-02 14:07:17,754 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current
user: flink
flink | 2022-11-02 14:07:18,137 WARN
org.apache.hadoop.util.NativeCodeLoader [] - Unable to
load native-hadoop library for your platform... using builtin-java classes
where applicable
flink | 2022-11-02 14:07:18,225 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current
Hadoop/Kerberos user: flink
flink | 2022-11-02 14:07:18,226 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK
64-Bit Server VM - Temurin - 1.8/25.345-b01
flink | 2022-11-02 14:07:18,226 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Arch: amd64
flink | 2022-11-02 14:07:18,226 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap
size: 981 MiBytes
flink | 2022-11-02 14:07:18,227 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME:
/opt/java/openjdk
flink | 2022-11-02 14:07:18,230 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop
version: 2.8.3
flink | 2022-11-02 14:07:18,230 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
flink | 2022-11-02 14:07:18,230 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xmx1073741824
flink | 2022-11-02 14:07:18,231 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Xms1073741824
flink | 2022-11-02 14:07:18,231 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-XX:MaxMetaspaceSize=268435456
flink | 2022-11-02 14:07:18,231 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog.file=/opt/flink/log/flink--standalonesession-0-flink.log
flink | 2022-11-02 14:07:18,232 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
flink | 2022-11-02 14:07:18,232 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
flink | 2022-11-02 14:07:18,232 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
-Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
flink | 2022-11-02 14:07:18,233 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program
Arguments:
flink | 2022-11-02 14:07:18,234 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--configDir
flink | 2022-11-02 14:07:18,234 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
/opt/flink/conf
flink | 2022-11-02 14:07:18,234 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--executionMode
flink | 2022-11-02 14:07:18,235 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - cluster
flink | 2022-11-02 14:07:18,235 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,235 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.off-heap.size=134217728b
flink | 2022-11-02 14:07:18,235 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,236 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.min=201326592b
flink | 2022-11-02 14:07:18,236 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,236 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-metaspace.size=268435456b
flink | 2022-11-02 14:07:18,236 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,237 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.heap.size=1073741824b
flink | 2022-11-02 14:07:18,237 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
flink | 2022-11-02 14:07:18,237 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
jobmanager.memory.jvm-overhead.max=201326592b
flink | 2022-11-02 14:07:18,238 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath:
/opt/flink/lib/flink-cep-1.15.2.jar:/opt/flink/lib/flink-connector-files-1.15.2.jar:/opt/flink/lib/flink-connector-kafka-1.15.2.jar:/opt/flink/lib/flink-csv-1.15.2.jar:/opt/flink/lib/flink-faker-0.5.0.jar:/opt/flink/lib/flink-json-1.15.2.jar:/opt/flink/lib/flink-scala_2.12-1.15.2.jar:/opt/flink/lib/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar:/opt/flink/lib/flink-shaded-zookeeper-3.5.9.jar:/opt/flink/lib/flink-table-api-java-uber-1.15.2.jar:/opt/flink/lib/flink-table-planner-loader-1.15.2.jar:/opt/flink/lib/flink-table-runtime-1.15.2.jar:/opt/flink/lib/flink-table-store-dist-0.2.1.jar:/opt/flink/lib/kafka-clients-3.3.1.jar:/opt/flink/lib/log4j-1.2-api-2.17.1.jar:/opt/flink/lib/log4j-api-2.17.1.jar:/opt/flink/lib/log4j-core-2.17.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.17.1.jar:/opt/flink/lib/flink-dist-1.15.2.jar:::
flink | 2022-11-02 14:07:18,238 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
--------------------------------------------------------------------------------
flink | 2022-11-02 14:07:18,240 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered
UNIX signal handlers for [TERM, HUP, INT]
flink | 2022-11-02 14:07:18,259 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.address, flink
flink | 2022-11-02 14:07:18,259 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.rpc.port, 6123
flink | 2022-11-02 14:07:18,260 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.bind-host, 0.0.0.0
flink | 2022-11-02 14:07:18,260 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.memory.process.size, 1600m
flink | 2022-11-02 14:07:18,260 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.bind-host, 0.0.0.0
flink | 2022-11-02 14:07:18,261 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.memory.process.size, 1728m
flink | 2022-11-02 14:07:18,261 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: taskmanager.numberOfTaskSlots, 1
flink | 2022-11-02 14:07:18,262 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: parallelism.default, 1
flink | 2022-11-02 14:07:18,262 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: jobmanager.execution.failover-strategy, region
flink | 2022-11-02 14:07:18,263 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.address, 0.0.0.0
flink | 2022-11-02 14:07:18,263 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: rest.bind-address, 0.0.0.0
flink | 2022-11-02 14:07:18,264 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: blob.server.port, 6124
flink | 2022-11-02 14:07:18,264 INFO
org.apache.flink.configuration.GlobalConfiguration [] - Loading
configuration property: query.server.port, 6125
flink | 2022-11-02 14:07:18,314 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting
StandaloneSessionClusterEntrypoint.
flink | 2022-11-02 14:07:18,371 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
default filesystem.
flink | 2022-11-02 14:07:18,442 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install
security context.
flink | 2022-11-02 14:07:18,460 WARN
org.apache.flink.runtime.util.HadoopUtils [] - Could not
find Hadoop configuration via any of the supported methods (Flink
configuration, environment variables).
flink | 2022-11-02 14:07:18,490 INFO
org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user
set to flink (auth:SIMPLE)
flink | 2022-11-02 14:07:18,497 INFO
org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file
will be created as /tmp/jaas-5958803181883791922.conf.
flink | 2022-11-02 14:07:18,511 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing
cluster services.
flink | 2022-11-02 14:07:18,522 INFO
org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Using working
directory: WorkingDirectory(/tmp/jm_3fa14cf24c77ac8d356de9bc3b5b07ae).
flink | 2022-11-02 14:07:18,890 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address flink:6123, bind address 0.0.0.0:6123.
taskmanager_2 | 2022-11-02 14:07:18,937 WARN
org.apache.flink.runtime.net.ConnectionUtils [] - Could not
connect to flink/172.23.0.4:6123. Selecting a local address using heuristics.
taskmanager_2 | 2022-11-02 14:07:18,938 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - TaskManager
will use hostname/address '48d9697ca669' (172.23.0.5) for communication.
taskmanager_2 | 2022-11-02 14:07:19,015 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address 172.23.0.5:0, bind address 0.0.0.0:0.
taskmanager_1 | 2022-11-02 14:07:19,036 WARN
org.apache.flink.runtime.net.ConnectionUtils [] - Could not
connect to flink/172.23.0.4:6123. Selecting a local address using heuristics.
taskmanager_1 | 2022-11-02 14:07:19,036 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - TaskManager
will use hostname/address '583c1c3a0ea1' (172.23.0.6) for communication.
taskmanager_1 | 2022-11-02 14:07:19,107 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address 172.23.0.6:0, bind address 0.0.0.0:0.
taskmanager_2 | 2022-11-02 14:07:19,634 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
taskmanager_2 | 2022-11-02 14:07:19,680 INFO
akka.remote.RemoteActorRefProvider [] - Akka Cluster
not in use - enabling unsafe features anyway because
`akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_2 | 2022-11-02 14:07:19,681 INFO akka.remote.Remoting
[] - Starting remoting
taskmanager_1 | 2022-11-02 14:07:19,762 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
flink | 2022-11-02 14:07:19,769 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
taskmanager_1 | 2022-11-02 14:07:19,803 INFO
akka.remote.RemoteActorRefProvider [] - Akka Cluster
not in use - enabling unsafe features anyway because
`akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_1 | 2022-11-02 14:07:19,804 INFO akka.remote.Remoting
[] - Starting remoting
flink | 2022-11-02 14:07:19,813 INFO
akka.remote.RemoteActorRefProvider [] - Akka Cluster
not in use - enabling unsafe features anyway because
`akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
flink | 2022-11-02 14:07:19,814 INFO akka.remote.Remoting
[] - Starting remoting
taskmanager_2 | 2022-11-02 14:07:19,917 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink@172.23.0.5:42023]
taskmanager_1 | 2022-11-02 14:07:20,064 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink@172.23.0.6:42189]
flink | 2022-11-02 14:07:20,065 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink@flink:6123]
taskmanager_2 | 2022-11-02 14:07:20,187 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink@172.23.0.5:42023
taskmanager_2 | 2022-11-02 14:07:20,216 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Using working
directory: WorkingDirectory(/tmp/tm_172.23.0.5:42023-f6c8bb)
taskmanager_2 | 2022-11-02 14:07:20,229 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics
reporter configured, no metrics will be exposed/reported.
taskmanager_2 | 2022-11-02 14:07:20,235 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address 172.23.0.5:0, bind address 0.0.0.0:0.
taskmanager_2 | 2022-11-02 14:07:20,263 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
taskmanager_2 | 2022-11-02 14:07:20,267 INFO
akka.remote.RemoteActorRefProvider [] - Akka Cluster
not in use - enabling unsafe features anyway because
`akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_2 | 2022-11-02 14:07:20,268 INFO akka.remote.Remoting
[] - Starting remoting
taskmanager_2 | 2022-11-02 14:07:20,290 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink-metrics@172.23.0.5:34613]
taskmanager_2 | 2022-11-02 14:07:20,319 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink-metrics@172.23.0.5:34613
flink | 2022-11-02 14:07:20,320 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink@flink:6123
taskmanager_2 | 2022-11-02 14:07:20,347 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService_172.23.0.5:42023-f6c8bb .
taskmanager_1 | 2022-11-02 14:07:20,356 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink@172.23.0.6:42189
taskmanager_2 | 2022-11-02 14:07:20,367 INFO
org.apache.flink.runtime.blob.PermanentBlobCache [] - Created BLOB
cache storage directory /tmp/tm_172.23.0.5:42023-f6c8bb/blobStorage
flink | 2022-11-02 14:07:20,380 INFO
org.apache.flink.runtime.blob.BlobServer [] - Created BLOB
server storage directory /tmp/jm_3fa14cf24c77ac8d356de9bc3b5b07ae/blobStorage
taskmanager_2 | 2022-11-02 14:07:20,379 INFO
org.apache.flink.runtime.blob.TransientBlobCache [] - Created BLOB
cache storage directory /tmp/tm_172.23.0.5:42023-f6c8bb/blobStorage
flink | 2022-11-02 14:07:20,386 INFO
org.apache.flink.runtime.blob.BlobServer [] - Started BLOB
server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000
taskmanager_1 | 2022-11-02 14:07:20,389 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Using working
directory: WorkingDirectory(/tmp/tm_172.23.0.6:42189-46dab1)
taskmanager_2 | 2022-11-02 14:07:20,391 INFO
org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled
external resources: []
taskmanager_2 | 2022-11-02 14:07:20,392 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Starting
TaskManager with ResourceID: 172.23.0.5:42023-f6c8bb
taskmanager_1 | 2022-11-02 14:07:20,405 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics
reporter configured, no metrics will be exposed/reported.
flink | 2022-11-02 14:07:20,410 INFO
org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics
reporter configured, no metrics will be exposed/reported.
taskmanager_1 | 2022-11-02 14:07:20,410 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address 172.23.0.6:0, bind address 0.0.0.0:0.
flink | 2022-11-02 14:07:20,417 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to
start actor system, external address flink:0, bind address 0.0.0.0:0.
taskmanager_2 | 2022-11-02 14:07:20,427 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerServices [] - Temporary
file directory '/tmp': total 298 GB, usable 197 GB (66.11% usable)
taskmanager_2 | 2022-11-02 14:07:20,438 INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager [] - Created a new
FileChannelManager for spilling of task related data to disk (joins, sorting,
...). Used directories:
taskmanager_2 | /tmp/flink-io-a33a42a4-12bd-4241-ad32-a69da961dcd7
taskmanager_1 | 2022-11-02 14:07:20,454 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
taskmanager_2 | 2022-11-02 14:07:20,458 INFO
org.apache.flink.runtime.io.network.netty.NettyConfig [] - NettyConfig
[server address: /0.0.0.0, server port: 0, ssl enabled: false, memory segment
size (bytes): 32768, transport type: AUTO, number of server threads: 1
(manual), number of client threads: 1 (manual), server connect backlog: 0 (use
Netty's default), client connect timeout (sec): 120, send/receive buffer size
(bytes): 0 (use Netty's default)]
taskmanager_1 | 2022-11-02 14:07:20,461 INFO
akka.remote.RemoteActorRefProvider [] - Akka Cluster
not in use - enabling unsafe features anyway because
`akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
taskmanager_1 | 2022-11-02 14:07:20,462 INFO akka.remote.Remoting
[] - Starting remoting
flink | 2022-11-02 14:07:20,466 INFO akka.event.slf4j.Slf4jLogger
[] - Slf4jLogger started
flink | 2022-11-02 14:07:20,479 INFO
akka.remote.RemoteActorRefProvider [] - Akka Cluster
not in use - enabling unsafe features anyway because
`akka.remote.use-unsafe-remote-features-outside-cluster` has been enabled.
flink | 2022-11-02 14:07:20,480 INFO akka.remote.Remoting
[] - Starting remoting
taskmanager_1 | 2022-11-02 14:07:20,510 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink-metrics@172.23.0.6:36747]
flink | 2022-11-02 14:07:20,522 INFO akka.remote.Remoting
[] - Remoting started; listening on addresses
:[akka.tcp://flink-metrics@flink:37609]
taskmanager_1 | 2022-11-02 14:07:20,522 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink-metrics@172.23.0.6:36747
flink | 2022-11-02 14:07:20,543 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system
started at akka.tcp://flink-metrics@flink:37609
taskmanager_1 | 2022-11-02 14:07:20,562 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService_172.23.0.6:42189-46dab1 .
flink | 2022-11-02 14:07:20,580 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at
akka://flink-metrics/user/rpc/MetricQueryService .
taskmanager_1 | 2022-11-02 14:07:20,582 INFO
org.apache.flink.runtime.blob.PermanentBlobCache [] - Created BLOB
cache storage directory /tmp/tm_172.23.0.6:42189-46dab1/blobStorage
taskmanager_2 | 2022-11-02 14:07:20,587 INFO
org.apache.flink.runtime.io.network.NettyShuffleServiceFactory [] - Created a
new FileChannelManager for storing result partitions of BLOCKING shuffles. Used
directories:
taskmanager_2 |
/tmp/flink-netty-shuffle-c3d2b336-07e9-4ccf-8667-0da2c0e75c9b
taskmanager_1 | 2022-11-02 14:07:20,592 INFO
org.apache.flink.runtime.blob.TransientBlobCache [] - Created BLOB
cache storage directory /tmp/tm_172.23.0.6:42189-46dab1/blobStorage
taskmanager_1 | 2022-11-02 14:07:20,610 INFO
org.apache.flink.runtime.externalresource.ExternalResourceUtils [] - Enabled
external resources: []
taskmanager_1 | 2022-11-02 14:07:20,611 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerRunner [] - Starting
TaskManager with ResourceID: 172.23.0.6:42189-46dab1
flink | 2022-11-02 14:07:20,631 INFO
org.apache.flink.runtime.dispatcher.FileExecutionGraphInfoStore [] -
Initializing FileExecutionGraphInfoStore: Storage directory
/tmp/executionGraphStore-35629f69-cfa4-4988-b484-fbef12d681d8, expiration time
3600000, maximum cache size 52428800 bytes.
taskmanager_1 | 2022-11-02 14:07:20,648 INFO
org.apache.flink.runtime.taskexecutor.TaskManagerServices [] - Temporary
file directory '/tmp': total 298 GB, usable 197 GB (66.11% usable)
taskmanager_1 | 2022-11-02 14:07:20,657 INFO
org.apache.flink.runtime.io.disk.iomanager.IOManager [] - Created a new
FileChannelManager for spilling of task related data to disk (joins, sorting,
...). Used directories:
taskmanager_1 | /tmp/flink-io-ad0d6004-a678-46b8-a875-27409a4613b7
taskmanager_1 | 2022-11-02 14:07:20,673 INFO
org.apache.flink.runtime.io.network.netty.NettyConfig [] - NettyConfig
[server address: /0.0.0.0, server port: 0, ssl enabled: false, memory segment
size (bytes): 32768, transport type: AUTO, number of server threads: 1
(manual), number of client threads: 1 (manual), server connect backlog: 0 (use
Netty's default), client connect timeout (sec): 120, send/receive buffer size
(bytes): 0 (use Netty's default)]
taskmanager_2 | 2022-11-02 14:07:20,673 INFO
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 128
MB for network buffer pool (number of memory segments: 4096, bytes per segment:
32768).
taskmanager_2 | 2022-11-02 14:07:20,705 INFO
org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Starting the
network environment and its components.
flink | 2022-11-02 14:07:20,737 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Upload
directory /tmp/flink-web-348451b6-b4b5-4332-a8eb-4195cf0f370a/flink-web-upload
does not exist.
flink | 2022-11-02 14:07:20,739 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Created
directory /tmp/flink-web-348451b6-b4b5-4332-a8eb-4195cf0f370a/flink-web-upload
for file uploads.
flink | 2022-11-02 14:07:20,743 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Starting rest
endpoint.
taskmanager_1 | 2022-11-02 14:07:20,781 INFO
org.apache.flink.runtime.io.network.NettyShuffleServiceFactory [] - Created a
new FileChannelManager for storing result partitions of BLOCKING shuffles. Used
directories:
taskmanager_1 |
/tmp/flink-netty-shuffle-cecc60b4-f0e0-448a-b024-1be6fc330a49
taskmanager_2 | 2022-11-02 14:07:20,820 INFO
org.apache.flink.runtime.io.network.netty.NettyClient [] - Transport
type 'auto': using EPOLL.
taskmanager_2 | 2022-11-02 14:07:20,823 INFO
org.apache.flink.runtime.io.network.netty.NettyClient [] - Successful
initialization (took 117 ms).
taskmanager_2 | 2022-11-02 14:07:20,832 INFO
org.apache.flink.runtime.io.network.netty.NettyServer [] - Transport
type 'auto': using EPOLL.
taskmanager_1 | 2022-11-02 14:07:20,859 INFO
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool [] - Allocated 128
MB for network buffer pool (number of memory segments: 4096, bytes per segment:
32768).
taskmanager_1 | 2022-11-02 14:07:20,887 INFO
org.apache.flink.runtime.io.network.NettyShuffleEnvironment [] - Starting the
network environment and its components.
taskmanager_2 | 2022-11-02 14:07:20,895 INFO
org.apache.flink.runtime.io.network.netty.NettyServer [] - Successful
initialization (took 68 ms). Listening on SocketAddress /0.0.0.0:37525.
taskmanager_2 | 2022-11-02 14:07:20,898 INFO
org.apache.flink.runtime.taskexecutor.KvStateService [] - Starting the
kvState service and its components.
taskmanager_2 | 2022-11-02 14:07:20,949 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at
akka://flink/user/rpc/taskmanager_0 .
taskmanager_2 | 2022-11-02 14:07:21,000 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job
leader service.
taskmanager_2 | 2022-11-02 14:07:21,004 INFO
org.apache.flink.runtime.filecache.FileCache [] - User file
cache uses directory /tmp/flink-dist-cache-15ff4df8-b6f5-4356-959e-73a7d8e09c0c
taskmanager_2 | 2022-11-02 14:07:21,011 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to
ResourceManager
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000).
taskmanager_1 | 2022-11-02 14:07:21,036 INFO
org.apache.flink.runtime.io.network.netty.NettyClient [] - Transport
type 'auto': using EPOLL.
taskmanager_1 | 2022-11-02 14:07:21,042 INFO
org.apache.flink.runtime.io.network.netty.NettyClient [] - Successful
initialization (took 154 ms).
taskmanager_1 | 2022-11-02 14:07:21,053 INFO
org.apache.flink.runtime.io.network.netty.NettyServer [] - Transport
type 'auto': using EPOLL.
taskmanager_1 | 2022-11-02 14:07:21,133 INFO
org.apache.flink.runtime.io.network.netty.NettyServer [] - Successful
initialization (took 86 ms). Listening on SocketAddress /0.0.0.0:35461.
taskmanager_1 | 2022-11-02 14:07:21,136 INFO
org.apache.flink.runtime.taskexecutor.KvStateService [] - Starting the
kvState service and its components.
taskmanager_1 | 2022-11-02 14:07:21,203 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at
akka://flink/user/rpc/taskmanager_0 .
taskmanager_1 | 2022-11-02 14:07:21,243 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job
leader service.
taskmanager_1 | 2022-11-02 14:07:21,245 INFO
org.apache.flink.runtime.filecache.FileCache [] - User file
cache uses directory /tmp/flink-dist-cache-cbe37ac6-95c7-4ea1-b41c-c0be94c0a181
taskmanager_1 | 2022-11-02 14:07:21,254 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to
ResourceManager
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000).
flink | 2022-11-02 14:07:21,282 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component log file:
/opt/flink/log/flink--standalonesession-0-flink.log
flink | 2022-11-02 14:07:21,282 INFO
org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined
location of main cluster component stdout file:
/opt/flink/log/flink--standalonesession-0-flink.out
taskmanager_2 | 2022-11-02 14:07:21,381 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not
resolve ResourceManager address
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*, retrying in 10000 ms:
Could not connect to rpc endpoint under address
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*.
taskmanager_1 | 2022-11-02 14:07:21,467 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Could not
resolve ResourceManager address
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*, retrying in 10000 ms:
Could not connect to rpc endpoint under address
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*.
flink | 2022-11-02 14:07:21,521 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Rest endpoint
listening at 0.0.0.0:8081
flink | 2022-11-02 14:07:21,523 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] -
http://0.0.0.0:8081 was granted leadership with
leaderSessionID=00000000-0000-0000-0000-000000000000
flink | 2022-11-02 14:07:21,524 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Web frontend
listening at http://0.0.0.0:8081.
flink | 2022-11-02 14:07:21,556 INFO
org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] -
DefaultDispatcherRunner was granted leadership with leader id
00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess.
flink | 2022-11-02 14:07:21,565 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Start SessionDispatcherLeaderProcess.
flink | 2022-11-02 14:07:21,569 INFO
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] -
Starting resource manager service.
flink | 2022-11-02 14:07:21,571 INFO
org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] -
Resource manager service is granted leadership with session id
00000000-0000-0000-0000-000000000000.
flink | 2022-11-02 14:07:21,576 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Recover all persisted job graphs that are not finished, yet.
flink | 2022-11-02 14:07:21,576 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] -
Successfully recovered 0 persisted job graphs.
flink | 2022-11-02 14:07:21,600 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager
at akka://flink/user/rpc/resourcemanager_0 .
flink | 2022-11-02 14:07:21,602 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at
akka://flink/user/rpc/dispatcher_1 .
flink | 2022-11-02 14:07:21,633 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Starting the resource manager.
taskmanager_2 | 2022-11-02 14:07:31,422 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Resolved
ResourceManager address, beginning registration
taskmanager_1 | 2022-11-02 14:07:31,494 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Resolved
ResourceManager address, beginning registration
flink | 2022-11-02 14:07:31,522 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering TaskManager with ResourceID 172.23.0.5:42023-f6c8bb
(akka.tcp://flink@172.23.0.5:42023/user/rpc/taskmanager_0) at ResourceManager
taskmanager_2 | 2022-11-02 14:07:31,548 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Successful
registration at resource manager
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_* under registration id
7f8dcb16a15971a1ad69c555269560f9.
flink | 2022-11-02 14:07:31,553 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering TaskManager with ResourceID 172.23.0.6:42189-46dab1
(akka.tcp://flink@172.23.0.6:42189/user/rpc/taskmanager_0) at ResourceManager
taskmanager_1 | 2022-11-02 14:07:31,566 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Successful
registration at resource manager
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_* under registration id
304fd4e226851d53127be09eebd39228.
flink | 2022-11-02 14:09:41,130 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received
JobGraph submission 'insert-into_my_catalog.default.word_count'
(0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,131 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting
job 'insert-into_my_catalog.default.word_count'
(0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,182 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.jobmaster.JobMaster at
akka://flink/user/rpc/jobmanager_2 .
flink | 2022-11-02 14:09:41,198 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing
job 'insert-into_my_catalog.default.word_count'
(0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,251 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart
back off time strategy
FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=2147483647,
backoffTimeMS=1000) for insert-into_my_catalog.default.word_count
(0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,319 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Running
initialization on master for job insert-into_my_catalog.default.word_count
(0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,319 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully
ran initialization on master in 0 ms.
flink | 2022-11-02 14:09:41,366 INFO
org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built
1 new pipelined regions in 2 ms, total 1 pipelined regions currently.
flink | 2022-11-02 14:09:41,380 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - No state
backend has been configured, using default (HashMap)
org.apache.flink.runtime.state.hashmap.HashMapStateBackend@66e2f2aa
flink | 2022-11-02 14:09:41,380 INFO
org.apache.flink.runtime.state.StateBackendLoader [] - State backend
loader loads the state backend as HashMapStateBackend
flink | 2022-11-02 14:09:41,382 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Checkpoint
storage is set to 'jobmanager'
flink | 2022-11-02 14:09:41,435 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint
found during restore.
flink | 2022-11-02 14:09:41,453 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Using
failover strategy
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@7366e212
for insert-into_my_catalog.default.word_count
(0c5f22c2ab3e83e1a1f9274818ff675b).
flink | 2022-11-02 14:09:41,472 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Starting
execution of job 'insert-into_my_catalog.default.word_count'
(0c5f22c2ab3e83e1a1f9274818ff675b) under job master id
00000000000000000000000000000000.
flink | 2022-11-02 14:09:41,477 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Starting
scheduling with scheduling strategy
[org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
flink | 2022-11-02 14:09:41,477 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job
insert-into_my_catalog.default.word_count (0c5f22c2ab3e83e1a1f9274818ff675b)
switched from state CREATED to RUNNING.
flink | 2022-11-02 14:09:41,488 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from CREATED to
SCHEDULED.
flink | 2022-11-02 14:09:41,489 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] -
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)
(e234b4060f0956d22ad81cf7edf1197d) switched from CREATED to SCHEDULED.
flink | 2022-11-02 14:09:41,489 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer ->
Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched
from CREATED to SCHEDULED.
flink | 2022-11-02 14:09:41,516 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to
ResourceManager
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
flink | 2022-11-02 14:09:41,521 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved
ResourceManager address, beginning registration
flink | 2022-11-02 14:09:41,523 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering job manager
00000000000000000000000000000...@akka.tcp://flink@flink:6123/user/rpc/jobmanager_2
for job 0c5f22c2ab3e83e1a1f9274818ff675b.
flink | 2022-11-02 14:09:41,527 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registered job manager
00000000000000000000000000000...@akka.tcp://flink@flink:6123/user/rpc/jobmanager_2
for job 0c5f22c2ab3e83e1a1f9274818ff675b.
flink | 2022-11-02 14:09:41,531 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager
successfully registered at ResourceManager, leader id:
00000000000000000000000000000000.
flink | 2022-11-02 14:09:41,533 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Received resource requirements from job 0c5f22c2ab3e83e1a1f9274818ff675b:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=1}]
taskmanager_2 | 2022-11-02 14:09:41,544 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Receive slot
request 2a3be1da0a0a5737027c89101aa867e6 for job
0c5f22c2ab3e83e1a1f9274818ff675b from resource manager with leader id
00000000000000000000000000000000.
taskmanager_2 | 2022-11-02 14:09:41,551 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Allocated
slot for 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,553 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job
0c5f22c2ab3e83e1a1f9274818ff675b for job leader monitoring.
taskmanager_2 | 2022-11-02 14:09:41,555 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to
register at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_2 with
leader id 00000000-0000-0000-0000-000000000000.
taskmanager_2 | 2022-11-02 14:09:41,575 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved
JobManager address, beginning registration
taskmanager_2 | 2022-11-02 14:09:41,598 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful
registration at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_2
for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:41,599 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Establish
JobManager connection for job 0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:41,604 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Offer
reserved slots to the leader of job 0c5f22c2ab3e83e1a1f9274818ff675b.
flink | 2022-11-02 14:09:41,623 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from SCHEDULED
to DEPLOYING.
flink | 2022-11-02 14:09:41,624 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Source: word_table[1] (1/1) (attempt #0) with attempt id
7a150a66716e80d16e4f4d21450a843e and vertex id
bc764cd8ddf7a0cff126f51c16239658_0 to 172.23.0.5:42023-f6c8bb @
flink-sandbox_taskmanager_2.flink-sandbox_default (dataPort=37525) with
allocation id 2a3be1da0a0a5737027c89101aa867e6
flink | 2022-11-02 14:09:41,631 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] -
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)
(e234b4060f0956d22ad81cf7edf1197d) switched from SCHEDULED to DEPLOYING.
flink | 2022-11-02 14:09:41,631 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1) (attempt #0) with attempt id
e234b4060f0956d22ad81cf7edf1197d and vertex id
20ba6b65f97481d5570070de90e4e791_0 to 172.23.0.5:42023-f6c8bb @
flink-sandbox_taskmanager_2.flink-sandbox_default (dataPort=37525) with
allocation id 2a3be1da0a0a5737027c89101aa867e6
flink | 2022-11-02 14:09:41,639 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer ->
Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched
from SCHEDULED to DEPLOYING.
flink | 2022-11-02 14:09:41,640 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Writer -> Global Committer -> Sink: end (1/1) (attempt #0) with attempt id
d1372739faeaa4f7c2d5dc3157c38091 and vertex id
b5c8d46f3e7b141acf271f12622e752b_0 to 172.23.0.5:42023-f6c8bb @
flink-sandbox_taskmanager_2.flink-sandbox_default (dataPort=37525) with
allocation id 2a3be1da0a0a5737027c89101aa867e6
taskmanager_2 | 2022-11-02 14:09:41,657 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,679 INFO
org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] -
Creating a changelog storage with name 'memory'.
taskmanager_2 | 2022-11-02 14:09:41,708 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task
Source: word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e), deploy into
slot with allocation id 2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,709 INFO
org.apache.flink.runtime.taskmanager.Task [] - Source:
word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e) switched from CREATED
to DEPLOYING.
taskmanager_2 | 2022-11-02 14:09:41,712 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,716 INFO
org.apache.flink.runtime.taskmanager.Task [] - Loading JAR
files for task Source: word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e)
[DEPLOYING].
taskmanager_2 | 2022-11-02 14:09:41,721 INFO
org.apache.flink.runtime.blob.BlobClient [] - Downloading
0c5f22c2ab3e83e1a1f9274818ff675b/p-2fcfa81de948a930c635827bf3c1c2dd73a1cc34-73131fc0e3af0bde76e76fed81b34031
from flink/172.23.0.4:6124
taskmanager_2 | 2022-11-02 14:09:41,736 INFO
org.apache.flink.runtime.blob.BlobClient [] - Downloading
0c5f22c2ab3e83e1a1f9274818ff675b/p-35ffaba250050d7c3202364ee51d6170823060af-8c7ee9ac1cd70b6d02680461334f2e15
from flink/172.23.0.4:6124
taskmanager_2 | 2022-11-02 14:09:41,743 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0
(e234b4060f0956d22ad81cf7edf1197d), deploy into slot with allocation id
2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,743 INFO
org.apache.flink.runtime.taskmanager.Task [] -
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0
(e234b4060f0956d22ad81cf7edf1197d) switched from CREATED to DEPLOYING.
taskmanager_2 | 2022-11-02 14:09:41,744 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,745 INFO
org.apache.flink.runtime.taskmanager.Task [] - Loading JAR
files for task GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0
(e234b4060f0956d22ad81cf7edf1197d) [DEPLOYING].
taskmanager_2 | 2022-11-02 14:09:41,752 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task
Writer -> Global Committer -> Sink: end (1/1)#0
(d1372739faeaa4f7c2d5dc3157c38091), deploy into slot with allocation id
2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,753 INFO
org.apache.flink.runtime.taskmanager.Task [] - Writer ->
Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091)
switched from CREATED to DEPLOYING.
taskmanager_2 | 2022-11-02 14:09:41,755 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
2a3be1da0a0a5737027c89101aa867e6.
taskmanager_2 | 2022-11-02 14:09:41,754 INFO
org.apache.flink.runtime.taskmanager.Task [] - Loading JAR
files for task Writer -> Global Committer -> Sink: end (1/1)#0
(d1372739faeaa4f7c2d5dc3157c38091) [DEPLOYING].
taskmanager_2 | 2022-11-02 14:09:42,019 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - No state
backend has been configured, using default (HashMap)
org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4cd774ec
taskmanager_2 | 2022-11-02 14:09:42,019 INFO
org.apache.flink.runtime.state.StateBackendLoader [] - State backend
loader loads the state backend as HashMapStateBackend
taskmanager_2 | 2022-11-02 14:09:42,022 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Checkpoint
storage is set to 'jobmanager'
taskmanager_2 | 2022-11-02 14:09:42,039 INFO
org.apache.flink.runtime.taskmanager.Task [] - Writer ->
Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091)
switched from DEPLOYING to INITIALIZING.
taskmanager_2 | 2022-11-02 14:09:42,045 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - No state
backend has been configured, using default (HashMap)
org.apache.flink.runtime.state.hashmap.HashMapStateBackend@39a0f61
taskmanager_2 | 2022-11-02 14:09:42,046 INFO
org.apache.flink.runtime.state.StateBackendLoader [] - State backend
loader loads the state backend as HashMapStateBackend
taskmanager_2 | 2022-11-02 14:09:42,046 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Checkpoint
storage is set to 'jobmanager'
taskmanager_2 | 2022-11-02 14:09:42,048 INFO
org.apache.flink.runtime.taskmanager.Task [] - Source:
word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e) switched from
DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:09:42,048 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer ->
Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched
from DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:09:42,051 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from DEPLOYING
to INITIALIZING.
taskmanager_2 | 2022-11-02 14:09:42,191 INFO
org.apache.flink.runtime.taskmanager.Task [] - Source:
word_table[1] (1/1)#0 (7a150a66716e80d16e4f4d21450a843e) switched from
INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:42,194 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_table[1] (1/1) (7a150a66716e80d16e4f4d21450a843e) switched from
INITIALIZING to RUNNING.
taskmanager_2 | 2022-11-02 14:09:42,549 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - No state
backend has been configured, using default (HashMap)
org.apache.flink.runtime.state.hashmap.HashMapStateBackend@4c0769d9
taskmanager_2 | 2022-11-02 14:09:42,549 INFO
org.apache.flink.runtime.state.StateBackendLoader [] - State backend
loader loads the state backend as HashMapStateBackend
taskmanager_2 | 2022-11-02 14:09:42,549 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Checkpoint
storage is set to 'jobmanager'
taskmanager_2 | 2022-11-02 14:09:42,550 INFO
org.apache.flink.runtime.taskmanager.Task [] -
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0
(e234b4060f0956d22ad81cf7edf1197d) switched from DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:09:42,552 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] -
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)
(e234b4060f0956d22ad81cf7edf1197d) switched from DEPLOYING to INITIALIZING.
taskmanager_2 | 2022-11-02 14:09:42,587 INFO
org.apache.flink.runtime.state.heap.HeapKeyedStateBackendBuilder [] - Finished
to build heap keyed state-backend.
taskmanager_2 | 2022-11-02 14:09:42,601 INFO
org.apache.flink.runtime.state.heap.HeapKeyedStateBackend [] - Initializing
heap keyed state backend with stream factory.
taskmanager_2 | 2022-11-02 14:09:42,646 INFO
org.apache.flink.runtime.taskmanager.Task [] -
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)#0
(e234b4060f0956d22ad81cf7edf1197d) switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:42,649 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] -
GroupAggregate[3] -> ConstraintEnforcer[4] (1/1)
(e234b4060f0956d22ad81cf7edf1197d) switched from INITIALIZING to RUNNING.
taskmanager_2 | 2022-11-02 14:09:42,664 INFO
org.apache.flink.runtime.taskmanager.Task [] - Writer ->
Global Committer -> Sink: end (1/1)#0 (d1372739faeaa4f7c2d5dc3157c38091)
switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:42,668 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Writer ->
Global Committer -> Sink: end (1/1) (d1372739faeaa4f7c2d5dc3157c38091) switched
from INITIALIZING to RUNNING.
flink | 2022-11-02 14:09:44,421 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 1 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398184398 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:44,550 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.MemoryManagerImpl [] -
orc.rows.between.memory.checks=5000
taskmanager_2 | 2022-11-02 14:09:44,564 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got
brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:09:44,635 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 88bc8525-373e-4037-b4dd-c6dd5f58d73f with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:09:44,904 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 1 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=498 ms, finalizationTime=8 ms).
flink | 2022-11-02 14:09:54,398 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 2 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398194396 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:09:54,591 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 574446aa-36c2-49aa-a0d6-edc3b8b72c56 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:09:54,618 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 2 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=218 ms, finalizationTime=4 ms).
flink | 2022-11-02 14:10:04,362 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 3 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398204361 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:04,521 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: dac80290-db56-4ccb-8075-b3c75c11adea with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:04,546 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 3 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=184 ms, finalizationTime=1 ms).
flink | 2022-11-02 14:10:07,010 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received
JobGraph submission 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,010 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting
job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,013 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC
endpoint for org.apache.flink.runtime.jobmaster.JobMaster at
akka://flink/user/rpc/jobmanager_3 .
flink | 2022-11-02 14:10:07,015 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing
job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,018 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart
back off time strategy NoRestartBackoffTimeStrategy for collect
(b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,022 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Running
initialization on master for job collect (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,023 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully
ran initialization on master in 0 ms.
flink | 2022-11-02 14:10:07,096 INFO
org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built
1 new pipelined regions in 1 ms, total 1 pipelined regions currently.
flink | 2022-11-02 14:10:07,100 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Using
application-defined state backend:
org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionStateBackend@351187aa
flink | 2022-11-02 14:10:07,100 INFO
org.apache.flink.runtime.state.StateBackendLoader [] - State backend
loader loads the state backend as BatchExecutionStateBackend
flink | 2022-11-02 14:10:07,101 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Using
application defined checkpoint storage:
org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionCheckpointStorage@218b842e
flink | 2022-11-02 14:10:07,102 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint
found during restore.
flink | 2022-11-02 14:10:07,105 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Using
failover strategy
org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@34f4197c
for collect (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:07,105 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Starting
execution of job 'collect' (b99dc3a03951e172bab40bdc3867a11a) under job master
id 00000000000000000000000000000000.
flink | 2022-11-02 14:10:07,107 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting
split enumerator for source Source: word_count[5].
flink | 2022-11-02 14:10:07,565 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Starting
scheduling with scheduling strategy
[org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
flink | 2022-11-02 14:10:07,565 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect
(b99dc3a03951e172bab40bdc3867a11a) switched from state CREATED to RUNNING.
flink | 2022-11-02 14:10:07,566 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)
(2f57d5f86e90495f0103c37122559ca1) switched from CREATED to SCHEDULED.
flink | 2022-11-02 14:10:07,567 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to
ResourceManager
akka.tcp://flink@flink:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000)
flink | 2022-11-02 14:10:07,568 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved
ResourceManager address, beginning registration
flink | 2022-11-02 14:10:07,569 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registering job manager
00000000000000000000000000000...@akka.tcp://flink@flink:6123/user/rpc/jobmanager_3
for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:07,571 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Registered job manager
00000000000000000000000000000...@akka.tcp://flink@flink:6123/user/rpc/jobmanager_3
for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:07,572 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager
successfully registered at ResourceManager, leader id:
00000000000000000000000000000000.
flink | 2022-11-02 14:10:07,573 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Received resource requirements from job b99dc3a03951e172bab40bdc3867a11a:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=1}]
taskmanager_1 | 2022-11-02 14:10:07,579 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Receive slot
request 9eaf993bc7b1eb47e8cce2ce7ef851ce for job
b99dc3a03951e172bab40bdc3867a11a from resource manager with leader id
00000000000000000000000000000000.
taskmanager_1 | 2022-11-02 14:10:07,585 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Allocated
slot for 9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,587 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Add job
b99dc3a03951e172bab40bdc3867a11a for job leader monitoring.
taskmanager_1 | 2022-11-02 14:10:07,589 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Try to
register at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_3 with
leader id 00000000-0000-0000-0000-000000000000.
taskmanager_1 | 2022-11-02 14:10:07,608 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Resolved
JobManager address, beginning registration
taskmanager_1 | 2022-11-02 14:10:07,623 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Successful
registration at job manager akka.tcp://flink@flink:6123/user/rpc/jobmanager_3
for job b99dc3a03951e172bab40bdc3867a11a.
taskmanager_1 | 2022-11-02 14:10:07,624 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Establish
JobManager connection for job b99dc3a03951e172bab40bdc3867a11a.
taskmanager_1 | 2022-11-02 14:10:07,628 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Offer
reserved slots to the leader of job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:07,633 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)
(2f57d5f86e90495f0103c37122559ca1) switched from SCHEDULED to DEPLOYING.
flink | 2022-11-02 14:10:07,633 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying
Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink
(1/1) (attempt #0) with attempt id 2f57d5f86e90495f0103c37122559ca1 and vertex
id cbc357ccb763df2852fee8c4fc7d55f2_0 to 172.23.0.6:42189-46dab1 @
flink-sandbox_taskmanager_1.flink-sandbox_default (dataPort=35461) with
allocation id 9eaf993bc7b1eb47e8cce2ce7ef851ce
taskmanager_1 | 2022-11-02 14:10:07,642 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,661 INFO
org.apache.flink.runtime.state.changelog.StateChangelogStorageLoader [] -
Creating a changelog storage with name 'memory'.
taskmanager_1 | 2022-11-02 14:10:07,681 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Received task
Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink
(1/1)#0 (2f57d5f86e90495f0103c37122559ca1), deploy into slot with allocation id
9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,682 INFO
org.apache.flink.runtime.taskmanager.Task [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0
(2f57d5f86e90495f0103c37122559ca1) switched from CREATED to DEPLOYING.
taskmanager_1 | 2022-11-02 14:10:07,687 INFO
org.apache.flink.runtime.taskmanager.Task [] - Loading JAR
files for task Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect
table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1) [DEPLOYING].
taskmanager_1 | 2022-11-02 14:10:07,691 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Activate slot
9eaf993bc7b1eb47e8cce2ce7ef851ce.
taskmanager_1 | 2022-11-02 14:10:07,695 INFO
org.apache.flink.runtime.blob.BlobClient [] - Downloading
b99dc3a03951e172bab40bdc3867a11a/p-2fcfa81de948a930c635827bf3c1c2dd73a1cc34-a67d489b268205f020dffb083ac03b73
from flink/172.23.0.4:6124
taskmanager_1 | 2022-11-02 14:10:07,709 INFO
org.apache.flink.runtime.blob.BlobClient [] - Downloading
b99dc3a03951e172bab40bdc3867a11a/p-35ffaba250050d7c3202364ee51d6170823060af-4a4384fee2d2573445ec6a38d289c704
from flink/172.23.0.4:6124
taskmanager_1 | 2022-11-02 14:10:07,969 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Using
application-defined state backend:
org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionStateBackend@58668db5
taskmanager_1 | 2022-11-02 14:10:07,969 INFO
org.apache.flink.runtime.state.StateBackendLoader [] - State backend
loader loads the state backend as BatchExecutionStateBackend
taskmanager_1 | 2022-11-02 14:10:07,974 INFO
org.apache.flink.streaming.runtime.tasks.StreamTask [] - Using
application defined checkpoint storage:
org.apache.flink.streaming.api.operators.sorted.state.BatchExecutionCheckpointStorage@3f8ed41d
taskmanager_1 | 2022-11-02 14:10:07,985 INFO
org.apache.flink.runtime.taskmanager.Task [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0
(2f57d5f86e90495f0103c37122559ca1) switched from DEPLOYING to INITIALIZING.
flink | 2022-11-02 14:10:07,990 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)
(2f57d5f86e90495f0103c37122559ca1) switched from DEPLOYING to INITIALIZING.
taskmanager_1 | 2022-11-02 14:10:08,470 INFO
org.apache.flink.streaming.api.operators.collect.CollectSinkFunction [] -
Initializing collect sink state with offset = 0, buffered results bytes = 0
taskmanager_1 | 2022-11-02 14:10:08,475 INFO
org.apache.flink.streaming.api.operators.collect.CollectSinkFunction [] -
Collect sink server established, address = /172.23.0.6:46067
flink | 2022-11-02 14:10:08,483 INFO
org.apache.flink.streaming.api.operators.collect.CollectSinkOperatorCoordinator
[] - Received sink socket server address: /172.23.0.6:46067
flink | 2022-11-02 14:10:08,495 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
Source: word_count[5] registering reader for parallel task 0 @ 172.23.0.6
flink | 2022-11-02 14:10:08,496 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
Source: word_count[5] received split request from parallel task 0
taskmanager_1 | 2022-11-02 14:10:08,497 INFO
org.apache.flink.runtime.taskmanager.Task [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0
(2f57d5f86e90495f0103c37122559ca1) switched from INITIALIZING to RUNNING.
flink | 2022-11-02 14:10:08,501 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)
(2f57d5f86e90495f0103c37122559ca1) switched from INITIALIZING to RUNNING.
taskmanager_1 | 2022-11-02 14:10:08,511 INFO
org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Reader
received NoMoreSplits event.
taskmanager_1 | 2022-11-02 14:10:08,524 INFO
org.apache.flink.connector.base.source.reader.SourceReaderBase [] - Closing
Source Reader.
taskmanager_1 | 2022-11-02 14:10:08,528 INFO
org.apache.flink.runtime.taskmanager.Task [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)#0
(2f57d5f86e90495f0103c37122559ca1) switched from RUNNING to FINISHED.
taskmanager_1 | 2022-11-02 14:10:08,528 INFO
org.apache.flink.runtime.taskmanager.Task [] - Freeing task
resources for Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect
table sink (1/1)#0 (2f57d5f86e90495f0103c37122559ca1).
taskmanager_1 | 2022-11-02 14:10:08,530 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] -
Un-registering task and sending final execution state FINISHED to JobManager
for task Source: word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table
sink (1/1)#0 2f57d5f86e90495f0103c37122559ca1.
flink | 2022-11-02 14:10:08,547 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source:
word_count[5] -> ConstraintEnforcer[6] -> Sink: Collect table sink (1/1)
(2f57d5f86e90495f0103c37122559ca1) switched from RUNNING to FINISHED.
flink | 2022-11-02 14:10:08,551 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job collect
(b99dc3a03951e172bab40bdc3867a11a) switched from state RUNNING to FINISHED.
flink | 2022-11-02 14:10:08,551 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager []
- Clearing resource requirements of job b99dc3a03951e172bab40bdc3867a11a
flink | 2022-11-02 14:10:08,551 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping
checkpoint coordinator for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:08,559 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job
b99dc3a03951e172bab40bdc3867a11a reached terminal state FINISHED.
flink | 2022-11-02 14:10:08,579 INFO
org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job
b99dc3a03951e172bab40bdc3867a11a has been registered for cleanup in the
JobResultStore after reaching a terminal state.
flink | 2022-11-02 14:10:08,582 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Stopping the
JobMaster for job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:08,588 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Closing
SourceCoordinator for source Source: word_count[5].
flink | 2022-11-02 14:10:08,589 INFO
org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source
coordinator for source Source: word_count[5] closed.
flink | 2022-11-02 14:10:08,593 INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore [] -
Shutting down
flink | 2022-11-02 14:10:08,594 INFO
org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] -
Releasing slot [9eaf993bc7b1eb47e8cce2ce7ef851ce].
flink | 2022-11-02 14:10:08,595 INFO
org.apache.flink.runtime.jobmaster.JobMaster [] - Close
ResourceManager connection 3fa14cf24c77ac8d356de9bc3b5b07ae: Stopping JobMaster
for job 'collect' (b99dc3a03951e172bab40bdc3867a11a).
flink | 2022-11-02 14:10:08,597 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] -
Disconnect job manager
00000000000000000000000000000...@akka.tcp://flink@flink:6123/user/rpc/jobmanager_3
for job b99dc3a03951e172bab40bdc3867a11a from the resource manager.
taskmanager_1 | 2022-11-02 14:10:08,605 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl [] - Free slot
TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1,
taskHeapMemory=384.000mb (402653174 bytes), taskOffHeapMemory=0 bytes,
managedMemory=512.000mb (536870920 bytes), networkMemory=128.000mb (134217730
bytes)}, allocationId: 9eaf993bc7b1eb47e8cce2ce7ef851ce, jobId:
b99dc3a03951e172bab40bdc3867a11a).
taskmanager_1 | 2022-11-02 14:10:08,608 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Remove job
b99dc3a03951e172bab40bdc3867a11a from job leader monitoring.
taskmanager_1 | 2022-11-02 14:10:08,611 INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Close
JobManager connection for job b99dc3a03951e172bab40bdc3867a11a.
flink | 2022-11-02 14:10:14,362 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 4 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398214360 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:14,532 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 5b845b0e-2915-4dfb-80d9-d669d9d638e5 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:14,550 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 4 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=190 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:10:24,362 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 5 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398224361 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:24,563 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 4b3812a4-94dd-46cd-9984-d1fee2e7afac with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:24,599 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 5 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=237 ms, finalizationTime=1 ms).
taskmanager_2 | 2022-11-02 14:10:24,661 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-4.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 402,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,685 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got
brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,686 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-2.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 402,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,687 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got
brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,687 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-1.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 401,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,688 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got
brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,689 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-0.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 383,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,690 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got
brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,690 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-3.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 402,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:10:24,713 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.MemoryManagerImpl [] -
orc.rows.between.memory.checks=5000
taskmanager_2 | 2022-11-02 14:10:24,714 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.OrcCodecPool [] - Got
brand-new codec LZ4
taskmanager_2 | 2022-11-02 14:10:24,715 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 20f29b63-c459-489a-adf1-f394ed078e66 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:34,326 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 6 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398234326 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:34,487 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 85a8279b-961c-43a2-9938-45fc06431e6b with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:34,513 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 6 for job 0c5f22c2ab3e83e1a1f9274818ff675b (9883 bytes,
checkpointDuration=186 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:10:44,327 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 7 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398244325 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:44,491 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 05e6b1e3-2282-4299-b1df-f71b271a0629 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:44,510 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 7 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=185 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:10:54,326 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 8 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398254325 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:10:54,520 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 8149f4f8-5f71-41a5-bf6a-6b0f492b8366 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:10:54,536 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 8 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=211 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:04,291 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 9 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398264290 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:04,428 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 13526b37-54e5-4db0-a12f-0e55c0e641bf with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:04,448 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 9 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7315 bytes,
checkpointDuration=158 ms, finalizationTime=0 ms).
taskmanager_2 | 2022-11-02 14:11:04,465 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-8.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 418,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,467 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-6.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 418,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,468 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-5.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 418,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,469 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-67352189-bdc4-4305-9504-c7cf2d4f7d0c-0.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 402,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,470 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-7.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 418,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:04,472 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: aa2e96ce-91d8-4691-83af-e640d4dda870 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:14,292 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 10 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398274290 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:14,464 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: bc74d0fb-084b-4ad6-8a44-fc7f379decd9 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:14,484 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 10 for job 0c5f22c2ab3e83e1a1f9274818ff675b (9884 bytes,
checkpointDuration=194 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:24,291 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 11 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398284290 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:24,428 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 2174fcd8-87e2-43d4-a8b2-16ee8cef2c78 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:24,444 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 11 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7316 bytes,
checkpointDuration=154 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:34,256 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 12 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398294255 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:34,413 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: ce1e4a3a-804d-4dfe-9b71-94b18f0288c6 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:34,429 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 12 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7316 bytes,
checkpointDuration=174 ms, finalizationTime=0 ms).
flink | 2022-11-02 14:11:44,255 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 13 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398304255 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:44,408 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 60ad313d-d8ce-4b0b-96db-877d6b3fc18a with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:44,424 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 13 for job 0c5f22c2ab3e83e1a1f9274818ff675b (7316 bytes,
checkpointDuration=168 ms, finalizationTime=1 ms).
taskmanager_2 | 2022-11-02 14:11:44,442 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-12.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 421,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,443 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-10.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 418,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,444 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-9.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 418,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,445 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-67352189-bdc4-4305-9504-c7cf2d4f7d0c-1.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 418,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,446 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.ReaderImpl [] - Reading
ORC rows from
file:/tmp/table_store/default.db/word_count/bucket-0/data-c818e7f8-5688-46ce-a1c2-441bc788e589-11.orc
with {include: [false, true, true, true, true, true], offset: 3, length: 421,
schema:
struct<_KEY_word:string,_SEQUENCE_NUMBER:bigint,_VALUE_KIND:tinyint,word:string,cnt:bigint>,
includeAcidColumns: true}
taskmanager_2 | 2022-11-02 14:11:44,448 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: eada9552-1ebb-4e2b-a8d1-78a19cc63b69 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:54,256 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering
checkpoint 14 (type=CheckpointType{name='Checkpoint',
sharingFilesStrategy=FORWARD_BACKWARD}) @ 1667398314255 for job
0c5f22c2ab3e83e1a1f9274818ff675b.
taskmanager_2 | 2022-11-02 14:11:54,413 INFO
org.apache.flink.table.store.shaded.org.apache.orc.impl.WriterImpl [] - ORC
writer created for path: 6f1a8224-91e1-4727-b024-a54f22066842 with stripeSize:
67108864 blockSize: 268435456 compression: LZ4 bufferSize: 262144
flink | 2022-11-02 14:11:54,427 INFO
org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed
checkpoint 14 for job 0c5f22c2ab3e83e1a1f9274818ff675b (9884 bytes,
checkpointDuration=172 ms, finalizationTime=0 ms).
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
