ycjunhua commented on issue #3704:
URL: https://github.com/apache/hudi/issues/3704#issuecomment-925466895
10:34:06,021 INFO org.apache.flink.runtime.taskmanager.Task
- Filter -> Map (1/8)#0 (921bd3faa6059f2011630dc6c7cf6205) switched from
RUNNING to FINISHED.
10:34:06,024 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for Filter -> Map (1/8)#0
(921bd3faa6059f2011630dc6c7cf6205).
10:34:06,024 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (1/8)#0 (1377c78b753cc343c4d864a472276ed9) switched from
RUNNING to FINISHED.
10:34:06,025 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (1/8)#0
(1377c78b753cc343c4d864a472276ed9).
10:34:06,024 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (7/8)#0 (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from
RUNNING to FINISHED.
10:34:06,025 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (7/8)#0
(cd6ba8fe96b84e26c7a0e9a0999a9e0c).
10:34:06,025 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (3/8)#0 (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from
RUNNING to FINISHED.
10:34:06,025 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task Filter -> Map (1/8)#0 921bd3faa6059f2011630dc6c7cf6205.
10:34:06,026 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (3/8)#0
(84bcfbf44e9fa5c3877d1d4a9c0e40e1).
10:34:06,026 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (1/8)#0 1377c78b753cc343c4d864a472276ed9.
10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (6/8)#0 (d4aeffa74f82b79361f229cb61dbc990) switched from
RUNNING to FINISHED.
10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (6/8)#0
(d4aeffa74f82b79361f229cb61dbc990).
10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (8/8)#0 (f55f88d3e637e42da3463df5ef5332a7) switched from
RUNNING to FINISHED.
10:34:06,027 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (8/8)#0
(f55f88d3e637e42da3463df5ef5332a7).
10:34:06,027 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Filter -> Map (1/8) (921bd3faa6059f2011630dc6c7cf6205) switched from
RUNNING to FINISHED.
10:34:06,026 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (5/8)#0 (ba6f95731e0e4f8bf6748ce3cae87a70) switched from
RUNNING to FINISHED.
10:34:06,028 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (5/8)#0
(ba6f95731e0e4f8bf6748ce3cae87a70).
10:34:06,029 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (1/8) (1377c78b753cc343c4d864a472276ed9) switched from
RUNNING to FINISHED.
10:34:06,028 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (2/8)#0 (991aeded53c2b1faea239c5f09c0f7ba) switched from
RUNNING to FINISHED.
10:34:06,032 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (2/8)#0
(991aeded53c2b1faea239c5f09c0f7ba).
10:34:06,027 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (7/8)#0 cd6ba8fe96b84e26c7a0e9a0999a9e0c.
10:34:06,032 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (3/8)#0 84bcfbf44e9fa5c3877d1d4a9c0e40e1.
10:34:06,033 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (7/8) (cd6ba8fe96b84e26c7a0e9a0999a9e0c) switched from
RUNNING to FINISHED.
10:34:06,033 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (6/8)#0 d4aeffa74f82b79361f229cb61dbc990.
10:34:06,033 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (8/8)#0 f55f88d3e637e42da3463df5ef5332a7.
10:34:06,033 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (5/8)#0 ba6f95731e0e4f8bf6748ce3cae87a70.
10:34:06,034 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (2/8)#0 991aeded53c2b1faea239c5f09c0f7ba.
10:34:06,036 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (3/8) (84bcfbf44e9fa5c3877d1d4a9c0e40e1) switched from
RUNNING to FINISHED.
10:34:06,037 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (6/8) (d4aeffa74f82b79361f229cb61dbc990) switched from
RUNNING to FINISHED.
10:34:06,037 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (8/8) (f55f88d3e637e42da3463df5ef5332a7) switched from
RUNNING to FINISHED.
10:34:06,037 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (5/8) (ba6f95731e0e4f8bf6748ce3cae87a70) switched from
RUNNING to FINISHED.
10:34:06,039 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (2/8) (991aeded53c2b1faea239c5f09c0f7ba) switched from
RUNNING to FINISHED.
10:34:06,069 INFO org.apache.flink.runtime.taskmanager.Task
- bucket_assigner (4/8)#0 (f2738a17abb5e3b94d2aa4afc3982bfb) switched from
RUNNING to FINISHED.
10:34:06,069 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for bucket_assigner (4/8)#0
(f2738a17abb5e3b94d2aa4afc3982bfb).
10:34:06,069 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,073 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,074 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task bucket_assigner (4/8)#0 f2738a17abb5e3b94d2aa4afc3982bfb.
10:34:06,073 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,078 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- bucket_assigner (4/8) (f2738a17abb5e3b94d2aa4afc3982bfb) switched from
RUNNING to FINISHED.
10:34:06,086 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:06,086 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:06,087 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:06,087 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,087 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,088 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,089 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,092 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[==>20210923103405__commit__INFLIGHT]}
10:34:06,093 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[==>20210923103405__commit__INFLIGHT]}
10:34:06,094 INFO org.apache.hudi.sink.StreamWriteFunction
- No data to write in subtask [0] for instant [20210923103405]
10:34:06,095 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[==>20210923103405__commit__INFLIGHT]}
10:34:06,095 INFO org.apache.hudi.sink.StreamWriteFunction
- No data to write in subtask [2] for instant [20210923103405]
10:34:06,096 INFO org.apache.hudi.sink.StreamWriteFunction
- No data to write in subtask [3] for instant [20210923103405]
10:34:06,096 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:06,096 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,097 INFO org.apache.hudi.client.AbstractHoodieClient
- Stopping Timeline service !!
10:34:06,097 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService
- Closing Timeline server
10:34:06,097 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator
- Executor executes action [handle write metadata event for instant
20210923103405] success!
10:34:06,097 INFO org.apache.hudi.client.AbstractHoodieClient
- Stopping Timeline service !!
10:34:06,098 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator
- Executor executes action [handle write metadata event for instant
20210923103405] success!
10:34:06,097 INFO org.apache.hudi.client.AbstractHoodieClient
- Stopping Timeline service !!
10:34:06,098 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService
- Closing Timeline server
10:34:06,098 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator
- Executor executes action [handle write metadata event for instant
20210923103405] success!
10:34:06,098 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService
- Closing Timeline server
10:34:06,099 INFO org.apache.hudi.timeline.service.TimelineService
- Closing Timeline Service
10:34:06,097 INFO org.apache.hudi.timeline.service.TimelineService
- Closing Timeline Service
10:34:06,099 INFO io.javalin.Javalin
- Stopping Javalin ...
10:34:06,098 INFO org.apache.hudi.timeline.service.TimelineService
- Closing Timeline Service
10:34:06,099 INFO io.javalin.Javalin
- Stopping Javalin ...
10:34:06,099 INFO io.javalin.Javalin
- Stopping Javalin ...
10:34:06,100 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[==>20210923103405__commit__INFLIGHT]}
10:34:06,102 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,103 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:06,104 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,104 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading Active commit timeline for
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,107 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[==>20210923103405__commit__INFLIGHT]}
10:34:06,111 INFO io.javalin.Javalin
- Javalin has stopped
10:34:06,111 INFO io.javalin.Javalin
- Javalin has stopped
10:34:06,111 INFO org.apache.hudi.timeline.service.TimelineService
- Closed Timeline Service
10:34:06,111 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService
- Closed Timeline server
10:34:06,111 INFO io.javalin.Javalin
- Javalin has stopped
10:34:06,112 INFO org.apache.hudi.timeline.service.TimelineService
- Closed Timeline Service
10:34:06,112 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService
- Closed Timeline server
10:34:06,111 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,111 INFO org.apache.hudi.timeline.service.TimelineService
- Closed Timeline Service
10:34:06,112 INFO org.apache.hudi.client.embedded.EmbeddedTimelineService
- Closed Timeline server
10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task
- hoodie_stream_write (3/4)#0 (ff5491c88ffc17a816e22c29b6da47be) switched
from RUNNING to FINISHED.
10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for hoodie_stream_write (3/4)#0
(ff5491c88ffc17a816e22c29b6da47be).
10:34:06,114 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task
- hoodie_stream_write (4/4)#0 (5e2085d96585101e586a7ea47bc56a98) switched
from RUNNING to FINISHED.
10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for hoodie_stream_write (4/4)#0
(5e2085d96585101e586a7ea47bc56a98).
10:34:06,114 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task hoodie_stream_write (3/4)#0
ff5491c88ffc17a816e22c29b6da47be.
10:34:06,114 INFO org.apache.flink.runtime.taskmanager.Task
- hoodie_stream_write (1/4)#0 (888768308836b8f4831890fa2934fe2c) switched
from RUNNING to FINISHED.
10:34:06,115 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for hoodie_stream_write (1/4)#0
(888768308836b8f4831890fa2934fe2c).
10:34:06,115 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task hoodie_stream_write (4/4)#0
5e2085d96585101e586a7ea47bc56a98.
10:34:06,115 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task hoodie_stream_write (1/4)#0
888768308836b8f4831890fa2934fe2c.
10:34:06,115 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,115 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading Active commit timeline for
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:06,115 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- hoodie_stream_write (3/4) (ff5491c88ffc17a816e22c29b6da47be) switched
from RUNNING to FINISHED.
10:34:06,116 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- hoodie_stream_write (4/4) (5e2085d96585101e586a7ea47bc56a98) switched
from RUNNING to FINISHED.
10:34:06,117 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- hoodie_stream_write (1/4) (888768308836b8f4831890fa2934fe2c) switched
from RUNNING to FINISHED.
10:34:06,117 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[==>20210923103405__commit__INFLIGHT]}
10:34:06,118 INFO org.apache.hudi.common.table.view.FileSystemViewManager
- Creating View Manager with storage type :REMOTE_FIRST
10:34:06,118 INFO org.apache.hudi.common.table.view.FileSystemViewManager
- Creating remote first table view
10:34:06,143 INFO org.apache.hudi.table.marker.DirectWriteMarkers
- Creating Marker
Path=file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/.temp/20210923103405/70b872ee-bb13-4296-8d2b-e541ba27d704_1-4-0_20210923103405.parquet.marker.CREATE
10:34:06,145 INFO org.apache.hudi.table.marker.DirectWriteMarkers
- [direct] Created marker file
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/.temp/20210923103405/70b872ee-bb13-4296-8d2b-e541ba27d704_1-4-0_20210923103405.parquet.marker.CREATE
in 3 ms
10:34:06,256 WARN org.apache.hadoop.io.compress.zlib.ZlibFactory
- Failed to load/initialize native-zlib library
10:34:06,256 INFO org.apache.hadoop.io.compress.CodecPool
- Got brand-new compressor [.gz]
10:34:06,542 INFO org.apache.hudi.io.HoodieCreateHandle
- New CreateHandle for partition : with fileId
70b872ee-bb13-4296-8d2b-e541ba27d704
10:34:06,563 INFO
org.apache.hudi.common.util.queue.IteratorBasedQueueProducer - starting to
buffer records
10:34:06,564 INFO org.apache.hudi.common.util.queue.BoundedInMemoryExecutor
- starting consumer thread
10:34:06,588 INFO
org.apache.hudi.common.util.queue.IteratorBasedQueueProducer - finished
buffering records
10:34:06,599 INFO org.apache.hudi.io.HoodieCreateHandle
- Closing the file 70b872ee-bb13-4296-8d2b-e541ba27d704 as we are done with
all the records 1
10:34:07,010 INFO org.apache.hudi.io.HoodieCreateHandle
- CreateHandle for partitionPath fileID
70b872ee-bb13-4296-8d2b-e541ba27d704, took 882 ms.
10:34:07,010 INFO org.apache.hudi.common.util.queue.BoundedInMemoryExecutor
- Queue Consumption is done; notifying producer threads
10:34:07,013 INFO org.apache.hudi.client.AbstractHoodieClient
- Stopping Timeline service !!
10:34:07,014 INFO org.apache.flink.runtime.taskmanager.Task
- hoodie_stream_write (2/4)#0 (d48422b9607bf34237abcaf9cbca24a2) switched
from RUNNING to FINISHED.
10:34:07,014 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for hoodie_stream_write (2/4)#0
(d48422b9607bf34237abcaf9cbca24a2).
10:34:07,015 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task hoodie_stream_write (2/4)#0
d48422b9607bf34237abcaf9cbca24a2.
10:34:07,015 INFO org.apache.flink.runtime.taskmanager.Task
- Sink: clean_commits (1/1)#0 (e46f7227496a98cb8360e4afa2fcdca1) switched
from RUNNING to FINISHED.
10:34:07,015 INFO org.apache.flink.runtime.taskmanager.Task
- Freeing task resources for Sink: clean_commits (1/1)#0
(e46f7227496a98cb8360e4afa2fcdca1).
10:34:07,016 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Un-registering task and sending final execution state FINISHED to
JobManager for task Sink: clean_commits (1/1)#0
e46f7227496a98cb8360e4afa2fcdca1.
10:34:07,016 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- hoodie_stream_write (2/4) (d48422b9607bf34237abcaf9cbca24a2) switched
from RUNNING to FINISHED.
10:34:07,017 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Sink: clean_commits (1/1) (e46f7227496a98cb8360e4afa2fcdca1) switched
from RUNNING to FINISHED.
10:34:07,018 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph
- Job insert-into_default_catalog.default_database.configure_area
(63fd2fc9f76ebcbf9b7d3d47dabbdf38) switched from state RUNNING to FINISHED.
10:34:07,018 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator
- Stopping checkpoint coordinator for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38.
10:34:07,019 INFO org.apache.hudi.client.AbstractHoodieWriteClient
- Committing 20210923103405 action commit
10:34:07,020 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:07,020 INFO
org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore -
Shutting down
10:34:07,021 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:07,022 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:07,023 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading Active commit timeline for
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:07,025 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[==>20210923103405__commit__INFLIGHT]}
10:34:07,026 INFO org.apache.hudi.common.table.view.FileSystemViewManager
- Creating View Manager with storage type :REMOTE_FIRST
10:34:07,026 INFO org.apache.hudi.common.table.view.FileSystemViewManager
- Creating remote first table view
10:34:07,028 INFO org.apache.hudi.common.util.CommitUtils
- Creating metadata for null numWriteStats:1numReplaceFileIds:0
10:34:07,028 INFO org.apache.flink.runtime.minicluster.MiniCluster
- Shutting down Flink Mini Cluster
10:34:07,028 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher
- Job 63fd2fc9f76ebcbf9b7d3d47dabbdf38 reached globally terminal state
FINISHED.
10:34:07,028 INFO org.apache.hudi.client.AbstractHoodieWriteClient
- Committing 20210923103405 action commit
10:34:07,029 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down
rest endpoint.
10:34:07,029 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Stopping TaskExecutor akka://flink/user/rpc/taskmanager_0.
10:34:07,030 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Close ResourceManager connection 23667cd006bb26eb958d7cd585d4d7de.
10:34:07,031 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing
TaskExecutor connection a6e88966-162b-44b4-b2fd-39461a1a440c because: The
TaskExecutor is shutting down.
10:34:07,040 INFO org.apache.flink.runtime.jobmaster.JobMaster
- Stopping the JobMaster for job
insert-into_default_catalog.default_database.configure_area(63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,044 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Close JobManager connection for job 63fd2fc9f76ebcbf9b7d3d47dabbdf38.
10:34:07,045 INFO org.apache.hudi.client.AbstractHoodieClient
- Stopping Timeline service !!
10:34:07,052 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:3, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: bc89ec13c8cfe5f30f33b9b92894ad6d, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,056 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: 764034c3267a443562b693e46aad20e5, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,057 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:6, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: 45b2be58c17c46712a1f99ffb71124c0, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,057 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: 3b5cadd7193ba9bd4dc2cf7ccc9667b2, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,057 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:2, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: 4a41e5491be9026da0456dd23f0709e4, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,058 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:5, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: 69e4facaa72255fa4011ad886be6e830, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,058 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:7, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: f738d448f48642d75b3bf69475df9c0a, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,058 INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl - Free slot
TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=16.000mb (16777216 bytes), networkMemory=8.000mb
(8388608 bytes)}, allocationId: 21a45995954d4f80f8e9559bd6c050c2, jobId:
63fd2fc9f76ebcbf9b7d3d47dabbdf38).
10:34:07,066 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService - Stop job
leader service.
10:34:07,067 INFO
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting
down TaskExecutorLocalStateStoresManager.
10:34:07,077 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache
directory C:\Users\zhujh\AppData\Local\Temp\3\flink-web-ui
10:34:07,080 INFO
org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down
complete.
10:34:07,084 INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down
cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..
10:34:07,084 INFO
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
- Closing components.
10:34:07,084 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl
- FileChannelManager removed spill file directory
C:\Users\zhujh\AppData\Local\Temp\3\flink-io-828c2b8c-9406-42ce-a880-da7d89a25952
10:34:07,085 INFO
org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down
the network environment and its components.
10:34:07,085 INFO
org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess -
Stopping SessionDispatcherLeaderProcess.
10:34:07,086 INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl
- FileChannelManager removed spill file directory
C:\Users\zhujh\AppData\Local\Temp\3\flink-netty-shuffle-d89eeb4b-bb89-4a97-9902-3a9b68d9d6e9
10:34:07,085 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher
- Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
10:34:07,086 INFO org.apache.flink.runtime.taskexecutor.KvStateService
- Shutting down the kvState service and its components.
10:34:07,086 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher
- Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_2.
10:34:07,087 INFO
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService - Stop job
leader service.
10:34:07,087 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing
the SlotManager.
10:34:07,087 INFO
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl -
Suspending the SlotManager.
10:34:07,088 INFO org.apache.flink.runtime.filecache.FileCache
- removed file cache directory
C:\Users\zhujh\AppData\Local\Temp\3\flink-dist-cache-a14975c7-d8f8-413c-86c0-3b9990d84ec5
10:34:07,089 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor
- Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
10:34:07,163 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Marking instant
complete [==>20210923103405__commit__INFLIGHT]
10:34:07,164 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Checking for
file exists
?file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/20210923103405.inflight
10:34:07,166 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Create new file
for toInstant
?file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/20210923103405.commit
10:34:07,166 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Completed
[==>20210923103405__commit__INFLIGHT]
10:34:07,166 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading HoodieTableMetaClient from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:07,168 INFO org.apache.hudi.common.table.HoodieTableConfig
- Loading table properties from
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/hoodie.properties
10:34:07,168 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Finished Loading Table of type COPY_ON_WRITE(version=1,
baseFileFormat=PARQUET) from
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:07,169 INFO org.apache.hudi.common.table.HoodieTableMetaClient
- Loading Active commit timeline for
file:///d:/yuou/dev/ods/mmt-new/router_configure/configure_area
10:34:07,171 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[20210923103405__commit__COMPLETED]}
10:34:07,172 INFO org.apache.hudi.common.table.view.FileSystemViewManager
- Creating View Manager with storage type :MEMORY
10:34:07,172 INFO org.apache.hudi.common.table.view.FileSystemViewManager
- Creating in-memory based Table View
10:34:07,184 INFO org.apache.hudi.table.marker.DirectWriteMarkers
- Removing marker directory at
file:/d:/yuou/dev/ods/mmt-new/router_configure/configure_area/.hoodie/.temp/20210923103405
10:34:07,202 INFO
org.apache.hudi.common.table.timeline.HoodieActiveTimeline - Loaded instants
upto : Option{val=[20210923103405__commit__COMPLETED]}
10:34:07,204 INFO org.apache.hudi.table.HoodieTimelineArchiveLog
- No Instants to archive
10:34:07,204 INFO org.apache.hudi.client.AbstractHoodieWriteClient
- Committed 20210923103405
10:34:07,204 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator
- Commit instant [20210923103405] success!
10:34:07,204 INFO org.apache.hudi.sink.StreamWriteOperatorCoordinator
- Executor executes action [handle write metadata event for instant
20210923103405] success!
10:34:07,213 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl
- Suspending SlotPool.
10:34:07,213 INFO org.apache.flink.runtime.jobmaster.JobMaster
- Close ResourceManager connection 23667cd006bb26eb958d7cd585d4d7de:
Stopping JobMaster for job
insert-into_default_catalog.default_database.configure_area(63fd2fc9f76ebcbf9b7d3d47dabbdf38)..
10:34:07,213 INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl
- Stopping SlotPool.
10:34:07,216 INFO
org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator
- Shutting down back pressure request coordinator.
10:34:07,216 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher
- Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
10:34:07,219 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
- Stopping Akka RPC service.
10:34:07,262 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
- Stopping Akka RPC service.
10:34:07,262 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
- Stopped Akka RPC service.
10:34:07,277 INFO org.apache.flink.runtime.blob.PermanentBlobCache
- Shutting down BLOB cache
10:34:07,278 INFO org.apache.flink.runtime.blob.TransientBlobCache
- Shutting down BLOB cache
10:34:07,280 INFO org.apache.flink.runtime.blob.BlobServer
- Stopped BLOB server at 0.0.0.0:65389
10:34:07,280 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService
- Stopped Akka RPC service.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
