kidloator opened a new issue, #7107: URL: https://github.com/apache/seatunnel/issues/7107
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 2024-07-04 18:33:15,748 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'SeaTunnel' (e5287c00d1bf482307307cf71e17448f). 2024-07-04 18:33:15,748 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'SeaTunnel' (e5287c00d1bf482307307cf71e17448f). 2024-07-04 18:33:15,749 INFO org.apache.flink.runtime.jobmaster.JobMasterServiceLeadershipRunner [] - JobMasterServiceLeadershipRunner for job e5287c00d1bf482307307cf71e17448f was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new JobMasterServiceProcess. 2024-07-04 18:33:15,750 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_9 . 2024-07-04 18:33:15,750 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'SeaTunnel' (e5287c00d1bf482307307cf71e17448f). 2024-07-04 18:33:15,750 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=2147483647, backoffTimeMS=1000) for SeaTunnel (e5287c00d1bf482307307cf71e17448f). 2024-07-04 18:33:15,751 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Created execution graph f2d3119a4c76370dbe3ddf33e19a99b4 for job e5287c00d1bf482307307cf71e17448f. 2024-07-04 18:33:15,752 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job SeaTunnel (e5287c00d1bf482307307cf71e17448f). 2024-07-04 18:33:15,752 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2024-07-04 18:33:15,905 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 0 ms, total 1 pipelined regions currently. 2024-07-04 18:33:15,905 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - No state backend has been configured, using default (HashMap) org.apache.flink.runtime.state.hashmap.HashMapStateBackend@652d1f95 2024-07-04 18:33:15,905 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as HashMapStateBackend 2024-07-04 18:33:15,905 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Checkpoint storage is set to 'jobmanager' 2024-07-04 18:33:15,905 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2024-07-04 18:33:15,905 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@664e5178 for SeaTunnel (e5287c00d1bf482307307cf71e17448f). 2024-07-04 18:33:15,907 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job 'SeaTunnel' (e5287c00d1bf482307307cf71e17448f) under job master id 00000000000000000000000000000000. 2024-07-04 18:33:15,908 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: MongoDB-CDC-source. 2024-07-04 18:33:15,924 INFO org.apache.seatunnel.connectors.seatunnel.cdc.mongodb.internal.MongodbClientProvider [] - Create and register mongo client bguser@[10.5.32.17:27017] 2024-07-04 18:33:16,005 INFO org.mongodb.driver.client [] - MongoClient with metadata {"driver": {"name": "mongo-java-driver|sync", "version": "4.7.1"}, "os": {"type": "Linux", "name": "Linux", "architecture": "amd64", "version": "4.18.0-305.3.1.el8.x86_64"}, "platform": "Java/Red Hat, Inc./1.8.0_312-b07"} created with settings MongoClientSettings{readPreference=primary, writeConcern=WriteConcern{w=null, wTimeout=null ms, journal=null}, retryWrites=true, retryReads=true, readConcern=ReadConcern{level=null}, credential=MongoCredential{mechanism=null, userName='bguser', source='admin', password=<hidden>, mechanismProperties=<hidden>}, streamFactoryFactory=null, commandListeners=[], codecRegistry=ProvidersCodecRegistry{codecProviders=[ValueCodecProvider{}, BsonValueCodecProvider{}, DBRefCodecProvider{}, DBObjectCodecProvider{}, DocumentCodecProvider{}, IterableCodecProvider{}, MapCodecProvider{}, GeoJsonCodecProvider{}, GridFSFileCodecProvider{}, J sr310CodecProvider{}, JsonObjectCodecProvider{}, BsonCodecProvider{}, EnumCodecProvider{}, com.mongodb.Jep395RecordCodecProvider@1add2356]}, clusterSettings={hosts=[10.5.32.17:27017], srvServiceName=mongodb, mode=SINGLE, requiredClusterType=UNKNOWN, requiredReplicaSetName='null', serverSelector='null', clusterListeners='[]', serverSelectionTimeout='30000 ms', localThreshold='30000 ms'}, socketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=0, receiveBufferSize=0, sendBufferSize=0}, heartbeatSocketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=10000, receiveBufferSize=0, sendBufferSize=0}, connectionPoolSettings=ConnectionPoolSettings{maxSize=100, minSize=0, maxWaitTimeMS=120000, maxConnectionLifeTimeMS=0, maxConnectionIdleTimeMS=0, maintenanceInitialDelayMS=0, maintenanceFrequencyMS=60000, connectionPoolListeners=[], maxConnecting=2}, serverSettings=ServerSettings{heartbeatFrequencyMS=10000, minHeartbeatFrequencyMS=500, serverListeners='[]', serverMonito rListeners='[]'}, sslSettings=SslSettings{enabled=false, invalidHostNameAllowed=false, context=null}, applicationName='null', compressorList=[], uuidRepresentation=UNSPECIFIED, serverApi=null, autoEncryptionSettings=null, contextProvider=null} 2024-07-04 18:33:16,012 INFO org.mongodb.driver.connection [] - Opened connection [connectionId{localValue:1, serverValue:44874735}] to 10.5.32.17:27017 2024-07-04 18:33:16,013 INFO org.mongodb.driver.cluster [] - Monitor thread successfully connected to server with description ServerDescription{address=10.5.32.17:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=8, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=19795927, setName='cmgo-10s0ahyb_0', canonicalAddress=10.5.32.17:27017, hosts=[10.5.32.15:27017, 10.5.32.17:27017], passives=[], arbiters=[], primary='10.5.32.17:27017', tagSet=TagSet{[]}, electionId=7fffffff0000000000000001, setVersion=4, topologyVersion=null, lastWriteDate=Thu Jul 04 18:33:10 CST 2024, lastUpdateTimeNanos=30934363414716361} 2024-07-04 18:33:16,015 INFO org.mongodb.driver.connection [] - Opened connection [connectionId{localValue:2, serverValue:44874736}] to 10.5.32.17:27017 2024-07-04 18:33:16,068 INFO org.mongodb.driver.connection [] - Opened connection [connectionId{localValue:3, serverValue:44874737}] to 10.5.32.17:27017 2024-07-04 18:33:16,092 INFO org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner [] - SnapshotSplitAssigner created with remaining tables: [test.user] 2024-07-04 18:33:16,093 INFO org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner [] - SnapshotSplitAssigner created with remaining splits: [] 2024-07-04 18:33:16,093 INFO org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner [] - SnapshotSplitAssigner created with assigned splits: [] 2024-07-04 18:33:16,094 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 2024-07-04 18:33:16,094 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job SeaTunnel (e5287c00d1bf482307307cf71e17448f) switched from state CREATED to RUNNING. 2024-07-04 18:33:16,094 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MongoDB-CDC-source -> *anonymous_datastream_source$1*[1] -> TableToDataSteam -> Kafka: Writer -> Kafka: Committer (1/1) (f2d3119a4c76370dbe3ddf33e19a99b4_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED. 2024-07-04 18:33:16,095 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager akka.tcp://flink@localhost:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000) 2024-07-04 18:33:16,095 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration 2024-07-04 18:33:16,095 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager 00000000000000000000000000000...@akka.tcp://flink@localhost:6123/user/rpc/jobmanager_9 for job e5287c00d1bf482307307cf71e17448f. 2024-07-04 18:33:16,096 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager 00000000000000000000000000000...@akka.tcp://flink@localhost:6123/user/rpc/jobmanager_9 for job e5287c00d1bf482307307cf71e17448f. 2024-07-04 18:33:16,096 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000. 2024-07-04 18:33:16,096 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Received resource requirements from job e5287c00d1bf482307307cf71e17448f: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2024-07-04 18:33:16,176 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MongoDB-CDC-source -> *anonymous_datastream_source$1*[1] -> TableToDataSteam -> Kafka: Writer -> Kafka: Committer (1/1) (f2d3119a4c76370dbe3ddf33e19a99b4_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING. 2024-07-04 18:33:16,177 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: MongoDB-CDC-source -> *anonymous_datastream_source$1*[1] -> TableToDataSteam -> Kafka: Writer -> Kafka: Committer (1/1) (attempt #0) with attempt id f2d3119a4c76370dbe3ddf33e19a99b4_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to localhost:38233-aab570 @ k8s01 (dataPort=37077) with allocation id 3ffef464d417c11d026a7af6d62ebd68 2024-07-04 18:33:16,654 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MongoDB-CDC-source -> *anonymous_datastream_source$1*[1] -> TableToDataSteam -> Kafka: Writer -> Kafka: Committer (1/1) (f2d3119a4c76370dbe3ddf33e19a99b4_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING. 2024-07-04 18:33:16,899 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: MongoDB-CDC-source registering reader for parallel task 0 (#0) @ localhost 2024-07-04 18:33:16,900 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: MongoDB-CDC-source -> *anonymous_datastream_source$1*[1] -> TableToDataSteam -> Kafka: Writer -> Kafka: Committer (1/1) (f2d3119a4c76370dbe3ddf33e19a99b4_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING. 2024-07-04 18:33:16,900 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: MongoDB-CDC-source received split request from parallel task 0 (#0) 2024-07-04 18:37:40,041 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1720089460040 for job e5287c00d1bf482307307cf71e17448f. 2024-07-04 18:37:40,077 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 1 for job e5287c00d1bf482307307cf71e17448f (6185 bytes, checkpointDuration=36 ms, finalizationTime=1 ms). 2024-07-04 18:37:40,078 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 1 as completed for source Source: MongoDB-CDC-source. ### SeaTunnel Version 2.3.5 ### SeaTunnel Config ```conf MongoDB-CDC { hosts = "x.x.x.x:27017" database = ["a"] collection = ["a.b"] username = username password = pwd result_table_name = "fake" startup_mode = "earliest" schema = { fields { "_id" : string, "age" : string, "name" : string, } } } ``` ### Running Command ```shell ./bin/start-seatunnel-flink-15-connector-v2.sh --config config/example.conf ``` ### Error Exception ```log nothing ``` ### Zeta or Flink or Spark Version flink:1.16.3 ### Java or Scala Version _No response_ ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@seatunnel.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org