Hi Hang,
I cross checked this issue multiple times. I also upgraded to flink 1.18
but the issue persists.
Can you please let me know a few guidelines on how to investigate this and
fix it positively.
Thanks,
Tauseef
On Thu, 23 Nov 2023 at 18:08, Tauseef Janvekar <tauseefjanve...@gmail.com>
wrote:
> Thanks Hang.
>
> I got it now. I will check on this and get back to you.
>
> Thanks,
> Tauseef.
>
> On Thu, 23 Nov 2023 at 17:29, Hang Ruan <ruanhang1...@gmail.com> wrote:
>
>> Hi, Tauseef.
>>
>> This error is not that you can not access the Kafka cluster. Actually,
>> this error means that the JM cannot access its TM.
>> Have you ever checked whether the JM is able to access the TM?
>>
>> Best,
>> Hang
>>
>> Tauseef Janvekar <tauseefjanve...@gmail.com> 于2023年11月23日周四 16:04写道：
>>
>>> Dear Team,
>>>
>>> We are facing the below issue while connecting to confluent kafka
>>> Can someone please help here.
>>>
>>> 2023-11-23 06:09:36,989 INFO org.apache.flink.runtime.executiongraph.
>>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out
>>> (1/1)
>>> (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>>> switched from SCHEDULED to DEPLOYING.
>>> 2023-11-23 06:09:36,994 INFO org.apache.flink.runtime.executiongraph.
>>> ExecutionGraph [] - Deploying Source: src_source -> Sink: Print
>>> to Std. Out (1/1) (attempt #0) with attempt id
>>> 496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0
>>> and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to flink-taskmanager:
>>> 6122-23f057 @ flink-taskmanager.flink.svc.cluster.local (dataPort=46589)
>>> with allocation id 80fe79389102bd305dd87a00247413eb
>>> 2023-11-23 06:09:37,011 INFO
>>> org.apache.kafka.common.security.authenticator.AbstractLogin [] -
>>> Successfully logged in.
>>> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
>>> AdminClientConfig [] - The configuration 'key.deserializer'
>>> was supplied but isn't a known config.
>>> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
>>> AdminClientConfig [] - The configuration
>>> 'value.deserializer' was supplied but isn't a known config.
>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>> AdminClientConfig [] - The configuration 'client.id.prefix'
>>> was supplied but isn't a known config.
>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>> AdminClientConfig [] - The configuration '
>>> partition.discovery.interval.ms' was supplied but isn't a known config.
>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>> AdminClientConfig [] - The configuration
>>> 'commit.offsets.on.checkpoint' was supplied but isn't a known config.
>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>> AdminClientConfig [] - The configuration
>>> 'enable.auto.commit' was supplied but isn't a known config.
>>> 2023-11-23 06:09:37,111 WARN org.apache.kafka.clients.admin.
>>> AdminClientConfig [] - The configuration 'auto.offset.reset'
>>> was supplied but isn't a known config.
>>> 2023-11-23 06:09:37,113 INFO org.apache.kafka.common.utils.
>>> AppInfoParser [] - Kafka version: 3.2.2
>>> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.
>>> AppInfoParser [] - Kafka commitId: 38c22ad893fb6cf5
>>> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.
>>> AppInfoParser [] - Kafka startTimeMs: 1700719777111
>>> 2023-11-23 06:09:37,117 INFO
>>> org.apache.flink.connector.kafka.source.enumerator.
>>> KafkaSourceEnumerator [] - Starting the KafkaSourceEnumerator for
>>> consumer group null without periodic partition discovery.
>>> 2023-11-23 06:09:37,199 INFO org.apache.flink.runtime.executiongraph.
>>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out
>>> (1/1)
>>> (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>>> switched from DEPLOYING to INITIALIZING.
>>> 2023-11-23 06:09:37,302 INFO
>>> org.apache.flink.runtime.source.coordinator.SourceCoordinator [] -
>>> Source Source: src_source registering reader for parallel task 0 (#0) @
>>> flink-taskmanager
>>> 2023-11-23 06:09:37,313 INFO org.apache.flink.runtime.executiongraph.
>>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out
>>> (1/1)
>>> (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>>> switched from INITIALIZING to RUNNING.
>>> 2023-11-23 06:09:38,713 INFO
>>> org.apache.flink.connector.kafka.source.enumerator.
>>> KafkaSourceEnumerator [] - Discovered new partitions: [aiops-3, aiops-2,
>>> aiops-1, aiops-0, aiops-5, aiops-4]
>>> 2023-11-23 06:09:38,719 INFO
>>> org.apache.flink.connector.kafka.source.enumerator.
>>> KafkaSourceEnumerator [] - Assigning splits to readers {0=[[Partition:
>>> aiops-1, StartingOffset: -1, StoppingOffset: -9223372036854775808], [
>>> Partition: aiops-2, StartingOffset: -1, StoppingOffset: -
>>> 9223372036854775808], [Partition: aiops-0, StartingOffset: -1,
>>> StoppingOffset: -9223372036854775808], [Partition: aiops-4,
>>> StartingOffset: -1, StoppingOffset: -9223372036854775808], [Partition:
>>> aiops-3, StartingOffset: -1, StoppingOffset: -9223372036854775808], [
>>> Partition: aiops-5, StartingOffset: -1, StoppingOffset: -
>>> 9223372036854775808]]}
>>> 2023-11-23 06:09:57,651 INFO akka.remote.transport.ProtocolStateActor
>>> [] - No response from remote for outbound
>>> association. Associate timed out after [20000 ms].
>>> 2023-11-23 06:09:57,651 WARN akka.remote.ReliableDeliverySupervisor
>>> [] - Association with remote system
>>> [akka.tcp://flink-metrics@flink-taskmanager:33837] has failed, address
>>> is now gated for [50] ms. Reason: [Association failed with
>>> [akka.tcp://flink-metrics@flink-taskmanager:33837]] Caused by: [No
>>> response from remote for outbound association. Associate timed out
>>> after [20000 ms].]
>>> 2023-11-23 06:09:57,668 WARN akka.remote.transport.netty.NettyTransport
>>> [] - Remote connection to [null] failed with
>>> org.jboss.netty.channel.ConnectTimeoutException: connection timed out:
>>> flink-taskmanager/172.20.208.151:33837
>>> 2023-11-23 06:14:38,188 INFO org.apache.kafka.clients.NetworkClient
>>> [] - [AdminClient clientId=KafkaSource-
>>> 7770001137980494918-enumerator-admin-client] Node -1 disconnected.
>>> 2023-11-23 06:19:38,354 INFO org.apache.kafka.clients.NetworkClient
>>> [] - [AdminClient clientId=KafkaSource-
>>> 7770001137980494918-enumerator-admin-client] Node 9 disconnected.
>>> 2023-11-23 06:24:39,060 INFO org.apache.kafka.clients.NetworkClient
>>> [] - [AdminClient clientId=KafkaSource-
>>> 7770001137980494918-enumerator-admin-client] Node 6 disconnected.
>>> 2023-11-23 06:29:39,801 INFO org.apache.kafka.clients.NetworkClient
>>> [] - [AdminClient clientId=KafkaSource-
>>> 7770001137980494918-enumerator-admin-client] Node 8 disconnected.
>>> 2023-11-23 06:34:40,544 INFO org.apache.kafka.clients.NetworkClient
>>> [] - [AdminClient clientId=KafkaSource-
>>> 7770001137980494918-enumerator-admin-client] Node 13 disconnected.
>>> 2023-11-23 06:39:41,245 INFO org.apache.kafka.clients.NetworkClient
>>> [] - [AdminClient clientId=KafkaSource-
>>> 7770001137980494918-enumerator-admin-client] Node 3 disconnected.
>>> 2023-11-23 06:44:41,976 INFO org.apache.kafka.clients.NetworkClient
>>> [] - [AdminClient clientId=KafkaSource-
>>> 7770001137980494918-enumerator-admin-client] Node 2 disconnected.
>>>
>>>
>>> Thanks,
>>> Tauseef
>>>
>>
