Hi Hang,
Few more points regarding this issue
1. The issue does not replicate in my local installation and occurs only on
kubernetes server installation.
2. We have used kubernetes operator to install flink on the server
Please let me know if any other info is required here.
Thanks,
Tauseef
On Fri, 24 Nov 2023 at 15:50, Tauseef Janvekar <tauseefjanve...@gmail.com>
wrote:
> Hi Hang,
>
> I cross checked this issue multiple times. I also upgraded to flink 1.18
> but the issue persists.
>
> Can you please let me know a few guidelines on how to investigate this and
> fix it positively.
>
> Thanks,
> Tauseef
>
> On Thu, 23 Nov 2023 at 18:08, Tauseef Janvekar <tauseefjanve...@gmail.com>
> wrote:
>
>> Thanks Hang.
>>
>> I got it now. I will check on this and get back to you.
>>
>> Thanks,
>> Tauseef.
>>
>> On Thu, 23 Nov 2023 at 17:29, Hang Ruan <ruanhang1...@gmail.com> wrote:
>>
>>> Hi, Tauseef.
>>>
>>> This error is not that you can not access the Kafka cluster. Actually,
>>> this error means that the JM cannot access its TM.
>>> Have you ever checked whether the JM is able to access the TM?
>>>
>>> Best,
>>> Hang
>>>
>>> Tauseef Janvekar <tauseefjanve...@gmail.com> 于2023年11月23日周四 16:04写道：
>>>
>>>> Dear Team,
>>>>
>>>> We are facing the below issue while connecting to confluent kafka
>>>> Can someone please help here.
>>>>
>>>> 2023-11-23 06:09:36,989 INFO org.apache.flink.runtime.executiongraph.
>>>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out
>>>> (1/1)
>>>> (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>>>> switched from SCHEDULED to DEPLOYING.
>>>> 2023-11-23 06:09:36,994 INFO org.apache.flink.runtime.executiongraph.
>>>> ExecutionGraph [] - Deploying Source: src_source -> Sink: Print
>>>> to Std. Out (1/1) (attempt #0) with attempt id
>>>> 496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0
>>>> and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to flink-taskmanager:
>>>> 6122-23f057 @ flink-taskmanager.flink.svc.cluster.local (dataPort=46589)
>>>> with allocation id 80fe79389102bd305dd87a00247413eb
>>>> 2023-11-23 06:09:37,011 INFO
>>>> org.apache.kafka.common.security.authenticator.AbstractLogin [] -
>>>> Successfully logged in.
>>>> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
>>>> AdminClientConfig [] - The configuration 'key.deserializer'
>>>> was supplied but isn't a known config.
>>>> 2023-11-23 06:09:37,109 WARN org.apache.kafka.clients.admin.
>>>> AdminClientConfig [] - The configuration
>>>> 'value.deserializer' was supplied but isn't a known config.
>>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>>> AdminClientConfig [] - The configuration 'client.id.prefix'
>>>> was supplied but isn't a known config.
>>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>>> AdminClientConfig [] - The configuration '
>>>> partition.discovery.interval.ms' was supplied but isn't a known config.
>>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>>> AdminClientConfig [] - The configuration
>>>> 'commit.offsets.on.checkpoint' was supplied but isn't a known config.
>>>> 2023-11-23 06:09:37,110 WARN org.apache.kafka.clients.admin.
>>>> AdminClientConfig [] - The configuration
>>>> 'enable.auto.commit' was supplied but isn't a known config.
>>>> 2023-11-23 06:09:37,111 WARN org.apache.kafka.clients.admin.
>>>> AdminClientConfig [] - The configuration
>>>> 'auto.offset.reset' was supplied but isn't a known config.
>>>> 2023-11-23 06:09:37,113 INFO org.apache.kafka.common.utils.
>>>> AppInfoParser [] - Kafka version: 3.2.2
>>>> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.
>>>> AppInfoParser [] - Kafka commitId: 38c22ad893fb6cf5
>>>> 2023-11-23 06:09:37,114 INFO org.apache.kafka.common.utils.
>>>> AppInfoParser [] - Kafka startTimeMs: 1700719777111
>>>> 2023-11-23 06:09:37,117 INFO
>>>> org.apache.flink.connector.kafka.source.enumerator.
>>>> KafkaSourceEnumerator [] - Starting the KafkaSourceEnumerator for
>>>> consumer group null without periodic partition discovery.
>>>> 2023-11-23 06:09:37,199 INFO org.apache.flink.runtime.executiongraph.
>>>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out
>>>> (1/1)
>>>> (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>>>> switched from DEPLOYING to INITIALIZING.
>>>> 2023-11-23 06:09:37,302 INFO
>>>> org.apache.flink.runtime.source.coordinator.SourceCoordinator [] -
>>>> Source Source: src_source registering reader for parallel task 0 (#0) @
>>>> flink-taskmanager
>>>> 2023-11-23 06:09:37,313 INFO org.apache.flink.runtime.executiongraph.
>>>> ExecutionGraph [] - Source: src_source -> Sink: Print to Std. Out
>>>> (1/1)
>>>> (496f859d5379cd751a3fc473625125f3_cbc357ccb763df2852fee8c4fc7d55f2_0_0)
>>>> switched from INITIALIZING to RUNNING.
>>>> 2023-11-23 06:09:38,713 INFO
>>>> org.apache.flink.connector.kafka.source.enumerator.
>>>> KafkaSourceEnumerator [] - Discovered new partitions: [aiops-3, aiops-2,
>>>> aiops-1, aiops-0, aiops-5, aiops-4]
>>>> 2023-11-23 06:09:38,719 INFO
>>>> org.apache.flink.connector.kafka.source.enumerator.
>>>> KafkaSourceEnumerator [] - Assigning splits to readers {0=[[Partition:
>>>> aiops-1, StartingOffset: -1, StoppingOffset: -9223372036854775808], [
>>>> Partition: aiops-2, StartingOffset: -1, StoppingOffset: -
>>>> 9223372036854775808], [Partition: aiops-0, StartingOffset: -1,
>>>> StoppingOffset: -9223372036854775808], [Partition: aiops-4,
>>>> StartingOffset: -1, StoppingOffset: -9223372036854775808], [Partition:
>>>> aiops-3, StartingOffset: -1, StoppingOffset: -9223372036854775808], [
>>>> Partition: aiops-5, StartingOffset: -1, StoppingOffset: -
>>>> 9223372036854775808]]}
>>>> 2023-11-23 06:09:57,651 INFO akka.remote.transport.ProtocolStateActor
>>>> [] - No response from remote for outbound
>>>> association. Associate timed out after [20000 ms].
>>>> 2023-11-23 06:09:57,651 WARN akka.remote.ReliableDeliverySupervisor
>>>> [] - Association with remote system
>>>> [akka.tcp://flink-metrics@flink-taskmanager:33837] has failed, address
>>>> is now gated for [50] ms. Reason: [Association failed with
>>>> [akka.tcp://flink-metrics@flink-taskmanager:33837]] Caused by: [No
>>>> response from remote for outbound association. Associate timed out
>>>> after [20000 ms].]
>>>> 2023-11-23 06:09:57,668 WARN akka.remote.transport.netty.
>>>> NettyTransport [] - Remote connection to [null]
>>>> failed with org.jboss.netty.channel.ConnectTimeoutException:
>>>> connection timed out: flink-taskmanager/172.20.208.151:33837
>>>> 2023-11-23 06:14:38,188 INFO org.apache.kafka.clients.NetworkClient
>>>> [] - [AdminClient clientId=KafkaSource-
>>>> 7770001137980494918-enumerator-admin-client] Node -1 disconnected.
>>>> 2023-11-23 06:19:38,354 INFO org.apache.kafka.clients.NetworkClient
>>>> [] - [AdminClient clientId=KafkaSource-
>>>> 7770001137980494918-enumerator-admin-client] Node 9 disconnected.
>>>> 2023-11-23 06:24:39,060 INFO org.apache.kafka.clients.NetworkClient
>>>> [] - [AdminClient clientId=KafkaSource-
>>>> 7770001137980494918-enumerator-admin-client] Node 6 disconnected.
>>>> 2023-11-23 06:29:39,801 INFO org.apache.kafka.clients.NetworkClient
>>>> [] - [AdminClient clientId=KafkaSource-
>>>> 7770001137980494918-enumerator-admin-client] Node 8 disconnected.
>>>> 2023-11-23 06:34:40,544 INFO org.apache.kafka.clients.NetworkClient
>>>> [] - [AdminClient clientId=KafkaSource-
>>>> 7770001137980494918-enumerator-admin-client] Node 13 disconnected.
>>>> 2023-11-23 06:39:41,245 INFO org.apache.kafka.clients.NetworkClient
>>>> [] - [AdminClient clientId=KafkaSource-
>>>> 7770001137980494918-enumerator-admin-client] Node 3 disconnected.
>>>> 2023-11-23 06:44:41,976 INFO org.apache.kafka.clients.NetworkClient
>>>> [] - [AdminClient clientId=KafkaSource-
>>>> 7770001137980494918-enumerator-admin-client] Node 2 disconnected.
>>>>
>>>>
>>>> Thanks,
>>>> Tauseef
>>>>
>>>
