Hi community,

I am pretty new to the Flink ecosystem and I am trying to create a Flink
consumer that consumes messages from an Azure Event Hub for Apache Kafka.
My flink job runs on an ubuntu vm.

When I run my job via the mvn -exec command the consumer brings messages.

Following a different process, where I start a standalone cluster (via
start-cluster.sh), then packaging my code to a .jar file and submitting the
job by using the command flink run, I get the following message:

INFO  org.apache.kafka.clients.admin.internals.AdminMetadataManager [] -
[AdminClient clientId=flink-consumer-enumerator-admin-client] Metadata
update failed
org.apache.kafka.common.errors.TimeoutException:
Call(callName=fetchMetadata, deadlineMs=1680868187237, tries=1,
nextAllowedTryMs=1680868187367) timed out at 1680868187267 after 1
attempt(s)
Caused by: org.apache.kafka.common.errors.DisconnectException: Cancelled
fetchMetadata request with correlation id 4 due to node 0 being disconnected

I think that the main reason behind the failure has something to do with
the configurations of the cluster that I start, as defined at conf.yaml,
since the mvn -exec runs it locally.

Any proposal, suggestion or guide is welcome guide.

Regards,
Lampros

Reply via email to