Hi Flink Team,

We’re running into a couple of issues running Flink on an Azure Kubernetes 
cluster.

AKS version : 1.29.7
Flink version : 1.16.3

Our AKS cluster is inside a VNET and we’ve followed this document to install 
the Flink cluster.
https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/resource-providers/standalone/kubernetes/

We built a fatjar and have used docker compose to run it locally with no 
issues.  However, when we take the same fatjar and try to deploy it to our AKS 
we run into a couple of issues.

We used the “Submit New Job” in the Dashboard to upload the fatjar and submit 
it.  I verified the fatjar has the MongoSource class so I’m not sure why the 
class not found exceptions is happening.  The other exception we can’t figure 
out as to why it happens on AKS but not running it from local.
I also tried to use the “flink run..” to submit the job with the same results.

Any help would be greatly appreciated.

Issue #1
ClassNotFound Exception for MongoSource

Issue #2
Caused by: org.apache.kafka.common.KafkaException: 
org.apache.kafka.common.errors.SaslAuthenticationException: Failed to configure 
SaslClientAuthenticator
                at 
org.apache.kafka.common.network.SaslChannelBuilder.buildChannel(SaslChannelBuilder.java:240)
 
~[blob_p-884c6863fcf1106e2b36db7bac43bdaf2e2b7ab8-cc40db2b62c2c4aa9d931b423dfb1c52:?]
                at 
org.apache.kafka.common.network.Selector.buildAndAttachKafkaChannel(Selector.java:338)
 
~[blob_p-884c6863fcf1106e2b36db7bac43bdaf2e2b7ab8-cc40db2b62c2c4aa9d931b423dfb1c52:?]
                ... 8 more
Caused by: org.apache.kafka.common.errors.SaslAuthenticationException: Failed 
to configure SaslClientAuthenticator
Caused by: java.lang.IllegalArgumentException: Callback handler must be 
castable to org.apache.kafka.common.security.auth.AuthenticateCallbackHandler: 
org.apache.kafka.common.security.oauthbearer.internals.OAuthBearerSaslClientCallbackHandler
                at 
org.apache.kafka.common.security.oauthbearer.internals.OAuthBearerSaslClient$OAuthBearerSaslClientFactory.createSaslClient(OAuthBearerSaslClient.java:182)
 
~[blob_p-884c6863fcf1106e2b36db7bac43bdaf2e2b7ab8-cc40db2b62c2c4aa9d931b423dfb1c52:?]
                at javax.security.sasl.Sasl.createSaslClient(Unknown Source) 
~[?:?]
                at 
org.apache.kafka.common.security.authenticator.SaslClientAuthenticator.lambda$createSaslClient$0(SaslClientAuthenticator.java:219)
 
~[blob_p-884c6863fcf1106e2b36db7bac43bdaf2e2b7ab8-cc40db2b62c2c4aa9d931b423dfb1c52:?]
                at java.security.AccessController.doPrivileged(Native Method) 
~[?:?]
                at javax.security.auth.Subject.doAs(Unknown Source) ~[?:?]
                at 
org.apache.kafka.common.security.authenticator.SaslClientAuthenticator.createSaslClient(SaslClientAuthenticator.java:215)
 ~

-Julio

Reply via email to