Hi Shammon, Thanks for your response.
If it is a network issue as you have mentioned, how does it read the contents of the jar file, we can see that the code is read and it throws an error only when executing the SQL. Also can you let us know exactly what address could be wrong here, so that we could correct from our end. My other doubt is whether we should port-forward the job manager (is it necessary when using Kubernetes standalone) before submitting the job using the run command. Thanks, Elakiya On Mon, Aug 14, 2023 at 11:15 AM Shammon FY <zjur...@gmail.com> wrote: > Hi, > > It seems that the client can not access the right network to submit you > job, maybe the address option in k8s is wrong and you can check the error > message in k8s log > > Best, > Shammon FY > > On Fri, Aug 11, 2023 at 11:40 PM elakiya udhayanan <laks....@gmail.com> > wrote: > >> >> Hi Team, >> We are using Apache Flink 1.16.1 configured as a standalone Kubernetes >> pod ,for one of our applications to read from confluent Kafka topics to do >> event correlation. We are using the flink's Table API join for the same (in >> SQL format).We are able to submit the job using the flink's UI. For our DEV >> environment , we implemented a jenkins pipeline, which downloads the jar >> that is required to submit the job and also creates the flink kubernetes >> pods and copy the downloaded jar to the flink pod's folder and uses the >> flink's run command to submit the job.The deployment step happens through >> the spinnaker webhook. We use a docker file to create the kubernetes pods, >> also have a docker-entrypoin.sh which has the flink run command to submit >> the job. >> >> Everything works fine, but when the job is getting submitted , we get the >> below exception. >> >> The flink run command used is >> >> *flink run /opt/flink/lib/application-0.0.1.jar* >> Any help is appreciated. >> >> ------------------------------------------------------------ >> The program finished with the following exception: >> >> org.apache.flink.client.program.ProgramInvocationException: The main method >> caused an error: Failed to execute sql >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) >> at >> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) >> at >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:843) >> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:240) >> at >> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1087) >> at >> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1165) >> at >> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) >> at >> org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1165) >> Caused by: org.apache.flink.table.api.TableException: Failed to execute sql >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:867) >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:827) >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:918) >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:730) >> at com.sample.SampleStreamingApp.main(SampleStreamingApp.java:157) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) >> at >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown >> Source) >> at >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown >> Source) >> at java.base/java.lang.reflect.Method.invoke(Unknown Source) >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) >> ... 8 more >> Caused by: org.apache.flink.util.FlinkException: Failed to execute job >> 'insert-into_default_catalog.default_database.Sample'. >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2203) >> at >> org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:206) >> at >> org.apache.flink.table.planner.delegation.DefaultExecutor.executeAsync(DefaultExecutor.java:95) >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:850) >> ... 17 more >> Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to >> submit JobGraph. >> 15:06:44.964 [main] ERROR org.apache.flink.client.cli.CliFrontend - Error >> while running the command. >> org.apache.flink.client.program.ProgramInvocationException: The main method >> caused an error: Failed to execute sql >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:843) >> ~[application-0.0.1.jar:?] >> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:240) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1087) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1165) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) >> [application-0.0.1.jar:?] >> at >> org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1165) >> [application-0.0.1.jar:?] >> aused by: org.apache.flink.table.api.TableException: Failed to execute sql >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:867) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:827) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:918) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:730) >> ~[application-0.0.1.jar:?] >> at com.sample.SampleStreamingApp.main(SampleStreamingApp.java:157) >> ~[application-0.0.1.jar:?] >> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) ~[?:?] >> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown >> Source) ~[?:?] >> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown >> Source) ~[?:?] >> at java.lang.reflect.Method.invoke(Unknown Source) ~[?:?] >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) >> ~[application-0.0.1.jar:?] >> ... 8 more >> Caused by: org.apache.flink.util.FlinkException: Failed to execute job >> 'insert-into_default_catalog.default_database.Sample'. >> at >> org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2203) >> ~[flink-dist-1.16.1.jar:1.16.1] >> at >> org.apache.flink.client.program.StreamContextEnvironment.executeAsync(StreamContextEnvironment.java:206) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.table.planner.delegation.DefaultExecutor.executeAsync(DefaultExecutor.java:95) >> ~[?:?] >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:850) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:827) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:918) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.table.api.internal.TableEnvironmentImpl.executeSql(TableEnvironmentImpl.java:730) >> ~[application-0.0.1.jar:?] >> at com.sample.SampleStreamingApp.main(SampleStreamingApp.java:157) >> ~[application-0.0.1.jar:?] >> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native >> Method) ~[?:?] >> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown >> Source) ~[?:?] >> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown >> Source) ~[?:?] >> at java.lang.reflect.Method.invoke(Unknown Source) ~[?:?] >> at >> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) >> ~[application-0.0.1.jar:?] >> ... 8 more >> Caused by: org.apache.flink.runtime.client.JobSubmissionException: Failed to >> submit JobGraph. >> at >> org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$11(RestClusterClient.java:448) >> ~[application-0.0.1.jar:?] >> at java.util.concurrent.CompletableFuture.uniExceptionally(Unknown >> Source) ~[?:?] >> at >> java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(Unknown >> Source) ~[?:?] >> at java.util.concurrent.CompletableFuture.postComplete(Unknown >> Source) ~[?:?] >> at >> java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) >> ~[?:?] >> at >> org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$6(FutureUtils.java:271) >> ~[application-0.0.1.jar:?] >> at java.util.concurrent.CompletableFuture.uniWhenComplete(Unknown >> Source) ~[?:?] >> at >> java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(Unknown >> Source) ~[?:?] >> at java.util.concurrent.CompletableFuture.postComplete(Unknown >> Source) ~[?:?] >> at >> java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) >> ~[?:?] >> at >> org.apache.flink.util.concurrent.FutureUtils$Timeout.run(FutureUtils.java:1125) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.util.concurrent.DirectExecutorService.execute(DirectExecutorService.java:217) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.util.concurrent.FutureUtils.lambda$orTimeout$12(FutureUtils.java:489) >> ~[application-0.0.1.jar:?] >> at java.util.concurrent.Executors$RunnableAdapter.call(Unknown >> Source) ~[?:?] >> at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?] >> at >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown >> Source) ~[?:?] >> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) >> ~[?:?] >> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown >> Source) ~[?:?] >> at java.lang.Thread.run(Unknown Source) ~[?:?] >> Caused by: java.util.concurrent.TimeoutException >> at >> org.apache.flink.util.concurrent.FutureUtils$Timeout.run(FutureUtils.java:1125) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.util.concurrent.DirectExecutorService.execute(DirectExecutorService.java:217) >> ~[application-0.0.1.jar:?] >> at >> org.apache.flink.util.concurrent.FutureUtils.lambda$orTimeout$12(FutureUtils.java:489) >> ~[application-0.0.1.jar:?] >> at java.util.concurrent.Executors$RunnableAdapter.call(Unknown >> Source) ~[?:?] >> at java.util.concurrent.FutureTask.run(Unknown Source) ~[?:?] >> at >> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown >> Source) ~[?:?] >> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) >> ~[?:?] >> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown >> Source) ~[?:?] >> at java.lang.Thread.run(Unknown Source) ~[?:?] >> at >> org.apache.flink.client.program.rest.RestClusterClient.lambda$submitJob$11(RestClusterClient.java:448) >> at >> java.base/java.util.concurrent.CompletableFuture.uniExceptionally(Unknown >> Source) >> at >> java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(Unknown >> Source) >> at >> java.base/java.util.concurrent.CompletableFuture.postComplete(Unknown Source) >> at >> java.base/java.util.concurrent.CompletableFuture.completeExceptionally(Unknown >> Source) >> at >> org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$6(FutureUtils.java:271) >> at >> java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(Unknown >> Source) >> at >> java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(Unknown >> Source) >> at >> java.base/java.util.concurrent.CompletableFuture.postComplete(Unknown Source) >> at >> java.base/java.util.concurrent.CompletableFuture.completeExceptionally(Unknown >> Source) >> at >> org.apache.flink.util.concurrent.FutureUtils$Timeout.run(FutureUtils.java:1125) >> at >> org.apache.flink.util.concurrent.DirectExecutorService.execute(DirectExecutorService.java:217) >> at >> org.apache.flink.util.concurrent.FutureUtils.lambda$orTimeout$12(FutureUtils.java:489) >> at >> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) >> at java.base/java.util.concurrent.FutureTask.run(Unknown Source) >> at >> java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown >> Source) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) >> at >> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) >> at java.base/java.lang.Thread.run(Unknown Source) >> Caused by: java.util.concurrent.TimeoutException >> ... 9 more >> >>
