Hi Manvi,

A NoSuchMethodError typically indicates a version mismatch.
I would check if the Flink versions of your program, the client, and the
cluster are the same.

Best, Fabian

Am Di., 20. Aug. 2019 um 21:09 Uhr schrieb manvmali <[email protected]
>:

> Hi, I am facing the issue of writing the data stream result into
> Cassandra. I tried with a sample job of just sinking a Tuple into
> Cassandra. And I keep on getting “java.lang.NoSuchMethodError” while
> running the job on Flink deployed on Kubernetes.
>
>
> Here is the sample WriteToCassandraJob:
>
> public class WriteToCassandra {
>
>     private static final String INSERT = "INSERT INTO kmv.testtable 
> (element1, element2) VALUES (?, ?)";
>     private static final ArrayList<Tuple2<String, Integer>> collection = new 
> ArrayList<>(20);
>
>     static {
>         for (int i = 0; i < 20; i++) {
>             collection.add(new Tuple2<>("cassandra-" + i, i));
>         }
>     }
>
>     public static void main(String[] args) throws Exception {
>         StreamExecutionEnvironment env = 
> StreamExecutionEnvironment.getExecutionEnvironment();
>
>         DataStreamSource<Tuple2<String, Integer>> source = 
> env.fromCollection(collection);
>
>         CassandraSink.addSink(source)
>                 .setQuery(INSERT)
>                 .setClusterBuilder(new ClusterBuilder() {
>                     @Override
>                     protected Cluster buildCluster(Builder builder) {
>                         return 
> builder.addContactPoint("172.28.232.144:9042").build();
>                     }
>                 })
>                 .build();
>
>         env.execute("WriteTupleIntoCassandra");
>     }
>
>
> }
>
>
>
> *StackTrace:*
>
> org.apache.flink.client.program.ProgramInvocationException: The program
> caused an error:
> at
> org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:93)
> at
> org.apache.flink.client.program.PackagedProgramUtils.createJobGraph(PackagedProgramUtils.java:80)
> at
> org.apache.flink.runtime.webmonitor.handlers.utils.JarHandlerUtils$JarHandlerContext.toJobGraph(JarHandlerUtils.java:126)
> at
> org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$getJobGraphAsync$6(JarRunHandler.java:142)
> at
> java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.NoSuchMethodError:
> org.apache.flink.api.java.ClosureCleaner.clean(Ljava/lang/Object;Z)V
> at
> org.apache.flink.streaming.connectors.cassandra.CassandraSinkBase.<init>(CassandraSinkBase.java:67)
> at
> org.apache.flink.streaming.connectors.cassandra.AbstractCassandraTupleSink.<init>(AbstractCassandraTupleSink.java:40)
> at
> org.apache.flink.streaming.connectors.cassandra.CassandraTupleSink.<init>(CassandraTupleSink.java:46)
> at
> org.apache.flink.streaming.connectors.cassandra.CassandraSink$CassandraTupleSinkBuilder.createSink(CassandraSink.java:454)
> at
> org.apache.flink.streaming.connectors.cassandra.CassandraSink$CassandraSinkBuilder.build(CassandraSink.java:415)
> at com.odc.atlas.testjob.WriteToCassandra.main(WriteToCassandra.java:37)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:529)
> at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:421)
> at
> org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:83)
>
>
> I also verified that my Flink and Scala versions are consistent. My grade
> dependencies looks like this:
>
> implementation "org.scala-lang:scala-library:2.12.8"
> implementation "org.apache.avro:avro:1.8.1"
> implementation "org.apache.flink:flink-scala_2.12:1.8.0"
> implementation "org.apache.flink:flink-streaming-scala_2.12:1.8.0"
> implementation "org.apache.flink:flink-avro:1.8.0"
> implementation "org.apache.flink:flink-connector-kafka-0.11_2.12:1.8.0"
> implementation "org.apache.flink:flink-connector-cassandra_2.12:1.8.0"
>
>
>
> Any pointers would be appreciated!
>
> Thanks,
> Manvi
>

Reply via email to