Re: Error while sinking results to Cassandra using Flink Cassandra Connector

2019-08-22 Thread Fabian Hueske
Hi Manvi, A NoSuchMethodError typically indicates a version mismatch. I would check if the Flink versions of your program, the client, and the cluster are the same. Best, Fabian Am Di., 20. Aug. 2019 um 21:09 Uhr schrieb manvmali : > Hi, I am facing the issue of writing the data stream result i

Error while sinking results to Cassandra using Flink Cassandra Connector

2019-08-20 Thread manvmali
Hi, I am facing the issue of writing the data stream result into Cassandra. I tried with a sample job of just sinking a Tuple into Cassandra. And I keep on getting “java.lang.NoSuchMethodError” while running the job on Flink deployed on Kubernetes. Here is the sample WriteToCassandraJob: publ

Re: Build Cassandra Connector with some customization

2018-05-30 Thread Chesnay Schepler
directory: flink-connectors/flink-connector-cassandra command: mvn package -Ddriver.version=3.1.4 -Dguava.version=16.0.1 On 29.05.2018 14:41, Soheil Pourbafrani wrote: I want to build Flink Cassandra connector against datastax version 3.1.4 guava 16.0.1 using what command I can do that? and in

Build Cassandra Connector with some customization

2018-05-29 Thread Soheil Pourbafrani
I want to build Flink Cassandra connector against datastax version 3.1.4 guava 16.0.1 using what command I can do that? and in what Flink source directory?

Re: What is the package in Flink-Cassandra-connector, includes Cassandra datastax core

2018-05-29 Thread Chesnay Schepler
The cassandra-driver-core dependency is not relocated (i.e. renamed) in the cassandra connector. If it were you wouldn't have conflicts ;) The cassandra-connector artifact is a fat-jar, and thus always contains this dependency. There is no way get rid of it with maven exclusions (outsid

What is the package in Flink-Cassandra-connector, includes Cassandra datastax core

2018-05-29 Thread Soheil Pourbafrani
Hi, I use Flink Cassandra Connector dependency in my maven project. Other components have conflict with the cassandra-driver-core that is embedded in flink-cassandra-connector. I tried to exclude that in pom.xml file like this: org.apache.flink flink-connector-cassandra_2.11 1.4.2

Re: Flink 1.4 with cassandra-connector: Shading error

2017-12-19 Thread Timo Walther
51dd29b83d2fb I think this can be explained very easily: 1. The flink-cassandra-connector-1.4 jar contains the Datastax Cassandra driver inside 2. The flink-cassandra-connector-1.4 jar contains a shaded (to org.apache.flink.cassandra.shaded.io.netty) netty 3. The DataStax driver executes the fo

Re: Flink 1.4 with cassandra-connector: Shading error

2017-12-19 Thread Nico Kruber
t;> initialize Netty, and I'm getting the following exception: >> >> Caused by: java.lang.AssertionError: Cannot locate Netty classes in >> the classpath:java.lang.ClassNotFoundException: >> com.datastax.shaded.netty.channel.Channel. >> Full exception here: >> https://gist.g

Re: Flink 1.4 with cassandra-connector: Shading error

2017-12-18 Thread Timo Walther
an be explained very easily: 1. The flink-cassandra-connector-1.4 jar contains the Datastax Cassandra driver inside 2. The flink-cassandra-connector-1.4 jar contains a shaded (to org.apache.flink.cassandra.shaded.io.netty) netty 3. The DataStax driver executes the following code when it initial

Flink 1.4 with cassandra-connector: Shading error

2017-12-18 Thread dominik
very easily: 1. The flink-cassandra-connector-1.4 jar contains the Datastax Cassandra driver inside 2. The flink-cassandra-connector-1.4 jar contains a shaded (to org.apache.flink.cassandra.shaded.io.netty) netty 3. The DataStax driver executes the following code when it initializes netty

Re: Cassandra Connector Problem (Possible Guava Conflict?)

2017-09-14 Thread AndreaKinn
Hi, I have the same problem but trying your solution so substituting this: org.apache.maven.plugins maven-shade-plugin 2.4.1

Re: Cassandra connector POJO - tombstone question

2017-06-01 Thread Tarandeep Singh
gt;>> you to cherry-pick it onto a 1.2 branch. >>> >>> I will add a ticket for this soon (currently getting timeouts in JIRA). >>> >>> Regards, >>> Chesnay >>> >>> >>> On 12.04.2017 02:27, Tarandeep Singh wrote: >>

Re: Cassandra connector POJO - tombstone question

2017-06-01 Thread Chesnay Schepler
Chesnay On 12.04.2017 02:27, Tarandeep Singh wrote: Hi, I am using flink-1.2 and Cassandra connector to write to cassandra tables. I am using POJOs with DataStax annotations as described here- https://ci.apache.org/projects/flink/flink

Re: Cassandra connector POJO - tombstone question

2017-06-01 Thread Tarandeep Singh
gt;> >> I will add a ticket for this soon (currently getting timeouts in JIRA). >> >> Regards, >> Chesnay >> >> >> On 12.04.2017 02:27, Tarandeep Singh wrote: >> >>> Hi, >>> >>> I am using flink-1.2 and Cassandra connec

Re: Cassandra connector POJO - tombstone question

2017-04-12 Thread Tarandeep Singh
you to cherry-pick it onto a 1.2 branch. > > I will add a ticket for this soon (currently getting timeouts in JIRA). > > Regards, > Chesnay > > > On 12.04.2017 02:27, Tarandeep Singh wrote: > >> Hi, >> >> I am using flink-1.2 and Cassandra connector to w

Re: Cassandra connector POJO - tombstone question

2017-04-12 Thread Chesnay Schepler
Singh wrote: Hi, I am using flink-1.2 and Cassandra connector to write to cassandra tables. I am using POJOs with DataStax annotations as described here- https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/cassandra.html My question is- how are nulls handles by cassandra

Cassandra connector POJO - tombstone question

2017-04-11 Thread Tarandeep Singh
Hi, I am using flink-1.2 and Cassandra connector to write to cassandra tables. I am using POJOs with DataStax annotations as described here- https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/connectors/cassandra.html My question is- how are nulls handles by cassandra sink

Re: Flink 1.2 and Cassandra Connector

2017-03-16 Thread Robert Metzger
I've created a pull request for the fix: https://github.com/apache/flink/pull/3556 It would be nice if one of the issue reporters could validate that the cassandra connector works after the fix. If it is a valid fix, I would like to include it into the upcoming 1.2.1 release. On Thu, M

Re: Flink 1.2 and Cassandra Connector

2017-03-16 Thread Robert Metzger
y adding this dependency > directly to the cassandra connector pom.xml (so that user jars always pull > it in via transitivity)? > > On Wed, Mar 15, 2017 at 4:09 PM, Nico wrote: > >> Hi @all, >> >> I came back to this issue today... >> >> @Robert: >> &

Re: Flink 1.2 and Cassandra Connector

2017-03-16 Thread Stephan Ewen
Can we improve the Flink experience here by adding this dependency directly to the cassandra connector pom.xml (so that user jars always pull it in via transitivity)? On Wed, Mar 15, 2017 at 4:09 PM, Nico wrote: > Hi @all, > > I came back to this issue today... > > @Robert:

Re: Flink 1.2 and Cassandra Connector

2017-03-15 Thread Nico
was to add the whole dependency: com.codahale.metrics metrics-core 3.0.2 This worked for me. Best, Nico 2017-03-06 11:46 GMT+01:00 Chesnay Schepler : > Hello, > > i believe the cassandra connector is not shading it's dependencies > properly. This didn't cause issue

Re: Flink 1.2 and Cassandra Connector

2017-03-06 Thread Chesnay Schepler
Hello, i believe the cassandra connector is not shading it's dependencies properly. This didn't cause issues in the past since flink used to have a dependency on codahale metrics as well. Please open a JIRA for this issue. Regards, Chesnay On 06.03.2017 11:32, Tarandeep Singh

Re: Flink 1.2 and Cassandra Connector

2017-03-06 Thread Tarandeep Singh
1.8 1.8 - On Sun, Feb 12, 2017 at 1:56 AM, Robert Metzger wrote: > Hi Nico, > The cassandra connector should be available on Maven central: > http://search.maven.org/#artifactdetails%7Corg.apache.

Re: Flink 1.2 and Cassandra Connector

2017-02-12 Thread Robert Metzger
Hi Nico, The cassandra connector should be available on Maven central: http://search.maven.org/#artifactdetails%7Corg.apache.flink%7Cflink-connector-cassandra_2.10%7C1.2.0%7Cjar Potentially, the issue you've mentioned is due to some shading issue. Is the "com/codahale/metrics/Metric

Flink 1.2 and Cassandra Connector

2017-02-09 Thread Nico
org.apache.flink.runtime.taskmanager.Task.run(Task.java:655) at java.lang.Thread.run(Thread.java:745) So I think the cassandra connector is the reason for it. Moreover, i don't see a version 1.2 in the maven repository for the connector as mentioned in the doc. org.apache.flink flink-connector-cassandra_2.10 1.2.0

Re: Cassandra Connector

2016-11-22 Thread Stephan Epping
a case classes) but we >> did not want the user to be aware of it. This has the neat property that we >> can change the underlying classes >> any way we want (like modifying the constructor) without breaking anything. >> >> Regards, >> Chesnay >>

Re: Cassandra Connector

2016-11-22 Thread Chesnay Schepler
be aware of it. This has the neat property that we can change the underlying classes any way we want (like modifying the constructor) without breaking anything. Regards, Chesnay On 22.11.2016 08:06, Stephan Epping wrote: Hello, I wondered why the cassandra connector has such an un

Re: Cassandra Connector

2016-11-22 Thread Chesnay Schepler
se classes) but we did not want the user to be aware of it. This has the neat property that we can change the underlying classes any way we want (like modifying the constructor) without breaking anything. Regards, Chesnay On 22.11.2016 08:06, Stephan Epping wrote: Hello, I wondered why the cass

Cassandra Connector

2016-11-21 Thread Stephan Epping
Hello, I wondered why the cassandra connector has such an unusual interface: CassandraSink csink = CassandraSink.addSink(readings) while all other sinks seem to look like RMQSink sink = new RMQSink(cfg, "readings_persist_out", new JSONReadingSchema()); readings.addSink(sink); best, Stephan

Re: Flink Cassandra Connector is not working

2016-10-27 Thread Fabian Hueske
.apache.flink.streaming.connectors.cassandra.CassandraSink$ > CassandraPojoSinkBuilder.build(CassandraSink.java:325) > > > Regards > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Flink-Cassandra- > Connector-is-not-working-tp

Flink Cassandra Connector is not working

2016-10-26 Thread NagaSaiPradeep
ra.CassandraSink$CassandraPojoSinkBuilder.build(CassandraSink.java:325) Regards -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Cassandra-Connector-is-not-working-tp9744.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Cassandra Connector Problem (Possible Guava Conflict?)

2016-06-26 Thread Eamon Kavanagh
contains 2 shaded guavas. >> I already have a fix ready that suppressed the root-poms shade plugin >> configuration inside the cassandra submit. >> >> I will submit that next week. >> >> >> On 26.06.2016 17:46, Eamon Kavanagh wrote: >>

Re: Cassandra Connector Problem (Possible Guava Conflict?)

2016-06-26 Thread Chesnay Schepler
I will submit that next week. On 26.06.2016 17:46, Eamon Kavanagh wrote: Hey everyone, I'm having an issue using the Flink -> Cassandra connector. The error message I get is: *Class com.datastax.driver.core.DefaultResultSetFuture does not implement the re

Re: Cassandra Connector Problem (Possible Guava Conflict?)

2016-06-26 Thread Eamon Kavanagh
e root-poms shade plugin > configuration inside the cassandra submit. > > I will submit that next week. > > > On 26.06.2016 17:46, Eamon Kavanagh wrote: > > Hey everyone, > > I'm having an issue using the Flink -> Cassandra connector.

Re: Cassandra Connector Problem (Possible Guava Conflict?)

2016-06-26 Thread Chesnay Schepler
ng an issue using the Flink -> Cassandra connector. The error message I get is: *Class com.datastax.driver.core.DefaultResultSetFuture does not implement the requested interface org.apache.flink.shaded.com.google.common.util.concurrent.ListenableFuture * I believe the problem is related

Cassandra Connector Problem (Possible Guava Conflict?)

2016-06-26 Thread Eamon Kavanagh
Hey everyone, I'm having an issue using the Flink -> Cassandra connector. The error message I get is: *Class com.datastax.driver.core.DefaultResultSetFuture does not implement the requested interface org.apache.flink.shaded.com.google.common.util.concurrent.ListenableFuture* I bel