Hi Gordon, Thanks for your answer. - I've built it with Maven 3.2.5 - I am using Jackson in my application (version 2.7.4)
Something that I have noticed when building Kinesis connector is that it excludes jackson: [INFO] Excluding com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.7.3 from the shaded jar. even though I can't find any mention of that in it's pom.xml. Cheers, Tomasz On 26 September 2017 at 15:43, Tzu-Li (Gordon) Tai <tzuli...@apache.org> wrote: > Hi Tomasz, > > Yes, dependency clashes may surface when executing actual job runs on > clusters. > > A few things to probably check first: > - Have you built Flink or the Kinesis connector with Maven version 3.3 or > above? If yes, try using a lower version, as 3.3+ results in some shading > issues when used to build Flink. > - I’m not sure if the Kinesis client has a Jackson dependency, but you could > also try checking if your application pulls in a conflicting Jackson version > (with Flink, which uses 2.7.4) via some other dependency. > > Cheers, > Gordon > > > On 26 September 2017 at 4:28:27 PM, Tomasz Dobrzycki > (dobrzycki.tom...@gmail.com) wrote: > > Hi guys, > > I'm working with Kinesis connector and currently trying to solve a > bizarre issue. > I had problems with Kinesis and httpcomponents which I was able to > solve using steps shown in: > https://github.com/apache/flink/pull/4150/commits/9b539470ac308d7af9df9a70792aa1fa8c6995fc > > That did the trick and I am able to run my code successfully via > IntelliJ. I am connecting to Kinesis stream hosted on AWS and reading > messages just fine. > > Unfortunately that is not true for running Flink via command line > scripts. I get this error when running start-local.sh into flink run > ... : > Caused by: java.lang.ClassNotFoundException: > com.fasterxml.jackson.dataformat.cbor.CBORFactory > > I have built my Kinesis connector and installed it via mvn install. Am > I missing some steps? I'm assuming that my code is fine given that I'm > able to run it through IntelliJ. > > Anyone faced this problem or maybe some solution comes to your mind? > > Cheers > Tomasz
