Thanks for the example code! I'll try it out.
Wendong
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-cannot-find-org-I0Itec-zkclient-serialize-ZkSerializer-tp2199p2294.html
Sent from the Apache Flink User Mailing List archive. m
Yes, I was running exactly that code. This is a repository containing the
files: https://github.com/rmetzger/scratch/tree/flink-sbt-master
Here is the program:
https://github.com/rmetzger/scratch/blob/flink-sbt-master/src/main/scala/org/myorg/quickstart/Job.scala
On Tue, Jul 28, 2015 at 2:01 AM, W
Just to confirm: are you able to compile and run the program of testing Kafka
similar to the following?
import org.apache.kafka.clients.producer.{ProducerConfig, KafkaProducer,
ProducerRecord}
import org.apache.flink.streaming.api.environment._
import org.apache.flink.streaming.connectors.kafka
Thank you for posting the full SBT files.
I now understand why you exclude the kafka dependency from Flink. SBT does
not support to read maven properties only defined in profiles.
I will fix the issue for Flink 0.10 (
https://issues.apache.org/jira/browse/FLINK-2408)
I was not able to reproduce
Below is the build.sbt I am using (also include project/assembly.sbt) :
//- Start build.sbt ---
version := "1.0"
scalaVersion := "2.10.4"
libraryDependencies ++= Seq("org.apache.flink" % "flink-scala" % "0.9.0",
"org.apache.flink" % "flink-clients" % "0.9.0")
Can you share your full sbt build file with me?
I'm trying to reproduce the issue, but I have never used sbt before.
I was able to configure the assembly plugin, but the produced fat jar
didn't contain the zkclient. Maybe your full sbt build file would help me
to identify the issue faster.
Let me
Wendong,
Sorry to hear that you are having such trouble with the example.
We are using the Kafka connector with many people, building the examples
with Maven. It works without any problems.
Maybe SBT is just not handling these dependencies correctly, or the SBT
script defines the dependencies in
Thanks Stephan and Till.
Since I couldn't make a working example of Flink and Kafka after struggling
a week, I have to temporarily stop the evaluation work and switch to other
tasks. I hope in the near future, someone can come up with a working sample
of KafkaWordCount, similar to that of Spark s
>> ******************
>>
>>
>>
>>
>> Best regards
>> Hawin
>>
>> -Original Message-
>> From: Wendong [mailto:wendong@gmail.com]
>> Sent: Tuesday, July 21, 2015 5:16 PM
org.apache.kafka
> kafka-clients
> 0.8.2.1
>
> **
>
>
>
>
> Best regards
> Hawin
>
> -Original Message-
> From: Wendong [mailto:wendong@gmail.com]
> Sent: Tuesday, July 21, 2015 5:16 PM
&g
21, 2015 5:16 PM
To: user@flink.apache.org
Subject: Re: Flink Kafka cannot find
org/I0Itec/zkclient/serialize/ZkSerializer
Hi Hawin,
I'm using sbt as shown in the original post. I tried using maven and
pom.xml, but got different NoClassDefFoundError: com/yammer/metrics/Metrics.
I've
Hi Hawin,
I'm using sbt as shown in the original post. I tried using maven and
pom.xml, but got different NoClassDefFoundError: com/yammer/metrics/Metrics.
I've downloaded metrics-core-2.2.0.jar under lib/ but it doesn't help. It
seems the errors from sbt and Maven belong to same nature. Here is m
Maybe you can posted your pom.xml file to identify your issue.
Best regards
Hawin
On Tue, Jul 21, 2015 at 2:57 PM, Wendong wrote:
> also tried using zkclient-0.3.jar in lib/, updated build.sbt and rebuild.
> It
> doesn't help. Still got the same error of NoClassDefFoundError:
> ZkSerializer
>
also tried using zkclient-0.3.jar in lib/, updated build.sbt and rebuild. It
doesn't help. Still got the same error of NoClassDefFoundError: ZkSerializer
in flink.streaming.connectors.kafka.api.KafkaSource.open().
--
View this message in context:
http://apache-flink-user-mailing-list-archive.23
Hi Max,
The program runs locally in one machine. I use "grep ZkSerializer" in the
generated fat jar file and it exists, so it seems build process is OK. I
also put zkclient-0.5.jar under /lib/ and it contains the
class of ZkSerializer.
Thanks,
Wendong
--
View this message in context:
http:/
Hi,
Are you running this locally or in a cluster environment? Did you put the
zkClient-0.5.jar in the /lib directory of every node (also task managers)?
It seems like sbt should include the zkClient dependency in the fat jar. So
there might be something wrong with your build process.
Best regard
to be specific, the error occurs at:
org.apache.flink.*streaming.connectors.kafka.api.KafkaSource.initializeConnection*(KafkaSource.java:175)
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-cannot-find-org-I0Itec-zkclient-seriali
17 matches
Mail list logo
