The class is in *kafka_2.10-0.8.2.1.jar* not in
spark-streaming-kafka_2.10-1.5.1.jar
I found the error... so embarrasing. I was executing in cluster-mode and I
only had the jars in the gateway. I guess that Spark chose an NodeManager
to execute a container with the Driver and load the libraries, b
That sounds like specific for Kafka. Check this
https://www.codatlas.com/github.com/apache/kafka/HEAD/core/src/main/scala/kafka/api/TopicMetadataRequest.scala
I cannot see it in
jar tvf spark-streaming-kafka_2.10-1.5.1.jar|grep TopicMetadataRequest
Dr Mich Talebzadeh
LinkedIn *
https://w
I was looking the log carefully looking for others error. Anyway the
complete Exception is:
2016-05-09 13:20:25,646 [Driver] ERROR
org.apache.spark.deploy.yarn.ApplicationMaster - User class threw
exception: java.lang.NoClassDefFoundError:
kafka/api/TopicMetadataRequest
java.lang.NoClassDefFoundEr
NoClassDefFoundError is different than saying that it could not be
loaded from the classpath.
>From my experience, there should be some other error before this error
which would give you better idea.
You can also check whether another version of kafka is embedded in any
of the jars listed below.
*jar tvf kafka_2.10-0.8.2.1.jar | grep TopicMetadataRequest *
1757 Thu Feb 26 14:30:34 CET 2015
kafka/api/TopicMetadataRequest$$anonfun$1.class
1712 Thu Feb 26 14:30:34 CET 2015
kafka/api/TopicMetadataRequest$$anonfun$readFrom$1.class
1437 Thu Feb 26 14:30:34 CET 2015
kafka/api/TopicMetadataR
