You're welcome. You need to specify the class. I meant like that: spark-submit /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5.0. 0-1245-hadoop2.7.3.2.5.0.0-1245.jar --class "give the name of the class"
On Saturday, February 25, 2017, Raymond Xie <xie3208...@gmail.com> wrote: > Thank you, it is still not working: > > [image: Inline image 1] > > By the way, here is the original source: > > https://github.com/apache/spark/blob/master/examples/ > src/main/python/streaming/kafka_wordcount.py > > > *------------------------------------------------* > *Sincerely yours,* > > > *Raymond* > > On Sat, Feb 25, 2017 at 4:48 PM, Anahita Talebi <anahita.t.am...@gmail.com > <javascript:_e(%7B%7D,'cvml','anahita.t.am...@gmail.com');>> wrote: > >> Hi, >> >> I think if you remove --jars, it will work. Like: >> >> spark-submit /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5.0. >> 0-1245-hadoop2.7.3.2.5.0.0-1245.jar >> >> I had the same problem before and solved it by removing --jars. >> >> Cheers, >> Anahita >> >> On Saturday, February 25, 2017, Raymond Xie <xie3208...@gmail.com >> <javascript:_e(%7B%7D,'cvml','xie3208...@gmail.com');>> wrote: >> >>> I am doing a spark streaming on a hortonworks sandbox and am stuck here >>> now, can anyone tell me what's wrong with the following code and the >>> exception it causes and how do I fix it? Thank you very much in advance. >>> >>> spark-submit --jars /usr/hdp/2.5.0.0-1245/spark/li >>> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >>> /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >>> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >>> >>> Error: >>> No main class set in JAR; please specify one with --class >>> >>> >>> spark-submit --class /usr/hdp/2.5.0.0-1245/spark/li >>> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >>> /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >>> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >>> >>> Error: >>> java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/spark/li >>> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >>> >>> spark-submit --class /usr/hdp/2.5.0.0-1245/kafka/l >>> ibs/kafka-streams-0.10.0.2.5.0.0-1245.jar /usr/hdp/2.5.0.0-1245/spark/li >>> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >>> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >>> >>> Error: >>> java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/kafka/li >>> bs/kafka-streams-0.10.0.2.5.0.0-1245.jar >>> >>> *------------------------------------------------* >>> *Sincerely yours,* >>> >>> >>> *Raymond* >>> >> >
