Hi, Rémy Thanks for sharing the problem. Could you give a complete example that can reproduce the error?
Thanks, moon On 2015년 7월 24일 (금) at 오전 2:51 PHELIPOT, REMY <[email protected]> wrote: > Hello, > > I’m trying to use Zeppelin with a machine learning algorithms: > val c = regionRDD.map{r => (r.id > ,clusters.predict(Vectors.dense(r.meanColor(0),r.meanColor(1),r.meanColor(2))))} > c.collect.groupBy(_._2) > > However, the spark executor failed to achieve the job and the following > error message is displayed: > 15/07/24 09:40:47 ERROR SparkUncaughtExceptionHandler: Uncaught exception > in thread Thread[Executor task launch worker-6,5,main] > java.lang.NoClassDefFoundError: Lorg/apache/zeppelin/spark/ZeppelinContext; > at java.lang.Class.getDeclaredFields0(Native Method) > at java.lang.Class.privateGetDeclaredFields(Class.java:2583) > at java.lang.Class.getDeclaredField(Class.java:2068) > [….] > at > org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > > The problem seems to be related to Zeppelin context, but I don’t know how > to solve this problem, any ideas? > I am using the latest version of Zeppelin with Spark 1.4.1 and Hadoop 2.6. > > Rémy > > Ce message et toutes les pièces jointes (ci-après le "message") sont > établis à l’intention exclusive des destinataires désignés. Il contient des > informations confidentielles et pouvant être protégé par le secret > professionnel. Si vous recevez ce message par erreur, merci d'en avertir > immédiatement l'expéditeur et de détruire le message. Toute utilisation de > ce message non conforme à sa destination, toute diffusion ou toute > publication, totale ou partielle, est interdite, sauf autorisation expresse > de l’émetteur. L'internet ne garantissant pas l'intégrité de ce message > lors de son acheminement, Atos (et ses filiales) décline(nt) toute > responsabilité au titre de son contenu. Bien que ce message ait fait > l’objet d’un traitement anti-virus lors de son envoi, l’émetteur ne peut > garantir l’absence totale de logiciels malveillants dans son contenu et ne > pourrait être tenu pour responsable des dommages engendrés par la > transmission de l’un d’eux. > > This message and any attachments (the "message") are intended solely for > the addressee(s). It contains confidential information, that may be > privileged. If you receive this message in error, please notify the sender > immediately and delete the message. Any use of the message in violation of > its purpose, any dissemination or disclosure, either wholly or partially is > strictly prohibited, unless it has been explicitly authorized by the > sender. As its integrity cannot be secured on the internet, Atos and its > subsidiaries decline any liability for the content of this message. > Although the sender endeavors to maintain a computer virus-free network, > the sender does not warrant that this transmission is virus-free and will > not be liable for any damages resulting from any virus transmitted. >
