Hello, I'm trying to include an external JAR file following the documentation for dependency management:
https://zeppelin.apache.org/docs/latest/manual/dependencymanagement.html The docs state, under "Loading Dependencies to Interpreter", that: "You can enter not only groupId:artifactId:version but also local file in artifact field". So, I enter the full path to my local JAR file. But when running a Spark job through the notebook, execution hangs and a Netty NoSuchMethod error message appears in the log; a full stack trace is copied below. This is using the latest binaries for Zeppelin (0.6.1), running locally. Does anybody have a suggestion how this can be resolved? Do I need to provide the required Netty dependencies? Many thanks, Michael Excerpt from Zeppelin logs: INFO [2016-09-05 17:20:53,794] ({Executor task launch worker-0} Logging.scala[logInfo]:54) - Fetching spark:// 192.168.1.81:54957/jars/[...]-assembly-1.0.jar to /private/var/folders/1v/_8cfp9313dv1sdmdhwggyp940000gn/T/spark-a0b6d56e-a884-4de3-8ded-65b1c21717f3/userFiles-98918d40-5946-4926-aa06-c5808cea7120/fetchFileTemp536145571300926075.tmp ERROR [2016-09-05 17:20:53,831] ({shuffle-server-1} TransportRequestHandler.java[operationComplete]:200) - Error sending result StreamResponse{streamId=/jars/[...]-assembly-1.0.jar, byteCount=32640349, body=FileSegmentManagedBuffer{file=[...]/zeppelin-0.6.1-bin-netinst/local-repo/2BVRQKH3U/[...]-assembly-1.0.jar, offset=0, length=32640349}} to /192.168.1.81:54959; closing connection io.netty.handler.codec.EncoderException: java.lang.NoSuchMethodError: io.netty.channel.DefaultFileRegion.<init>(Ljava/io/File;JJ)V at io.netty.handler.codec.MessageToMessageEncoder.write(MessageToMessageEncoder.java:107) at io.netty.channel.AbstractChannelHandlerContext.invokeWrite(AbstractChannelHandlerContext.java:658) at io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:716) at io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:651) at io.netty.handler.timeout.IdleStateHandler.write(IdleStateHandler.java:266) at io.netty.channel.AbstractChannelHandlerContext.invokeWrite(AbstractChannelHandlerContext.java:658) at io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:716) at io.netty.channel.AbstractChannelHandlerContext.writeAndFlush(AbstractChannelHandlerContext.java:706) at io.netty.channel.AbstractChannelHandlerContext.writeAndFlush(AbstractChannelHandlerContext.java:741) at io.netty.channel.DefaultChannelPipeline.writeAndFlush(DefaultChannelPipeline.java:895) at io.netty.channel.AbstractChannel.writeAndFlush(AbstractChannel.java:240) at org.apache.spark.network.server.TransportRequestHandler.respond(TransportRequestHandler.java:193) at org.apache.spark.network.server.TransportRequestHandler.processStreamRequest(TransportRequestHandler.java:149) at org.apache.spark.network.server.TransportRequestHandler.handle(TransportRequestHandler.java:110) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:119) at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:51) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:254) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319) at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:85) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:333) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:319) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:787) at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:130) at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511) at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468) at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NoSuchMethodError: io.netty.channel.DefaultFileRegion.<init>(Ljava/io/File;JJ)V at org.apache.spark.network.buffer.FileSegmentManagedBuffer.convertToNetty(FileSegmentManagedBuffer.java:133) at org.apache.spark.network.protocol.MessageEncoder.encode(MessageEncoder.java:54) at org.apache.spark.network.protocol.MessageEncoder.encode(MessageEncoder.java:33) at io.netty.handler.codec.MessageToMessageEncoder.write(MessageToMessageEncoder.java:89)
