I moved lib files..the consumer still gets the below error
this is how I install kafka from the online docs. are the docs
incorrect?
tar -xzf kafka-0.8.0-src.tgz
cd kafka-#{version}-src
./sbt update
./sbt package
./sbt assembly-package-dependency
2014-02-26 05:36:35,298 INFO [main]
io.druid.segment.realtime.RealtimeManager - Calling the FireDepartment and
getting a Firehose.
2014-02-26 05:36:35,300 ERROR [main] io.druid.cli.CliBroker - Error when
starting up. Failing.
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
at com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
at io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
at io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
at io.druid.cli.Main.main(Main.java:91)
Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at
io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
at
io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
at
io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
at
io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
... 10 more
Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 25 more
^Z
[3]+ Stopped tail -f realtime.log
On Wed, Feb 26, 2014 at 1:26 PM, Jun Rao <[email protected]> wrote:
> You just need to copy scala-library.jar. The version depends on scala
> version that the kafka jar is built with.
>
> Thanks,
>
> Jun
>
>
> On Tue, Feb 25, 2014 at 9:21 PM, David Montgomery <
> [email protected]
> > wrote:
>
> > Below are the scala jar files I have on the system. Which do I move?
> >
> > and I move to this dir? /var/lib/kafka-0.8.0-src/lib
> >
> >
> >
> >
> > root@do-kafka-sg-development-20140217110812:/var/lib/kafka-0.8.0-src#
> find
> > / -name *scala*.jar
> > /root/.ivy2/cache/org.scalatest/scalatest/jars/scalatest-1.2.jar
> >
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.8.0.jar
> >
> /root/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.9.2.jar
> >
> >
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.9.2.jar
> >
> >
> /root/.ivy2/cache/org.scala-lang/scala-compiler/jars/scala-compiler-2.8.0.jar
> > /root/.sbt/boot/scala-2.9.2/lib/scala-compiler.jar
> > /root/.sbt/boot/scala-2.9.2/lib/scala-library.jar
> > /root/.sbt/boot/scala-2.8.0/lib/scala-compiler.jar
> > /root/.sbt/boot/scala-2.8.0/lib/scala-library.jar
> >
> >
> >
> >
> > On Wed, Feb 26, 2014 at 1:11 PM, Jun Rao <[email protected]> wrote:
> >
> > > You just need to add the scala jar to the lib dir.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > >
> > > On Tue, Feb 25, 2014 at 8:40 PM, David Montgomery <
> > > [email protected]
> > > > wrote:
> > >
> > > > Hi,
> > > >
> > > > This is how I start kafka.
> > > >
> > > > command = /var/lib/kafka-<%=@version%>-src/bin/kafka-server-start.sh
> > > > /var/lib/kafka-<%=@version%>-src/config/server.properties
> > > >
> > > > In another application I get teh below error. The suggestion is to
> add
> > > the
> > > > scalar libraries to the path. How do I do that?
> > > >
> > > >
> > > > thanks
> > > >
> > > >
> > > > java.lang.reflect.
> > > > InvocationTargetException
> > > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > > at
> > > >
> > > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > > > at
> > > >
> > > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > > at java.lang.reflect.Method.invoke(Method.java:606)
> > > > at
> > > >
> > > >
> > >
> >
> com.metamx.common.lifecycle.Lifecycle$AnnotationBasedHandler.start(Lifecycle.java:331)
> > > > at
> com.metamx.common.lifecycle.Lifecycle.start(Lifecycle.java:250)
> > > > at
> io.druid.guice.LifecycleModule$2.start(LifecycleModule.java:136)
> > > > at
> io.druid.cli.GuiceRunnable.initLifecycle(GuiceRunnable.java:72)
> > > > at io.druid.cli.ServerRunnable.run(ServerRunnable.java:40)
> > > > at io.druid.cli.Main.main(Main.java:91)
> > > > Caused by: java.lang.NoClassDefFoundError: scala/ScalaObject
> > > > at java.lang.ClassLoader.defineClass1(Native Method)
> > > > at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> > > > at
> > > >
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> > > > at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> > > > at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > > > at java.security.AccessController.doPrivileged(Native Method)
> > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > > > at
> > > >
> > > >
> > >
> >
> io.druid.firehose.kafka.KafkaEightFirehoseFactory.connect(KafkaEightFirehoseFactory.java:76)
> > > > at
> > > >
> > io.druid.segment.realtime.FireDepartment.connect(FireDepartment.java:90)
> > > > at
> > > >
> > > >
> > >
> >
> io.druid.segment.realtime.RealtimeManager$FireChief.init(RealtimeManager.java:150)
> > > > at
> > > >
> > io.druid.segment.realtime.RealtimeManager.start(RealtimeManager.java:87)
> > > > ... 10 more
> > > > Caused by: java.lang.ClassNotFoundException: scala.ScalaObject
> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > > > at java.security.AccessController.doPrivileged(Native Method)
> > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > > > ... 25 more
> > > >
> > >
> >
>
