Needing to manually copy the jars to all of the nodes would mean that you aren't applying the Pig 'register <jar>;' command properly.
-----Original Message----- From: "Christian Decker" <decker.christ...@gmail.com> Sent: Wednesday, August 18, 2010 7:08am To: user@cassandra.apache.org Subject: Re: Cassandra and Pig I got one step further by cheating a bit, I just took all the Cassandra Jars and dropped them into the Hadoop lib folder, so at least now I can run some pig scripts over the data in Cassandra, but this is far from optimal since it means I'd have to distribute my UDFs also to the Hadoop cluster, or did I miss something? Regards, Chris -- Christian Decker Software Architect http://blog.snyke.net On Tue, Aug 17, 2010 at 4:04 PM, Christian Decker < decker.christ...@gmail.com> wrote: > Ok, by now it's getting very strange. I deleted the entire installation and > restarted from scratch and now I'm getting a similar error even though I'm > going through the pig_cassandra script. > > 2010-08-17 15:54:10,049 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 0% complete > 2010-08-17 15:55:10,032 [Thread-10] INFO > org.apache.cassandra.config.DatabaseDescriptor - Auto DiskAccessMode > determined to be standard > 2010-08-17 15:55:24,652 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - HadoopJobId: job_201008111350_0020 > 2010-08-17 15:55:24,652 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - More information at: > http://hmaster:50030/jobdetails.jsp?jobid=job_201008111350_0020 > 2010-08-17 15:56:05,690 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 33% complete > 2010-08-17 15:56:09,874 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 100% complete > 2010-08-17 15:56:09,874 [main] ERROR > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 1 map reduce job(s) failed! > 2010-08-17 15:56:10,261 [main] INFO > > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - Failed! > 2010-08-17 15:56:10,351 [main] ERROR org.apache.pig.tools.grunt.Grunt - > ERROR 2997: Unable to recreate exception from backed error: Error: > java.lang.ClassNotFoundException: org.apache.thrift.TBase > > > which is a bit different from my original error, but on the backend I get a > classic ClassNotFoundException. > > Any ideas? > -- > Christian Decker > Software Architect > http://blog.snyke.net >
