Hi Manu, Glad that you have the issue resolved.
If i understand the issue correctly.... Your cassandra installation had RandomParitioner but the bulk loader configuration (cassandra.yaml) had Murmur3Partitioner? By fixing the cassandra.yaml for the bulk loader the issue got resolved? If not then we might have a bug and your feedback might help the community. Regards, </VJ> On Wed, Sep 19, 2012 at 10:41 PM, Manu Zhang <owenzhang1...@gmail.com>wrote: > the problem seems to have gone away with changing Murmur3Partitioner back > to RandomPartitioner > > > On Thu, Sep 20, 2012 at 11:14 AM, Manu Zhang <owenzhang1...@gmail.com>wrote: > >> Yeah, BulkLoader. You did help me to elaborate my question. Thanks! >> >> >> On Thu, Sep 20, 2012 at 10:58 AM, Michael Kjellman < >> mkjell...@barracuda.com> wrote: >> >>> I assumed you were talking about BulkLoader. I haven't played with trunk >>> yet so I'm afraid I won't be much help here... >>> >>> On Sep 19, 2012, at 7:56 PM, "Manu Zhang" <owenzhang1...@gmail.com >>> <mailto:owenzhang1...@gmail.com>> wrote: >>> >>> cassandra-trunk (so it's 1.2); no Hadoop, bulk load example here >>> http://www.datastax.com/dev/blog/bulk-loading#comment-127019; buffer >>> size is 64 MB as in the example; I'm dealing with about 1GB data. job >>> config, you mean? >>> >>> On Thu, Sep 20, 2012 at 10:32 AM, Michael Kjellman < >>> mkjell...@barracuda.com<mailto:mkjell...@barracuda.com>> wrote: >>> A few questions: what version of 1.1 are you running. What version of >>> Hadoop? >>> >>> What is your job config? What is the buffer size you've chosen? How much >>> data are you dealing with? >>> >>> On Sep 19, 2012, at 7:23 PM, "Manu Zhang" <owenzhang1...@gmail.com >>> <mailto:owenzhang1...@gmail.com>> wrote: >>> >>> > I've been bulk loading data into Cassandra and seen the following >>> exception: >>> > >>> > ERROR 10:10:31,032 Exception in thread >>> Thread[CompactionExecutor:5,1,main] >>> > java.lang.RuntimeException: Last written key >>> DecoratedKey(-442063125946754, 313130303136373a31) >= current key >>> DecoratedKey(-465541023623745, 313036393331333a33) writing into >>> /home/manuzhang/cassandra/data/tpch/lineitem/tpch-lineitem-tmp-ia-56-Data.db >>> > at >>> org.apache.cassandra.io.sstable.SSTableWriter.beforeAppend(SSTableWriter.java:131) >>> > at >>> org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:152) >>> > at >>> org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:169) >>> > at >>> org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48) >>> > at >>> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) >>> > at >>> org.apache.cassandra.db.compaction.CompactionTask.execute(CompactionTask.java:69) >>> > at >>> org.apache.cassandra.db.compaction.CompactionManager$1.run(CompactionManager.java:152) >>> > at >>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) >>> > at >>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >>> > at java.util.concurrent.FutureTask.run(FutureTask.java:166) >>> > at >>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >>> > at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >>> > at java.lang.Thread.run(Thread.java:722) >>> > >>> > The running Cassandra and that I load data into are the same one. >>> > >>> > What's the cause? >>> >>> 'Like' us on Facebook for exclusive content and other resources on all >>> Barracuda Networks solutions. >>> >>> Visit http://barracudanetworks.com/facebook >>> >>> >>> >>> >>> >>> >>> 'Like' us on Facebook for exclusive content and other resources on all >>> Barracuda Networks solutions. >>> Visit http://barracudanetworks.com/facebook >>> >>> >>> >> >
