Re: I don't understand shuffle progress

2013-09-17 Thread Juan Manuel Formoso
I have been trying to make it work non-stop since Friday afternoon. I officially gave up today and I'm going to go the sstableloader route. I wrote a little of what I tried here: http://seniorgeek.com.ar/blog/2013/09/16/tips-for-running-cassandra-shuffle/ (I have yet to update it with the fact tha

Re: I don't understand shuffle progress

2013-09-17 Thread Paulo Motta
That is very disappointing to hear. Vnodes support is one of the main reasons we're upgrading from 1.1.X to 1.2.X. So you're saying the only feasible way of enabling VNodes on an upgraded C* 1.2 is by doing fork writes to a brand new cluster + bulk load of sstables from the old cluster? Or is it p

Re: I don't understand shuffle progress

2013-09-17 Thread Robert Coli
On Tue, Sep 17, 2013 at 4:00 PM, Juan Manuel Formoso wrote: > Any better alternatives than creating a small application that reads from > one cluster and inserts in the new one that anybody can suggest? > > http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandra In theory if you

How can I switch from multiple disks to a single disk?

2013-09-17 Thread Juan Manuel Formoso
Because I ran out of space when shuffling, I was forced to add multiple disks on my Cassandra nodes. When I finish compacting, cleaning up, and repairing, I'd like to remove them and return to one disk per node. What is the procedure to make the switch? Can I just kill cassandra, move the data fr

Re: I don't understand shuffle progress

2013-09-17 Thread Juan Manuel Formoso
> If your shuffle succeeds, you will be the first reported case of shuffle succeeding on a non-test cluster. Awesome! :O I'll try to migrate to a new cluster then. Any better alternatives than creating a small application that reads from one cluster and inserts in the new one that anybody can su

Re: I don't understand shuffle progress

2013-09-17 Thread Robert Coli
On Tue, Sep 17, 2013 at 12:13 PM, Juan Manuel Formoso wrote: > I am running shuffle on a cluster after upgrading to 1.2.X, and I don't > understand how to check progress. > If your shuffle succeeds, you will be the first reported case of shuffle succeeding on a non-test cluster. Until I hear a re

I don't understand shuffle progress

2013-09-17 Thread Juan Manuel Formoso
I am running shuffle on a cluster after upgrading to 1.2.X, and I don't understand how to check progress. I'm counting the lines of cassandra-shuffle ls, and it decreases VERY slowly. Sometimes not at all after 24 hours of processing. Is that value accurate? Does the shuffle operation supports di