Re: Offline migration: Random->Murmur

2013-12-31 Thread Robert Coli
On Mon, Dec 30, 2013 at 6:15 PM, Aaron Morton wrote: > I wrote a small (yet untested) utility, which should be able to read > SSTable files from disk and write them into a cassandra cluster using > Hector. > > Consider using the SSTableSimpleUnsortedWriter (see > http://www.datastax.com/dev/blog/

Re: Offline migration: Random->Murmur

2013-12-30 Thread Aaron Morton
> I wrote a small (yet untested) utility, which should be able to read SSTable > files from disk and write them into a cassandra cluster using Hector. Consider using the SSTableSimpleUnsortedWriter (see http://www.datastax.com/dev/blog/bulk-loading) to create the SSTables you can then bulk load

Re: Offline migration: Random->Murmur

2013-12-28 Thread Edward Capriolo
Internally we have a tool that does get range slice on the souce cluster and replicates to destination. Remeber that writes are itempotemt. Our tool can optionally only replicate data between two timestamps, allowing incremental transfers. So if you get your application writing new data to both c

Re: Offline migration: Random->Murmur

2013-12-23 Thread horschi
Interesting you even dare to do a live migration :-) Do you do all Murmur-writes with the timestamp from the "Random"-data? So that all migrated data is written with timestamps from the past. On Mon, Dec 23, 2013 at 3:59 PM, Rahul Menon wrote: > Christian, > > I have been planning to migrate

Re: Offline migration: Random->Murmur

2013-12-23 Thread Rahul Menon
Christian, I have been planning to migrate my cluster from random to murmur3 in a similar manner. I intend to use pycassa to read and then write to the newer cluster. My only concern would be ensuring the consistency of already migrated data as the cluster ( with random ) would be constantly servi

Offline migration: Random->Murmur

2013-12-23 Thread horschi
Hi list, has anyone ever tried to migrate a cluster from Random to Murmur? We would like to do so, to have a more standardized setup. I wrote a small (yet untested) utility, which should be able to read SSTable files from disk and write them into a cassandra cluster using Hector. This migration w