Re: Cassandra backup queston regarding commitlogs

2012-05-01 Thread Roshan
Many thanks Aaron. I will post a support issue for them. But will keep the snapshot + incremental backups + commitlogs to recover any failure situation. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-

Re: Cassandra backup queston regarding commitlogs

2012-05-01 Thread aaron morton
If you delete the commit logs you are rolling back to exactly what was in the snapshot. When you take a snapshot it flushes the memtables first, so there is nothing in the commit log that is not in the snapshot. Rolling back to a snapshot is rollback to that point in time. If you want to resto

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread Roshan
http://www.datastax.com/docs/1.0/operations/backup_restore -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-tp7508823p7515679.html Sent from the cassandra-u...@incubator.apache.org mailing list archive

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread aaron morton
Can you provide a link to that page ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 1/05/2012, at 10:12 AM, Roshan wrote: > Many Thanks Aaron. > > According to the datastax restore documentation, they ask to remove the > commitlogs befor

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread Roshan
Many Thanks Aaron. According to the datastax restore documentation, they ask to remove the commitlogs before restoring (Clear all files the /var/lib/cassandra/commitlog (by default)). In that case better not to follow this step in a server rash situation. Thanks /Roshan -- View this message

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread aaron morton
When the server starts it reads the SSTables then applies the Commit Logs. There is nothing you need to do other than leave the commit logs where they are. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 30/04/2012, at 6:02 PM, Roshan wr

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread Roshan
Hi Aaron Thanks for the comments. Yes for the durability will keep them in a safe place. But such crash situation, how can I restore the data (because those are not in a SSTable and only in commit log). Do I need to replay only that commit log when server starts after crash? Will it override the

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread aaron morton
> 1. If I already have a Cassandra cluster running, would changing the > incremental_backups parameter in the cassandra.yaml of each node, and then > restart it do the trick? Yes it is a per node setting. > 2. Assuming I am creating a daily snapshot, what is the gain from setting > incrementa

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread aaron morton
Each mutation is applied to the commit log before being applied to the memtable. On server start the SSTables are read before replaying the commit logs. This is part of the crash only software design and happens for every start. AFAIk there is no facility to snapshot commit log files as they ar

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread Roshan
Tamar Please don't jump to other users discussions. If you want to ask any issue, create a new one, please. Thanks. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-question-regarding-commitlogs-tp7508823p7511913.html Sent from

Re: Cassandra backup queston regarding commitlogs

2012-04-28 Thread Tamar Fraenkel
I want to add a couple of questions regrading incremental backups: 1. If I already have a Cassandra cluster running, would changing the i ncremental_backups parameter in the cassandra.yaml of each node, and then restart it do the trick? 2. Assuming I am creating a daily snapshot, what is the gain