Re: Backup Restore

2019-04-30 Thread Ivan Junckes Filho
Thanks guys! On Fri, Apr 26, 2019 at 1:17 PM Alain RODRIGUEZ wrote: > Hello Ivan, > > Is there a way I can do one command to backup and one to restore a backup? > > > > Handling backups and restore automatically is not an easy task to work on. > It's not straight forward. But it's doable and som

Re: Backup Restore

2019-04-26 Thread Alain RODRIGUEZ
Hello Ivan, Is there a way I can do one command to backup and one to restore a backup? Handling backups and restore automatically is not an easy task to work on. It's not straight forward. But it's doable and some did some tools (with both open source and commercial licences) do this process (o

Re: Backup Restore

2019-04-25 Thread Naman Gupta
You should take a look into ssTableLoader cassandra utility, https://docs.datastax.com/en/cassandra/3.0/cassandra/tools/toolsBulkloader.html On Fri, Apr 26, 2019 at 1:33 AM Ivan Junckes Filho wrote: > Hi guys, > > I am trying do a bakup and restore script in a simple way. Is there a way > I can

Re: backup/restore cassandra data

2018-03-08 Thread Dipan Shah
schema. Thanks, Dipan Shah From: onmstester onmstester Sent: Thursday, March 8, 2018 1:31 PM To: user Subject: Re: backup/restore cassandra data Thanks But is'nt there a method to restore the node as it was before the crash, like commitlog and every last

Re: backup/restore cassandra data

2018-03-08 Thread onmstester onmstester
Thanks But is'nt there a method to restore the node as it was before the crash, like commitlog and every last data inserted? How often snapshots would be created? Shouldn't they be created manually by nodetool? I haven't created snapshots on the node! Sent using Zoho Mail On Thu,

Re: backup/restore cassandra data

2018-03-07 Thread Ben Slater
You should be able to follow the same approach(s) as restoring from a backup as outlined here: https://docs.datastax.com/en/cassandra/2.1/cassandra/operations/ops_backup_snapshot_restore_t.html#ops_backup_snapshot_restore_t Cheers Ben On Thu, 8 Mar 2018 at 17:07 onmstester onmstester wrote: > W

RE: Backup restore with a different name

2016-11-03 Thread Michael Laws
Hi Jens – I put together a couple of simple scripts a couple of years ago that might do exactly what you need. These leverage nodetool snapshot and sstableloader to create keyspace snapshots, collect up all the necessary SSTable files in an easy-to-move file, rename the keyspace, restore it to the

Re: Backup restore with a different name

2016-11-03 Thread kurt Greaves
On 2 November 2016 at 22:10, Jens Rantil wrote: > I mean "exposing that state for reference while keeping the (corrupt) > current state in the live cluster". The following should work: 1. Create a new table with the same schema but different name (in the same or a different keyspace).

Re: Backup restore with a different name

2016-11-03 Thread Rajath Subramanyam
Hi Jens, Looks like what you need is an "any point in time" recovery solution. I suggest that you go back to the snapshot that you issued that was closest to "20161102" and restore that snapshot using the bulk loader to a new table called "users_20161102". If you need to recover precisely to a par

Re: Backup restore with a different name

2016-11-02 Thread Jens Rantil
Bryan, On Wed, Nov 2, 2016 at 11:38 AM, Bryan Cheng wrote: > do you mean restoring the cluster to that state, or just exposing that > state for reference while keeping the (corrupt) current state in the live > cluster? I mean "exposing that state for reference while keeping the (corrupt) curre

Re: Backup restore with a different name

2016-11-02 Thread Jens Rantil
Thanks Anubhav, Looks like a Java project without any documentation whatsoever ;) How do I use the tool? What does it do? Cheers, Jens On Wed, Nov 2, 2016 at 11:36 AM, Anubhav Kale wrote: > You would have to build some logic on top of what’s natively supported. > > > > Here is an option: https

Re: Backup restore with a different name

2016-11-02 Thread Bryan Cheng
Hi Jens, When you refer to restoring a snapshot for a developer to look at, do you mean restoring the cluster to that state, or just exposing that state for reference while keeping the (corrupt) current state in the live cluster? You may find these useful: https://docs.datastax.com/en/cassandra/2

RE: Backup restore with a different name

2016-11-02 Thread Anubhav Kale
You would have to build some logic on top of what’s natively supported. Here is an option: https://github.com/anubhavkale/CassandraTools/tree/master/BackupRestore From: Jens Rantil [mailto:jens.ran...@tink.se] Sent: Wednesday, November 2, 2016 2:21 PM To: Cassandra Group Subject: Backup restor

RE: Backup/Restore in Cassandra

2014-03-07 Thread java8964
-0500 Subject: Re: Backup/Restore in Cassandra From: jlacefi...@datastax.com To: user@cassandra.apache.org Hello, Full snapshot forces a flush, yes.Incremental hard-links to SSTables, yes. This question really depends on how your cluster was "lost". Node Loss: You wou

Re: Backup/Restore in Cassandra

2014-03-07 Thread Jonathan Lacefield
Hello, Full snapshot forces a flush, yes. Incremental hard-links to SSTables, yes. This question really depends on how your cluster was "lost". Node Loss: You would be able to restore a node based on restoring backups + commit log or just by using repair. Cluster Loss: (all nod

Re: backup/restore from sstable files ?

2012-11-12 Thread Rob Coli
On Sat, Nov 10, 2012 at 3:00 PM, Tyler Hobbs wrote: > For an alternative that doesn't require the same ring topology, you can use > the bulkloader, which will take care of distributing the data to the correct > nodes automatically. For more details on which cases are best for the different bulk l

Re: backup/restore from sstable files ?

2012-11-10 Thread Tyler Hobbs
On Fri, Nov 9, 2012 at 6:04 PM, Rob Coli wrote: > > > some of my colleagues seem to use this method to backup/restore a > cluster, > > successfully: > > > >> on each of the node, save entire /cassandra/data/ dir to S3, > > then on a new set of nodes, with exactly the same number of nodes, copy >

Re: backup/restore from sstable files ?

2012-11-09 Thread Rob Coli
On Thu, Nov 8, 2012 at 5:15 PM, Yang wrote: > some of my colleagues seem to use this method to backup/restore a cluster, > successfully: > >> on each of the node, save entire /cassandra/data/ dir to S3, > then on a new set of nodes, with exactly the same number of nodes, copy > back each of the d

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Peter Schuller
> that with storage, there are *lots* of urban legends and people making > strange claims. In this case it is wrong for fundamental reasons > independent of kernel implementation details. Also, note that it is not specific to log based file systems. Even "old" file systems the predates journaling

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Peter Schuller
> A snippet from the wikipedia page on XFS for example: > http://en.wikipedia.org/wiki/XFS > ... > > Snapshots > > XFS does not provide direct support for snapshots, as it expects the > snapshot process to be implemented by the volume manager. Taking a snapshot > of an XFS filesystem involves freez

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Josep Blanquer
On Thu, Jun 23, 2011 at 8:54 AM, Peter Schuller wrote: > > Actually, I'm afraid that's not true (unless I'm missing something). Even > if > > you have only 1 drive, you still need to stop writes to the disk for the > > short time it takes the low level "drivers" to snapshot it (i.e., marking > >

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Peter Schuller
> If taking an atomic snapshot of the device on which a file system is > located on, assuming the file system is designed to be crash > consistent, it *has* to result in a consistent snapshot. Anything else > would directly violate the claim that the file system is crash > consistent, making the pr

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Peter Schuller
> Actually, I'm afraid that's not true (unless I'm missing something). Even if > you have only 1 drive, you still need to stop writes to the disk for the > short time it takes the low level "drivers" to snapshot it (i.e., marking > all blocks as clean so you can do CopyOnWrite later). I.e., you nee

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Josep Blanquer
On Thu, Jun 23, 2011 at 8:02 AM, William Oberman wrote: > I've been doing EBS snapshots for mysql for some time now, and was using a > similar pattern as Josep (XFS with freeze, snap, unfreeze), with the extra > complication that I was actually using 8 EBS's in RAID-0 (and the extra > extra compli

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Josep Blanquer
On Thu, Jun 23, 2011 at 7:30 AM, Peter Schuller wrote: > > EBS volume atomicity is good. We've had tons of experience since EBS came > > out almost 4 years ago, to back all kinds of things, including large > DBs. > > One important thing to have in mind though, is that EBS snapshots are > done >

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread William Oberman
I've been doing EBS snapshots for mysql for some time now, and was using a similar pattern as Josep (XFS with freeze, snap, unfreeze), with the extra complication that I was actually using 8 EBS's in RAID-0 (and the extra extra complication that I had to lock the MyISAM tables... glad to be moving

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Peter Schuller
>> EBS volume atomicity is good. We've had tons of experience since EBS came >> out almost 4 years ago,  to back all kinds of things, including large DBs. And thanks a lot for coming forward with production experience. That is always useful with these things. -- / Peter Schuller

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Peter Schuller
> EBS volume atomicity is good. We've had tons of experience since EBS came > out almost 4 years ago,  to back all kinds of things, including large DBs. > One important thing to have in mind though, is that EBS snapshots are done > at the block level, not at the filesystem level. So depending on th

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Josep Blanquer
On Thu, Jun 23, 2011 at 5:04 AM, Peter Schuller wrote: > > 1. Is it feasible to run directly against a Cassandra data directory > > restored from an EBS snapshot? (as opposed to nodetool snapshots restored > > from an EBS snapshot). > > Assuming EBS is not buggy, including honor write barriers, i

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-23 Thread Peter Schuller
> 1. Is it feasible to run directly against a Cassandra data directory > restored from an EBS snapshot? (as opposed to nodetool snapshots restored > from an EBS snapshot). Assuming EBS is not buggy, including honor write barriers, including the linux guest kernel etc, then yes. EBS snapshots of a

Re: Backup/Restore: Coordinating Cassandra Nodetool Snapshots with Amazon EBS Snapshots?

2011-06-22 Thread aaron morton
> 1. Is it feasible to run directly against a Cassandra data directory restored > from an EBS snapshot? (as opposed to nodetool snapshots restored from an EBS > snapshot). I dont have experience with the EBS snapshot, but I've never been a fan of OS level snapshots that are not coordinated with