Re: Reenable data access after temporarily moving data out of data directory

2016-02-24 Thread Alain RODRIGUEZ
rom copying data from a replica. > > Thanks, > > Jason > > -- > *From:* Carlos Alonso > *To:* user@cassandra.apache.org; Jason Kania > *Sent:* Wednesday, February 24, 2016 5:31 AM > *Subject:* Re: Reenable data access after temporarily moving data out of > data dire

Re: Reenable data access after temporarily moving data out of data directory

2016-02-24 Thread Jason Kania
, 2016 5:31 AM Subject: Re: Reenable data access after temporarily moving data out of data directory Hi Jason Try this:  https://docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsRefresh.html Carlos Alonso | Software Engineer | @calonso On 24 February 2016 at 07:07, Jason Kania wrote: Hi

Re: Reenable data access after temporarily moving data out of data directory

2016-02-24 Thread Alain RODRIGUEZ
Hi Jason, nodetool refresh should be ok. You can also restart the node. Both should work. C*heers, - Alain Rodriguez France The Last Pickle http://www.thelastpickle.com 2016-02-24 7:07 GMT+01:00 Jason Kania : > Hi, > > I encountered an error in Cassandra or the latest Oracle

Re: Reenable data access after temporarily moving data out of data directory

2016-02-24 Thread Carlos Alonso
Hi Jason Try this: https://docs.datastax.com/en/cassandra/2.1/cassandra/tools/toolsRefresh.html Carlos Alonso | Software Engineer | @calonso On 24 February 2016 at 07:07, Jason Kania wrote: > Hi, > > I encountered an error in Cassandra or the latest Oracle JVM tha

Reenable data access after temporarily moving data out of data directory

2016-02-23 Thread Jason Kania
Hi, I encountered an error in Cassandra or the latest Oracle JVM that causes the JVM to terminate during compaction in my situation (CASSANDRA 11200). In trying work around the problem and access the data , I moved the data eg ma-NNN-big-Filter.db, ma-367-big-Data.db etc. out of the data directo

Re: Issues in moving data from cassandra to elasticsearch in java.

2014-11-25 Thread William Arbaugh
Sounds like you're trying to use C* as a message broker. Perhaps try using Kafka or RabbitMQ as a front-end. Then have two subscribers - one pulls and places into elasticsearch and the other inserts into C*. Yes it is more complex front-end, but it will give you the functionality you want. > O

Re: Issues in moving data from cassandra to elasticsearch in java.

2014-11-25 Thread Eric Stevens
Consider adding log_bucket timestamp, and then indexing that column. Your data loader can SELECT * FROM logs WHERE log_bucket = ?. The value you supply there would be the timestamp log bucket you're processing - in your case logged_at % 5. However, I'll caution against writing data to Cassandra

Fwd: Issues in moving data from cassandra to elasticsearch in java.

2014-11-25 Thread Vinod Joseph
Hi, I am working on a java plugin which moves data from cassandra to elasticsearch. This plugin must run in the server for every 5 seconds. The data is getting moved, but the issue is that every time the plugin runs(ie after every 5 seconds) all the data, including data which has been

Re: Moving data from 1.0.9 cluster to a 2.0.* cluster

2014-01-12 Thread Or Sher
I think I rather wait until I'll be able to upgrade the current cluster and then make the migration. Thanks! On Thu, Jan 9, 2014 at 8:41 PM, Robert Coli wrote: > On Thu, Jan 9, 2014 at 6:54 AM, Or Sher wrote: > >> I want to use sstableloader in order to load 1.0.9 data to a 2.0.* >> cluster. >

Re: Moving data from 1.0.9 cluster to a 2.0.* cluster

2014-01-09 Thread Robert Coli
On Thu, Jan 9, 2014 at 6:54 AM, Or Sher wrote: > I want to use sstableloader in order to load 1.0.9 data to a 2.0.* cluster. > I know that the sstable format is incompatible between the two versions. > What are my options? > http://www.palominodb.com/blog/2012/09/25/bulk-loading-options-cassandr

Moving data from 1.0.9 cluster to a 2.0.* cluster

2014-01-09 Thread Or Sher
Hi all, I want to use sstableloader in order to load 1.0.9 data to a 2.0.* cluster. I know that the sstable format is incompatible between the two versions. What are my options? Is there a tool to upgrade sstables directly without any real nodes involvement? -- Or Sher

Re: Moving data from one datacenter to another

2012-12-21 Thread Vegard Berget
void a filename crash, >>> just substitute the numbers with for example XXX in the data-files? >The names have to match the expected patterns. > >It may be easier to rename the files in your first copy, not the second delta >copy. Bump the file numbers enough that all the files

Re: Moving data from one datacenter to another

2012-12-20 Thread aaron morton
s in your first copy, not the second delta copy. Bump the file numbers enough that all the files in the delta copy do not need to be renamed. >> 3) Is this really a sane way to do things? If you are moving data from one set of nodes in a cassandra cluster to another set of nodes in anothe

Re: Moving data from one datacenter to another

2012-12-19 Thread B. Todd Burruss
to get it "correct", meaning consistent, it seems you will need to do a repair no matter what since the source cluster is taking writes during this time and writing to commit log. so to avoid filename issues just do the first copy and then repair. i am not sure if they can have any filename. to

Moving data from one datacenter to another

2012-12-19 Thread Vegard Berget
Hi, I know this have been a topic here before, but I need some input on how to move data from one datacenter to another (and google just gives me some old mails) - and at the same time moving "production" writing the same way.  To add the target cluster into the source cluster and just replicate da

Re: moving data from single node cassandra

2011-03-22 Thread Robert Coli
On Sun, Mar 20, 2011 at 4:42 PM, aaron morton wrote: > When compacting it will use the path with the greatest free space. When > compaction completes successfully the files will lose their temporary status > and that will be their new home. > > On 18 Mar 2011, at 14:10, John Lewis wrote: > >> |

Re: moving data from single node cassandra

2011-03-20 Thread aaron morton
When compacting it will use the path with the greatest free space. When compaction completes successfully the files will lose their temporary status and that will be their new home. Aaron On 18 Mar 2011, at 14:10, John Lewis wrote: > | data_file_directories makes it seem as though cassandra ca

Re: moving data from single node cassandra

2011-03-17 Thread Komal Goyal
Thanks Maki :) I copied the existing var folder to the new hardisk and changes the path to the data directories in the storage-config.xml I was successfully able to connect with cassandra and read the data that was shifted to the new location. On Fri, Mar 18, 2011 at 6:33 AM, Maki Watanabe

Re: moving data from single node cassandra

2011-03-17 Thread John Lewis
| data_file_directories makes it seem as though cassandra can use more than one location for sstable storage. Does anyone know how it splits up the data between partitions? I am trying to plan for just about every worst case scenario I can right now, and I want to know if I can change the config

Re: moving data from single node cassandra

2011-03-17 Thread Maki Watanabe
Refer to: http://wiki.apache.org/cassandra/StorageConfiguration You can specify the data directories with following parameter in storage-config.xml (or cassandra.yaml in 0.7+). commit_log_directory : where commitlog will be written data_file_directories : data files saved_cache_directory : saved

moving data from single node cassandra

2011-03-17 Thread Komal Goyal
Hi, I am having single node cassandra setup on a windows machine. Very soon I have ran out of space on this machine so have increased the hardisk capacity of the machine. Now I want to know how I configure cassandra to start storing data in these high space partitions? Also how the existing data

Re: Moving data

2011-02-04 Thread buddhasystem
hey can be reconstructed as needed when reading back. Also, make sure you wrap Cassandra writes etc into exceptions. When load is high, you might get timeouts at TSocket level etc. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Moving-data-tp5992669p59

Re: Moving data

2011-02-04 Thread Jonathan Ellis
I'm afraid there is no short answer. The long answer is, 1) Read about Cassandra data modeling at http://wiki.apache.org/cassandra/ArticlesAndPresentations. It is not as simple as "one table equals one columnfamily." 2) Write a program to read your data out of SQL Server and write it into Cassan

Moving data

2011-02-04 Thread Morey, Gary
I have several large SQL Server 2005 tables. I need to load the data in these tables into Cassandra. FYI, the Cassandra installation is on a linux server running CentOS. Can anyone suggest the best way to accomplish this? I am a newbie to Cassandra, so any advice would be greatly appreciated