Re: Node tokens / data move

2013-07-08 Thread aaron morton
> Can I just copy data files for the required keyspaces, create schema manually > and run repair? If you have something like RF 3 and 3 nodes then yes, you can copy the data from one node in the source cluster to all nodes in the dest cluster and use cleanup to remove the unneeded data. Because

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread aaron morton
Without vnodes the initial_token is stored in the yaml file, as well as the system LocationInfo CF. With vnodes the only place the tokens are stored is in the system KS. So moving a node without it's system KS will cause it to generate new ones which will mean data is moved around. Cheers -

Re: Purpose of BLOB datatype

2013-07-08 Thread Ollif Lee
Pls explain why and how. On Mon, Jul 8, 2013 at 5:44 PM, Sylvain Lebresne wrote: > If you do have blobs, the preferred way is to not encode them in strings > at all, but rather to use prepared statement (which don't involve a > conversion to string). > > -- > Sylvain > > > On Mon, Jul 8, 2013 at

Re: Trying to write when at cassandra capacity

2013-07-08 Thread sankalp kohli
I dont know what exactly will happen. These are the things which might happen 1) Commit log on disk gets recycled so I am assuming it might keep working. 2) SStable wont be able to create new files so it will see an IO exception. On Mon, Jul 8, 2013 at 5:58 PM, Faraaz Sareshwala wrote: > What

Node tokens / data move

2013-07-08 Thread Baskar Duraikannu
We have two clusters used by two different groups with vnodes enabled. Now there is a need to move some of the keyspaces from cluster 1 to cluster 2. Can I just copy data files for the required keyspaces, create schema manually and run repair? Anything else required? Please help. -- Thanks,

Trying to write when at cassandra capacity

2013-07-08 Thread Faraaz Sareshwala
What does cassandra do when it is at its data capacity (disk drives and memtable is full) and writes continue to pour in? My intuition says that cassandra won't be able to handle the new writes (they will either get silently dropped or cassandra will hit an OOM -- does anyone know which one?). The

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread sankalp kohli
"Leaving the system keyspaces behind is OK if you are not using vnodes. " Why is it different for vnodes? On Mon, Jul 8, 2013 at 3:37 PM, aaron morton wrote: > This might work for user created keyspaces but might not work for system > keyspace > > Leaving the system keyspaces behind is OK if yo

Re: Compaction: pending tasks are stuck

2013-07-08 Thread aaron morton
> It started with Cassandra 1.1.10 and on Friday we've migrated to 1.2.6 and > now we have the issue that flushes are no longer executed automatically - we > have to do them every hour by hand (nodetool flush) in order to keep the > nodes on an acceptable utilizatzion level. Without manual flush

Re: Working with libcql

2013-07-08 Thread aaron morton
Did you see the demo app ? Seems to have a few examples of reading data. https://github.com/mstump/libcql/blob/master/demo/main.cpp#L85 Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 9/07/2013, at 1:14 AM, Shubham

Re: CassandraDaemon - recent unsafe memory access operation in compiled Java code

2013-07-08 Thread aaron morton
Glyn, For tracking purposes could you create an issue on https://issues.apache.org/jira/browse/CASSANDRA and link to the ticket your raised. Just incase something has to change when memmapping. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealan

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread aaron morton
> This might work for user created keyspaces but might not work for system > keyspace Leaving the system keyspaces behind is OK if you are not using vnodes. Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 9/07/2013,

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Robert Coli
On Mon, Jul 8, 2013 at 2:39 PM, Tony Anecito wrote: > I filed the issue in JIRA. > For those playing along at home : https://issues.apache.org/jira/browse/CASSANDRA-5732 =Rob

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread sankalp kohli
"If RF=N or RF>N, you can just copy all SStables to all nodes, watching out for name collision." This might work for user created keyspaces but might not work for system keyspace On Mon, Jul 8, 2013 at 2:07 PM, Robert Coli wrote: > On Fri, Jul 5, 2013 at 7:54 PM, srmore wrote: > >> RF of old

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Tony Anecito
I will try the pre-prod environment to see what happens.   I filed the issue in JIRA.   Thanks! From: Tony Anecito To: Robert Coli ; "user@cassandra.apache.org" Sent: Monday, July 8, 2013 3:18 PM Subject: Re: Cassandra intermittant with query in 1.2.5... Thanks Robert I will do that. I alre

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Tony Anecito
Thanks Robert I will do that. I already filled out a question with the initial info via the forum seeing if I was doing something wrong. I did see a reference to the issue but it was not repeatable. I am thinking there is a very serious bug that would worry all Cassandra users if they read this

Re: Cassandra intermittant with query in 1.2.5...

2013-07-08 Thread Robert Coli
On Sat, Jul 6, 2013 at 10:57 PM, Tony Anecito wrote: > I better understand the issue now with secondary index query and Cassadra > 1.2.5. not returnng rows. > > I did some more testng of the issue mentioned below and discovered a very > repeatable sequence and it is as follows: > > 1. Starting st

Re: Migrating data from 2 node cluster to a 3 node cluster

2013-07-08 Thread Robert Coli
On Fri, Jul 5, 2013 at 7:54 PM, srmore wrote: > RF of old and new cluster is the same RF=3. Keyspaces and schema info is > also same. > You have a cluster where RF=3 and N=2? Does it.. work? What are the tokens of old and new nodes? >> > tokens for old cluster ( 2-node ) > If RF=N or RF>N, you

Re: General doubts about bootstrap

2013-07-08 Thread Robert Coli
On Sat, Jul 6, 2013 at 1:50 PM, Rodrigo Felix < rodrigofelixdealme...@gmail.com> wrote: > >- Is it normal to take about 9 minutes to add a new node? Follows the >log generated by a script to add a new node. > > Sure. > >- Is there a way to reduce the time to start cassandra? > > Not u

playORM version 1.6 released

2013-07-08 Thread Hiller, Dean
Another new release is up in maven repos… - Astyanx is upgraded to 1.56.42 - Hbase support is almost done(barring those few test cases) - And following issues are fixed: Thanks to snazy and hsn10 :) https://github.com/deanhiller/playorm/issues/80 https://github.com/deanhiller/playorm/issues/81 h

Re: does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread S Ahmed
Hi Peter, Can you describe your environment, # of documents and what kind of usage pattern you have? On Mon, Jul 8, 2013 at 2:06 PM, Peter Lin wrote: > I regularly store word and pdf docs in cassandra without any issues. > > > > > On Mon, Jul 8, 2013 at 1:46 PM, S Ahmed wrote: > >> I'm gues

Re: does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread Peter Lin
I regularly store word and pdf docs in cassandra without any issues. On Mon, Jul 8, 2013 at 1:46 PM, S Ahmed wrote: > I'm guessing that most people use cassandra to store relatively smaller > payloads like 1-5kb in size. > > Is there anyone using it to store say 100kb (1/10 of a megabyte) and

Re: does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread Nate McCall
100kb should be fine. For larger values, there's been a lot of people doing "file chunking" for a while now. The Astyanax folks have a recipe for this: https://github.com/Netflix/astyanax/wiki/Chunked-Object-Store The DataStax Enterprise CassandraFileSystem impl works similarly. Your intuition is

does anyone store large values in cassandra e.g. 100kb?

2013-07-08 Thread S Ahmed
I'm guessing that most people use cassandra to store relatively smaller payloads like 1-5kb in size. Is there anyone using it to store say 100kb (1/10 of a megabyte) and if so, was there any tweaking or gotchas that you ran into?

Re: unsubscribe

2013-07-08 Thread Robert Coli
On Sun, Jul 7, 2013 at 8:26 PM, casablinca126.com wrote: > unsubscribe > http://wiki.apache.org/cassandra/FAQ#unsubscribe =Rob

Re: CassandraDaemon - recent unsafe memory access operation in compiled Java code

2013-07-08 Thread Glyn Davies
Hi, Yes, this continues without the JNA jar. In fact, the only thing which cured it was a reboot (!) Some serious dark magic going on there, as there were no Java processes running and nothing held the cassandra files open. I found a couple of Java dump texts, and opened an Java bug with one

Re: CQL and IN

2013-07-08 Thread Tony Anecito
Thanks Petrov I will read what you sent a link to. I am trying to find out what capability CQL wise is truely available in order to determine my end state for my data model.   Last night after I discovered the cashing issues that affected queries I was able to create two queries one to get a lis

Working with libcql

2013-07-08 Thread Shubham Mittal
Hi, I found out that there exist a C++ client libcql for cassandra but its github repository just provides the example on how to connect to cassandra. Is there anyone who has written some code using libcql to read and write data to a cassandra DB, kindly share it. Thanks

Re: CQL and IN

2013-07-08 Thread Oleksandr Petrov
Hi Tony, you can check out a guide here: http://clojurecassandra.info/articles/kv.html which explains pretty most of things you need to know about queries for starters. It includes CQL code examples, just disregard Clojure ones, there's nothing strictly Clojure-driver specific in that guide. On

Re: Purpose of BLOB datatype

2013-07-08 Thread Pavel Kirienko
> If you do have blobs, the preferred way is to not encode them in strings at all, but rather to use prepared statement (which don't involve a conversion to string). Awesome. Thanks. On Mon, Jul 8, 2013 at 1:44 PM, Sylvain Lebresne wrote: > If you do have blobs, the preferred way is to not enc

Re: Purpose of BLOB datatype

2013-07-08 Thread Sylvain Lebresne
If you do have blobs, the preferred way is to not encode them in strings at all, but rather to use prepared statement (which don't involve a conversion to string). -- Sylvain On Mon, Jul 8, 2013 at 11:07 AM, Pavel Kirienko < pavel.kirienko.l...@gmail.com> wrote: > Hi all, > > I am curious why t

Re: Compaction: pending tasks are stuck

2013-07-08 Thread Steffen Rusitschka
The heap size is 3GB and the GC has to run only every 30 minutes... I'm pretty sure increasing heap won't help. Am 08.07.2013 11:15, schrieb Radim Kolar: Without manual flush the CPU goes mad after a couple of hours on each instance. increase heap size -- Steffen Rusitschka CTO MegaZebra

Re: Compaction: pending tasks are stuck

2013-07-08 Thread Radim Kolar
Without manual flush the CPU goes mad after a couple of hours on each instance. increase heap size

Purpose of BLOB datatype

2013-07-08 Thread Pavel Kirienko
Hi all, I am curious why there is BLOB datatype that accepts HEX strings only. HEX encoding requires twice as much space as original data, thus it is rather ineffective. Instead, base64 encoding with ASCII datatype seems more effective in terms of space, and I believe it doesn't impose noticeable

Compaction: pending tasks are stuck

2013-07-08 Thread Steffen Rusitschka
Hi cassandra list, we are having in issue in one of our Cassandra clusters where all 3 nodes with RF 3 have 22 pending tasks (nodetool compactionstats) since mid of April that are never be executed. Even after a restart they show up. It started with Cassandra 1.1.10 and on Friday we've migrat