Re: Notes and questions from performing a large delete

2013-12-07 Thread Edward Capriolo
It is definately unexpected and can be very impactful to reset such impprtant settings. On Saturday, December 7, 2013, Josh Dzielak wrote: > Thanks Nate. I hadn't noticed that and it definitely explains it. > It'd be nice to see that called out much more clearly. As we found out the implications

Re: com.datastax.driver.core.exceptions.InvalidTypeException: Invalid type for value 1 of CQL type text, expecting class java.lang.String but class [Ljava.lang.Object; provided

2013-12-07 Thread Dave Brosius
BoundStatement query = prBatchInsert.bind(userId, attributes.values().toArray(new *String*[attributes.size()])) On 12/07/2013 03:59 PM, Techy Teck wrote: I am trying to insert into Cassandra database using Datastax Java driver. But everytime I am getting below exception at `prBatchInsert.bin

Re: com.datastax.driver.core.exceptions.InvalidTypeException: Invalid type for value 1 of CQL type text, expecting class java.lang.String but class [Ljava.lang.Object; provided

2013-12-07 Thread Keith Wright
As the comment in your code suggests, you need to cast the array passed to the bind method as Object[]. This is true anytime you pass an array to a varargs method. On Dec 7, 2013 4:01 PM, Techy Teck wrote: I am trying to insert into Cassandra database using Datastax Java driver. But everytime

com.datastax.driver.core.exceptions.InvalidTypeException: Invalid type for value 1 of CQL type text, expecting class java.lang.String but class [Ljava.lang.Object; provided

2013-12-07 Thread Techy Teck
I am trying to insert into Cassandra database using Datastax Java driver. But everytime I am getting below exception at `prBatchInsert.bind` line- com.datastax.driver.core.exceptions.InvalidTypeException: Invalid type for value 1 of CQL type text, expecting class java.lang.String but class [Lj

Re: cassandra performance problems

2013-12-07 Thread Nate McCall
If you are really set on using Cassandra as a cache, I would recommend disabling durable writes for the keyspace(s)[0]. This will bypass the commitlog (the flushing/rotation of which my be a good-sized portion of your performance problems given the number of tables). [0] http://www.datastax.com/do

Re: Notes and questions from performing a large delete

2013-12-07 Thread Josh Dzielak
Thanks Nate. I hadn't noticed that and it definitely explains it. It'd be nice to see that called out much more clearly. As we found out the implications can be severe! -Josh On Thursday, December 5, 2013 at 11:30 AM, Nate McCall wrote: > Per the 256mb to 5mb change, check the very last sect

Re: calculating sizes on disk

2013-12-07 Thread Tim Wintle
I have found that in (limited) practice that it's fairly hard to estimate due to compression and compaction behaviour. I think measuring and extrapolating (with an understanding of the datastructures) is the most effective. Tim Sent from my phone On 6 Dec 2013 20:54, "John Sanda" wrote: > I hav

Re: calculating sizes on disk

2013-12-07 Thread Steven Siebert
Nice work John. If you learn any more, please share. S On Sat, Dec 7, 2013 at 11:50 AM, John Sanda wrote: > I finally got the math right for the partition index after tracing through > SSTableWriter.IndexWriter.append(DecoratedKey key, RowIndexEntry > indexEntry). I should also note that I am

Re: calculating sizes on disk

2013-12-07 Thread John Sanda
I finally got the math right for the partition index after tracing through SSTableWriter.IndexWriter.append(DecoratedKey key, RowIndexEntry indexEntry). I should also note that I am working off of the source for 1.2.9. Here is the break down for what gets written to disk in the append() call (my ke

Re: help on backup muiltinode cluster

2013-12-07 Thread Ray Sutton
I have not use tablesnap but it appears that it does not necessarily depend upon taking a cassandra snapshot. The example given in their documentation shows the source folder as /var/lib/cassandra/data/GiantKeyspace, which is the root of the "GiantKeyspace" keyspace. But, snapshots operate at the c

Re: How to monitor the progress of a HintedHandoff task?

2013-12-07 Thread Tom van den Berge
Rahul, I've made some progress in my investigations in the mean time. It seems that the network bandwidth to my remote data center is relatively small, and at the same time my application generates far more write operations that I was expecting, resulting in more replication data to the remote DC.

Re: help on backup muiltinode cluster

2013-12-07 Thread Andre Sprenger
If you lose RF + 1 nodes the data that is replicated to only these nodes is gone, good idea to have a recent backup than. Another situation is when you deploy a bug in the software and start writing crap data to Cassandra. Replication does not help and depending on the situation you need to restore

Re: help on backup muiltinode cluster

2013-12-07 Thread Hannu Kröger
One typical reason is to protect against human error. > On 7.12.2013, at 11.09, Jason Wee wrote: > > Hmm... cassandra fundamental key features like fault tolerant, durable and > replication. Just out of curiousity, why would you want to do backup? > > /Jason > > >> On Sat, Dec 7, 2013 at 3:

Re: help on backup muiltinode cluster

2013-12-07 Thread Jason Wee
Hmm... cassandra fundamental key features like fault tolerant, durable and replication. Just out of curiousity, why would you want to do backup? /Jason On Sat, Dec 7, 2013 at 3:31 AM, Robert Coli wrote: > On Fri, Dec 6, 2013 at 6:41 AM, Amalrik Maia wrote: > >> hey guys, I'm trying to take bac