Re: How to find total number of rows in Cassandra databaase?

2013-04-22 Thread Techy Teck
Is there any way to see how many rows are there using CLI mode? If I don't want to use CQL mode. On Mon, Apr 22, 2013 at 12:13 AM, Nikolay Mihaylov wrote: > Hi > > it is very important to know that counting rows is very very > very expensive. > here is my 5 cents - > > in one of my early projec

RE: 'sstableloader' is not recognized as an internal or external command,

2013-04-22 Thread Viktor Jevdokimov
If your Cassandra cluster is on Linux, I believe that streaming is not supported in mixed environment, i.e. Cassandra nodes can't stream between Windows and Linux and sstableloader can't stream feom Windows to Linux. If your Cassandra also on Windows, just try to create bat file for sstableload

Re: Unable to drop secondary index

2013-04-22 Thread Michal Michalski
A little update: OK, after ~8 hours of GC madness and compacting node B (the one on which keyspace has disappeared) works fine. No issues noticed so far. Node A was started with larger heap and after I turned debugging on I can see it does this: DEBUG [MutationStage:110] 2013-04-23 06:23:44

'sstableloader' is not recognized as an internal or external command,

2013-04-22 Thread Techy Teck
I have bunch of `SSTables` with me that I got from somebody within my team. Now I was trying to push those `SSTABLES` into `Cassandra database`. I created corresponding keyspace and column family successfully. Now as soon as I execute `SSTableLoader` command, I always get below exception? S

Insert into column which is of DateType

2013-04-22 Thread Techy Teck
I created my column family in Cassandra database like this from the CLI- create column family PROFILE with key_validation_class = 'UTF8Type' and comparator = 'UTF8Type' and default_validation_class = 'UTF8Type' and column_metadata = [ {column_name : lmd, validation_class : 'DateType'} ]; Now I

Re: Ec2Snitch to Ec2MultiRegionSnitch

2013-04-22 Thread Dane Miller
On Thu, Apr 18, 2013 at 7:41 AM, Alain RODRIGUEZ wrote: > I am wondering about the process to grow from one data center to a few of > them. First thing is we use EC2Snitch for now. So I guess we have to switch > to Ec2MultiRegionSnitch. > > c/ I am using the SimpleStrategy. Is it worth it/mandator

Re: Datastax Java Driver connection issue

2013-04-22 Thread Abhijit Chanda
Aaron, Just for clarification, why it is necessary to set the server rpc address to 127.0.0.1? On Mon, Apr 22, 2013 at 2:22 AM, aaron morton wrote: > Make sure that the server rpc_address is set to 127.0.0.1 > > Cheers > > - > Aaron Morton > Freelance Cassandra Consultant > New

Re: com.datastax.driver.core.exceptions.InvalidQueryException using Datastax Java driver

2013-04-22 Thread Techy Teck
I am using correct keyspace name for that column family. I have verified that as well. Can I insert into Column Family (that I created from CLI mode) using Datastax Java driver or not with Cassandra 1.2.3? On Mon, Apr 22, 2013 at 5:05 AM, Internet Group wrote: > It seems to me that you are not

Re: ordered partitioner

2013-04-22 Thread Jonathan Ellis
Not in general, no. There are places, like indexing, that need to use a local partitioner rather than the global one. Which uses of the DK constructor looked erroneous to you? On Mon, Apr 22, 2013 at 10:54 AM, Desimpel, Ignace wrote: > Hi, > > > > I was trying to implement my own ordered partit

Re: Cassandra + Hadoop - 2 Task attempts with million of rows

2013-04-22 Thread Shamim
We are using Hadoop 1.0.3 and pig 0.11.1 version -- Best regards   Shamim A. 22.04.2013, 21:48, "Shamim" : > Hello all, >   recently we have upgrade our cluster (6 nodes) from cassandra version 1.1.6 > to 1.2.1. Our cluster is evenly partitioned (Murmur3Partitioner). We are > using pig for par

Cassandra + Hadoop - 2 Task attempts with million of rows

2013-04-22 Thread Shamim
Hello all,   recently we have upgrade our cluster (6 nodes) from cassandra version 1.1.6 to 1.2.1. Our cluster is evenly partitioned (Murmur3Partitioner). We are using pig for parse and compute aggregate data. When we submit job through pig, what i consistently see is that, while most of the ta

ordered partitioner

2013-04-22 Thread Desimpel, Ignace
Hi, I was trying to implement my own ordered partitioner and got into problems. The current DecoratedKey is using a ByteBufferUtil.compareUnsigned for comparing the key. I was thinking of having a signed comparison, so I thought of making my own DecoratedKey, Token and Partitioner. That way I wo

Re: Unable to drop secondary index

2013-04-22 Thread Michal Michalski
Missing keyspace has reappeared on node B after restart, but it seems to behave like node A. It starts, GC goes wild, I can see this: INFO [ScheduledTasks:1] 2013-04-22 15:20:52,701 GCInspector.java (line 119) GC for ParNew: 646 ms for 1 collections, 6314013024 used; max is 8506048512 INFO [

Re: Unable to drop secondary index

2013-04-22 Thread Michal Michalski
W dniu 21.04.2013 22:17, aaron morton pisze: This is a tricky one to diagnose remotely. I could try using nodetool resetlocalschema on each node, it's just wild guess incase there is something odd one one node. I've run it on one node (let's call it A) and it finished without any problems. T

Re: Moving cluster

2013-04-22 Thread Kais Ahmed
Yes Mike, this is what I meant when I spoke about the two solutions :) Thank you to all, 2013/4/21 Michael Theroux > I believe the two solutions that are being referred to is the "lift and > shift" vs. upgrading by replacing a node and letting it restore from the > cluster. > > I don't think t

loading all rows from cassandra using multiple (python) clients in parallel

2013-04-22 Thread John R. Frank
Cassandra Experts, I understand that when using Cassandra's recommended RandomPartitioner (or Murmur3Partitioner), it is not possible to do meaningful range queries on keys, because the rows are distributed around the cluster using the md5 hash of the key. These hashes are called "tokens."

Re: com.datastax.driver.core.exceptions.InvalidQueryException using Datastax Java driver

2013-04-22 Thread Internet Group
It seems to me that you are not saying the keyspace of your column family 'profile'. Regards, Francisco. On Apr 20, 2013, at 9:56 PM, Techy Teck wrote: > I created my column family like this from the CLI- > > > create column family profile > with key_validation_class = 'UTF8Type' > a

Re: Thrift message length exceeded

2013-04-22 Thread Oleksandr Petrov
I've submitted a patch that fixes the issue for 1.2.3: https://issues.apache.org/jira/browse/CASSANDRA-5504 Maybe guys know a better way to fix it, but that helped me in a meanwhile. On Mon, Apr 22, 2013 at 1:44 AM, Oleksandr Petrov < oleksandr.pet...@gmail.com> wrote: > If you're using Cassand

Re: Anyway To Query Just The Partition Key?

2013-04-22 Thread Sylvain Lebresne
What you want is https://issues.apache.org/jira/browse/CASSANDRA-4536 I believe. On Sat, Apr 13, 2013 at 8:16 PM, Gareth Collins wrote: > Edward, > > Thanks for the response. This is what I thought. The only reason why I am > doing it like this is that I don't know these partition keys in advanc

Re: Advice on memory warning

2013-04-22 Thread Alain RODRIGUEZ
I would have said the exact opposite, but I am not really sure. I have configured the threshold to 80% of the heap since I have 8GB heap. I think the purpose of this threshold is to keep a security margin to avoid OOMing. C* can be configured with 1GB heap so the margin is about 250MB. On a 8GB he

Re: How to find total number of rows in Cassandra databaase?

2013-04-22 Thread Nikolay Mihaylov
Hi it is very important to know that counting rows is very very very expensive. here is my 5 cents - in one of my early projects we made separate column family, with just single row. we inserted each row key from other CF on this row as column key. then once a day or who, we did get_count(). ho