Re: How to perform range queries efficiently?

2013-08-26 Thread Alain RODRIGUEZ
Can you send us the result of a "describe columnfamily users" ? How many rows are presents in this table ? Do you have indexes defined ? What is a "long time" exactly ? Alain Le 23 août 2013 14:53, "Sávio Teles" a écrit : > I need to perform range query efficiently. I have the table like: > >

Re: Decommission faster than bootstrap

2013-08-26 Thread Rodrigo Felix
Boris, We are not using secondary index. We tested both on version 1.1.5 and 1.1.12 and had similar results. Does anybody know what are the steps in details to bootstrap and to decommission a node? I'd like to figure out which step is creating this difference. For me, the time should be simila

Re: Cassandra Secondary Index implementation

2013-08-26 Thread Roshan
Hello First get some understanding about secondary indexes. http://www.datastax.com/docs/1.1/ddl/indexes Thanks. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-Secondary-Index-implementation-tp7589792p7589906.html Sent from the cas

Re: insert performance (1.2.8)

2013-08-26 Thread Keith Freeman
That sounds interesting, but not sure exactly what you mean? My key is like this: "((f1, f2, day) timeuuid)", and f1/f2 are roughly well-distributed. So my inserts are pretty evenly distributed across about 22k combinations of f1+f2 each day. Are you saying that you get better performance by

Re: write load while idle?

2013-08-26 Thread sankalp kohli
Storing OpsCenter data on the same cluster you are monitoring might not work well. I had an issue in which Cassandra had issues and OpsCenter wont load. You might want to store this data in some other cluster or create a fake DC and assign OpsCenter data to that fake DC. On Thu, Aug 22, 2013 at 4

Re: Periodical deletes and compaction strategy

2013-08-26 Thread sankalp kohli
The problem is that tombstones will hang in there till GC grace period. You can reduce the GC grace period and then catch lost deletes in the application layer if you know you should not be seeing such an old record. Also in 1.2, they have some setting which enable an sstable to be compacted if it

Re: conflict resolution in range scans

2013-08-26 Thread sankalp kohli
It will compare them using timestamps. You might want to look at RowRepairResolver. On Sun, Aug 25, 2013 at 2:23 PM, Nate McCall wrote: > See that last part on this page: > http://wiki.apache.org/cassandra/ReadRepair > > This doc is dated, but I'm pretty sure it still works this way. > > > On S

Re: Cassandra 1.2: old node does not want to re-join the ring

2013-08-26 Thread Robert Coli
On Mon, Aug 26, 2013 at 5:39 AM, Denis Kot wrote: > 2) Stop gossip > > 3) Stop thrift > 4) Drain > 5) Stop Cassandra 6) Move all data to ebs (we using ephemeral volumes for > data) > 7) Stop / Start instance > 8) Move data back > 9) Start Cassandra > 10) stop cassandra 11) set auto_bootstrap:fals

Re: Large # of Pending Tasks?

2013-08-26 Thread Girish Kumar
I'm running "ReleaseVersion: 1.2.5-SNAPSHOT" version. - Well, I see that REQUEST_RESPONSE is capped at # processor count (below code). The foreground writers and readers are still set at what c*.yaml

Re: Large # of Pending Tasks?

2013-08-26 Thread Nate McCall
Interesting - my understanding is that the only places where stages are capped at "available processors" have to do with clustering operations (see the static initializer in o.a.c.concurrent.StageManager). What version are you using, by the way? Most likely I'm missing something though. On Mon,

Re: how-to scan a table using CQL3

2013-08-26 Thread Alain RODRIGUEZ
Furthermore I think this is already available on the 1.2.8. Not tested yet. 2013/8/26 Keith Wright > I noticed in C* 2.0 that it will support automatic paging for CQL queries ( > https://issues.apache.org/jira/browse/CASSANDRA-4415). I'm wondering if > this will make future table scans as simp

Re: Large # of Pending Tasks?

2013-08-26 Thread Girish Kumar
This is the 'Active Count' as observed on jconsole under 'org.apache.cassandra.request' ReadStage->Attributes. Below details... ActiveCount -> 12 .. Core Pool Size -> 192 Core Threads -> 192 CurrentlyBlockedTasks -> 0 MaximumThreads -> 192 PendingTasks -> 691 TotalBlockedTasks -> 0 I expect ac

Re: Cluster Management

2013-08-26 Thread Nate McCall
> > > For example, if I want to make some changes to the configuration file that > resides on each node, is there a tool that will propagate the change to > each node? > > You may also want to take a look at Priam from the Netflix folks: https://github.com/Netflix/Priam Assumes AWS (though some of

Re: Cluster Management

2013-08-26 Thread Patricia Gorla
Anthony, We use a number of tools to manage our Cassandra cluster. * Datastax OpsCenter [0] for at a glance information, and trending statistics. You can also run operations through here, though I prefer to use nodetool for any mutative operation. * nodetool for ad hoc status checks, and day-to-d

Re: Large # of Pending Tasks?

2013-08-26 Thread Nate McCall
I'm not quite sure what you mean by 'active task count' - what is the output of 'nodetool tpstats' when you run this test? On Mon, Aug 26, 2013 at 4:39 AM, Girish Kumar wrote: > Hi, > > I'm using a single node Cassandra on 24 Core/48GB system. I have set my > writers and readers (in yaml) to be

Re: How to perform range queries efficiently?

2013-08-26 Thread Sávio Teles
Ops, inverted index*! 2013/8/26 Sávio Teles > Do I Have to use revert index to optimize range query operation? > > > 2013/8/23 Sávio Teles > >> I need to perform range query efficiently. I have the table like: >> >> users >> --- >> user_id | age | gender | salary | ... >> >> The attr user_

Re: How to perform range queries efficiently?

2013-08-26 Thread Sávio Teles
Do I Have to use revert index to optimize range query operation? 2013/8/23 Sávio Teles > I need to perform range query efficiently. I have the table like: > > users > --- > user_id | age | gender | salary | ... > > The attr user_id is the PRIMARY KEY. > > Example of querying: > > select * f

Re: how-to scan a table using CQL3

2013-08-26 Thread Keith Wright
I noticed in C* 2.0 that it will support automatic paging for CQL queries (https://issues.apache.org/jira/browse/CASSANDRA-4415). I'm wondering if this will make future table scans as simple as "select * from ". Anyone try this yet? From: Alain RODRIGUEZ mailto:arodr...@gmail.com>> Reply-To:

Cassandra 1.2: old node does not want to re-join the ring

2013-08-26 Thread Denis Kot
Hello, We have Cassandra's cluster of 6 nodes, 3 seeds. One day AWS sent us a message that one of our instance will be decommissioned and this was seed01. To fix this we should simply stop/start instance to move it to new AWS host. Before stop/start we did: 2) Stop gossip 3) Stop thrift 4) Drain 5

Re: Periodical deletes and compaction strategy

2013-08-26 Thread cem
Hi Alain, I solved the same issue by implementing a client that manages time range partitions. Each time range partition is a CF. Cem. On Mon, Aug 26, 2013 at 11:34 AM, Alain RODRIGUEZ wrote: > Hi, > > Any guidance on this topic would be appreciated :). > > > 2013/8/23 Alain RODRIGUEZ > >> Hi

Large # of Pending Tasks?

2013-08-26 Thread Girish Kumar
Hi, I'm using a single node Cassandra on 24 Core/48GB system. I have set my writers and readers (in yaml) to be around 192 for both and read and write. In this mode, when stressed with 192 threads for inserts and reads, what I observed via the jconsole of 'client request' the active read and wri

Re: Periodical deletes and compaction strategy

2013-08-26 Thread Alain RODRIGUEZ
Hi, Any guidance on this topic would be appreciated :). 2013/8/23 Alain RODRIGUEZ > Hi, > > I am currently using about 10 CF to store temporal data. Those data are > growing pretty big (hundreds of GB when I actually only need information > from the last month - i.e. about hundreds of MB). > >

Re: CqlStorage creates wrong schema for Pig

2013-08-26 Thread Miguel Angel Martin junquera
hi Chad . I have this issue I send a mail to user-pig-list and I still i can resolve this, and I can not access to column values. In this mail I write some things that I try without results... and information about this issue. http://mail-archives.apache.org/mod_mbox/pig-user/201308.mbox/%3c