Re: Unable to reliably count keys on a thrift CF

2016-04-25 Thread Jens Rantil
Hi Carlos, In CQL, for the cornercase you describe, you could simply do SELECT * FROM tbl WHERE key=#{key} LIMIT 1000; and if it returns 1000 items, you'd iteratively do SELECT * FROM tbl WHERE key=#{key} AND column1 > #{last_col1_in_prev_query} LIMIT 1000; Also, have a look at fetchSi

Re: Combining two clusters/keyspaces into single cluster

2016-04-25 Thread Jens Rantil
Hi Arlington, I don't think that's possible to do live simply within the realm of Cassandra since the nodes are in separate Cassandra clusters. What you could do is do double writing from your application while doing Cassandra Bulk Loading described here: http://stackoverflow.com/a/12528029/260805

Re: Combining two clusters/keyspaces into single cluster

2016-04-25 Thread Jan Kesten
Hi, one way I think might work (but not tested in any way by me and there will be some lag / stale data): - create the keyspace2 von cluster1 - use nodetool flush and snapshot on cluster2, remember the timestamp - use sstableloader to write all sstables from cluster2 snapshot to cluster1 - you

Re: When are hints written?

2016-04-25 Thread Bo Finnerup Madsen
Hi Jens, I suspected that write_request_timeout_in_ms was involved, so I have already raised that to 12 on all nodes in the cluster, and to 13 on the client. This is much longer that any of our writes takes. I looked at the hints files that where being written, and they where all 42 bytes

Re: When are hints written?

2016-04-25 Thread Bo Finnerup Madsen
Hi Jan, I don't think I expressed myself clearly :) The load I mention is as reported by linux. It is my understanding that a load of 20 means that the computer have enough work to saturate 20 CPU's. Seeing as we only have 2 vCPUs in our AWS machines, it is quite a bit more than 20% :) Regarding

Re: When are hints written?

2016-04-25 Thread Jens Rantil
Hi again Bo, Yeah, definitely wounds weird you are seeing hints. It's definitely interesting that you aren't seeing hints for 2.1.13. Are you seeing hints when not using materialized views in 3.0.3? Cheers, Jens On Mon, Apr 25, 2016 at 10:05 AM Bo Finnerup Madsen wrote: > Hi Jan, > > I don't

Re: Alternative approach to setting up new DC

2016-04-25 Thread Jens Rantil
Jan: sstableloader will only stream to nodes that are supposed to hold the data. The nodes on the new DC have different token ranges, so I can't simply copy the sstables. Surbhi: Because 2-5 minutes of connectivity issues (VPN downtime) between the DCs breaks the bootstrap process. /J On Fri, Ap

Re: Unable to reliably count keys on a thrift CF

2016-04-25 Thread Carlos Alonso
Hi Jens. Thanks for your response but my idea is to count different keys, so, if I understood correctly selecting WHERE key = #{key} won't give me any new key, right? Thanks! Carlos Alonso | Software Engineer | @calonso On 25 April 2016 at 09:22, Jens Rantil wrote

Re: Debugging out of memory

2016-04-25 Thread Alain RODRIGUEZ
Hi, This one is old, do you still need help there? Sorry we missed it. 1. What Cassandra version do you use? 2. What does "nodetool tpstats" show you. Any dropped or pending message? 3. Is your error a full heap memory issue or native one? 4. What configurations did you change from d

Re: Upgrading to SSD

2016-04-25 Thread Alain RODRIGUEZ
Hi Anuj, > You could do the following instead to minimize server downtime: > > 1. rsync while the server is running > 2. rsync again to get any new files > 3. shut server down > 4. rsync for the 3rd time > 5. change directory in yaml and start back up > +1 Here are some more details about that

Re: Changing snitch from PropertyFile to Gossip

2016-04-25 Thread Alain RODRIGUEZ
Hi Carlos, Why running a repair there if the topology did not change? Is it as a best practice, just in case, or is there a specific reason? C*heers, --- Alain Rodriguez - al...@thelastpickle.com France The Last Pickle - Apache Cassandra Consulting http://www.thelastpickle.co

StatusLogger is logging too many information

2016-04-25 Thread jason zhao yang
Hi, Currently StatusLogger will log info when there are dropped messages or GC more than 200 ms. In my use case, there are about 1000 tables. The status-logger is logging too many information for each tables. I wonder is there a way to reduce this log? for example, only print the thread pool in

Re: Basic query in setting up secure inter-dc cluster

2016-04-25 Thread Ajay Garg
Hi Everyone. Kindly reply in "yes" or "no", as to whether it is possible to setup encryption only between particular pair of nodes? Or is it an "all" or "none" feature, where encryption is present between EVERY PAIR of nodes, or in NO PAIR of nodes. Thanks and Regards, Ajay On Mon, Apr 18, 2016

Re: Changing snitch from PropertyFile to Gossip

2016-04-25 Thread Carlos Rolo
I just run it to be sure. Sometimes mistakes happen and it's a way to be sure. Em 25/04/2016 10:19, "Alain RODRIGUEZ" escreveu: > Hi Carlos, > > Why running a repair there if the topology did not change? Is it as a best > practice, just in case, or is there a specific reason? > > C*heers, > -

Re: StatusLogger is logging too many information

2016-04-25 Thread Anuj Wadehra
Hi, You can set the property gc_warn_threshold_in_ms in yaml.For example, if your application is ok with a 2000ms pause, you can set the value to 2000 such that only gc pauses greater than 2000ms will lead to gc and status log. Please refer https://issues.apache.org/jira/plugins/servlet/mobile#i

Re: Unable to reliably count keys on a thrift CF

2016-04-25 Thread Anuj Wadehra
Hi Carlos, Please check if the JIRA :  https://issues.apache.org/jira/browse/CASSANDRA-11467 fixes your problem. We had been facing row count issue with thrift cf / compact storage and this fixed it. Above is fixed in latest 2.1.14. Its a two line fix. So, you can also prepare a custom jar and ch

MX4J with Cassandra 3.5 always empty response

2016-04-25 Thread Nico Haller
I just added the mx4j-tools jar (version 3.0.2) in my lib folder and also enabled remote jmx access without authentication (using firewall to protect access). During startup I can see the two following log statements: HttpAdaptor version 3.0.2 started on port 8081 mx4j successfuly loaded So, it s

Data repairing on one node questionably affects data on others

2016-04-25 Thread ssiv...@gmail.com
Hi All, I have cluster of 7 nodes completely balanced (each node owns ~500GB of data). And I have one keyspace and one table and three replicas. Than, I just failed one node's disk, replace it with a new one and started repairing. During that process I noticed that additional two nodes have sta

Inconsistent Reads after Restoring Snapshot

2016-04-25 Thread Anuj Wadehra
Hi, We have 2.0.14. We use RF=3 and read/write at Quorum. Moreover, we dont use incremental backups. As per the documentation at  https://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_backup_snapshot_restore_t.html  , if i need to restore a Snapshot on SINGLE node in a cluster, I wou

Re: Upgrading to SSD

2016-04-25 Thread Anuj Wadehra
Thanks All !! Anuj On Mon, 25/4/16, Alain RODRIGUEZ wrote: Subject: Re: Upgrading to SSD To: user@cassandra.apache.org Date: Monday, 25 April, 2016, 2:45 PM Hi Anuj, You could do the following instead to minimize server downtime: 1. rsync whi