Re: SSTable count in Nodetool tablestats(LevelCompactionStrategy)

2018-04-19 Thread kurt greaves
I'm currently investigating this issue on one of our clusters (but much worse, we're seeing >100 SSTables and only 2 in the levels) on 3.11.1. What version are you using? It's definitely a bug. On 17 April 2018 at 10:09, wrote: > Dear Community, > > > > One of the tables in my keyspace is using

Re: How to know version of TLS being used

2018-04-19 Thread Rajesh Kishore
If you are using java client , generally to find what is the protocol and cipher used , you can configure -Djavax.net.debug=ssl for the java program. You can configure this property either at server /client and redirect the output to some file. You will see message in ssl negotiation something like

Re: Does Cassandra supports ACID txn

2018-04-19 Thread Ben Slater
The second SO answer just says the partitions will be collocated (ie on the same server) not that the two tables will use the same partition. In any event, Cassandra does not have the kind of functionality you are looking for. The closest is logged batch but as Sylvain said, "all that guarantees is

what's the read cl of list read-on-write operations?

2018-04-19 Thread Jinhua Luo
Hi All, Some list operations, like set by index, needs to read the whole list before update. So what's the read consistency level of that read? Use the same cl of the setting for the normal read? - To unsubscribe, e-mail: user-un

Re: Does Cassandra supports ACID txn

2018-04-19 Thread Rajesh Kishore
Re-framing my question: So, it means that having different tables will not result into same partition even though you have same partition key. Ex. TableA( Partionkey(id)) TableB( Partionkey(id)) TableC( Partionkey(id)) and as part of batch operation I am somehow providing same id say "20" It wo

Re: Large size KS management

2018-04-19 Thread Anup Shirolkar
Hi Aiman, Can you please clarify whether the mentioned size of 800GB is considering Replication Factor(RF) or without it ? If yes, what is the RF ? Also, what is the method used to measure keyspace data size e.g size of directory, nodetool command etc. It would be helpful to know about the clust

Re: Does Cassandra supports ACID txn

2018-04-19 Thread Rajesh Kishore
So, it means that having different tables will not result into same partition even though you have same partition key. Ex. TableA( Partionkey(id)) TableB( Partionkey(id)) TableC( Partionkey(id)) and as part of batch operation I am somehow providing same id say "20" It wont be considered as Atomi

Re: Cassandra 3.7 - Problem with Repairs - all nodes failing

2018-04-19 Thread Anup Shirolkar
Contd. Upgrading from 3.7 to 3.11.1 will not involving any major changes. It can be achieved without any downtime and it should not impact on Cassandra clients. You can test the upgrade on a test cluster to be sure if you are considering to upgrade prod. Thanks, Anup On 20 April 2018 at 13:28, A

Re: Cassandra 3.7 - Problem with Repairs - all nodes failing

2018-04-19 Thread Anup Shirolkar
Hi Leena, The repairs are most likely failing because of some bug in Cassandra 3.7. I don't have a JIRA reference handy but there are quite some issues in this version. Considering your scenario, it is highly recommended that you should upgrade to 3.11.1. Although, you have mentioned that upgradi

Large size KS management

2018-04-19 Thread Aiman Parvaiz
Hi all I have been given a 15 nodes C* 2.2.8 cluster to manage which has a large size KS (~800GB). Given the size of the KS most of the management tasks like repair take a long time to complete and disk space management is becoming tricky from the systems perspective. This KS size is going to

Re: Detecting data centre failure

2018-04-19 Thread Niclas Hedhman
Also beware of "DC goes down" is not necessarily a total failure. It may be only a given client that doesn't see the DC, it may be that some hosts in one DC sees some hosts in the other DC and so on... The black/white "DC goes down" perception may lead to poor decisions on how to deal with failures

Re: Phantom growth resulting automatically node shutdown

2018-04-19 Thread kurt greaves
This was fixed (again) in 3.0.15. https://issues.apache.org/jira/browse/CASSANDRA-13738 On Fri., 20 Apr. 2018, 00:53 Jeff Jirsa, wrote: > There have also been a few sstable ref counting bugs that would over > report load in nodetool ring/status due to overlapping normal and > incremental repairs

Re: Token range redistribution

2018-04-19 Thread Richard Gray
On 2018-04-19 21:20, kurt greaves wrote: That's assuming your data is perfectly consistent, which is unlikely. Typically that strategy is a bad idea and you should avoid it. Oh, it's definitely a bad idea. I was just pointing out that the OP might still be able to avoid data loss if they haven

Re: copy from one table to another

2018-04-19 Thread Rahul Singh
Each table has a different Guid — doing a hard link may work as long as the sstable dir’s guid is he same as the newly created table in the system schema. -- Rahul Singh rahul.si...@anant.us Anant Corporation On Apr 19, 2018, 10:41 AM -0500, Kyrylo Lebediev , wrote: > The table is too large to

Re: copy from one table to another

2018-04-19 Thread Kyrylo Lebediev
The table is too large to be copied fast/effectively , so I'd like to leverage immutableness property of SSTables. My idea is to: 1) create new empty table (NewTable) with the same structure as existing one (OldTable) 2) at some time run simultaneous 'nodetool snapshot -t ttt OldTable' on al

Re: Phantom growth resulting automatically node shutdown

2018-04-19 Thread Jeff Jirsa
There have also been a few sstable ref counting bugs that would over report load in nodetool ring/status due to overlapping normal and incremental repairs (which you should probably avoid doing anyway) -- Jeff Jirsa > On Apr 19, 2018, at 9:27 AM, Rahul Singh wrote: > > I’ve seen something s

Re: [EXTERNAL] Re: Cassandra downgrade version

2018-04-19 Thread Jeff Jirsa
The real way to know for sure is for someone to go look at the sstable format changelog, and I’m traveling so it won’t be me, but for the record: If you snapshot everything, including system tables, you can always restore the snapshot - it’ll take downtime and you’ll lose data written after the

Re: [EXTERNAL] Re: Cassandra downgrade version

2018-04-19 Thread Michael Shuler
On 04/19/2018 08:48 AM, Durity, Sean R wrote: > So, the specific question here is whether there is any sstable format > change between 3.1.0 and 3.11.2. I don’t know if there is. Here's how to quickly test that: git clone https://github.com/apache/cassandra.git cd cassandra/ git checkout cassand

Re: Datastax Cassandra version 6

2018-04-19 Thread Jeff Jirsa
It doesn’t answer your question, but I’m obligated to point out that Datastax’s product is Datastax Enterprise / DSE, not “Datastax Cassandra”, as Cassandra is a trademark of the Apache software foundation. -- Jeff Jirsa > On Apr 19, 2018, at 9:42 AM, Chandan Goel wrote: > > Hi, > > Anyon

RE: [EXTERNAL] Re: Cassandra downgrade version

2018-04-19 Thread Durity, Sean R
This answer surprises me, because I would expect NOT to be able to downgrade if there are any changes in the sstable structure. I assume: - Upgrade is done while the application is up and writing data (so any new data is written in the new format) - Any compactions that happen

Re: Datastax Cassandra version 6

2018-04-19 Thread Pranay akula
It's already available to download Thanks Pranay On Thu, Apr 19, 2018, 8:42 AM Chandan Goel wrote: > Hi, > > > > Anyone aware when is Datastax launching version 6 for Cassandra. > > Datastax claims that ver 6 gives double the performance than ver 5.1. > > > > Thanks > > Chandan > > > > > --

Datastax Cassandra version 6

2018-04-19 Thread Chandan Goel
Hi, Anyone aware when is Datastax launching version 6 for Cassandra. Datastax claims that ver 6 gives double the performance than ver 5.1. Thanks Chandan Disclaimer The information in this email and any attachments may c

Re: Phantom growth resulting automatically node shutdown

2018-04-19 Thread Rahul Singh
I’ve seen something similar in 2.1. Our issue was related to file permissions being flipped due to an automation and C* stopped seeing Sstables so it started making new data — via read repair or repair processes. In your case if nodetool is reporting data that means that it’s growing due to dat

Cassandra 3.7 - Problem with Repairs - all nodes failing

2018-04-19 Thread Leena Ghatpande
we have 8 node prod cluster running on cassandra 3.7. Our 2 largest tables have around 100M and 30M rows respectively while all others are relatively smaller. we have been running repairs on alternate days on 2 of our keyspaces. We run repair on each node in the cluster with the -pr option on eve

Re: Phantom growth resulting automatically node shutdown

2018-04-19 Thread horschi
Did you check the number of files in your data folder before & after the restart? I have seen cases where cassandra would keep creating sstables, which disappeared on restart. regards, Christian On Thu, Apr 19, 2018 at 12:18 PM, Fernando Neves wrote: > I am facing one issue with our Cassandra

Re: Detecting data centre failure

2018-04-19 Thread Jeff Jirsa
Many drivers have a downgrading consistency feature that does it for you, but really you probably want to catch the timeout or unavailable exception and handle it in your app -- Jeff Jirsa > On Apr 19, 2018, at 5:52 AM, Venkata Hari Krishna Nukala > wrote: > > Hi, > > I am working on a C*

How to know version of TLS being used

2018-04-19 Thread Ashutosh Kumar
I have configured client_encryption_options in cassandra.yaml . How do I know which version of TLS is being used? Thanks Ashutosh

Detecting data centre failure

2018-04-19 Thread Venkata Hari Krishna Nukala
Hi, I am working on a C* cluster which is installed on two data centres. Our app is in installed on those data centres and they serve life traffic all the time. Keyspaces are configure with NetworkTopologyStrategy and we are using LOCAL_QUORUM. Now I have got a case where stronger consistency is

Phantom growth resulting automatically node shutdown

2018-04-19 Thread Fernando Neves
I am facing one issue with our Cassandra cluster. Details: Cassandra 3.0.14, 12 nodes, 7.4TB(JBOD) disk size in each node, ~3.5TB used physical data in each node, ~42TB whole cluster and default compaction setup. This size maintain the same because after the retention period some tables are droppe

Re: Dropped Mutations

2018-04-19 Thread Shalom Sagges
Thanks a lot Hitesh! I'll try to re-tune the heap to a lower level Shalom Sagges DBA T: +972-74-700-4035 We Create Meaningful Connections

RE: Does Cassandra supports ACID txn

2018-04-19 Thread Jacques-Henri Berthemet
When using BATCH on multiple tables you’ll need to use a LOGGED batch. When you send the request, it will be written to the batch log of all (relevant) nodes, when this write is successful it will be “accepted” and nodes will try to apply the batch operations. If for any reason a statement fails

Re: Does Cassandra supports ACID txn

2018-04-19 Thread Sylvain Lebresne
On Thu, Apr 19, 2018 at 11:13 AM Rajesh Kishore wrote: > Thanks for the response. Let me put my question again wrt a example > > I want to perform a atomic txn say insert/delete/update on a set of tables > TableA > TableB > TableC > > When these are performed as batch operations and let us say so

Re: How to restrict users to specific DC.

2018-04-19 Thread Sam Tunnicliffe
https://issues.apache.org/jira/browse/CASSANDRA-13985 is probably what you're looking for here Thanks, Sam On 10 April 2018 at 11:55, Rahul Singh wrote: > That seems to be more of a network segmentation issue. Protect the other > nodes behind a firewall / security group. Each node in the differ

Re: Token range redistribution

2018-04-19 Thread kurt greaves
That's assuming your data is perfectly consistent, which is unlikely. Typically that strategy is a bad idea and you should avoid it. On Thu., 19 Apr. 2018, 07:00 Richard Gray, wrote: > On 2018-04-18 21:28, kurt greaves wrote: > > replacing. Simply removing and adding back a new node without repl

Re: Does Cassandra supports ACID txn

2018-04-19 Thread Rajesh Kishore
Thanks for the response. Let me put my question again wrt a example I want to perform a atomic txn say insert/delete/update on a set of tables TableA TableB TableC When these are performed as batch operations and let us say something goes wrong while doing operation at TableC Would the system rol

RE: Does Cassandra supports ACID txn

2018-04-19 Thread Jacques-Henri Berthemet
Cassandra support LWT (Lightweight transactions), you may find this doc interesting: https://docs.datastax.com/en/cassandra/3.0/cassandra/dml/dmlDataConsistencyTOC.html In any case, LWT or BATCH you won’t have external control on the tx, it’s either done or not done. In case of timeout you won’t

Re: Does Cassandra supports ACID txn

2018-04-19 Thread DuyHai Doan
No ACID transaction any soon in Cassandra On Thu, Apr 19, 2018 at 7:35 AM, Rajesh Kishore wrote: > Hi, > > I am bit confused by reading different articles, does recent version of > Cassandra supports ACID transaction ? > > I found BATCH command , but not sure if it supports rollback, consider >