Renaming Partition Key

2019-03-14 Thread Debjani Nag
Hi Everyone , As per documentation , we cannot rename partition key . But partition key can be renamed . *https://docs.datastax.com/en/cql/3.3/cql/cql_reference/cqlAlterTable.htm *l * Refer : Restrictions apply to t

Re: good monitoring tool for cassandra

2019-03-14 Thread Rahul Singh
I wrote this last year. It's mostly still relevant --- as Jonathan said, Prometheus+Grafana is the best "make your own hammers and nails" approach. https://blog.anant.us/resources-for-monitoring-datastax-cassandra-spark-solr-performance/ On Thu, Mar 14, 2019 at 8:13 PM Jonathan Haddad wrote:

Re: good monitoring tool for cassandra

2019-03-14 Thread Jonathan Haddad
I've worked with several teams using DataDog, folks are pretty happy with it. We (The Last Pickle) did the dashboards for them: http://thelastpickle.com/blog/2017/12/05/datadog-tlp-dashboards.html Prometheus + Grafana is great if you want to host it yourself. On Fri, Mar 15, 2019 at 12:45 PM Jef

Re: Cannot replace_address /10.xx.xx.xx because it doesn't exist ingossip

2019-03-14 Thread Stefan Miklosovic
It is just a C* in Docker Compose with static IP addresses as long as all containers run. I am just killing Cassandra process and starting it again in each container. On Fri, 15 Mar 2019 at 10:47, Jeff Jirsa wrote: > Are your IPs changing as you restart the cluster? Kubernetes or Mesos or > some

Re: Cannot replace_address /10.xx.xx.xx because it doesn't exist ingossip

2019-03-14 Thread Jeff Jirsa
Are your IPs changing as you restart the cluster? Kubernetes or Mesos or something where your data gets scheduled on different machines? If so, if it gets an IP that was previously in the cluster, it’ll stomp on the old entry in the gossiper maps -- Jeff Jirsa > On Mar 14, 2019, at 3:42 PM

Re: good monitoring tool for cassandra

2019-03-14 Thread Jeff Jirsa
-dev, +user Datadog worked pretty well last time I used it. -- Jeff Jirsa > On Mar 14, 2019, at 11:38 PM, Sundaramoorthy, Natarajan > wrote: > > Can someone share knowledge on good monitoring tool for cassandra? Thanks > > This e-mail, including attachments, may include confidential and

Re: Cannot replace_address /10.xx.xx.xx because it doesn't exist ingossip

2019-03-14 Thread Stefan Miklosovic
Hi Fd, I tried this on 3 nodes cluster. I killed node 2, both node1 and node3 reported node2 to be DN, then I killed node1 and node3 and I restarted them and node2 was reported like this: [root@spark-master-1 /]# nodetool status Datacenter: DC1 === Status=Up/Down |/ State=Normal/Leavi

Re: Inconsistent results after restore with Cassandra 3.11.1

2019-03-14 Thread sandeep nethi
Cql select queries are returning 0 rows even though the data is actually available in sstables. But when i load/restore the same data with sstable loader data can be queried without any issues. Am using network topology strategy for all keyspace. Thanks On Fri, 15 Mar 2019 at 12:11 PM, Rahul

Re: Adding New Column with Default Value

2019-03-14 Thread Rahul Singh
*Spark.* Alter the table, add a column. Run a spark job to scan your table, and set a value. * val myKeyspace = "pinch" val myTable = "hitter"* *def updateColumns(row: CassandraRow): CassandraRow = { * * val inputMap = row.toMap val newData = Map( "newColumn" -> "somevalue" ) * * var outputMap

Re: update manually rows in cassandra

2019-03-14 Thread Rahul Singh
CQL supports JSON in and out from the Cassandra table, but if your JSON in the table is a string, then you need to update it as a string. https://docs.datastax.com/en/cql/3.3/cql/cql_using/useInsertJSON.html https://docs.datastax.com/en/cql/3.3/cql/cql_using/useQueryJSON.html What's the schema of

Re: Inconsistent results after restore with Cassandra 3.11.1

2019-03-14 Thread Rahul Singh
Can you define "inconsistent" results.. ? What's the topology of the cluster? What were you expecting and what did you get? On Thu, Mar 14, 2019 at 7:09 AM sandeep nethi wrote: > Hello, > > Does anyone experience inconsistent results after restoring Cassandra > 3.11.1 with refresh command? Was t

Re: [EXTERNAL] Re: Migrate large volume of data from one table to another table within the same cluster when COPY is not an option.

2019-03-14 Thread Rahul Singh
Adding to Stefan's comment. There is a "scylladb" migrator, which uses the spark connector from Datastax, and theoretically can work on any Cassandra compiant DB.. and should not be limited to cassandra to scylla. https://www.scylladb.com/2019/02/07/moving-from-cassandra-to-scylla-via-apache-spark

RE: To Repair or Not to Repair

2019-03-14 Thread Nick Hatfield
Beautiful, thank you very much! From: Jonathan Haddad [mailto:j...@jonhaddad.com] Sent: Thursday, March 14, 2019 4:55 PM To: user Subject: Re: To Repair or Not to Repair My coworker Alex (from The Last Pickle) wrote an in depth blog post on TWCS. We recommend not running repair on tables that

Re: To Repair or Not to Repair

2019-03-14 Thread Jonathan Haddad
My coworker Alex (from The Last Pickle) wrote an in depth blog post on TWCS. We recommend not running repair on tables that use TWCS. http://thelastpickle.com/blog/2016/12/08/TWCS-part1.html It's enough of a problem that we added a feature into Reaper to auto-blacklist TWCS / DTCS tables from be

To Repair or Not to Repair

2019-03-14 Thread Nick Hatfield
It seems that running a repair works really well, quickly and efficiently when repairing a column family that does not use TWCS. Has anyone else had a similar experience? Wondering if running TWCS is doing more harm than good as it chews up a lot of cpu and for extended periods of time in compar

RE: [EXTERNAL] Re: Default TTL on CF

2019-03-14 Thread Durity, Sean R
I spent a month of my life on similar problem... There wasn't an easy answer, but this is what I did #1 - Stop the problem from growing further. Get new inserts using a TTL (or set the default on the table so they get it). App team had to do this one. #2 - Delete any data that should already be

RE: [EXTERNAL] Re: Migrate large volume of data from one table to another table within the same cluster when COPY is not an option.

2019-03-14 Thread Durity, Sean R
The possibility of a highly available way to do this gives more challenges. I would be weighing the cost of a complex solution vs the possibility of a maintenance window when you stop your app to move the data, then restart. For the straight copy of the data, I am currently enamored with DataSta

RE: Cannot replace_address /10.xx.xx.xx because it doesn't exist ingossip

2019-03-14 Thread Fd Habash
I can conclusively say, none of these commands were run. However, I think this is the likely scenario … If you have a cluster of three nodes 1,2,3 … - If 3 shows as DN - Restart C* on 1 & 2 - Nodetool status should NOT show node 3 IP at all. Restarting the cluster while a node is down resets go

Re: AxonOps - Cassandra operational management tool

2019-03-14 Thread AxonOps
Thank you for taking the time for writing this great feedback. I've commented in-line to yours. Hayato On Wed, 13 Mar 2019 at 01:04, Rahul Singh wrote: > Nice.. Good to see the community producing tools around the Cassandra > product. > > Few pieces of feedback > > *Kudos* > 1. Glad that you ar

Re: Default TTL on CF

2019-03-14 Thread Nick Hatfield
Awesome! Thank you! On 3/14/19, 9:29 AM, "Jeff Jirsa" wrote: >SSTableReader and CQLSSTableWriter if you’re comfortable with Java > > >-- >Jeff Jirsa > > >> On Mar 14, 2019, at 1:28 PM, Nick Hatfield >>wrote: >> >> Bummer but, reasonable. Any cool tricks I could use to make that process >> eas

Re: Cannot replace_address /10.xx.xx.xx because it doesn't exist in gossip

2019-03-14 Thread Jeff Jirsa
Two things that wouldn't be a bug: You could have run removenode You could have run assassinate Also could be some new bug, but that's much less likely. On Thu, Mar 14, 2019 at 2:50 PM Fd Habash wrote: > I have a node which I know for certain was a cluster member last week. It > showed in nod

Cannot replace_address /10.xx.xx.xx because it doesn't exist in gossip

2019-03-14 Thread Fd Habash
I have a node which I know for certain was a cluster member last week. It showed in nodetool status as DN. When I attempted to replace it today, I got this message ERROR [main] 2019-03-14 14:40:49,208 CassandraDaemon.java:654 - Exception encountered during startup java.lang.RuntimeException: C

Re: Audit in C*

2019-03-14 Thread Rane, Sanjay
unsubscribe Sent from my iPhone On Mar 14, 2019, at 6:01 AM, Nitan Kainth mailto:nitankai...@gmail.com>> wrote: This email is from an external sender. 3.11 Regards, Nitan Cell: 510 449 9629 On Mar 14, 2019, at 3:18 AM, Per Otterström mailto:per.otterst...@ericsson.com>> wrote: With ecAudi

Re: Query failure

2019-03-14 Thread Léo FERLIN SUTTON
I checked and the configuration file matched on all the nodes. I checked `cqlsh --cqlversion "3.4.0" -u cassandra_superuser -p my_password nodeXX 9042` with each node and finally one failed. It had somehow not been restarted since the configuration change. It was not responsive to `systemctl sto

Re: Default TTL on CF

2019-03-14 Thread Jeff Jirsa
SSTableReader and CQLSSTableWriter if you’re comfortable with Java -- Jeff Jirsa > On Mar 14, 2019, at 1:28 PM, Nick Hatfield wrote: > > Bummer but, reasonable. Any cool tricks I could use to make that process > easier? I have many TB of data on a live cluster and was hoping to > starting cl

Re: Default TTL on CF

2019-03-14 Thread Nick Hatfield
Bummer but, reasonable. Any cool tricks I could use to make that process easier? I have many TB of data on a live cluster and was hoping to starting cleaning out the earlier bad habits of data housekeeping On 3/14/19, 9:24 AM, "Jeff Jirsa" wrote: >It does not impact existing data > >The data get

Re: Default TTL on CF

2019-03-14 Thread Jeff Jirsa
It does not impact existing data The data gets an expiration time stamp when you write it. Changing the default only impacts newly written data If you need to change the expiration time on existing data, you must update it -- Jeff Jirsa > On Mar 14, 2019, at 1:16 PM, Nick Hatfield wrote: >

Default TTL on CF

2019-03-14 Thread Nick Hatfield
Hello, Can anyone tell me if setting a default TTL will affect existing data? I would like to enable a default TTL and have cassandra add that TTL to any rows that don’t currently have a TTL set. Thanks,

Re: Audit in C*

2019-03-14 Thread Nitan Kainth
Good to know Bobbie Regards, Nitan Cell: 510 449 9629 > On Mar 13, 2019, at 3:21 PM, Bobbie Haynes wrote: > > Yes.we are using it and it is very helpful to u so far...! > >> On Wed, Mar 13, 2019 at 11:38 AM Rahul Singh >> wrote: >> Which version are you referring to? >> >>> On Wed, Mar 13

Re: Audit in C*

2019-03-14 Thread Nitan Kainth
3.11 Regards, Nitan Cell: 510 449 9629 > On Mar 14, 2019, at 3:18 AM, Per Otterström > wrote: > > With ecAudit you can get audit records for login attempts and queries on > selected ks/tables. Currently there is no way to get audit records for > rejected attempts/queries _only_, but that’s

Re: Audit in C*

2019-03-14 Thread Nitan Kainth
Thank you Pelle Regards, Nitan Cell: 510 449 9629 > On Mar 14, 2019, at 3:18 AM, Per Otterström > wrote: > > With ecAudit you can get audit records for login attempts and queries on > selected ks/tables. Currently there is no way to get audit records for > rejected attempts/queries _only_,

Re: Query failure

2019-03-14 Thread Sam Tunnicliffe
Hi Leo my guess would be that your configuration is not consistent across all nodes in the cluster. The responses you’re seeing are totally indicative of being connected to a node where PasswordAuthenticator is not enabled in cassandra.yaml. Thanks, Sam > On 14 Mar 2019, at 10:56, Léo FERLIN

Re: Cluster size "limit"

2019-03-14 Thread Jeff Jirsa
So gossip behaves reasonably well up into the ~1000 or so hosts per cluster. Repairs can get hard to schedule with ~256 vnodes and large numbers of nodes. It's do-able, it just requires a bit of extra work. Personally, I wouldn't run over 60 hosts with 256 vnodes, but I know from JIRA that some pe

Inconsistent results after restore with Cassandra 3.11.1

2019-03-14 Thread sandeep nethi
Hello, Does anyone experience inconsistent results after restoring Cassandra 3.11.1 with refresh command? Was there any bug in this version of cassandra?? Thanks in advance. Regards, Sandeep

Query failure

2019-03-14 Thread Léo FERLIN SUTTON
Hello ! Recently I have noticed some clients are having errors almost every time they try to contact my Cassandra cluster. The error messages vary but there is one constant : *It's not constant* ! Let me show you : >From the client host : `cqlsh --cqlversion "3.4.0" -u cassandra_superuser -p m

Re: [EXTERNAL] Re: Cluster size "limit"

2019-03-14 Thread Ahmed Eljami
So less vnodes allows more nodes, I understand. But, It still hard to implement on existing cluster with more than 10 Keyspaces with different RF...

RE: Audit in C*

2019-03-14 Thread Per Otterström
With ecAudit you can get audit records for login attempts and queries on selected ks/tables. Currently there is no way to get audit records for rejected attempts/queries _only_, but that’s an interesting feature for future versions. The plug-in is free to use under the Apache 2.0 license and com