Tombstone experience

2018-08-23 Thread Charulata Sharma (charshar)
Hi All, I have shared my experience of tombstone clearing in this blog post. Sharing it in this forum for wider distribution. https://medium.com/cassandra-tombstones-clearing-use-case/the-curios-case-of-tombstones-d897f681a378 Thanks, Charu

Re: Upgrade from 2.1 to 3.11

2018-08-23 Thread Mun Dega
Looks like there are a couple of issues open regarding 3.11.2 release: https://issues.apache.org/jira/browse/CASSANDRA-14355 https://issues.apache.org/jira/browse/CASSANDRA-14495 Ma On Thu, Aug 23, 2018 at 10:54 PM Mun Dega wrote: > Interesting. Any other suggestions what other things change

Re: Upgrade from 2.1 to 3.11

2018-08-23 Thread Mun Dega
Interesting. Any other suggestions what other things changed that would be major between 2.1 and 3.x? In Change Log all isee is bug fixes and further improvements. On Thu, Aug 23, 2018, 21:37 Gosar M wrote: > we also increased the max_heap_count (sysctl.conf) value to resolve OOO > memory is

Re: Cassandra 2.2.7 Compaction after Truncate issue

2018-08-23 Thread James Shaw
you may go OS level to delete the files.That's what I did before. Truncate action is frequently failed on some remote nodes in a heavy transactions env. Thanks, James On Thu, Aug 23, 2018 at 8:54 PM, Rahul Singh wrote: > David , > > What CL do you set when running this command? > > Rahul Sing

Re: Upgrade from 2.1 to 3.11

2018-08-23 Thread Gosar M
we also increased the max_heap_count (sysctl.conf) value to resolve OOO memory issue. On Thursday, 23 August 2018, 16:04:20 GMT-7, Mun Dega wrote: 120G data28G heap out of 48 on system9 node cluster, RF3 On Thu, Aug 23, 2018, 17:19 Mohamadreza Rostami wrote: Hi,How much data do you

Re: How to rename the column name in Cassandra tables

2018-08-23 Thread Rahul Singh
Which documentation are you referring to? Which version of Cassandra? https://docs.datastax.com/en/cql/3.3/cql/cql_reference/cqlAlterTable.html Renaming a column The main purpose of RENAME is to change the names of CQL-generated primary key and column names that are missing from a legacy table.

Re: Fwd: Removing Extra Spaces and Row counts while using Capture Command

2018-08-23 Thread Rahul Singh
What’s your goal? Just output the results and save as JSON? There may be a better way to do what you want. https://github.com/tenmax/cqlkit/blob/master/README.md Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We bu

Re: Cassandra 2.2.7 Compaction after Truncate issue

2018-08-23 Thread Rahul Singh
David , What CL do you set when running this command? Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital business technology platforms. On Aug 14, 2018, 11:49 AM -0500, David Payne , wrote: > S

Re: 90million reads

2018-08-23 Thread Rahul Singh
Agreed. If your data model is good and no major read latencies due to little or no data skew, wide partitions, or tombstones, you can literally scale linearly. You could also consider having a plan in which you ramp up as the traffic increases. Rahul Singh Chief Executive Officer m 202.905.2818

Re: Upgrade from 2.1 to 3.11

2018-08-23 Thread Mun Dega
120G data 28G heap out of 48 on system 9 node cluster, RF3 On Thu, Aug 23, 2018, 17:19 Mohamadreza Rostami < mohamadrezarosta...@gmail.com> wrote: > Hi, > How much data do you have? How much RAM do your servers have? How much do > you have a heep? > On Thu, Aug 23, 2018 at 10:14 PM Mun Dega wro

Re: A blog about Cassandra in the IoT arena

2018-08-23 Thread Rahul Singh
Agreed. One of the ideas I had on partition size is to automatically synthetically shard based on some basic patterns seen in the data. It could be implemented as a tool that would create a new table with an additional part of the key that is an automatic created shard, or it would use an exist

Re: Upgrade from 2.1 to 3.11

2018-08-23 Thread Mohamadreza Rostami
Hi, How much data do you have? How much RAM do your servers have? How much do you have a heep? On Thu, Aug 23, 2018 at 10:14 PM Mun Dega wrote: > Hello, > > We recently upgraded from Cassandra 2.1 to 3.11.2 on one cluster. The > process went OK including upgradesstable but we started to experien

Upgrade from 2.1 to 3.11

2018-08-23 Thread Mun Dega
Hello, We recently upgraded from Cassandra 2.1 to 3.11.2 on one cluster. The process went OK including upgradesstable but we started to experience high latency for r/w, occasional OOM and long GC pause after. For the same cluster with 2.1, we didn't have any issues like this. We also kept serve

Switching Snitch

2018-08-23 Thread Pradeep Chhetri
Hello, I am currently running a 3.11.2 cluster in SimpleSnitch hence the datacenter is datacenter1 and rack is rack1 for all nodes on AWS. I want to switch to GPFS by changing the rack name to the availability-zone name and datacenter name to region name. When I try to restart individual nodes by

Re: A blog about Cassandra in the IoT arena

2018-08-23 Thread DuyHai Doan
As I used to tell some people, the day we make : 1. partition size unlimited, or at least huge partition easily manageable (compaction, repair, streaming, partition index file) 2. tombstone a non-issue that day, Cassandra will dominate any other IoT technology out there Until then ... On Thu, A

Re: A blog about Cassandra in the IoT arena

2018-08-23 Thread Rahul Singh
Good analysis of how the different key structures affect use cases and performance. I think you could extend this article with potential evaluation of FiloDB which specifically tries to solve the OLAP issue with arbitrary queries. Another option is leveraging Elassandra (index in Elasticsearch c

Re: duplicate rows for partition

2018-08-23 Thread Marcus Olsson
Hi, I believe the "tDate" is stored with milliseconds precision which could explain why these duplicate dates are shown. Could you try running the following query: "SELECT userid, secondaryid, blobAsBigint(timestampAsBlob("tDate")), tid3, sid4, pid5, associate_degree FROM user_data;" The "tDat

A blog about Cassandra in the IoT arena

2018-08-23 Thread Affan Syed
Hi, we wrote a blog about some of the results that engineers from AN10 shared earlier. I am sharing it here for greater comments and discussions. http://www.an10.io/technology/cassandra-and-iot-queries-are-they-a-good-match/ Thank you. - Affan