Potential bug re to MVs after upgrading from 3.11.x to 4.0.x

2023-05-31 Thread Rahul Singh
Good afternoon, Am looking into some latent issues post 3.11.x to 4.0.x upgrade. The system is using materialized views and the core problem is related to how the mutations are being sent from the parent table to two related materialized views. In 3.11.x, without any tuning ( no flag set for *-Dc

Re: Log4j vulnerability

2021-12-13 Thread Rahul Reddy
Hello, I see this jar log4j-over-slf4j-1.7.7.jar does it have any impact on it? Why that jar is used for ? On Sat, Dec 11, 2021 at 12:45 PM Brandon Williams wrote: > https://issues.apache.org/jira/browse/CASSANDRA-5883 > > As that ticket shows, Apache Cassandra has never used log4j2. > > On

Re: Ansible Cassandra Collection

2021-03-19 Thread Rahul Singh
ckling the same / similar issues. Best regards, Rahul Singh rahul.xavier.si...@gmail.com http://cassandra.link On Fri, Mar 19, 2021 at 9:27 AM Erick Ramirez wrote: > Fantastic, Rhys! Thanks very much. I'm sure it will prove very useful for > users in the community. Cheers! > >>

Re: data modeling qu: use a Map datatype, or just simple rows... ?

2020-09-19 Thread Rahul Singh
with natural string keys like “email.” Best regards, Rahul Singh From: Sagar Jambhulkar Sent: Saturday, September 19, 2020 6:45:25 AM To: user@cassandra.apache.org ; Attila Wind Subject: Re: data modeling qu: use a Map datatype, or just simple rows... ? Don't really see a difference in two op

Cassandra.Link Knowledge Base - v. 0.7 - Jobs Section

2020-08-05 Thread Rahul Singh
Folks, Quick update. We added a jobs section that's aggregating jobs from a few different job markets but only those that relate to Cassandra. Right now it's just a "lucene" based filter from a larger data set, but our team is working to put some ML action to do NLP based classification. Would lo

Open Request for Reference Architectures / Case Studies of Apache Cassandra

2020-07-31 Thread Rahul Singh
Folks, I'm looking for articles, blogs, diagrams, or someone to answer some questions so that I can help repopulate a *case study database of uses of Cassandra*. I'll be publishing these on the *https://cassandra.link * site. I'm also collecting reference architectures so

Re: Memory decline

2020-06-19 Thread Rahul Reddy
ve seen leak. If you’ve configured to have >> swap=0, then you end up in a position where even if the memory usage is >> stale, nothing can push the stale pages out of the way. >> >> >> >> *From: *Rahul Reddy >> *Reply-To: *"user@cassandra.apache.org

Memory decline

2020-06-18 Thread Rahul Reddy
Hello, Im seeing continuous decline in memory on a Cassandra instance used to have 20g free memory 15 days back and now its 15g and continue to go down. Same instance it caused the cassandra instance crash before. Can you please give me some pointers to look for which is causing continuous decline

Connections limit on gocql

2020-05-26 Thread Rahul Reddy
Hello, Our service code is written in goland uses gocql to connect todb and we have 30 node cluster. And we have service connections coming from kubernettes pods when we scaleup pods to 500 for each pod we are getting connections 1500 per each node. We are not seeing any issues now but wanted to

Cassandra.Link Knowledge Base - v. 0.5

2020-03-03 Thread Rahul Singh
Our apprentice / analyst team (Tanaka, Jordon, and Cynthia) at Anant.us have been making improvements to the best public collection of curated links for Apache Cassandra at https://Cassandra.Link — they’ve fixed several issues related to the search interface. This week we’ll also be releasing “

Null values in sasi indexed column

2020-02-19 Thread Rahul Reddy
Hello, We have a requirement to query based on a column which is not part of priamry key. We are planning to create sasi index . Before creating index want to confirm how would be index behaviour if it has 10% of data will be null and data distribution across the nodes 6-6 nodes wth RF 3? Please

Ec2 instance transient network issues caused 500 errors

2019-12-30 Thread Rahul Reddy
Hello, We have our cassandra cluster running on aws and we have 2 dc’s 6 and 6 nodes in both regions with RF=3 and cassandra version 3.11.3 . One of the ec2 instance had issues with network issues for 9 minutes. Since it was network issue neither ec2 was down nor cassandra down. But this cause

Re: "Maximum memory usage reached (512.000MiB), cannot allocate chunk of 1.000MiB"

2019-12-02 Thread Rahul Reddy
ite heavy. Real time > applications are different than time series data environments and ... . > > > > On Sun, Dec 1, 2019 at 7:09 PM Rahul Reddy > wrote: > >> Hello, >> >> We are seeing memory usage reached 512 mb and cannot allocate 1MB. I see >

"Maximum memory usage reached (512.000MiB), cannot allocate chunk of 1.000MiB"

2019-12-01 Thread Rahul Reddy
Hello, We are seeing memory usage reached 512 mb and cannot allocate 1MB. I see this because file_cache_size_mb by default set to 512MB. Datastax document recommends to increase the file_cache_size. We have 32G over all memory allocated 16G to Cassandra. What is the recommended value in my case

Re: Aws instance stop and star with ebs

2019-11-06 Thread Rahul Reddy
lt;==> > Made weak by time and fate, but strong in will, > To strive, to seek, to find, and not to yield. > Ulysses - A. Lord Tennyson > > *Daemeon C.M. Reiydelle* > > *email: daeme...@gmail.com * > *San Francisco 1.415.501.0198/Skype daemeon.c.m.reiydelle* > >

Re: Aws instance stop and star with ebs

2019-11-06 Thread Rahul Reddy
minutes, that sounds suspiciously like blocking on a default TCP > socket timeout. > > > > *From: *Rahul Reddy > *Reply-To: *"user@cassandra.apache.org" > *Date: *Wednesday, November 6, 2019 at 12:12 PM > *To: *"user@cassandra.apache.org" > *Subject: *R

Re: Aws instance stop and star with ebs

2019-11-06 Thread Rahul Reddy
enter timeout as I recall. > > You may be forced to tcpdump the interface(s) to see where the chatter is. > Out of curiosity, when you restart the node, have you snapped the jvm's > memory to see if e.g. heap is even in use? > > > On Tue, Nov 5, 2019 at 7:03 PM Rahul

Re: Aws instance stop and star with ebs

2019-11-05 Thread Rahul Reddy
ontain confidential and legally > privileged information. If you are not the intended recipient, do not copy > or disclose its content, but please reply to this email immediately and > highlight the error to the sender and then immediately delete the message. > > > On Wed, 6 Nov

Re: Aws instance stop and star with ebs

2019-11-05 Thread Rahul Reddy
INFO [RequestResponseStage-7] 2019-11-05 15:16:27,166 Gossiper.java:1019 - InetAddress /nodewhichitwasshowing down is now UP what is causing delay for 10mins to be able to say that node is reachable On Wed, Oct 30, 2019, 8:37 AM Rahul Reddy wrote: > And also aws ec2 stop and start comes with new

Re: Aws instance stop and star with ebs

2019-10-30 Thread Rahul Reddy
And also aws ec2 stop and start comes with new instance with same ip and all our file systems are in ebs mounted fine. Does coming new instance with same ip cause any gossip issues? On Tue, Oct 29, 2019, 6:16 PM Rahul Reddy wrote: > Thanks Alex. We have 6 nodes in each DC with RF=3 with

Re: Aws instance stop and star with ebs

2019-10-29 Thread Rahul Reddy
determine what caused the Cassandra unavialbe though log says its stared and listening ? On Tue, Oct 29, 2019, 4:44 PM Oleksandr Shulgin < oleksandr.shul...@zalando.de> wrote: > On Tue, Oct 29, 2019 at 9:34 PM Rahul Reddy > wrote: > >> >> We have our infrastructure on aws a

Aws instance stop and star with ebs

2019-10-29 Thread Rahul Reddy
Hello, We have our infrastructure on aws and we use ebs storage . And aws was retiring on of the node. Since our storage was persistent we did nodetool drain and stopped and start the instance . This caused 500 errors in the service. We have local_quorum and rf=3 why does stopping one instance cau

Re: New column

2019-08-22 Thread Rahul Reddy
>> You can tweak the params as needed. If you've got a cluster up, use the >> --host to point to it.If you don't have a cluster up, you can spin one >> up in AWS in about 5-10 minutes using our tools: >> https://thelastpickle.com/tlp-cluster/ >> >> Happy

Re: Cassandra copy command

2019-08-21 Thread Rahul Reddy
Thanks Jean, I have dc1 and dc2 existing. added dc3 from dc1 and dc4 from dc2. If I want to run repair on one node in dc3 from dc1 only is it possible? On Wed, Aug 21, 2019, 8:11 AM Jean Carlo wrote: > Hello Rahul, > > To ensure the consistency among the DCs, it is enough to run

Re: Cassandra copy command

2019-08-21 Thread Rahul Reddy
Yep I did run rebuild on each new node On Wed, Aug 21, 2019, 7:25 AM Stefan Miklosovic < stefan.mikloso...@instaclustr.com> wrote: > Hi Rahul, > > how did you add that dc3 to cluster? The rule of thumb here is to do > rebuild from each node, for example like here > > h

Re: Cassandra copy command

2019-08-21 Thread Rahul Reddy
Does it get the data only from dc3? On Wed, Aug 21, 2019, 6:46 AM Stefan Miklosovic < stefan.mikloso...@instaclustr.com> wrote: > Hi Rahul, > > what is your motivation behind this? Why do you want to make sure the > count is same? What is the purpose of that? All you should care

Cassandra copy command

2019-08-21 Thread Rahul Reddy
Hello, I have 3 datacenters . Want to make sure record count is same in all dc's . If I run copy command node1 in dc1 does it get the data from only dc1? Nodetool cfstats I'm seeing discrepancies in partitions count is it because we didn't run cleanup after adding few nodes and remove them?. To ru

Re: New column

2019-08-19 Thread Rahul Reddy
next release. > > On Sun, Aug 18, 2019, 12:58 PM Rahul Reddy > wrote: > >> Hello, >> >> We have a table and want to add column and select based on existing >> entire primary key plus new column using allow filtering. Since my where >> clause has all the pri

New column

2019-08-18 Thread Rahul Reddy
Hello, We have a table and want to add column and select based on existing entire primary key plus new column using allow filtering. Since my where clause has all the primary key + new column does the allow filtering scan only the partions which are listed or does it has to scan whole table? What

Cassandra node down metric

2019-07-30 Thread Rahul Reddy
Hello, I'm using jmx metric node org_apache_cassandra_net_failuredetector_downendpointcount to monitor number of Cassandra nodes down. For any reason (aws schedule retirement) we decommission Cassandra node this metric shows the node down for 72 hours until the gossip clearead. We want keep trac

Re: Assassinate or decommission?

2019-07-30 Thread Rahul Reddy
tpickle.com/blog/2018/09/18/assassinate.html > > Rahul Reddy schrieb am Di., 30. Juli 2019, > 11:18: > >> Hello, >> >> While removing old data center any specific reason to use assassinate >> instead of decommission ? >> >> https://docs.datastax.com/en/dse/5.1/dse-admin/datastax_enterprise/operations/opsDecomissionDC.html >> >> >> >> >> >> >> >>

Assassinate or decommission?

2019-07-30 Thread Rahul Reddy
Hello, While removing old data center any specific reason to use assassinate instead of decommission ? https://docs.datastax.com/en/dse/5.1/dse-admin/datastax_enterprise/operations/opsDecomissionDC.html

Re: Jmx metrics shows node down

2019-07-29 Thread Rahul Reddy
And also system.peers table doesn't have the information on old nodes only ghost nodes to be there in JMX On Mon, Jul 29, 2019, 7:39 AM Rahul Reddy wrote: > We removed many times nodes from a cluster but never seen the jmx metric > down stay for 72 hours. So it has to be complet

Re: Jmx metrics shows node down

2019-07-29 Thread Rahul Reddy
< oleksandr.shul...@zalando.de> wrote: > On Mon, Jul 29, 2019 at 1:21 PM Rahul Reddy > wrote: > >> >> Decommissioned 2 nodes from cluster nodetool status doesn't list the >> nodes as expected but jmx metrics shows still those 2 nodes has down. >> Nodetool gossip

Jmx metrics shows node down

2019-07-29 Thread Rahul Reddy
Hello, Decommissioned 2 nodes from cluster nodetool status doesn't list the nodes as expected but jmx metrics shows still those 2 nodes has down. Nodetool gossip shows the 2 nodes in Left state. Why does my jmx still shows those nodes down even after 24 hours. Cassandra version 3.11.3 ? Anything

Re: Dse keypsaces in apache cluster

2019-07-24 Thread Rahul Reddy
or info on their product, and be > very careful. Also note I don't have specific experience with your exact > scenario. > > (My experience with Datastax is version 4.6-5.0) > > On Wed, Jul 24, 2019, 10:34 AM Rahul Reddy > wrote: > >> Hello, >> >> I h

Dse keypsaces in apache cluster

2019-07-24 Thread Rahul Reddy
Hello, I have 2 data centers with dse Cassandra added new DC with apache Cassandra . Dse_perf,dse_systen,dse_security,dse_leases keypsaces created as well . Can we delete them ?

Cassandra.Link Knowledge Base - v. 0.4

2019-07-20 Thread Rahul Singh
Hey Cassandra community , Thanks for all the feedback in the past on my cassandra knowledge base project. Without the feedback cycle it’s not really for the community. V. 0.1 - Awesome Cassandra  readme.me https://anant.github.io/awesome-cassandra Hundreds of Cassandra articles tools etc. organ

Re: Rebooting one Cassandra node caused all the application nodes go down

2019-07-19 Thread Rahul Reddy
Sorry no corruption errors. Thanks Jeff, Anything specific to look into if this happens again On Fri, Jul 19, 2019, 2:40 PM Nitan Kainth wrote: > You no corruption error or you see corruption error? > > > Regards, > > Nitan > > Cell: 510 449 9629 > > On J

Re: Rebooting one Cassandra node caused all the application nodes go down

2019-07-19 Thread Rahul Reddy
19, 2019, at 12:32 PM, ZAIDI, ASAD A wrote: > > “aws asked to set nvme_timeout to higher number in etc/grub.conf.” > > > > Did you ask AWS if setting higher value is real solution to bug - Is there > not any patch available to address the bug? - just curios to know >

Re: Rebooting one Cassandra node caused all the application nodes go down

2019-07-19 Thread Rahul Reddy
Thanks for quick response rajshekar. Correct same cassandra.yml and same java On Fri, Jul 19, 2019, 11:56 AM Rajsekhar Mallick wrote: > Hello Rahul, > > May you please confirm on below things. > > 1. Cassandra.yaml file of the node which was started after the machine > rebo

Rebooting one Cassandra node caused all the application nodes go down

2019-07-19 Thread Rahul Reddy
Here , We have 6 nodes each in 2 data centers us-east-1 and us-west-2 . We have RF 3 and cl set to local quorum. And gossip snitch. All our instance are c5.2xlarge and data files and comit logs are stored in gp2 ebs. C5 instance type had a bug which aws asked to set nvme_timeout to higher numbe

Snitch

2019-07-17 Thread Rahul Reddy
Hello, All our infrastructure is in aws but we still use gossippropertyfilesnitch. We have two datacenters us_east_1 and us_west_2 trying to add us_east_1_analytics in the same aws DC as us_east_1and us_west_2_analytics in same aws DC us_west_2. Tried to use dc_suffix it seems to be helpful only i

Re: Adding new DC with different version of Cassandra

2019-07-01 Thread Rahul Reddy
t; > > On Jul 1, 2019, at 3:25 AM, Rahul Reddy > wrote: > > > > Hello All, > > > > We have datastax Cassandra cluster which uses 3.11.0 and we want to add > new DC with apache Cassandra 3.11.3. we tried doing the same and data got > streamed to new DC. Sinc

Adding new DC with different version of Cassandra

2019-07-01 Thread Rahul Reddy
Hello All, We have datastax Cassandra cluster which uses 3.11.0 and we want to add new DC with apache Cassandra 3.11.3. we tried doing the same and data got streamed to new DC. Since we are able to stream data any other issues we need to consider. Is it because of same type of sstables used in bot

Understanding output of read/write histogram using opscenter API

2019-06-04 Thread Bhardwaj, Rahul
sample output. we could not find the way to get different percentile's data using API for read-histogram and write-histogram. Kindly help or provide some doc link related to its explanation. Thanks and Regards, Rahul Bhardwaj write-histogram.json Description: write-histogram

Re: Sstableloader

2019-05-30 Thread Rahul Reddy
hen up to 3.11. > > On Wed, May 29, 2019, 5:56 PM Nitan Kainth wrote: > > If cassandra version is same, it should work > > > > Regards, > > Nitan > > Cell: 510 449 9629 > > > On May 28, 2019, at 4:21 PM, Rahul Reddy wrote: > > Hello, > > > > Does sstableloader works between datastax and Apache cassandra. I'm trying > to migrate dse 5.0.7 to Apache 3.11.1 ? > >

Sstableloader

2019-05-28 Thread Rahul Reddy
Hello, Does sstableloader works between datastax and Apache cassandra. I'm trying to migrate dse 5.0.7 to Apache 3.11.1 ?

Re: CassKop : a Cassandra operator for Kubernetes developped by Orange

2019-05-24 Thread Rahul Singh
Fantastic! Now there are three teams making k8s operators for C*: Datastax, Instaclustr, and now Orange. rahul.xavier.si...@gmail.com http://cassandra.link I'm speaking at #DataStaxAccelerate, the world’s premiere #ApacheCassandra conference, and I want to see you there! Use my code Singh50 for

Re: Cassandra cross dc replication row isolationCassandra cross dc replication row isolation

2019-05-07 Thread Rahul Singh
Depends on the consistency level you are setting on write and read. What CL are you writing at and what CL are you reading at? The consistency level tells the coordinator when to send acknowledgement of a write and whether to cross DCs to confirm a write. It also tells the coordinator how many

Re: Five Questions for Cassandra Users

2019-04-01 Thread Rahul Singh
Answers inline. 1. Do the same people where you work operate the cluster and write the code to develop the application? No but the operators need to know development , data-modeling, and generally how to "code" the application. (Coding is a low-level task of assigning a code to a concept.

Re: How do u setup networking for Opening Solr Web Interface when on cloud?

2019-04-01 Thread Rahul Singh
This is probably not a question for this community... but rather for Datastax support or the Datastax Academy slack group. More specifically this is a "how to expose solr securely" question which is amply answered well on the interwebs if you look for it on Google. rahul.xavier.si...@gmail.com h

Re: TWCS Compactions & Tombstones

2019-03-26 Thread Rahul Singh
What's your timewindow? Roughly how much data is in each window? If you examine the sstable data and see that is truly old data with little chance that it has any new data, you can just remove the SStables. You can do a rolling restart -- take down a node, remove mc-254400-* and then start it up.

Re: Merging two cluster's in to one without any downtime

2019-03-26 Thread Rahul Singh
In my experience, I'd use two methods to make sure that you are covering your ass. 1. "old school" methodology would be to do the SStable load from old to new cluster -- if you do incremental snapshots, then you could technically minimize downtime and just load the latest increments with a little

Re: good monitoring tool for cassandra

2019-03-14 Thread Rahul Singh
I wrote this last year. It's mostly still relevant --- as Jonathan said, Prometheus+Grafana is the best "make your own hammers and nails" approach. https://blog.anant.us/resources-for-monitoring-datastax-cassandra-spark-solr-performance/ On Thu, Mar 14, 2019 at 8:13 PM Jonathan Haddad wrote:

Re: Adding New Column with Default Value

2019-03-14 Thread Rahul Singh
*Spark.* Alter the table, add a column. Run a spark job to scan your table, and set a value. * val myKeyspace = "pinch" val myTable = "hitter"* *def updateColumns(row: CassandraRow): CassandraRow = { * * val inputMap = row.toMap val newData = Map( "newColumn" -> "somevalue" ) * * var outputMap

Re: update manually rows in cassandra

2019-03-14 Thread Rahul Singh
CQL supports JSON in and out from the Cassandra table, but if your JSON in the table is a string, then you need to update it as a string. https://docs.datastax.com/en/cql/3.3/cql/cql_using/useInsertJSON.html https://docs.datastax.com/en/cql/3.3/cql/cql_using/useQueryJSON.html What's the schema of

Re: Inconsistent results after restore with Cassandra 3.11.1

2019-03-14 Thread Rahul Singh
Can you define "inconsistent" results.. ? What's the topology of the cluster? What were you expecting and what did you get? On Thu, Mar 14, 2019 at 7:09 AM sandeep nethi wrote: > Hello, > > Does anyone experience inconsistent results after restoring Cassandra > 3.11.1 with refresh command? Was t

Re: [EXTERNAL] Re: Migrate large volume of data from one table to another table within the same cluster when COPY is not an option.

2019-03-14 Thread Rahul Singh
Adding to Stefan's comment. There is a "scylladb" migrator, which uses the spark connector from Datastax, and theoretically can work on any Cassandra compiant DB.. and should not be limited to cassandra to scylla. https://www.scylladb.com/2019/02/07/moving-from-cassandra-to-scylla-via-apache-spark

Re: Audit in C*

2019-03-13 Thread Rahul Singh
Which version are you referring to? On Wed, Mar 13, 2019 at 10:28 AM Nitan Kainth wrote: > Hi, > > Anybody have used auditing to find out failed login attempts, or > unauthorized access tries. > > I found ecAudit by Ericsson, is it free to use? Has anybody tried it? > > Ref: https://github.com/E

Re: AxonOps - Cassandra operational management tool

2019-03-12 Thread Rahul Singh
Nice.. Good to see the community producing tools around the Cassandra product. Few pieces of feedback *Kudos* 1. Glad that you are doing it 2. Looks great 3. Willing to try it out if you find this guy called "Free Time" for me :) *Criticism* 1. It mimics a lot of stack components that are out th

Re: cassandra upgrades multi-DC in parallel

2019-03-12 Thread Rahul Singh
Carl, If you have done an automation and tested it a few time on a lower environment with the same data from production, I'd say go for it.. but as Jonathan said, if there's an issue, you won't be able to continue operations. On Tue, Mar 12, 2019 at 3:20 PM Jonathan Haddad wrote: > Nothing pr

Re: [EXTERNAL] RE: SASI queries- cqlsh vs java driver

2019-02-27 Thread Rahul Singh
+1 on Datastax and could consider looking at Elassandra. On Thu, Feb 7, 2019 at 9:14 AM Durity, Sean R wrote: > Kenneth is right. Trying to port/support a relational model to a CQL model > the way you are doing it is not going to go well. You won’t be able to > scale or get the search flexibilit

Re: High GC pauses leading to client seeing impact

2019-02-27 Thread Rahul Singh
There are a few factors: sometimes data that is in a fat partition clogs up the heap space / memtable space and tombstones don't help that much either. This is worsened by data skew . I agree , if CMS is working for now, continue using it and then upgrade to better versions of Java / C*. Few thing

Re: Connection status on cluster exposed anywhere?

2019-02-27 Thread Rahul Singh
You can get statistics at a table level, and you can get some information at a keyspace level, but it's an approximation. Better to get tablelevel and aggregate up. Here are some pointers. https://blog.anant.us/resources-for-monitoring-datastax-cassandra-spark-solr-performance/ On Wed, Feb 27,

Re: Feedback wanted for Knowledge base for all things cassandra (cassandra.link)

2019-02-25 Thread Rahul Singh
robably just take their feed and integrate it and add others as I find them. I wish I had more time to contribute! Best, On Mon, Feb 25, 2019 at 11:17 AM Kenneth Brotman wrote: > Hi Rahul! > > > > A truly outstanding effort for the community. I think it should be tied >

Feedback wanted for Knowledge base for all things cassandra (cassandra.link)

2019-02-25 Thread Rahul Singh
Folks, I've been scrounging time to work on a knowledge resource for all things Cassandra ( Cassandra, DSE, Scylla, YugaByte, Elassandra) I feel like the Cassandra core community still has the most knowledge even though people are fragmenting into their brands. Would love to get your feedback on

Re: Tombstones in memtable

2019-02-24 Thread Rahul Reddy
t problem are you solving here? If you’re serving reads > and sitting under 50% cpu, it’s not clear to me what you’re trying to fix. > Tombstones scanned won’t matter for your table, so if that’s your only > concern, I’d ignore it. > > > > -- > Jeff Jirsa > > > On Feb 23

Re: Tombstones in memtable

2019-02-23 Thread Rahul Reddy
Reads increase on all most all nodes same is the case with CPU. it's goes high on all nodes On Sat, Feb 23, 2019, 11:04 PM Kenneth Brotman wrote: > When the CPU utilization spikes from 5-10% to 50%, how many nodes does it > happen to at the same time? > > > &

Re: Tombstones in memtable

2019-02-23 Thread Rahul Reddy
8192M" HEAP_NEWSIZE="800M" ``` On Sat, Feb 23, 2019, 10:15 PM Rahul Reddy wrote: > Thanks Jeff, > > Since low writes and high reads most of the time data in memtables only. > When I noticed intially issue no stables on disk everything in memtable > only. > > On Sat,

Re: Tombstones in memtable

2019-02-23 Thread Rahul Reddy
bit > (given the sizes in your cfstats I’d probably go to 4K instead of 64k), and > maybe consider LCS or TWCS instead of STCS (Which is appropriate depends on > a lot of factors, but STCS is probably causing a fair bit of unnecessary > compactions and probably is very slow to expire d

Re: Tombstones in memtable

2019-02-23 Thread Rahul Reddy
one problems with that table / that select. > > -- > Jeff Jirsa > > > On Feb 23, 2019, at 5:55 PM, Rahul Reddy wrote: > > Changing gcgs didn't help > > CREATE KEYSPACE ksname WITH replication = {'class': > 'NetworkTopologyStrategy', 'dc1'

Re: Tombstones in memtable

2019-02-23 Thread Rahul Reddy
35.43 42.51 124 1 99% 0.00 42.51 51.01 124 1 Min 0.00 8.24 5.7273 0 Max 1.00 42.51152.32

Re: Tombstones in memtable

2019-02-23 Thread Rahul Reddy
gt; On Feb 22, 2019, at 8:37 AM, Kenneth Brotman > wrote: > > Can we see the histogram? Why wouldn’t you at times have that many > tombstones? Makes sense. > > > > Kenneth Brotman > > > > *From:* Rahul Reddy [mailto:rahulreddy1...@gmail.com > ] > *Sent

Tombstones in memtable

2019-02-21 Thread Rahul Reddy
We have small table records are about 5k . All the inserts comes as 4hr ttl and we have table level ttl 1 day and gc grace seconds has 3 hours. We do 5k reads a second during peak load. During the peak load seeing Alerts for tomstone scanned histogram reaching million. Cassandra version 3.11.1. Pl

Re: Cassandra.log

2019-02-11 Thread Rahul Reddy
Thank you On Sun, Feb 10, 2019, 5:46 PM Sri Rathan Rangisetti < srirathan.rangise...@gmail.com> wrote: > It will be part of cassandra startup script, of you are using RHEL its > located at /etc/inti.d/cassandra > > > Regards > Sri Rathan > > On Sun, Feb 10, 2019

Cassandra.log

2019-02-10 Thread Rahul Reddy
Hello, I'm using Cassandra 3.11.1 and trying to change the name of cassandra.log(which is generate during startup of Cassandra) file. Can someone point me to configuration file where it is configured . System.log/debug.log located in logback.xml but not the Cassandra.log. Thanks

Re: Maximum memory usage

2019-02-10 Thread Rahul Reddy
Thanks Kenneth, 110mb is the biggest partition in our db On Sun, Feb 10, 2019, 9:55 AM Kenneth Brotman wrote: > Rahul, > > > > Those partitions are tiny. Could you give us the table histograms for the > biggest tables. > > > > Thanks, > > > > K

Re: Maximum memory usage

2019-02-10 Thread Rahul Reddy
> On Wednesday, February 6, 2019, 6:19:42 AM PST, Rahul Reddy < > rahulreddy1...@gmail.com> wrote: > > > Hello, > > I see maximum memory usage alerts in my system.log couple of times in a > day as INFO. So far I haven't seen any issue with db. Why those messag

Re: Maximum memory usage

2019-02-10 Thread Rahul Reddy
ning > very often or logging a OOM. > > Dinesh > > > On Wednesday, February 6, 2019, 6:19:42 AM PST, Rahul Reddy < > rahulreddy1...@gmail.com> wrote: > > > Hello, > > I see maximum memory usage alerts in my system.log couple of times in a > day as INFO. So

Re: Maximum memory usage

2019-02-10 Thread Rahul Reddy
the “nodetool tablehistograms” > > > > Kenneth Brotman > > > > *From:* Rahul Reddy [mailto:rahulreddy1...@gmail.com] > *Sent:* Wednesday, February 06, 2019 6:19 AM > *To:* user@cassandra.apache.org > *Subject:* Maximum memory usage > > > > Hello, > >

Maximum memory usage

2019-02-06 Thread Rahul Reddy
Hello, I see maximum memory usage alerts in my system.log couple of times in a day as INFO. So far I haven't seen any issue with db. Why those messages are logged in system.log do we have any impact for reads/writes with those warnings? And what nerd to be looked INFO [RMI TCP Connection(170917)

Sub range repair

2019-01-01 Thread Rahul Reddy
Hello, Is it possible to find subrange needed for repair in Apache Cassandra like dse which uses dsetool list_subranges like below doc https://docs.datastax.com/en/archived/datastax_enterprise/4.8/datastax_enterprise/srch/srchRepair.html?hl=repair

Re: C* as fluent data storage, 10MB/sec/node?

2018-12-20 Thread Rahul Singh
Agree with JEFF in twcs. Also look At https://github.com/paradoxical-io/cassieq for reference. Good ideas for a queue on Cassandra. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital business

Re: Optimizing for connections

2018-12-20 Thread Rahul Singh
See inline Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital business technology platforms. On Dec 9, 2018, 2:02 PM -0500, Devaki, Srinivas , wrote: > Hi Guys, > > Have a couple of

Re: Alter table

2018-12-20 Thread Rahul Singh
If you use collections such as a map you could get by with just upserts. A collection in a column gives you the ability to have “flexible” schema for your “documents” as in mongo while the regular fields can act as “records” as in a more Traditional table. Rahul Singh Chief Executive Officer m

Re: Cassandra repair in different version

2018-09-21 Thread Rahul Singh
Is there a reason why these versions are so different ? I would recommend bringing 3.0.6 to 3.0.13 before doing cluster wise commands. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital

Re: Cassandra system table diagram

2018-09-21 Thread Rahul Singh
I think his question was related specifically to the system tables. KDM is a good tool for designing the tables but not necessarily for viewing the system tables. Abdul, try out a tool called DB Schema Visualizer. It supports Cassandra Rahul Singh Chief Executive Officer m 202.905.2818 Anant

Re: Scrub a single SSTable only?

2018-09-11 Thread Rahul Singh
What’s the RF for that data ? If you can manage downtime one node I’d recommend just bringing it down, and then repairing after you delete the bad file and bring it back up. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C

Re: Using CDC Feature to Stream C* to Kafka (Design Proposal)

2018-09-11 Thread Rahul Singh
. Have used it several times. Cassandra is a great place to store data in transport. Rahul On Sep 10, 2018, 5:21 PM -0400, DuyHai Doan , wrote: > Also using Calvin means having to implement a distributed monotonic sequence > as a primitive, not trivial at all ... > > > On Mon, Se

Re: Regarding migrating data from Oracle to Cassandra.migrate data from Oracle to Cassandra.

2018-09-10 Thread Rahul Singh
Look into Kafka Connect. It does tracking internally in a topic. Works better going from relational to Cassandra. Still won’t fix your potential data model issue related to skew and wide partitions. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW

Re: Using CDC Feature to Stream C* to Kafka (Design Proposal)

2018-09-10 Thread Rahul Singh
on both clusters / DBS. All that means is that I need to sequence the change before it happens so I can predictably ensure it’s Scheduled for write / Mutation. So I’m Back to square one: having a definitive queue / ledger separate from the individual commit log of the cluster. Rahul Singh

Re: Using CDC Feature to Stream C* to Kafka (Design Proposal)

2018-09-10 Thread Rahul Singh
you’ll want to do what Jon suggested and source the event from Kafka for all subsequent processes rather than process in Cassandra and the create the event in Kafka. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We

Re: [EXTERNAL] Regarding migrating data from Oracle to Cassandra.migrate data from Oracle to Cassandra.

2018-09-05 Thread Rahul Singh
Look here for some “migration” or data modeling articles. https://anant.github.io/awesome-cassandra/ Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital business technology platforms. On Sep 5

Re: [EXTERNAL] Regarding migrating data from Oracle to Cassandra.migrate data from Oracle to Cassandra.

2018-09-05 Thread Rahul Singh
providing. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital business technology platforms. On Sep 5, 2018, 10:47 AM -0500, Jeff Jirsa , wrote: > All of  Sean's points are good, a

Re: Datastax encryption with kms

2018-09-04 Thread Rahul Singh
This is a Cassandra user group — consider joining the Datastax Academy Slack group and asking there. Rahul Singh Chief Executive Officer m 202.905.2818 Anant Corporation 1010 Wisconsin Ave NW, Suite 250 Washington, D.C. 20007 We build and manage digital business technology platforms. On Sep 4

Datastax encryption with kms

2018-09-04 Thread Rahul Reddy
Hello, Has anyone done the dse cassandra stable/ commitlog tde encryption saving the keys in kms or vault instead of kmip. If it's possible please do let me know

Re: A blog about Cassandra in the IoT arena

2018-08-29 Thread Rahul Singh
one level deeper. Maybe it’s another compaction strategy that evenly distributes data by either threshold of size or maintain a certain number of sstables. Don’t have any ideas yet on anything better than Merkle trees. Will get back to you with ideas or code. Good stuff. Rahul On Aug 24, 2018

RE: [EXTERNAL] Re: Re: bigger data density with Cassandra 4.0?

2018-08-29 Thread Rahul Singh
YugaByte is also another new dancer in the Cassandra dance. The data store is based on RocksDB — and it’s written in C++. Although they ar wire compliant with c* I’m pretty are everything under the hood is NOT a port like Scylla was initially. Rahul Singh Chief Executive Officer m 202.905.2818

Re: Tombstone experience

2018-08-24 Thread Rahul Singh
set a short TTL that you would have deleted and that will eventually clear our data depending on the value you set. My suggestion for those cases where you must do business rules deletions, use a continuous spark job / Spark streaming on another DC to maintain data hygiene. Rahul Singh Chief

  1   2   3   4   >