Hi,
This was a one time issue for which we are looking for the RCA. Generally
P99 latencies of all the tables are less than 12ms. There was a few ms jump
in P99 on one of the node at this time at coordinator level. The CL is
Local_Quorum.
Another error we noticed in system log at the same time on
How many sstables per read ? -- >> 1 to 4 sstables
Are your partitions unbounded ? >> No
What max size are the partitions ? >> P99 varies from few bytes to 70KB
while max partition of tables varies from few bytes to 900 KB
On Thu, Oct 24, 2024 at 11:00 AM Stéphane Alleaume
wrote:
> Hi,
>
> How
You can check in your lower environment.
On Fri, 11 Aug, 2023, 06:25 Surbhi Gupta, wrote:
> Thanks,
>
> I am looking to to upgrade to 4.1.x .
> Please advise.
>
> Thanks
> Surbhi
>
> On Thu, Aug 10, 2023 at 5:39 PM MyWorld wrote:
>
>> Though it's re
Though it's recommended to upgrade to latest version of 3.11.x and then to
ver 4 but even upgrading directly won't be a problem. Just check the
release notes.
However for production, I would recommend to go for 4.0.x latest stable
version.
Regards
Ashish
On Sat, 8 Jul, 2023, 05:44 Surbhi Gupta,
Hi surbhi ,
There are 2 drawbacks associated with MV.
1. Inconsistent view
2. The lock it takes on the base table. This gets worse when you have huge
number of clustering keys in a specific partition.
It's better you re-design a seperate table and let your API do a parallel
write on both.
Regards
Hi,
P95 should not be a problem if rightly designed. Levelled compaction
strategy further reduces this, however it consume some resources. For read,
caching is also helpful.
Can you check your cpu iowait as it could be the reason for delay
Regards,
Ashish
On Fri, 11 Aug, 2023, 04:58 Shaurya Gupta
ng wrote:
>
> Did anyone connecting to the servers' storage port via telnet, nc (netcat)
> or something similar? 218762506 is 0x0D0A0D0A, which is two newlines.
>
>
> On 29/06/2023 11:49, MyWorld wrote:
>
> When checked in the source nodes, we got similar errors.
>
> For
umber back to
> the originating host, and find out what is that program? or indeed it was
> one of the servers in the cluster, not something else, which could indicate
> a misconfiguration of the firewall rules.
>
>
> On 29/06/2023 01:26, MyWorld wrote:
>
> Hi all,
> We ar
Hi all,
We are currently using Apache cassandra 4.0.7 in our environment. While
adding a new node in the existing 3-node DC, we found below error.
This error is observed multiple times when the node was in the UJ (up and
joining) state.
Our current server-to-server internode encryption settings ar
Hi all,
We are facing one issue in installing cassandra-4.0.7.
### We started with* yum installation.* We setup repo "cassandra.repo" as
below:
[cassandra]
name=Apache Cassandra
baseurl=https://redhat.cassandra.apache.org/40x/noboolean/
gpgcheck=1
repo_gpgcheck=1
gpgkey=https://downloads.apache.or
, wrote:
> Consistently 200ms, during the back-and-forth negotiation rather than the
> handshake? That sounds suspiciously like Nagle interacting with Delayed
> ACK.
>
> On Wed, Jan 11, 2023 at 8:41 AM MyWorld wrote:
>
>> Hi all,
>> We are facing a connection latency o
Hi all,
We are facing a connection latency of 200ms between API server and db
server during connection.
We are working with Apache cassandra 4.0.7 and open jdk ver 11.0.17. We are
using php on API side and connecting using php Cassandra driver (CPP ver
2.7) with below string.
$cluster = Cassandra::
How many rows you are expecting within your partition?
On Mon, 3 Oct, 2022, 21:56 Karthik K, wrote:
> We have a table designed to retrieve products by name in ascending order.
> OrganisationID and ProductType will be the compound partition key, whereas
> the ProductName will be the clustering ke
>
> *From:* Bowen Song
> *Sent:* Friday, July 1, 2022 08:48
> *To:* user@cassandra.apache.org
> *Subject:* Re: Query around Data Modelling -2
>
>
>
> This message was sent from outside the company. Please do not click links
> or open attachments unless you recognise the
ng on weekly scheduled
> compactions? Or running weekly major compactions? Neither of these sounds
> right.
> On 30/06/2022 15:03, MyWorld wrote:
>
> Hi all,
>
> Another query around data Modelling.
>
> We have a existing table with below structure:
> Table(PK,CK, col1,col2,
:
> How are you running repair? -pr? Or -st/-et?
>
> 4.0 gives you real incremental repair which helps. Splitting the table
> won’t make reads faster. It will increase the potential parallelization of
> compaction.
>
> On Jun 30, 2022, at 7:04 AM, MyWorld wrote:
>
>
> Hi
Hi all,
Another query around data Modelling.
We have a existing table with below structure:
Table(PK,CK, col1,col2, col3, col4,col5)
Now each Pk here have 1k - 10k Clustering keys. Each PK has size from 10MB
to 80MB. We have overall 100+ millions partitions. Also we have set
levelled compactions
that data stays in page
> cache, so the extra read may not even go to disk anyway.
>
> So with your actual data shape, I imagine you won’t really notice the
> nominal inefficiency of the first model, and I’d be inclined to do that
> until you demonstrate it won’t work (I bet it works fine
ach model?
>
>
> > On Jun 22, 2022, at 6:38 PM, MyWorld wrote:
> >
> >
> > Hi all,
> >
> > Just a small query around data Modelling.
> > Suppose we have to design the data model for 2 different use cases which
> will query the data on same set
Hi all,
Just a small query around data Modelling.
Suppose we have to design the data model for 2 different use cases which
will query the data on same set of (partion+clustering key). So should we
maintain a seperate table for each or a single table.
Model1 - Combined table
Table(Pk,CK, col1,col2
Hi all,
I want to check all partitions greater than a certain threshold in my
existing apache cassandra column family.
Is there any alternative for datastax sstable tool 'sstablepartitions' in
open source apache cassandra?
Regards,
Ashish Gupta
Hi all,
I have a table (with default gc_grace_seconds) where we have some row
tombstones created. Currently there are 2 sstables for this.
When we check the sstablemetadata, we found Estimated droppable tombstones:
0.689(for sstable1) and 1.094(for sstable2)
After executing nodetool compact on thi
Anyone have any clue?
On Wed, Mar 9, 2022 at 7:01 PM MyWorld wrote:
> Hi all,
> Some problems with the display. Resending my query-
>
> I am modelling a table for a shopping site where we store products for
> customers and their data in json. Max prods for a customer is 10k.
&
uot; so that fetching in
limit(pagination) becomes easy.
Note : prod_order could change for a product frequently
Regards,
Ashish
On Wed, Mar 9, 2022 at 6:55 PM MyWorld wrote:
> Hi all,
>
> I am modelling a table for a shopping site where we store products for
> customers and their dat
Hi all,
I am modelling a table for a shopping site where we store products for
customers and their data in json. Max prods for a customer is 10k.
>>We initially designed this table with the architecture below:
cust_prods(cust_id bigint PK, prod_id bigint CK, prod_data text).
cust_id is partition
you will it pull files from all nodes --- that is 5 in your
> case. so it will be 3 GB/s , on-premise side may not handle it due to
> firewall setting.
>
> Regards,
> Jim
>
> On Tue, Oct 5, 2021 at 8:43 AM MyWorld wrote:
>
>> Logged "nodetool failuredetector"
to AWS, this was one of the factor to
> consider.
>
> Thanks
>
>
> On Tue, Oct 5, 2021 at 4:00 AM MyWorld wrote:
>
>> Hi all,
>>
>> Need urgent help.
>> We have one Physical Data Center of 5 nodes with 1 TB data on each
>> (Location: Dallas). Current
Hi all,
Need urgent help.
We have one Physical Data Center of 5 nodes with 1 TB data on each
(Location: Dallas). Currently we are using Cassandra ver 3.0.9. Now we are
Adding one more Data Center of 5 nodes(Location GCP-US) and have joined it
to the existing one.
While running nodetool rebuild co
Hi all,
We are using Prometheus + grafana for monitoring apache cassandra with
scrape interval of 15s. We have a table 'x' with partition size varying
from 2mb to 80mb.
We know there are few big partition entries present in this table and my
objective is to monitor when this big partition entry is
not recommended. I'd highly recommend you
>> upgrade the existing DC before decommissioning it. Of course, you can skip
>> the upgrade sstables on it which is often the most time consuming part.
>>
>>
>> Cheers,
>>
>> Bowen
>>
>> On 06/0
re so instead of upgrading it I
will simply discard that DC
Regards,
Ashish
On Mon, Sep 6, 2021, 7:31 AM Jeff Jirsa wrote:
> In-line
>
> On Sep 3, 2021, at 11:12 AM, MyWorld wrote:
>
>
> Hi Jeff,
> Thanks for your response.
> To answer your question, Yes, we have created
migrate to GCP first and then think of upgrade 4.0 later
4. OR Is there any reason I should upgrade to 3.11.x first
Regards,
Ashish
On Fri, Sep 3, 2021, 11:11 PM Jeff Jirsa wrote:
>
>
> On Fri, Sep 3, 2021 at 10:33 AM MyWorld wrote:
>
>> Hi all,
>> We are doing a POC on de
Hi all,
We are doing a POC on dev environment to upgrade apache cassandra 3.0.9 to
4.0.0. We have the below setup currently on cassandra 3.0.9
DC1 - GCP(india) - 1 node
DC2 - GCP(US) - 1 node
For upgradation, we carried out below steps on DC2 - GCP(US) node:
Step1. Install apache cassandra 4.0.0
S
Kindly help in this regard. What could be the possible reason for load and
mutation spike in india data center
On 2021/07/20 00:14:56 MyWorld wrote:
> Hi Arvinder,
> It's a separate cluster. Here max partition size is 32mb.
>
> On 2021/07/19 23:57:27 Arvinder Dhillon wrote:
>
tern, you could potentially have a
compound key of userid+datetime, or some other time-based split. You could
also just split each user's rows into subsets with some sort of indirect
mapping, though that can get messy pretty fast.
>
> On Mon, Jul 19, 2021 at 9:01 AM MyWorld > wrote
Hi Arvinder,
It's a separate cluster. Here max partition size is 32mb.
On 2021/07/19 23:57:27 Arvinder Dhillon wrote:
> Is this the same cluster with 1G partition size?
>
> -Arvinder
>
> On Mon, Jul 19, 2021, 4:51 PM MyWorld wrote:
>
> > Hi daemeon,
> > We hav
potentially have
a
> compound key of userid+datetime, or some other time-based split. You
could
> also just split each user's rows into subsets with some sort of indirect
> mapping, though that can get messy pretty fast.
>
> On Mon, Jul 19, 2021 at 9:01 AM MyWorld wrote:
>
> &
working and latency.
>
>
>
>
>
> On Mon, Jul 19, 2021 at 10:38 AM MyWorld wrote:
>
> > Hi all,
> >
> > Currently we have a cluster with 2 DC of 3 nodes each. One DC is in
GCP-US
> > while other is in GCP-India. Just to add here, configuration of every
node
>
evels
> used, and how you are bulk loading. Is this a batch by any chance?
>
> Patrick
>
> On Mon, Jul 19, 2021 at 10:38 AM MyWorld wrote:
>
> > Hi all,
> >
> > Currently we have a cluster with 2 DC of 3 nodes each. One DC is in
GCP-US
> > while other is
Yes it seems like a GC issue. And since the default timeout for write/read
is 2000ms and 5000ms, you might be experiencing timeout issues.
But you need to check reason behind this GC pause. Heavy partition or high
tombstones could be one reason. Check your table stats for the same.
As suggested you
Hi all,
Currently we have a cluster with 2 DC of 3 nodes each. One DC is in GCP-US
while other is in GCP-India. Just to add here, configuration of every node
accross both DC is same. Cpu-6, Ram-32gb, Heap-8gb
We do all our write on US data center. While performing a bulk write on GCP
US, we obser
Hi all,
We are currently storing our user activity log in Cassandra with below
architecture.
Create table user_act_log(
Userid bigint,
Datetime bigint,
Sno UUID,
some more columns)
With partition key - userid
Clustering key - datetime, sno
And TTL of 6 months
With time our table data have gr
High latency at table level could be a result of no of factors.
High tombstones
GC
Bloom filter fp
I/O bottleneck
Insufficient cache or threads
Since your partion size is not a problem here, try running major
compaction on this table.
Also you can turn on caching for this table.
As mentioned abov
t; raft.so - Cassandra consulting, support, and managed services
>
>
> On Thu, May 6, 2021 at 11:35 PM MyWorld wrote:
>
>> Hi All,
>>
>> We had a set up of 3 node single DC cluster on Google cloud with RF=3 for
>> development purposes. Service Team hosted in Dallas
Hi All,
We had a set up of 3 node single DC cluster on Google cloud with RF=3 for
development purposes. Service Team hosted in Dallas servers was able to
connect from php as well as golang code properly. Initially we have set up
the following settings in cassandra.yaml:
Listen address:
Broadcast
Hi,
We have a cluster with one Data Center of 3 nodes in GCP-US(RF=3).Current
apache cassandra version 3.11.6. We are planning to add one new Data Center
of 3 nodes in GCP-India.
At peak hours, files generation in commit logs at GCP-US side on one node
is around 1 GB per minute (i.e 17+ mbps).
Cu
hose same kind of bad queries.
>
>
>
> Sean Durity
>
>
>
> *From:* MyWorld
> *Sent:* Tuesday, January 26, 2021 8:50 AM
> *To:* user@cassandra.apache.org
> *Subject:* [EXTERNAL] Cassandra timeouts 3.11.6
>
>
>
> Hi,
>
> We have a cluster of 4 nodes al
Hi,
We have a cluster of 4 nodes all in one DC (apache cass version : 3.11.6).
Things were working fine till last month when all of a sudden we started
facing Operation time outs at client end intermittently.
We have prometheus+grafana configured for monitoring.
On checking we found the following
Hi,
We are currently using apache cassandra 3.11.6 in our production
environment with single DC of 4 nodes.
2 nodes have configuration : Ssd 24 cores, 64gb ram, 20gb heap size
Other 2 nodes have: Ssd 32cores, 64gb ram, 20gb heap size
I have several questions around this.
1. Does different conf
Hi,
We are currently using apache cassandra 3.11.6. We have a cluster of 4
nodes all in single DC.
All of a sudden we started experiencing high connection timeout on the
cluster. This timeout spikes are coming intermittently.
As checked from grafana, read/write time, jvm threads count, client coun
50 matches
Mail list logo
