Re: [RELEASE] Apache Cassandra 5.0.0 GA released

2024-09-05 Thread Slater, Ben via user
Huge milestone! Congratulations to everyone involved! Cheers Ben From: Mick Semb Wever Sent: 06 September 2024 07:28 To: user@cassandra.apache.org ; dev Subject: [RELEASE] Apache Cassandra 5.0.0 GA released EXTERNAL EMAIL - USE CAUTION when clicking links

Re: Requesting Feedback for Cassandra as a backup solution.

2024-02-17 Thread Slater, Ben via user
certainly seen that be succesful. However, a really good recommendation probably requires a bit more understand of just what kind of issues you’re worried about with Kafka. Cheers Ben From: Bowen Song via user Date: Saturday, 17 February 2024 at 23:40 To: user@cassandra.apache.org Cc: Bowen Song

RE: Re: Unable to gossip with peers when starting cluster

2022-11-11 Thread Ben Klein
0.9 was never a seed before. Based on your comment, I also tried, from having all three nodes up (following the initial bootstrap), restarting 0.7. This failed with the same error. On 2022/11/09 15:37:24 Jeff Jirsa wrote: > When you say you configured them to talk to .0.31 as a seed, did you

Re: Ldap/AD Authentication

2022-09-15 Thread Slater, Ben
Hi Our LDAP Authenticator for Cassandra is open source, Apache 2.0 licenced and free to use: https://github.com/instaclustr/cassandra-ldap We do offer support for it as part of our Cassandra support contracts but you don’t need to buy support to use it. Cheers Ben -- Ben Slater Chief

Re: Cassandra node JVM hang during node repair a table with materialized view

2020-04-16 Thread Ben G
Thanks a lot. We are working on removing views and control the partition size. I hope the improvements help us Best regards Gb Erick Ramirez 于2020年4月16日周四 下午2:08写道: > GC collector is G1. I ever repair the node after scale up. The JVM issue >> reproduced. Can I increase the heap to 40 GB on

Re: Cassandra node JVM hang during node repair a table with materialized view

2020-04-15 Thread Ben G
Thanks a lot for your sharing. The node is added recently. The bootstrap failed since too many tombstone. So we enabled the node without bootstrap enabled. Some sstables are not created in bootstrap. So the missing files might be numerous. I have set the repair thread number is 1. should I als

Cassandra node JVM hang during node repair a table with materialized view

2020-04-15 Thread Ben G
Hello experts I have a 9 nodes cluster on AWS. Recently, some nodes were down and I want to repair the cluster after I restarted them. But I found the repair operation causes lots of memtable flush and then the JVM GC failed. Consequently, the node hang. I am using the cassandra 3.1.0. java vers

Re: cassandra_migration_wait

2020-01-13 Thread Ben Mills
Hi Reid, Many thanks! Very helpful. Will have a look at that source. Ben On Mon, Jan 13, 2020 at 2:08 PM Reid Pinchback wrote: > I can’t find it anywhere either, but I’m looking at a 3.11.4 source > image. From the naming I’d bet that this is being used to fe

cassandra_migration_wait

2020-01-13 Thread Ben Mills
entation on this but cannot seem to find it anywhere. Anyone know what this is configuring and what the value implies? Thanks in advance for your help. Ben

Re: repair failed

2020-01-02 Thread Ben Mills
h cluster or DC? Thanks, Ben On Sun, Dec 29, 2019 at 3:54 AM gloCalHelp.com wrote: > TO Oliver : >Maybe repair should be executed after all data in MEMTBL are all > flushed into harddisk? > > > Sincerely yours, > Georgelin > www_8ems_...@sina.com > mobile:0086 180 598

Re: AWS ephemeral instances + backup

2019-12-05 Thread Ben Slater
We have some tooling that does that kind of thing using S3 rather than attached EBS but a similar principle. There is a bit of an overview here: https://www.instaclustr.com/advanced-node-replace/ It's become a pretty core part of our ops toolbox since we introduced it. Cheers Ben ---

Re: Aws instance stop and star with ebs

2019-11-05 Thread Ben Slater
The logs between first start and handshaking should give you a clue but my first guess would be replaying commit logs. Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/inst

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
ive stalls happening on either reading > from disk or flushing dirty pages to disk. > > > > > > *From: *Ben Mills > *Reply-To: *"user@cassandra.apache.org" > *Date: *Monday, November 4, 2019 at 12:14 PM > *To: *"user@cassandra.apache.org" > *Subject: *Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC > > > > CGroup >

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
(as I haven't shared our tuning goals), but any feedback is, again, appreciated. On Mon, Nov 4, 2019 at 10:28 AM Reid Pinchback wrote: > Hi Ben, just catching up over the weekend. > > > > The typical advice, per Sergio’s link reference, is an obvious starting > point.

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
Hi (yet again) Sergio, Finally, note that we use this sidecar <https://github.com/Stackdriver/stackdriver-prometheus-sidecar> for shipping metrics to Stackdriver. It runs as a second container within our Prometheus stateful set. On Mon, Nov 4, 2019 at 8:46 AM Ben Mills wrote: >

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
inside the JVM (heap space). Hope this helps. On Mon, Nov 4, 2019 at 8:26 AM Ben Mills wrote: > Hi Sergio, > > Thanks for this and sorry for the slow reply. > > We are indeed still running Java 8 and so it's very helpful. > > This Cassandra cluster has been running reliably

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
e-tanzu/velero> for DR. Hope this helps. On Fri, Nov 1, 2019 at 5:34 PM Sergio wrote: > Hi Ben, > > Well, I had a similar question and Jon Haddad was preferring ParNew + CMS > over G1GC for java 8. > https://lists.apache.org/thread.html/283547619b1dcdcddb80947a45e2178158394e317

Re: Memory Recommendations for G1GC

2019-11-01 Thread Ben Mills
a stress tool any > configuration > > Sergio > > On Fri, Nov 1, 2019, 12:31 PM Ben Mills wrote: > >> Greetings, >> >> We are planning a Cassandra upgrade from 3.7 to 3.11.5 and considering a >> change to the GC config. >> >> What is the minimum amo

Re: Memory Recommendations for G1GC

2019-11-01 Thread Ben Mills
ke you’ll end up with your entire database in memory. > > > > *From: *Ben Mills > *Reply-To: *"user@cassandra.apache.org" > *Date: *Friday, November 1, 2019 at 3:31 PM > *To: *"user@cassandra.apache.org" > *Subject: *Memory Recommendations for G1GC

Memory Recommendations for G1GC

2019-11-01 Thread Ben Mills
Greetings, We are planning a Cassandra upgrade from 3.7 to 3.11.5 and considering a change to the GC config. What is the minimum amount of memory that needs to be allocated to heap space when using G1GC? For GC, we currently use CMS. Along with the version upgrade, we'll be running the stateful

Re: Repair Issues

2019-10-26 Thread Ben Mills
Thanks Ghiyasi. On Sat, Oct 26, 2019 at 9:17 AM Hossein Ghiyasi Mehr wrote: > If the problem exist still, and all nodes are up, reboot them one by one. > Then try to repair one node. After that repair other nodes one by one. > > On Fri, Oct 25, 2019 at 12:56 AM Ben Mills wrote: &g

Re: Repair Issues

2019-10-24 Thread Ben Mills
> cause of a problem, but in your case there's so many potential problems I > don't think it's worth digging into, especially since the problem might be > one of the 500 or so bugs that were fixed since this release. > > Once you've done those things it'll

Re: Repair Issues

2019-10-24 Thread Ben Mills
d when the pods are down. This is a subtlety of running Cassandra in Kubernetes. On Thu, Oct 24, 2019 at 4:24 PM Reid Pinchback wrote: > Ben, you may find this helpful: > > > > https://blog.pythian.com/so-you-have-a-broken-cassandra-sstable-file/ > > > > >

Re: Repair Issues

2019-10-24 Thread Ben Mills
ou using Cassandra reaper? > > On Thu, Oct 24, 2019, 12:31 PM Ben Mills wrote: > >> Greetings, >> >> Inherited a small Cassandra cluster with some repair issues and need some >> advice on recommended next steps. Apologies in advance for a long email. >> >>

Repair Issues

2019-10-24 Thread Ben Mills
Greetings, Inherited a small Cassandra cluster with some repair issues and need some advice on recommended next steps. Apologies in advance for a long email. Issue: Intermittent repair failures on two non-system keyspaces. - platform_users - platform_management Repair Type: Full, parallel rep

Re: Cassandra-stress testing

2019-08-21 Thread Ben Slater
any useful response from the community. Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our latest t

Re: Cassandra-stress testing

2019-08-20 Thread Ben Slater
://www.instaclustr.com/certified-apache-cassandra/ Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our latest technica

Re: high write latency on a single table

2019-07-22 Thread Ben Slater
Is the size of the data in your “state” column variable? The higher write latencies at the 95%+ could line up with large volumes of data for particular rows in that column (the one column not in both tables)? Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.

Re: CassKop : a Cassandra operator for Kubernetes developped by Orange

2019-05-25 Thread Ben Bromhead
This all looks really awesome, while i wish there wasn't as much duplicated effort across the different projects it's great to see how different teams are solving this very real problem! Also Attila we do have our cloud offering as you mentioned, but we also have our own k8s operator which is Apac

Re: CL=LQ, RF=3: Can a Write be Lost If Two Nodes ACK'ing it Die

2019-05-03 Thread Ben Slater
the two nodes dieing (although it’s very likely there will be three replicas from the start if the cluster is in a healthy state at the time of the write). Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr&

Re: CL=LQ, RF=3: Can a Write be Lost If Two Nodes ACK'ing it Die

2019-05-02 Thread Ben Slater
many not have made its way to the third node by the time the first two replicas are lost. If there is a replica on the third node it can be recovered to the other two nodes by either rebuild (actually replace) or repair. Cheers Ben --- *Ben Slater**Chief Product Officer* <ht

Re: CL=LQ, RF=3: Can a Write be Lost If Two Nodes ACK'ing it Die

2019-05-02 Thread Ben Slater
In scenario 2, if the row has been written to node 3 it will be replaced on the other nodes via rebuild or repair. --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/inst

Re: different query result after a rerun of the same query

2019-04-30 Thread Ben Slater
monitor the dropped mutations metrics. Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our latest t

Re: different query result after a rerun of the same query

2019-04-29 Thread Ben Slater
, changes in topology without following proper procedure, etc. Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclu

Re: different query result after a rerun of the same query

2019-04-29 Thread Ben Slater
inserted (relative to your attempt to query it)? Cheers Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our lat

Re: A cluster (RF=3) not recovering after two nodes are stopped

2019-04-25 Thread Ben Slater
Ben --- *Ben Slater**Chief Product Officer* <https://www.instaclustr.com/platform/> <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our latest technical blog posts here <https://www.in

Re: A cluster (RF=3) not recovering after two nodes are stopped

2019-04-23 Thread Ben Slater
Is it possible that stress is overloading node 1 so it’s not recovering state properly when node 2 comes up? Have you tried running with a lower load (say 2 or 3 threads)? Cheers Ben --- *Ben Slater* *Chief Product Officer* <https://www.facebook.com/instaclustr> <https://tw

Re: ***UNCHECKED*** Query regarding cassandra column write time set by client Timestamp Generator

2019-04-09 Thread Ben Slater
Maybe stabledump can help you? https://cassandra.apache.org/doc/4.0/tools/sstable/sstabledump.html --- *Ben Slater* *Chief Product Officer* <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our lat

Re: ***UNCHECKED*** Query regarding cassandra column write time set by client Timestamp Generator

2019-04-09 Thread Ben Slater
Not in the logs but I think you should be able to use the WRITETIME function to view via CQL (see https://cassandra.apache.org/doc/latest/cql/dml.html#select) Cheers Ben --- *Ben Slater* *Chief Product Officer* <https://www.facebook.com/instaclustr> <https://twitter.com/instaclust

unsubscribe

2019-02-11 Thread Ben Standefer
unsubscribe –Ben Standefer Sent via Superhuman ( https://sprh.mn/?vip=benstande...@gmail.com )

Re: How to read the Index.db file

2019-02-07 Thread Ben Slater
They don’t do exactly what you want but depending on why you are trying to get this info you might find our sstable-tools useful: https://github.com/instaclustr/cassandra-sstable-tools --- *Ben Slater* *Chief Product Officer* <https://www.facebook.com/instaclustr> <https://tw

Re: Authenticate cassandra-stress with cqlshrc

2019-01-08 Thread Ben Slater
Yep, cassandra-stress doesn’t attempt to use the cqlshrc file. Seems to me it could be convenient so might make a nice contribution to the project. Cheers Ben --- *Ben Slater* *Chief Product Officer* <https://www.facebook.com/instaclustr> <https://twitter.com/instaclust

Re: Authenticate cassandra-stress with cqlshrc

2019-01-08 Thread Ben Slater
(in which case I don’t think there is one but stress has a hell of a lot of options so I could be wrong). Cheers Ben --- *Ben Slater* *Chief Product Officer* <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr>

Re: Cassandra single unreachable node causing total cluster outage

2018-11-27 Thread Ben Slater
In what way does the cluster become unstable (ie more specifically what are the symptoms)? My first thought would be the loss of the node causing the other nodes to become overloaded but that doesn’t seem to fit with your point 2. Cheers Ben --- *Ben Slater* *Chief Product Officer* <ht

Re: [EXTERNAL] Is Apache Cassandra supports Data at rest

2018-11-14 Thread Ben Slater
I wrote a blog post a while ago on the pros and cons of encrypting in your application for use with Cassandra that you might find useful background on this subject: https://www.instaclustr.com/securing-apache-cassandra-with-application-level-encryption/ Cheers Ben On Wed, 14 Nov 2018 at 13:47

Re: Multiple cluster for a single application

2018-11-07 Thread Ben Slater
management environment but if you app functionality allows your to split into multiple clusters (ie all your data is not all in one giant table) then I would generally look to split. Splitting also gives you the advantage of making it harder to have an outage that brings everything down. Cheers Ben On

Re: Cassandra DCOS | monitoring connection and user activity

2018-11-01 Thread Ben Bromhead
rn e-mail. Regardless of >> content, this e-mail shall not operate to bind DXC Technology Company or >> any of its affiliates to any order or other contract unless pursuant to >> explicit written agreement or government initiative expressly permitting >> the use of e-mail for such purpose. --. >> > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Reliability at Scale Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer

Re: [ANNOUNCE] StratIO's Lucene plugin fork

2018-10-30 Thread Ben Slater
For anyone who is interested, we’ve published a blog with some more background on this and some more detail of our ongoing plans: https://www.instaclustr.com/instaclustr-support-cassandra-lucene-index/ Cheers Ben On Fri, 19 Oct 2018 at 09:42 kurt greaves wrote: > Hi all, > >

Re: Advantage over Cassandra in Kubernetes

2018-10-11 Thread Ben Bromhead
een solved before. - The Cassandra examples in the official Kubernetes documentation is not something you want to take into production. Cheers Ben On Thu, Oct 11, 2018 at 6:50 PM Goutham reddy wrote: > Hi, > We are in the process of setting up Cassandra cluster with high > availabilit

Re: cold vs hot data

2018-09-13 Thread Ben Slater
o PDF e-mail accounts will be archived and may > be scanned by us and/or by external service providers to detect and prevent > threats to our systems, investigate illegal or inappropriate behavior, > and/or eliminate unsolicited promotional e-mails (“spam”). If you have any > concerns

Re: Secure data

2018-08-01 Thread Ben Slater
-application-level-encryption/ We also use encrypted GP2 EBS pretty widely without issue. Cheers Ben On Thu, 2 Aug 2018 at 05:38 Jonathan Haddad wrote: > You can also get full disk encryption with LUKS, which I've used before. > > On Wed, Aug 1, 2018 at 12:36 PM Jeff Jirsa w

Re: Re: [EXTERNAL] full text search on some text columns

2018-07-31 Thread Ben Slater
We (Instaclustr) will be submitting a PR for 3.11.3 support for cassandra-lucene-index once 3.11.3 is officially released as we offer it as part of our service and have customers using it. Cheers Ben On Wed, 1 Aug 2018 at 14:06 onmstester onmstester wrote: > It seems to be an interest

Re: Timeout for only one keyspace in cluster

2018-07-21 Thread Ben Slater
Note that that writetimeout exception can be C*s way of telling you when there is contention on a LWT (rather than actually timing out). See https://issues.apache.org/jira/browse/CASSANDRA-9328 Cheers Ben On Sun, 22 Jul 2018 at 11:20 Goutham reddy wrote: > Hi, > As it is a single partiti

Re: Jmx_exporter CPU spike

2018-07-09 Thread Ben Bromhead
like GC etc, but feel free to submit a PR! Ben On Mon, Jul 9, 2018 at 12:03 AM Rahul Singh wrote: > How often are you polling the JMX? How much of a spike are you seeing in > CPU? > > -- > Rahul Singh > rahul.si...@anant.us > > Anant Corporation > On Jul 5, 2

Re: Certified Cassandra for Enterprise use

2018-05-29 Thread Ben Slater
Hi Pranay We (Instaclustr) provide enterprise support for Cassandra ( https://www.instaclustr.com/services/cassandra-support/) which may cover what you are looking for. Please get in touch direct if you would like to discuss. Cheers Ben On Tue, 29 May 2018 at 10:11 Pranay akula wrote: >

Re: Using K8s to Manage Cassandra in Production

2018-05-23 Thread Ben Bromhead
r... > > 2018-05-23 17:17 GMT+02:00 Ben Bromhead : > >> The official Kubernetes Java driver is actually pretty feature complete, >> if not exactly idiomatic Java... it's only missing full examples to get it >> to GOLD compatibility levels iirc. >> >> A f

Re: Using K8s to Manage Cassandra in Production

2018-05-23 Thread Ben Bromhead
ent gromakowski < vincent.gromakow...@gmail.com> wrote: > Why did you choose java for the operator implementation when everybody > seems to use the go client (probably for greater functionalities) ? > > 2018-05-23 15:39 GMT+02:00 Ben Bromhead : > >> You can get a good way wit

Re: Using K8s to Manage Cassandra in Production

2018-05-23 Thread Ben Bromhead
know use cases where people are > using Mesos or a custom tool built with terraform/chef etc to run their > production clusters but have yet to find a real K8s use case. > > > > *Questions?* > > Is K8s a reasonable choice for managing a production C* cluster? > > Are there documented use cases for this? > > > > Any help would be greatly appreciated. > > > > -- > > Regards, > > > > *Hassaan Pasha* > > -- > > Regrads, > > Pavel Sapezhko > > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Reliability at Scale Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer

Re: Interesting Results - Cassandra Benchmarks over Time Series Data for IoT Use Case I

2018-05-17 Thread Ben Slater
but you might also find relevant: https://www.instaclustr.com/cassandra-connector-for-spark-5-tips-for-success/ Cheers Ben On Thu, 17 May 2018 at 18:06 Arbab Khalil wrote: > We have been exploring IoT specific C* schema design over the past few > months. We wanted to share the benchmarkin

Re: Basic Copy vs Snapshot for backup

2018-05-10 Thread Ben Slater
The snapshot gives you a complete set of your sstables at a point in time. If you were copying sstables directly from a live node you would have to deal with files coming and going due to compactions. Cheers Ben On Thu, 10 May 2018 at 16:45 wrote: > Dear Community, > > > > Is th

Re: Cassandra Summit 2019 / Cassandra Summit 2018

2018-05-03 Thread Ben Bromhead
8 (probably too late)? > > > > Is there a planning committee? > > > > Who wants there to be a Cassandra Summit 2019 and who thinks there is a > better way? > > > > We could try a Cassandra Distributed Summit 2019 where we meet virtually > and perhaps asynchronously, but there would be a lot more energy and > bonding if it’s not virtual. I’m up for any of these. > > > > Kenneth Brotman > > > > > > > > > > -- > > > > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Reliability at Scale Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer

Re: Does Cassandra supports ACID txn

2018-04-25 Thread Ben Slater
then a single write to hotel_enabled. hotel_enabled could also be something like hotel_details so the other tables really are just indexes. You need to do more reads but whatever you do consistency doesn’t come for free. Cheers Ben On Thu, 26 Apr 2018 at 12:44 Rajesh Kishore wrote: > Correct

Re: read repair with consistency one

2018-04-21 Thread Ben Slater
find inconsistencies. - If read_repair_chance or dc_local_read_repair_chance are >0 then extra replicas are checked as part of the query for the % of queries specified by the chance setting. Again, if inconsistencies are found, they are repaired. I expect this mechanism would still apply for CL=ONE. Ch

Re: Does Cassandra supports ACID txn

2018-04-19 Thread Ben Slater
level (eg in the catch block delete the records that were inserted). That, however, does not provide you the isolation part of ACID. You also tend to find that if you have properly denormalised your data model for Cassandra there is less requirement for these type of batched updates. Cheers Ben O

Re: Cassandra datastax cerrification

2018-04-14 Thread Ben Bromhead
220 should be enough for cerrification and also i am > reading definitive guide on cassandra ..any other material required ? Any > practise test websites? As certification is costly and wanna clear in one > go ... > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1

Re: Sorl/DSE Spark

2018-04-13 Thread Ben Bromhead
Thanks Jeff. On Thu, Apr 12, 2018, 21:37 Jeff Jirsa wrote: > Pretty sure Ben meant that datastax produces DSE, not Cassandra, and since > the questions specifically mentions DSE in the subject (implying that the > user is going to be running either solr or spark within DSE t

Re: Sorl/DSE Spark

2018-04-13 Thread Ben Bromhead
On Thu, Apr 12, 2018, 21:23 Niclas Hedhman wrote: > Ben, > > 1. I don't see anything in this thread that is DSE specific, so I think it > belongs here. > DSE is literally in the title. > 2. Careful when you say that Datastax produces Cassandra. Cassandra is a >

Re: Sorl/DSE Spark

2018-04-12 Thread Ben Bromhead
. Spark is notorious for causing >>>> latency spikes in Cassandra which is not great if you are are sensitive to >>>> that. >>>> >>>> Regards, >>>> Evelyn. >>>> >>>> On 12 Apr 2018, at 6:55 am, kooljava2 >>>> wrote: >>>> >>>> Hello, >>>> >>>> We are exploring on configuring Sorl/Spark. Wanted to get input on >>>> this. >>>> 1) How do we decide which one to use? >>>> 2) Do we run this on a DC where there is less workload? >>>> >>>> Any other suggestion or comments are appreciated. >>>> >>>> Thank you. >>>> >>>> >>>> >>> -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Reliability at Scale Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer

Re: datastax cassandra minimum hardware recommendation

2018-04-04 Thread Ben Bromhead
> http://www.thelastpickle.com >> >> 2018-04-04 9:44 GMT+01:00 sujeet jog : >> >>> the datastax site has a hardware recommendation of 16CPU / 32G RAM for >>> DSE Enterprise, Any idea what is the minimum hardware recommendation >>> supported, can each node be 8CPU and the support covering it ?.. >>> >> >> > -- Ben Bromhead CTO | Instaclustr <https://www.instaclustr.com/> +1 650 284 9692 Reliability at Scale Cassandra, Spark, Elasticsearch on AWS, Azure, GCP and Softlayer

Re: Roadmap for 4.0

2018-03-30 Thread Ben Bromhead
erson working on it (or are offering to work on it instead) and can get it ready for review in a timely fashion. That way we can build a more realistic working target. For major breaking changes, there is always 5.0 or 4.1 or whatever we end up doing :) Cheers Ben On Thu, Feb 15, 2018 at 9:39 PM

Re: Cassandra client tuning

2018-03-18 Thread Ben Slater
Sent using Zoho Mail <https://www.zoho.com/mail/> > > > ---- On Sun, 18 Mar 2018 13:14:54 +0330 *Ben Slater > >* wrote > > When you say batch was worth than async in terms of throughput are you > comparing throughput with the same number of threads or something? I w

Re: Cassandra client tuning

2018-03-18 Thread Ben Slater
oughput but much less > CPU usage at client side. > > Sent using Zoho Mail <https://www.zoho.com/mail/> > > > On Sun, 18 Mar 2018 12:46:02 +0330 *Ben Slater > >* wrote > > You will probably find grouping writes into small batches improves overall >

Re: Cassandra client tuning

2018-03-18 Thread Ben Slater
You will probably find grouping writes into small batches improves overall performance (if you are not doing it already). See the following presentation for some more info: https://www.slideshare.net/Instaclustr/microbatching-highperformance-writes Cheers Ben On Sun, 18 Mar 2018 at 19:23

Re: cassandra spark-connector-sqlcontext too many tasks

2018-03-17 Thread Ben Slater
I think that is probably a question for the Spark Connector forum: https://groups.google.com/a/lists.datastax.com/forum/#!forum/spark-connector-user as it’s much more related to the function of the connector than functionality of Cassandra itself. Cheers Ben On Sat, 17 Mar 2018 at 21:18

Re: Amazon Time Sync Service + ntpd vs chrony

2018-03-08 Thread Ben Bromhead
server. Since the last write wins, the data generator should be the > one setting its timestamp. > > On Thu, Mar 8, 2018 at 2:12 PM, Ben Slater > wrote: > >> It is important to make sure you are using the same NTP servers across >> your cluster - we used to see relatively fr

Re: Amazon Time Sync Service + ntpd vs chrony

2018-03-08 Thread Ben Slater
-synchronization/ which references some really good and detailed posts from logentries.com on the potential issues). Cheers Ben On Fri, 9 Mar 2018 at 02:07 Michael Shuler wrote: > As long as your nodes are syncing time using the same method, that > should be good. Don't mix daemons, however, sin

Re: backup/restore cassandra data

2018-03-07 Thread Ben Slater
You should be able to follow the same approach(s) as restoring from a backup as outlined here: https://docs.datastax.com/en/cassandra/2.1/cassandra/operations/ops_backup_snapshot_restore_t.html#ops_backup_snapshot_restore_t Cheers Ben On Thu, 8 Mar 2018 at 17:07 onmstester onmstester wrote

Re: One time major deletion/purge vs periodic deletion

2018-03-07 Thread Ben Slater
want to check out deleting compaction strategy to see if it works for your use case: https://github.com/protectwise/cassandra-util/tree/master/deleting-compaction-strategy Cheers Ben On Wed, 7 Mar 2018 at 17:19 Charulata Sharma (charshar) wrote: > Well it’s not like that. We don’t just pu

Re: Cassandra/Spark failing to process large table

2018-03-06 Thread Ben Slater
issues. Cheers Ben On Tue, 6 Mar 2018 at 22:18 Faraz Mateen wrote: > Thanks a lot for the response. > > Setting consistency to ALL/TWO started giving me consistent count results > on both cqlsh and spark. As expected, my query time has increased by 1.5x ( > Before, it was taking ~1.6

Re: Cassandra/Spark failing to process large table

2018-03-03 Thread Ben Slater
but requires all replicas to be available for the query to succeed. If you are using QUORUM for your writes then querying at QUORUM or LOCAL_QUORUM as appropriate should give you consistent results. Cheers Ben On Sun, 4 Mar 2018 at 00:59 Kant Kodali wrote: > The fact that cqlsh itself gi

Re: Cassandra Needs to Grow Up by Version Five!

2018-02-21 Thread Ben Slater
of this issues you have raised is just the same way that Microsoft does with CosmosDB (ie hiding them behind our managed service tooling). Cheers Ben On Wed, 21 Feb 2018 at 19:22 DuyHai Doan wrote: > For UI and interactive data exploration there is already the Cassandra > interpreter for

Re: if the heap size exceeds 32GB..

2018-02-12 Thread Ben Wood
ess object pointer. > (Of course talking about ES) > > But if this is a general theory about the JVM, does that apply to > Cassandra as well? > > I am using a 64 GB physical memory server and I am concerned about heap > size allocation. > > Thank you. > -- Ben Wood Software Engineer - Data Agility Mesosphere

Re: LWT broken?

2018-02-12 Thread Mahdi Ben Hamida
rce-applied it before actually reading the new value On Sun, Feb 11, 2018 at 5:36 PM, Mahdi Ben Hamida <mailto:ma...@signalfx.com>> wrote: Totally understood that it's not worth (or it's rather incorrect) to mix serial and non serial operations for LWT tables. It woul

Re: LWT broken?

2018-02-11 Thread Mahdi Ben Hamida
Haddad wrote: If you want consistent reads you have to use the CL that enforces it. There’s no way around it. On Fri, Feb 9, 2018 at 2:35 PM Mahdi Ben Hamida <mailto:ma...@signalfx.com>> wrote: In this case, we only write using CAS (code guarantees that). We also never update, just inser

Re: LWT broken?

2018-02-09 Thread Mahdi Ben Hamida
33 PM, Mahdi Ben Hamida <mailto:ma...@signalfx.com>> wrote:  Under what circumstances would we be reading inconsistent results ? Is there a case where we end up reading a value that actually end up not being written ? If you ever write the same value with CAS and without

Re: LWT broken?

2018-02-09 Thread Mahdi Ben Hamida
level but serial for reading tables updated by LWT operations. Otherwise you might end up reading inconsistent results. On 09.02.18 08:06, Mahdi Ben Hamida wrote: Hello, I'm running a 2.0.17 cluster (I know, I know, need to upgrade) with 46 nodes across 3 racks (& RF=3). I'

LWT broken?

2018-02-08 Thread Mahdi Ben Hamida
Hello, I'm running a 2.0.17 cluster (I know, I know, need to upgrade) with 46 nodes across 3 racks (& RF=3). I'm seeing that under high contention, LWT may actually not guarantee uniqueness. With a total of 16 million LWT transactions (with peak LWT concurrency around 5k/sec), I found 38 conf

Re: What kind of Automation you have for Cassandra related operations on AWS ?

2018-02-08 Thread Ben Wood
wrote: > Hi All, > > What kind of Automation you have for Cassandra related operations on AWS > like restacking, restart of the cluster , changing cassandra.yaml > parameters etc ? > > Thanks > > -- Ben Wood Software Engineer - Data Agility Mesosphere

Re: Cassandra 3.11 fails to start with JDK8u162

2018-01-18 Thread Ben Wood
e+313&entry=gmail&source=g> > > > > > The contents of this e-mail are intended for the named addressee only. It > contains information that may be confidential. Unless you are the named > addressee or an authorized designee, you may not copy or use it, or > disclose it to anyone else. If you received it in error please notify us > immediately and then destroy it. Dynatrace Austria GmbH (registration > number FN 91482h) is a company registered in Linz whose registered office > is at 4040 Linz, Austria, Freistädterstraße 313 > <https://maps.google.com/?q=4040+Linz,+Austria,+Freist%C3%A4dterstra%C3%9Fe+313&entry=gmail&source=g> > -- Ben Wood Software Engineer - Data Agility Mesosphere

Re: Meltdown/Spectre Linux patch - Performance impact on Cassandra?

2018-01-12 Thread Ben Slater
We’re seeing evidence across our fleet that AWS has rolled something out in the last 24 hours that has significantly reduce the performance impacts - back pretty close to pre-patch levels. Yet to see if the impacts come back with o/s patching on top of the improved hypervisor. Cheers Ben On

Re: How quickly we can bootstrap

2017-11-17 Thread Ben Slater
generic enough to work in any virtualised environment. You can find more detail here if interested: https://www.instaclustr.com/instaclustr-dynamic-resizing-for-apache-cassandra/ Cheers Ben On Sat, 18 Nov 2017 at 05:02 Anshu Vajpayee wrote: > Cassandra supports elastic scalability - meaning

Re: Inter Data Center Latency calculation of a Multi DC cluster running in AWS

2017-10-17 Thread Ben Wood
transaction in AWS West as local dc)*. >> >> >> 2. Utilize the https://github.com/gitaroktato/cassandra-replication- >> latency-tools open source project where a Python Cassandra clients >> writes in one Data Center and other client reads in other data center. >> >> >> Can you please suggest if my strategies above will help in finding the >> Inter DC latency or there are other ways I need to follow. >> >> >> Thank You, >> Bill Walters. >> >> >> > -- Ben Wood Software Engineer - Data Agility Mesosphere

Re: C* 3 node issue -Urgent

2017-09-06 Thread Ben Bromhead
. > >>> > >>> ​ > >> > >> > >> - > >> To unsubscribe, e-mail: user-unsubscr...@cassandra.apache.org > >> For additional commands, e-mail: user-h...@cassandra.apache.org > >>

Re: Full table scan with cassandra

2017-08-16 Thread Ben Bromhead
more time, equals ~30 minutes. > > May be we are totally wrong trying to use Cassandra this way? > > -- > > Best Regards, > > > *Alexander Kotelnikov* > > *Team Lead* > > DIGINETICA > Retail Technology Company > > m: +7.921.915.06.28 <+7%20921%20915-06-2

Re: Answering the question of Cassandra Summit 2017

2017-08-11 Thread Ben Bromhead
t. > > There it is. Fire away with your questions, comments. All I ask is keep it > respectful because this is a community of amazing people. You have changed > the world over these years and I know it won’t stop. You know I got a hug > for you wherever we just happen to meet.

Re: Creating a copy of a C* cluster

2017-08-07 Thread Ben Slater
For minimum disruption to your production cluster, restoring from backups is probably the best option. However, there is no reason adding a DC, building and then splitting shouldn’t work if done correct. Cheers Ben On Tue, 8 Aug 2017 at 07:11 Robert Wille wrote: > We need to make a copy o

Re: Cassandra UNREACHABLE node

2017-07-18 Thread Ben Slater
I’m not sure it’s going to help you a lot as the issue is still open and there is not a lot of info in the ticket but your issue looks a lot like this JIRA to me: https://issues.apache.org/jira/browse/CASSANDRA-13363 Cheers Ben On Tue, 18 Jul 2017 at 17:46 Shashikant Kulkarni (शशिकांत कुलकर्णी

Re: Manual Repairs

2017-06-21 Thread Ben Slater
functionality in most circumstances. Cheers Ben On Thu, 22 Jun 2017 at 08:27 Mark Furlong wrote: > Can a repair be paused, and if paused can it be restarted from the point > of the pause, or does it start over? > > > > *Mark Furlong* > > Sr. Database Administrator > >

Re: Cassandra cost vs an RDBMS?

2017-06-15 Thread Ben Slater
with Cassandra and next to impossible to achieve with RDBMS. Cheers Ben On Thu, 15 Jun 2017 at 18:17 Ali Akhtar wrote: > A client recently inquired about the costs of running Cassandra vs a > traditional RDBMS like Postgres or Mysql, in the cloud. > > They are releasing a b2b pro

Re: Long running compaction on huge hint table.

2017-05-21 Thread Ben Slater
meet your needs. Cheers Ben On Sun, 21 May 2017 at 21:47 varun saluja wrote: > Hi All, > > Can someone Please suggest any recommendations for write intensive jobs > > Regards, > Varun Saluja > Sent from my iPhone > > On 17-May-2017, at 3:52 PM, varun saluja wrote:

  1   2   3   4   5   >