Re: cassandra_migration_wait

2020-01-13 Thread Ben Mills
ed the > cassandra.migration_task_wait_in_seconds property. It’s already coded to > have a default of 1 second, which matches what you are seeing in the shell > script var. The relevant Java source is > org.apache.cassandra.service.MigrationManager, line 62. > > > > *From: *Ben Mills > *Repl

cassandra_migration_wait

2020-01-13 Thread Ben Mills
Greetings, We are running Cassandra 3.11.2 in Kubernetes and use a run.sh to set some environment variables and a few other things. This script includes: CASSANDRA_MIGRATION_WAIT="${CASSANDRA_MIGRATION_WAIT:-1}" setting this environment variable to "1". I looked for documentation on this but ca

Re: repair failed

2020-01-02 Thread Ben Mills
Hi Oliver, I don't have a quick answer (or any answer yet), though we ran into a similar issue and I'm wondering about your environment and some configs. - Operating system? - Cloud or on-premise? - Version of Cassandra? - Version of Java? - Compaction strategy? - Primarily read or primarily writ

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
ive stalls happening on either reading > from disk or flushing dirty pages to disk. > > > > > > *From: *Ben Mills > *Reply-To: *"user@cassandra.apache.org" > *Date: *Monday, November 4, 2019 at 12:14 PM > *To: *"user@cassandra.apache.org" > *Subject: *Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC > > > > CGroup >

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
and you said you’re expecting a relatively even > balance in reads and writes. I’m just saying, by way of example, I’d start > weighing if the advice I get online was based in experience similar to my > current circumstance, or ones that were very different. > > > > R &g

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
Hi (yet again) Sergio, Finally, note that we use this sidecar <https://github.com/Stackdriver/stackdriver-prometheus-sidecar> for shipping metrics to Stackdriver. It runs as a second container within our Prometheus stateful set. On Mon, Nov 4, 2019 at 8:46 AM Ben Mills wrote: >

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
inside the JVM (heap space). Hope this helps. On Mon, Nov 4, 2019 at 8:26 AM Ben Mills wrote: > Hi Sergio, > > Thanks for this and sorry for the slow reply. > > We are indeed still running Java 8 and so it's very helpful. > > This Cassandra cluster has been running reliably

Re: ***UNCHECKED*** Re: Memory Recommendations for G1GC

2019-11-04 Thread Ben Mills
ou perform disaster recovery backup? > > > Best, > > Sergio > > Il giorno ven 1 nov 2019 alle ore 14:14 Ben Mills ha > scritto: > >> Thanks Sergio - that's good advice and we have this built into the plan. >> Have you heard a solid/consistent recomme

Re: Memory Recommendations for G1GC

2019-11-01 Thread Ben Mills
a stress tool any > configuration > > Sergio > > On Fri, Nov 1, 2019, 12:31 PM Ben Mills wrote: > >> Greetings, >> >> We are planning a Cassandra upgrade from 3.7 to 3.11.5 and considering a >> change to the GC config. >> >> What is the minimum amo

Re: Memory Recommendations for G1GC

2019-11-01 Thread Ben Mills
ke you’ll end up with your entire database in memory. > > > > *From: *Ben Mills > *Reply-To: *"user@cassandra.apache.org" > *Date: *Friday, November 1, 2019 at 3:31 PM > *To: *"user@cassandra.apache.org" > *Subject: *Memory Recommendations for G1GC

Memory Recommendations for G1GC

2019-11-01 Thread Ben Mills
Greetings, We are planning a Cassandra upgrade from 3.7 to 3.11.5 and considering a change to the GC config. What is the minimum amount of memory that needs to be allocated to heap space when using G1GC? For GC, we currently use CMS. Along with the version upgrade, we'll be running the stateful

Re: Repair Issues

2019-10-26 Thread Ben Mills
Thanks Ghiyasi. On Sat, Oct 26, 2019 at 9:17 AM Hossein Ghiyasi Mehr wrote: > If the problem exist still, and all nodes are up, reboot them one by one. > Then try to repair one node. After that repair other nodes one by one. > > On Fri, Oct 25, 2019 at 12:56 AM Ben Mills wrote: &g

Re: Repair Issues

2019-10-24 Thread Ben Mills
> cause of a problem, but in your case there's so many potential problems I > don't think it's worth digging into, especially since the problem might be > one of the 500 or so bugs that were fixed since this release. > > Once you've done those things it'll

Re: Repair Issues

2019-10-24 Thread Ben Mills
d when the pods are down. This is a subtlety of running Cassandra in Kubernetes. On Thu, Oct 24, 2019 at 4:24 PM Reid Pinchback wrote: > Ben, you may find this helpful: > > > > https://blog.pythian.com/so-you-have-a-broken-cassandra-sstable-file/ > > > > >

Re: Repair Issues

2019-10-24 Thread Ben Mills
ou using Cassandra reaper? > > On Thu, Oct 24, 2019, 12:31 PM Ben Mills wrote: > >> Greetings, >> >> Inherited a small Cassandra cluster with some repair issues and need some >> advice on recommended next steps. Apologies in advance for a long email. >> >>

Repair Issues

2019-10-24 Thread Ben Mills
Greetings, Inherited a small Cassandra cluster with some repair issues and need some advice on recommended next steps. Apologies in advance for a long email. Issue: Intermittent repair failures on two non-system keyspaces. - platform_users - platform_management Repair Type: Full, parallel rep