Re: [DISCUSS] CEP-40: Data Transfer Using Cassandra Sidecar for Live Migrating Instances

2024-04-19 Thread Jon Haddad
Jeff, this is probably the best explanation and justification of the idea that I've heard so far. I like it because 1) we really should have something official for backups 2) backups / object store would be great for analytics 3) it solves a much bigger problem than the single goal of moving inst

Re: [DISCUSS] CEP-40: Data Transfer Using Cassandra Sidecar for Live Migrating Instances

2024-04-19 Thread Jeff Jirsa
I think Jordan and German had an interesting insight, or at least their comment made me think about this slightly differently, and I’m going to repeat it so it’s not lost in the discussion about zerocopy / sendfile.The CEP treats this as “move a live instance from one machine to another”. I know wh

Re: [DISCUSS] CEP-40: Data Transfer Using Cassandra Sidecar for Live Migrating Instances

2024-04-19 Thread Dinesh Joshi
On Thu, Apr 18, 2024 at 12:46 PM Ariel Weisberg wrote: > > If there is a faster/better way to replace a node why not have Cassandra > support that natively without the sidecar so people who aren’t running the > sidecar can benefit? > I am not the author of the CEP so take whatever I say with a

Re: [DISCUSS] CEP-40: Data Transfer Using Cassandra Sidecar for Live Migrating Instances

2024-04-19 Thread Dinesh Joshi
On Fri, Apr 19, 2024 at 3:12 PM Jon Haddad wrote: > I haven't looked at streaming over TLS, so I might be way off base here, > but our own docs ( > https://cassandra.apache.org/doc/latest/cassandra/architecture/streaming.html) > say ZCS is not available when using encryption, and if we have to br

Re: [DISCUSS] CEP-40: Data Transfer Using Cassandra Sidecar for Live Migrating Instances

2024-04-19 Thread Jon Haddad
I haven't looked at streaming over TLS, so I might be way off base here, but our own docs ( https://cassandra.apache.org/doc/latest/cassandra/architecture/streaming.html) say ZCS is not available when using encryption, and if we have to bring the data into the JVM then I'm not sure how it would eve

Re: [DISCUSS] CEP-40: Data Transfer Using Cassandra Sidecar for Live Migrating Instances

2024-04-19 Thread C. Scott Andreas
These are the salient points here for me, yes:> My understanding from the proposal is that Sidecar would be able to migrate from a Cassandra instance that is already dead and cannot recover.> That’s one thing I like about having it an external process — not that it’s bullet proof but it’s one less

Re: [DISCUSS] CEP-40: Data Transfer Using Cassandra Sidecar for Live Migrating Instances

2024-04-19 Thread Jordan West
If we are considering the main process then we have to do some additional work to ensure that it doesn’t put pressure on the JVM and introduce latency. That’s one thing I like about having it an external process — not that it’s bullet proof but it’s one less thing to worry about. Jordan On Thu, A

Re: discuss: add to_human_size function

2024-04-19 Thread Claude Warren, Jr via dev
I like the idea. Is the intention to have the of the function be parsable by the config parsers like DataRateSpec, DataStorageSpec, or DurationSpec? Claude On Thu, Apr 18, 2024 at 9:47 PM Ariel Weisberg wrote: > Hi, > > I think it’s a good quality of life improvement, but I am someone who > b