March 2025 project status update

2025-03-07 Thread Josh McKenzie
What happened last month? *New PMC members and committers, that's what.* We welcomed *three* new people to the PMC in Feb: Jeremiah Jordan, Caleb Rackliffe, and Ekaterina Dimitrova. We're the better for all three of them being here with us; thank you all for your hard work over the years and de

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Štefan Miklošovič
Because an earlier reply hinted that mounting a bucket yields "terrible results". That has moved the discussion, in my mind, practically to the place of "we are not going to do this", to which I explained that in this particular case I do not find the speed important, because the use cases you want

Re: [UPDATE] CEP-37

2025-03-07 Thread Jordan West
Thank you for the update Jaydeep. Very excited to see the progress here. I’m removed the internal status of our deployment of it now but from the JIRAs, meetings, and other conversations my impression is this feature has been heavily tested and is production grade. Jordan On Fri, Mar 7, 2025 at 1

Re: March 2025 project status update

2025-03-07 Thread Josh McKenzie
Did you know I sometimes fail at email filtering? 4 new committers! FOUR. Welcome to Bernardo Botella Corbi as well! That was 3 days ago too. /sigh Congrats everyone! On Fri, Mar 7, 2025, at 1:39 PM, Josh McKenzie wrote: > What happened last month? *New PMC members and committers, that's what.*

Re: March 2025 project status update

2025-03-07 Thread Blake Eggleston
ahem, sorry looks like we're still waiting on something from Abe on that one. Nevermind for now :) On Fri, Mar 7, 2025, at 1:05 PM, Blake Eggleston wrote: > Technically March, but Abe Ratnofsky was also added as a committer. Looks > like the announcement for that was missed > > On Fri, Mar 7, 2

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Jordan West
I too initially felt we should just use mounts and was excited by e.g. Single Zone Express mounting. As Cheng mentioned we tried it…and the results were disappointing (except for use cases who could sometimes tolerate seconds of p99 latency. That brought me around to needing an implementation we ow

Re: [RELEASE] Apache Cassandra Sidecar 0.1.0 released

2025-03-07 Thread Patrick McFadin
We happen to have some very informed engineers discussing Sidecar and the many things you can do with it at Cassandra Forward. Come check out the talk and give them a shout-out! https://www.datastax.com/events/cassandra-forward-march-2025 Congrats on the release! On Fri, Mar 7, 2025 at 10:44 AM B

Re: CEP-15 Update

2025-03-07 Thread Caleb Rackliffe
1. Just a quick reminder that CASSANDRA-18196 is where we had been tracking this previously with respect to things like the feature flag ( CASSANDRA-18195 ), etc. I'm not su

Re: Dropwizard/Codahale metrics deprecation in Cassandra server

2025-03-07 Thread Jon Haddad
As long as operators are able to use all the OTel tooling, I'm happy. I'm not looking to try to decide what the metrics API looks like, although I think trying to plan for 15 years out is a bit unnecessary. A lot of the DB will be replaced by then. That said, I'm mostly hands off on code and you

Re: [DISCUSS] AWS IAM-based client authentication

2025-03-07 Thread Joel Shepherd
Related JIRA: https://issues.apache.org/jira/browse/CASSANDRA-20416 Includes links to the draft code and more complete documentation of the proposed approach. Thanks -- Joel. On 3/4/2025 12:48 PM, Joel Shepherd wrote: Hi - I have a side project that provides client- and node-side Java plug-i

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Jon Haddad
Supporting a filesystem mount is perfectly reasonable. If you wanted to use that with the S3 mount, there's nothing that should prevent you from doing so, and the filesystem version is probably the default implementation that we'd want to ship with since, to your point, it doesn't require additiona

Re: [RELEASE] Apache Cassandra Sidecar 0.1.0 released

2025-03-07 Thread Bernardo Botella
This is a huge milestone! It’s incredible to see this release happening. Congrats to everyone involved! > On Mar 7, 2025, at 9:48 AM, Francisco Guerrero wrote: > > The Cassandra team is pleased to announce the release of Apache Sidecar > Cassandra version 0.1.0. > > > Downloads of source and

[RELEASE] Apache Cassandra Sidecar 0.1.0 released

2025-03-07 Thread Francisco Guerrero
The Cassandra team is pleased to announce the release of Apache Sidecar Cassandra version 0.1.0. Downloads of source and binary distributions are available here: https://dlcdn.apache.org/cassandra/cassandra-sidecar/0.1.0/ The Maven artifacts can be found at: https://repo.maven.apache.org/ma

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Jon Haddad
If that's not your intent, then you should be more careful with your replies. When you write something like this: > While this might work, what I find tricky is that we are forcing this to users. Not everybody is interested in putting everything to a bucket and server traffic from that. They just

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Štefan Miklošovič
I was explaining multiple times (1) that I don't have anything against what is discussed here. Having questions about what that is going to look like does not mean I am dismissive. (1) https://lists.apache.org/thread/ofh2q52p92cr89wh2l3djsm5n9dmzzsg On Fri, Mar 7, 2025 at 5:44 PM Jon Haddad wro

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Štefan Miklošovič
The only way I see that working is that, if everything was in a bucket, if you take a snapshot, these SSTables would be "copied" from live data dir (living in a bucket) to snapshots dir (living in a bucket). Basically, we would need to say "and if you go to take a snapshot on this table, instead of

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Jon Haddad
Nobody is saying you can't work with a mount, and this isn't a conversation about snapshots. Nobody is forcing users to use object storage either. You're making a ton of negative assumptions here about both the discussion, and the people you're having it with. Try to be more open minded. On Fr

Re: CEP-15 Update

2025-03-07 Thread Jordan West
I would love to have my questions answered and see some graphs I don’t think those are unreasonable asks nor do they take away from the awesome work done. I was suggesting 1-2 weeks for folks to have the opportunity to produce that data if the original authors didn’t have time. I also don’t think t

Re: [DISCUSS] AWS IAM-based client authentication

2025-03-07 Thread C. Scott Andreas
Joel, thanks for reaching out. This sounds interesting, I bet there are many who would benefit from IAM-based authentication. If you haven't yet, could you request a Jira account? Someone will be able to approve it almost immediately if you don't have one yet. https://selfserve.apache.org/jira-

Re: CEP-15 Update

2025-03-07 Thread Jon Haddad
I defer to the judgement of the folks that are most impacted by it - ones that are in the code, working on the next release. If you all think it's good to merge, then I am 100% in support of it. I suspect merging will help get it out faster, and I don't see any future in which we don't ship this

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread guo Maxwell
Thank you very much, I'm certainly interested. I'll start working on the update for cep-36 next week. Mick Semb Wever 于2025年3月7日 周五下午7:07写道: > > > On Thu, 6 Mar 2025 at 09:40, Štefan Miklošovič > wrote: > >> That is cool but this still does not show / explain how it would look >> like when it c

Re: CEP-15 Update

2025-03-07 Thread Josh McKenzie
3.5 years is an incredible amount of time and work; it really is significant and thanks to everyone involved for the investment of time and energy. We have a rocky history with large, disruptive contributions in the past that have either blocked forward progress post-merge (CASSANDRA-8099), or l

Re: Welcome Ekaterina Dimitrova as Cassandra PMC member

2025-03-07 Thread Ekaterina Dimitrova
Thank you all for the kind words here and some of you reached out in Slack, thank you for the warm welcome! On Wed, 5 Mar 2025 at 22:43, Tolbert, Andy wrote: > Congratulations Ekaterina!! > > On Wed, Mar 5, 2025 at 8:52 PM Jordan West wrote: > >> Congratulations!!! >> On Wed, Mar 5, 2025 at 07:

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Mick Semb Wever
On Thu, 6 Mar 2025 at 09:40, Štefan Miklošovič wrote: > That is cool but this still does not show / explain how it would look like > when it comes to dependencies needed for actually talking to storages like > s3. > As Benedict writes, dealing with optional dependencies is not hard (and as Jon

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Štefan Miklošovič
BTW, snapshots are quite special because these are not "files", they are just hard links. They "materialize" as regular files once underlying SSTables are compacted away. How are you going to hardlink from local storage to an object storage anyway? We will always need to "upload". On Fri, Mar 7, 2

Re: [DISCUSS] CEP-36: A Configurable ChannelProxy to alias external storage locations

2025-03-07 Thread Štefan Miklošovič
Jon, all "big three" support mounting a bucket locally. That being said, I do not think that completely ditching this possibility for Cassandra working with a mount, e.g. for just uploading snapshots there etc, is reasonable. GCP https://cloud.google.com/storage/docs/cloud-storage-fuse/quickstar