Re: [VOTE] Release Apache Cassandra 4.0.2

2022-02-08 Thread Joshua McKenzie
I find myself agreeing with Jeremiah's sentiment here. For example, we're asking people that are on 4.0.1 to make the difficult choice between accepting the risk of whatever prompts an urgent release vs. accepting the risk of potentially destabilizing their GA critical infrastructure. The 4.0 line

Cassandra project biweekly status update 2021-02-07

2022-02-07 Thread Joshua McKenzie
This is the Special "We need to talk" edition. :) Something interesting changed in the past two weeks - we had our first couple of rotations of a Build Lead ( https://cwiki.apache.org/confluence/display/CASSANDRA/Build+Lead). And why do we need to talk? Well, Brandon and I created a lot of test f

Re: Build tool

2022-02-03 Thread Joshua McKenzie
Could someone take on clearly enumerating the pros and cons of ant vs. maven? Without clarity this is going to keep stagnating as a war of unsubstantiated opinions and fizzle out like it has so many times in the past. I'd like to see it either change or the topic be put to rest. :) On Thu, Feb

Re: [DISCUSS] CEP-7 Storage Attached Index

2022-02-02 Thread Joshua McKenzie
> jasonstack.zhao@ > > gmail.com> wrote: > > Thank you Patrick for hosting Cassandra Contributor Meeting > > for > > CEP-7 > > > SAI. > > The recorded video is available here: > > https://cwiki.apache.org/confluence/display/CASSANDRA/ > 2020-09-0

Re: Request for volunteers: key test failures

2022-01-28 Thread Joshua McKenzie
s > processes are left around and a few other tests will then fail on timeouts, > OOM, ip collision etc. You might fix this one and get the others to go away > bc they were somehow side-effects. > > #collaborating > > Regards > On 27/1/22 20:20, Joshua McKenzie wrote: >

Request for volunteers: key test failures

2022-01-27 Thread Joshua McKenzie
Hey all. Working through our first week as Build Lead and there's a lot of backlog to process. We had some changes to improve CPU utilization on apache infra for ci-cassandra and infra is looking into further optimizations; things are much more responsive from a UX perspective at least on the site.

Re: Have we considered static type checking for our python libs?

2022-01-26 Thread Joshua McKenzie
d, Jan 26, 2022 at 3:23 PM Brandon Williams wrote: > On Wed, Jan 26, 2022 at 2:17 PM Joshua McKenzie > wrote: > >> > >> I'm unable to think of an instance where typing in python could have > helped me, > > > > Discoverability, IDE integration, more primitiv

Re: Have we considered static type checking for our python libs?

2022-01-26 Thread Joshua McKenzie
> > I'm unable to think of an instance where typing in python could have > helped me, Discoverability, IDE integration, more primitives to describe your intent in your code to other maintainers, and shifting a certain class of runtime errors to being "merge-time" errors all come to mind. There's

Re: Have we considered static type checking for our python libs?

2022-01-26 Thread Joshua McKenzie
to predict that it might payoff with lower > development overhead, as we can run our tests much more quickly, and debug > failures much more easily. > > > > *From: *Joshua McKenzie > *Date: *Wednesday, 26 January 2022 at 13:40 > *To: *dev > *Subject: *Re: Have we considere

Re: Have we considered static type checking for our python libs?

2022-01-26 Thread Joshua McKenzie
d by much better versions of the same > test. > > > > > > *From: *Joshua McKenzie > *Date: *Wednesday, 26 January 2022 at 12:59 > *To: *dev > *Subject: *Have we considered static type checking for our python libs? > > Relevant links: > > 1) Optional stat

Have we considered static type checking for our python libs?

2022-01-26 Thread Joshua McKenzie
Relevant links: 1) Optional static typing for python: https://docs.python.org/3/library/typing.html 2) Mypy static type checker for python: https://github.com/python/mypy So the question - has anyone given any serious thought to introducing type hints and a static type checker in ccm and python dt

Re: Is removal of dead code bug or feature?

2022-01-25 Thread Joshua McKenzie
I consider removal of dead code and refactoring to be in the same category: critical to the longevity of the project, and not adding stability value to GA releases which is our only priority for them. So improvement, and thus trunk / unreleased only. ~Josh On Mon, Jan 24, 2022 at 8:08 PM Ekateri

Cassandra project status update 2022-1-24

2022-01-24 Thread Joshua McKenzie
Three weeks to cover so not strictly biweekly this time. Apologies for the miss last week; US holiday combined with pandemic related interruptions meant pushing a week. Just gives us more to talk about! [For new Contributors] First off, check out the official site for details on getting started

Re: UDF future

2022-01-23 Thread Joshua McKenzie
Lazy consensus seems like a safe path here. https://community.apache.org/committers/lazyConsensus.html On Sat, Jan 22, 2022 at 4:24 PM Ekaterina Dimitrova wrote: > > Hi everyone, > > Thank you for responding to my email. > > Looking at the responses, I guess I should directly open tickets - one

[DISCUSS] Patching, versioning, and LTS releases

2022-01-21 Thread Joshua McKenzie
I took a stab at codifying a lot of what we've talked about in terms of "what code goes where" that's tribal knowledge thus far undocumented on our project; I've had another long-timer review it and I think it's ready for broader community input. Roughly 1 page, quick reading, should all be stuff w

Call for Build Lead volunteers

2022-01-21 Thread Joshua McKenzie
Cwiki article: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=199527692 The previous ML thread about this got derailed by the ever exciting topic of our merge strategy. Let's not do that here. :) Simply calling for volunteers to help take on this role starting the week of Jan 31

Re: [DICSUSS] Marketing contributions

2022-01-21 Thread Joshua McKenzie
I was particularly influenced by this mental model of thinking about open source contributions in the past: https://d33wubrfki0l68.cloudfront.net/dfb15f354706fa763ff385e5eea61520bcdcf8bb/1b0fc/assets/media/community-engagement-oss-image.png Related article: https://www.bvp.com/atlas/roadmap-open-s

Re: UDF future

2022-01-19 Thread Joshua McKenzie
+1 to deprecate, drop, add hooks. On Wed, Jan 19, 2022 at 2:22 PM Brandon Williams wrote: > Yes, just javascript. > > On Wed, Jan 19, 2022 at 1:20 PM Yifan Cai wrote: > >> > >> I think we should deprecate scripted UDFs now and drop them from the > next major, but possibly provide hooks for pe

Re: [VOTE] Formalizing our CI process

2022-01-13 Thread Joshua McKenzie
72 hours has passed. With some tweaking and Joey's amendment, we have 12 binding +1 and 4 non-binding +1. I've updated the wiki to reflect that this process is now ratified: https://cwiki.apache.org/confluence/display/CASSANDRA/Cassandra+CI+Process Thanks everyone! ~Josh On Thu, Jan 13, 2022 at

Re: [VOTE] Formalizing our CI process

2022-01-12 Thread Joshua McKenzie
I'd say an amendment with a directional poll would be fine. I don't think this is controversial. That's me taking "the spirit of the law" rather than the letter though. I'm good either way. ~Josh On Wed, Jan 12, 2022 at 11:51 AM Joseph Lynch wrote: > On Wed

Re: [VOTE] Formalizing our CI process

2022-01-12 Thread Joshua McKenzie
I fully concede your point and concern Joey but I propose we phrase that differently to emphasize the importance of clean tests. "All releases by default are expected to have a green test run on ci-cassandra Jenkins. In exceptional circumstances (security incidents, data loss, etc requiring hotfix

Re: [VOTE] Formalizing our CI process

2022-01-11 Thread Joshua McKenzie
hen all we'd have to > do to get out of a sticky situation is cut jira tickets ... Or if this > is just a "valid reason" that a PMC could be -1 then that's fine too. > > -Joey > > > On Mon, Jan 10, 2022 at 11:00 AM Joshua McKenzie > wrote: > > > &g

Re: [VOTE] Formalizing our CI process

2022-01-11 Thread Joshua McKenzie
wrote: > > > On Mon, 10 Jan 2022 at 20:00, Joshua McKenzie > wrote: > >> Wiki draft article here: >> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=199530280 >> > > > +1 > > small nits: > - none of the other confluence pages use

Re: [VOTE] Formalizing our CI process

2022-01-10 Thread Joshua McKenzie
+1 On Mon, Jan 10, 2022 at 3:32 PM Michael Shuler wrote: > +1 > > Michael > > On 1/10/22 13:00, Joshua McKenzie wrote: > > Wiki draft article here: > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=199530280 > > < > https://cwiki.a

[VOTE] Formalizing our CI process

2022-01-10 Thread Joshua McKenzie
Wiki draft article here: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=199530280 The vote will be open for 72 hours (it's short + early indication on discussion was consensus). Committer / pmc votes binding. Simple majority passes. References: Background: original ML thread he

Re: [DISCUSS] Releasable trunk and quality

2022-01-06 Thread Joshua McKenzie
> > If you see a merge commit in the history, isn't it normal to presume that > it will contain the additional change for that branch for the parent commit > getting merged in? I've been noodling on this a bit; I think it's a question of degree. When I see a merge commit my intuitive expectation i

Re: Clarifying CI release criteria

2022-01-05 Thread Joshua McKenzie
; > Thanks, > Ekaterina > > On Tue, 4 Jan 2022 at 14:51, Joshua McKenzie wrote: > >> Here's a link to a draft article for the confluence wiki covering what we >> discussed on this thread: >> https://cwiki.apache.org/confluence/pages/resumedraft.action?draft

Re: [DISCUSS] Releasable trunk and quality

2022-01-05 Thread Joshua McKenzie
14102901&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-14102901 On Wed, Jan 5, 2022 at 9:52 AM Joshua McKenzie wrote: > A wise man once said "Simple is a feature" ;) > > Our current process (commit oldest, merge up or merge -s ours w/ --amend): > - is confusing for new contr

Re: [DISCUSS] Releasable trunk and quality

2022-01-05 Thread Joshua McKenzie
s wrong). > > > > > > *From: *bened...@apache.org > *Date: *Tuesday, 4 January 2022 at 23:52 > *To: *David Capwell , Joshua McKenzie < > jmcken...@apache.org> > *Cc: *Henrik Ingo , dev < > dev@cassandra.apache.org> > *Subject: *Re: [DISCUSS] Releasab

Re: [DISCUSS] Releasable trunk and quality

2022-01-04 Thread Joshua McKenzie
ack open BACKPRT tickets and work on them to close them. > > henrik > > On Tue, Dec 14, 2021 at 8:53 PM Joshua McKenzie > wrote: > >> > >> > I like a change originating from just one commit, and having tracking >> > visible across the branches. This gives you

Re: Clarifying CI release criteria

2022-01-04 Thread Joshua McKenzie
iscussed here as well as outstanding work, I'll get it published and integrated with the confluence wiki and get the remainder of the work into a JIRA epic to be tracked. On Fri, Dec 17, 2021 at 4:41 PM Joshua McKenzie wrote: > I'll get this into a draft article on the wiki s

Re: Cassandra project biweekly status update 2022-01-03

2022-01-04 Thread Joshua McKenzie
at Chris > T drafts? He uses your recaps as a basis. > > Shared on the #cassandra-website channel. Example: > https://cassandra.apache.org/_/blog/Apache-Cassandra-Changelog-10-October-2021.html > > On Tue, Jan 4, 2022 at 7:21 AM Joshua McKenzie > wrote: > >> Could we

Re: Cassandra project biweekly status update 2022-01-03

2022-01-04 Thread Joshua McKenzie
> > Could we post these on the blog as well I always wanted to be a blogger. Sounds like now's my chance. ;) In all seriousness I think this is a great idea. I'll find out what I need to know to make this happen and make it so. On Mon, Jan 3, 2022 at 7:38 PM Patrick McFadin wrote: > What Ellis

Re: Cassandra project biweekly status update 2022-01-03

2022-01-03 Thread Joshua McKenzie
o so it's fresh. That help clarify? ~Josh On Mon, Jan 3, 2022 at 2:57 PM Manish G wrote: > There is already a list of tickets with mentors associated. Do these > 'lhfs' also fall in same category? > > On Mon, Jan 3, 2022, 8:51 PM Joshua McKenzie wrote: > >

Cassandra project biweekly status update 2022-01-03

2022-01-03 Thread Joshua McKenzie
/wave Happy 2022 everyone! [New contributors getting started] There are two curated options for getting started if you're new to the project and looking to get oriented: Failing tests, or starter tickets we label "lhf" (low hanging fruit). Don't let either fool you - it's almost always interesting

Re: [DISCUSS] Next release cut

2022-01-03 Thread Joshua McKenzie
+1 to 4.1 in May. On Mon, Jan 3, 2022 at 12:58 PM David Capwell wrote: > 4.1 target of may works for me, we may want to remove a few things in > Config.java if not wrapped up on time (thinking track warnings and > guardrails, though that should be handled by then) > > > On Dec 14, 2021, at 5:02

Re: [DISCUSS] Periodic snapshot publishing with minor version bumps

2021-12-21 Thread Joshua McKenzie
A{1,2},C{3,2,1},B{3,2,1} I'm very strongly in favor of some permutation of A or the 3rd on B and C due to the release at a .0 version. I've never heard of a project versioning otherwise (happy to have examples pointed out). I'm a big fan of prior art / settled law / following idioms. I find t

Re: Clarifying CI release criteria

2021-12-17 Thread Joshua McKenzie
ocument where we discuss required test suites to be run pre-commit. If not > - then I guess we should add those things here too? > > On Fri, 17 Dec 2021 at 11:36, Joshua McKenzie > wrote: > > > Good call; thanks for the reminder. > > > > So maybe add a > > >

Re: Clarifying CI release criteria

2021-12-17 Thread Joshua McKenzie
wrote: > Could we also add something about running new tests through the > multiplexer? > > On Fri, Dec 17, 2021 at 10:23 AM Joshua McKenzie > wrote: > > > > So to clarify it all in one place, the proposed new CI process we should > > test for consensus is: >

Re: Clarifying CI release criteria

2021-12-17 Thread Joshua McKenzie
So to clarify it all in one place, the proposed new CI process we should test for consensus is: 1. Canonical CI for a release is ci-cassandra. We can optionally, and in practice will, run circle as well but don't codify blocking on that. 2. (NEW) We don't release unless we get a fully green run. 3

Re: Clarifying CI release criteria

2021-12-17 Thread Joshua McKenzie
What if we tried the following: 1. Canonical CI for a release is ci-cassandra. We can optionally, and in practice will, run circle as well but don't codify blocking on that. 2. (NEW) We don't release unless we get a fully green run. 3. Before any merge, you need either a non-regressing (i.e. no ne

Re: Clarifying CI release criteria

2021-12-16 Thread Joshua McKenzie
> > ci-cassandra.a.o needs to be our canonical CI it's the only one fully usable by a volunteer based only green in both counts as green I think today might just be my day to annoy you Mick. :D Sorry! I think this is contradictory. We can't require circle to be green for a release if the free

Re: [DISCUSS] Periodic snapshot publishing with minor version bumps

2021-12-16 Thread Joshua McKenzie
> > it breaks the code and drivers. b) accepting that the code and drivers is fragile with versions and we need > to keep it simple. Oh yeah, that's a dealbreaker then. Wasn't aware. we agreed to do periodic snapshot publishing I poked around a tiny bit - Spark and Flink both interpret "periodi

Re: [DISCUSS] Periodic snapshot publishing with minor version bumps

2021-12-16 Thread Joshua McKenzie
> > I don’t really see the advantage to this over 4.1.0-SNAPSHOT1 Only benefit is that it indicates the purpose of the snapshot (date-based) rather than leaving it unspecified / as an exercise to the reader. If the theorized workflow is people testing latest snapshot, doesn't add any value. On

Re: [DISCUSS] Periodic snapshot publishing with minor version bumps

2021-12-16 Thread Joshua McKenzie
> > general feedback seems to be that users don't care so long as version > numbers are going up Curious to hear more about this. It doesn't match my intuition or experience running systems but I'm also n=1 and there's a lot of opinions in the world. Leap-frogged by Benedict's response here, but

LEAK DETECTED: to hot prop cassandra.debugrefcount or not

2021-12-16 Thread Joshua McKenzie
In tracking down the leak that led to https://issues.apache.org/jira/browse/CASSANDRA-17174, it came to my attention that debugging ref counts is a -D property rather than a JMX flippable hot property in Ref.java: public static final boolean DEBUG_ENABLED = > System.getProperty("cassandra.debugref

Clarifying CI release criteria

2021-12-15 Thread Joshua McKenzie
What CI criteria are we using to gate minor and major releases? For example: All tests from all suites on all configurations? A subset? All the test suite columns on the following page? https://ci-cassandra.apache.org/job/Cassandra-trunk/ All the test suites in all combinations on all JDKs on cir

Re: [DISCUSS] Releasable trunk and quality

2021-12-14 Thread Joshua McKenzie
> > I like a change originating from just one commit, and having tracking > visible across the branches. This gives you immediate information about > where and how the change was applied without having to go to the jira > ticket (and relying on it being accurate) I have the exact opposite experien

Cassandra project biweekly status update 2021-12-14

2021-12-14 Thread Joshua McKenzie
Happy Tuesday Morning and Afternoon, which is almost Monday! Benjamin took the time to put together a roadmap (Awesome!) for the next Cassandra release - check that out here: https://cwiki.apache.org/confluence/display/CASSANDRA/Roadmap [New contributors getting started] We have a seasonally cal

Re: [DISCUSS] Releasable trunk and quality

2021-12-14 Thread Joshua McKenzie
> > Merge commits aren’t that useful > I keep coming back to this. Arguably the only benefit they offer now is procedurally forcing us to not miss a bugfix on a branch, but given how much we amend many things presently anyway that dilutes that benefit. Having 1/3rd of your commit history be nois

Re: [DISCUSS] Releasable trunk and quality

2021-12-09 Thread Joshua McKenzie
> > limiting this feature to trunk _only_ patches? If so, that seems rather > weak. It's definitely a weaker guarantee. On the plus side, if we're doing bugfix only to all released branches and limiting improvements and new features to trunk, in theory those will be the more disruptive patches tha

Re: [DISCUSS] Releasable trunk and quality

2021-12-09 Thread Joshua McKenzie
Good with all the above (reasonable arguments) except I don't understand: > > I find it cleaner that work is found associated to one sha on the hardest > branch, and we treat (or should be) CI holistically across branches. If we -s ours and amend merge commits on things that straddle stuff like 80

Re: [DISCUSS] Releasable trunk and quality

2021-12-07 Thread Joshua McKenzie
0:35 AM Brandon Williams wrote: > On Tue, Dec 7, 2021 at 8:18 AM Joshua McKenzie > wrote: > > So let me pose the question here to the list: is there anyone who would > > like to advocate for the current merge strategy (apply to oldest LTS, > merge > > up, often -s ou

Re: [DISCUSS] Releasable trunk and quality

2021-12-07 Thread Joshua McKenzie
e a clean test run. This doesn’t > fully resolve flakiness, but it does provide 95%+ of the necessary pressure > to maintain test quality, and a consistent way of determining that. > > This is how a lot of other projects maintain correctness, and I think how > many forks of Cassandra

Re: [DISCUSS] Releasable trunk and quality

2021-12-07 Thread Joshua McKenzie
> > > * What to do if a test fails intermittently? - Open a ticket. During > > investigation - Use the CircleCI jobs for running tests in a loop to find > > when it fails or to verify the test was fixed. (This is already in my > draft > > CircleCI document, not yet relea

Re: [DISCUSS] Releasable trunk and quality

2021-12-06 Thread Joshua McKenzie
much as possible as well. Goal is to make it easy to do the right thing and hard to do the wrong thing, and to have these things written down rather than have it be tribal knowledge that varies a lot across the project. ~Josh On Sat, Dec 4, 2021 at 9:04 AM Joshua McKenzie wrote: > After some

Re: [DISCUSS] Disabling MIME-part filtering on this mailing list

2021-12-06 Thread Joshua McKenzie
+1 On Mon, Dec 6, 2021 at 8:06 AM Brandon Williams wrote: > +1 > > On Mon, Dec 6, 2021 at 5:00 AM Aleksey Yeschenko > wrote: > > > > Agreed as well. > > > > > On 4 Dec 2021, at 23:28, bened...@apache.org wrote: > > > > > > I think you were correct to start a DISCUSS thread, Bowen. You should >

Re: [DISCUSS] Releasable trunk and quality

2021-12-04 Thread Joshua McKenzie
complete * Test boards for supported branches are green Phase 2: * Add Harry to recurring run against trunk * Add Harry to release pipeline * Suite of perf tests against trunk recurring On Wed, Nov 17, 2021 at 1:42 PM Joshua McKenzie wrote: > Sorry for not catching that Benedict, you&#x

Cassandra project biweekly status update 2021-11-29

2021-11-29 Thread Joshua McKenzie
Sorry for the miss last week; it being a holiday in the US meant I was on the road managing tiny humans and a puppy with my partner and I failed to hand off update email responsibility to someone else. Which means we have three weeks to cover! [New contributor Getting Started] As a new contributor

Re: Resurrection of CASSANDRA-9633 - SSTable encryption

2021-11-19 Thread Joshua McKenzie
;d be better off investing our time into documenting how to do full disk encryption in a variety of scenarios + explaining why that is our recommended approach instead of taking the time and energy to design, implement, debug, and then maintain an inferior solution. On Fri, Nov 19, 2021 at 7:49 AM Joshua M

Re: [DISCUSS] Releasable trunk and quality

2021-11-17 Thread Joshua McKenzie
> > We might have to rebase several dependent merge commits and want to merge > them atomically. So far as I know these tools don’t work fantastically in > this scenario, but if I’m wrong that’s fantastic. If not, given how > important these things are, should we consider revisiting our

Re: [DISCUSS] Releasable trunk and quality

2021-11-17 Thread Joshua McKenzie
ssions in a timeseries history > of benchmark results: https://github.com/datastax-labs/hunter Just like > with correctness testing it's my experience that catching regressions the > day they happened is much better than trying to do it at beta or rc time. > > Piotr also blogged

Re: [VOTE] CEP-17: SSTable format API

2021-11-16 Thread Joshua McKenzie
+1 On Tue, Nov 16, 2021 at 10:14 AM Andrés de la Peña wrote: > +1 > > On Tue, 16 Nov 2021 at 08:39, Sam Tunnicliffe wrote: > > > +1 > > > > > On 15 Nov 2021, at 19:42, Branimir Lambov wrote: > > > > > > Hi everyone, > > > > > > I would like to start a vote on this CEP. > > > > > > Proposal: >

Re: [DISCUSS] Mentoring newcomers

2021-11-14 Thread Joshua McKenzie
Sign me up. On Fri, Nov 12, 2021 at 4:38 PM David Capwell wrote: > I am cool helping. > > > On Nov 12, 2021, at 10:29 AM, Ekaterina Dimitrova > wrote: > > > > I am in too > > > > On Fri, 12 Nov 2021 at 13:23, wrote: > > > >> I am interested as well. > >> > >> Sent from my iPhone > >> > >>> On

Re: [VOTE] CEP-3: Guardrails

2021-11-12 Thread Joshua McKenzie
+1 On Thu, Nov 11, 2021 at 12:06 PM David Capwell wrote: > +1 > > > On Nov 11, 2021, at 7:10 AM, Sumanth Pasupuleti < > sumanth.pasupuleti...@gmail.com> wrote: > > > > +1 > > > > On Thu, Nov 11, 2021 at 6:10 AM Gary Dusbabek > wrote: > > > >> +1 > >> > >> On Thu, Nov 11, 2021 at 5:30 AM Andrés

Re: [DISCUSS] CEP-3: Guardrails

2021-11-10 Thread Joshua McKenzie
Kind of a nit, but I advocate for us having a guardrails.yaml and updating this line: > > *cassandra.yaml:* allows configuring individual guardrails at startup, > being globally disabled by default. These guardrails will also be > dynamically configurable through JMX and/or virtual tables. The cas

Re: [DISCUSS] CEP-17: SSTable format API (CASSANDRA-17056)

2021-11-09 Thread Joshua McKenzie
> > trunk -> anything goes, not trunk -> try not to change these interfaces Have we ever clarified what "these interfaces" are? Was just talking to David and I realized I didn't even JavaDoc CommitLogReadHandler as _being designed_ for external usage. /sigh I think it'd be valuable for us to go t

Re: [DISCUSS] Creating a new slack channel for newcomers

2021-11-09 Thread Joshua McKenzie
> > not because there's 600 pair of eyes watching > this (TBH, if you didn't mention it, I wouldn't have noticed it) oof; that wasn't my intent at all! :) I think a clearly written and easy to find community > guideline highlighting that this mailing list is suitable for beginner > questions, and

Cassandra project biweekly status update 2021-11-08

2021-11-08 Thread Joshua McKenzie
First off - Congrats again to Sumanth Pasupuleti on becoming a committer on the project! Well deserved; looking forward to working with you further. It looks like ponymail got an upgrade; I didn't even realize that was possible at this point. :) So caveat emptor: the links I put in here to individ

Re: [DISCUSS] Creating a new slack channel for newcomers

2021-11-08 Thread Joshua McKenzie
Asking questions in front of 600 people (even virtually) can be prohibitively hard for a lot of people. I'm with Ekaterina; flagging certain people in the channel as "available to mentor" so new contributors would know who they could reach out to 1:1 to get situated and potentially build some confi

Re: [DISCUSS] Releasable trunk and quality

2021-11-05 Thread Joshua McKenzie
able to identify the tests affected by our changes, but I think it could > have prevented many of the recently fixed flakies. > > > On Thu, 4 Nov 2021 at 12:24, Joshua McKenzie wrote: > > > > > > > we noticed CI going from a > > > steady 3-ish failures to ma

Re: [DISCUSS] Releasable trunk and quality

2021-11-04 Thread Joshua McKenzie
> > we noticed CI going from a > steady 3-ish failures to many and it's getting fixed. So we're moving in > the right direction imo. > An observation about this: there's tooling and technology widely in use to help prevent ever getting into this state (to Benedict's point: blocking merge on CI fail

Re: [DISCUSS] Releasable trunk and quality

2021-11-03 Thread Joshua McKenzie
erent infra related > > failures in the different CIs. Not an easy topic, indeed. I support > running > > all tests, just having in mind all the related issues/complications. > > > > I would say in my mind upgrade tests are particularly important to be > green &g

Re: [DISCUSS] Releasable trunk and quality

2021-11-02 Thread Joshua McKenzie
. > > >> > > >>> What are the costs? > > >> I think the costs are quite low, perhaps even negative. Hidden work > > >> produced by merges that break things can be much more costly than > > getting > > >> the work right first time, as attribution is m

[DISCUSS] Releasable trunk and quality

2021-10-30 Thread Joshua McKenzie
We as a project have gone back and forth on the topic of quality and the notion of a releasable trunk for quite a few years. If people are interested, I'd like to rekindle this discussion a bit and see if we're happy with where we are as a project or if we think there's steps we should take to chan

Re: [VOTE] Release dtest-api 0.0.11

2021-10-30 Thread Joshua McKenzie
+1 On Fri, Oct 29, 2021 at 11:19 AM Jacek Lewandowski < lewandowski.ja...@gmail.com> wrote: > +1 > > - - -- --- - - > Jacek Lewandowski > > > On Fri, Oct 29, 2021 at 4:48 PM Brandon Williams wrote: > > > +1 > > > > On Fri, Oct 29, 2021 at 7:45 AM Mick Semb Wever wrote:

Re: [DISCUSS] How to implement backward compatibility (CASSANDRA-17048)

2021-10-26 Thread Joshua McKenzie
+1 to Benedict's perspective here. Supporting both sstable ID paradigms should be relatively trivial and low cost to maintain going forward. On Tue, Oct 26, 2021 at 7:54 AM bened...@apache.org wrote: > I think it is probably acceptable to prevent downgrades once a new feature > is enabled, as th

Re: [DISCUSS] CEP-18: Improving Modularity

2021-10-26 Thread Joshua McKenzie
> > To me having some defined interfaces for interacting with different > sections of the code is a huge boon for improving developer productivity > going forward in the project. Every place where we can reduce the amount > of code reaching inside another module to get at a random internal class i

Cassandra project biweekly status update 2021-10-25

2021-10-25 Thread Joshua McKenzie
I can't believe it's been two weeks already. [New contributors getting started] As a new contributor we recommend starting in one of two places: Failing tests, or what we call "lhf" (low hanging fruit). Query for failing tests: https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=496&q

Re: [VOTE] CEP-15: General Purpose Transactions

2021-10-15 Thread Joshua McKenzie
> > The major reason is that there is not a clear path from the simple CAS > operations supported by Accord to full SQL support > We have not discussed full SQL support and I know of no existing consensus on the topic of the evolution of our developer APIs. It may be worth opening up a ML DISCUSS t

Cassandra project biweekly status update 2021-10-11

2021-10-11 Thread Joshua McKenzie
Back to Mondays. We'll be covering about a week and a half here to get ourselves back to a biweekly cadence. [New contributors getting started] As a new contributor you have a couple great options for getting started: Failing tests, and what we call "lhf" (low hanging fruit). Query for failing te

Re: [VOTE] Release dtest-api 0.0.10

2021-10-05 Thread Joshua McKenzie
+1 On Tue, Oct 5, 2021 at 2:15 PM Brandon Williams wrote: > +1 > > On Tue, Oct 5, 2021 at 11:47 AM Oleksandr Petrov > wrote: > > > > Proposing the test build of in-jvm dtest API 0.0.10 for release. > > > > Repository: > > > https://gitbox.apache.org/repos/asf?p=cassandra-in-jvm-dtest-api.git;a=

Cassandra project biweekly status update 2021-09-29

2021-09-29 Thread Joshua McKenzie
I can't help but notice these project emails have slipped a touch later in the week; I'll do my best to get us back on track on every other Monday in a week and a half. So that said, how have the past two weeks looked? [The Discussions] https://lists.apache.org/list.html?dev@cassandra.apache.org

Re: Welcome Aleksei Zotov as Cassandra committer

2021-09-21 Thread Joshua McKenzie
Congrats Aleksei! On Tue, Sep 21, 2021 at 7:51 AM Jonathan Ellis wrote: > Congratulations, Aleksei! > > On Tue, Sep 21, 2021 at 3:55 AM Benjamin Lerer wrote: > > > The PMC members are pleased to announce that Aleksei Zotov has accepted > > last Friday the invitation to become committer. > > >

Re: [DISCUSS] CASSANDRA-16922 CEP-10: Major Prerequisites (Phase 1)

2021-09-17 Thread Joshua McKenzie
> > ideally if feature development is expected to span more than a single > quarter it would be best to target phased incorporation into mainline Strong +1 here. Ariel was right. :) On Fri, Sep 17, 2021 at 4:47 PM Ekaterina Dimitrova wrote: > Gmail cut what I wrote. > > The way I read the exc

Re: Python dtest node reusage CASSANDRA-16951

2021-09-15 Thread Joshua McKenzie
We already have plenty of unit tests that have the cognitive burden of shared static state and need for idempotency / defense against order of execution. I think having another tool in our toolbox to profile long-running tests and batch them and/or share a data set makes sense. On Wed, Sep 15, 202

Cassandra project biweekly status update 2021-09-15

2021-09-15 Thread Joshua McKenzie
Hey there folks - just a smidge past time for our biweekly check-in. Cassandra 4.0.1 was released on 2021-09-07 with a critical fix for gossip in large clusters. We had some good discussion on tidying up our test failure situation on the project. We now have a clean filter showing the known test

Re: Keeping on top of test failures

2021-09-13 Thread Joshua McKenzie
ing that old after the big 4.0 push > > On 10/9/21 18:21, Joshua McKenzie wrote: > > Thanks for the feedback everyone. Drafting site changes now and I'll pull > > the trigger on JIRA probably Monday; give people the weekend to chew on > > this. > > > > If I o

Re: Defining which code changes target which release types

2021-09-13 Thread Joshua McKenzie
example I > > have put in a lot of work refactoring repair coordination and I plan to > do > > a lot more… do I support falling back to old logic or old behavior? In > > CASSANDRA-16909 I document a lot of places which are buggy and have shown > > to cause production issu

Re: Defining which code changes target which release types

2021-09-10 Thread Joshua McKenzie
r the wiki or the site or both. Thanks everyone for the feedback! ~Josh On Thu, Sep 2, 2021 at 9:57 AM Joshua McKenzie wrote: > Feature flag basically means "experimental" > > I'm thinking of feature flags more as giving the power to operators to > decide what they do

Re: Keeping on top of test failures

2021-09-10 Thread Joshua McKenzie
e la Peña > wrote: > >> +1, thanks for the proposal. > >> > >> On Thu, 9 Sept 2021 at 16:45, Brandon Williams > wrote: > >> > >>> +1 > >>> > >>> On Thu, Sep 9, 2021 at 10:39 AM Joshua McKenzie > >>> wrot

Keeping on top of test failures

2021-09-09 Thread Joshua McKenzie
(Taking #cassandra-dev slack chat to here) For context, we have a long history of an ebb and flow of flaky test failures building up and getting burned down, but don't really have a workflow or discipline around having a clean snapshot of where we are or attempting to stay at some kind of steady s

Re: [VOTE] CEP-13: Denylisting partitions

2021-09-08 Thread Joshua McKenzie
+1 On Wed, Sep 8, 2021 at 12:31 PM Sumanth Pasupuleti < sumanth.pasupuleti...@gmail.com> wrote: > Hi everyone, > > I’m proposing this CEP for approval. > > Proposal: > > https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-13%3A+Denylisting+partitions > Discussion: > > https://lists.apache.o

Re: [DISCUSS] CASSANDRA-15234

2021-09-03 Thread Joshua McKenzie
r config API. :) > I am all in for simplification and to make our users’ lives easier. But at > this point we shouldn’t be comparing the length of the files I think as the > comments were stripped only for the POC. I guess many of them will get back > in the actual doc version unfort

Re: [DISCUSS] CASSANDRA-15234

2021-09-02 Thread Joshua McKenzie
Reading through the two, the grouping approach seems like it's a lot more friendly to newcomers as well as providing context specific cues for relationships between params you're editing. Showing and not telling, if you will. Opening up a 1500+ line .yaml file is very daunting, even if most of it

Re: Defining which code changes target which release types

2021-09-02 Thread Joshua McKenzie
> > Feature flag basically means "experimental" I'm thinking of feature flags more as giving the power to operators to decide what they do and don't allow users of the database access to. Even if a feature is very stable and non-experimental, it can have negative effects on other use-cases on a sh

Re: [DISCUSS] CEP-13: Denylisting partitions

2021-09-02 Thread Joshua McKenzie
...@gmail.com> wrote: > +1. Made changes to the design document linked against the CEP to reflect > this feedback. Specifically, the following sections have been updated > * Operations to blacklist > * Blacklist information store > > Thanks, > Sumanth > > > On Fri, Au

Re: Defining which code changes target which release types

2021-09-01 Thread Joshua McKenzie
> > I would move "Deprecating functionality" to be under Minor version. Good call. I'll get this into a wiki article once we hash it out on thread here. consensus requirements were dropped after being noted for patch releases, > was that intentional? Hm. With how our project works we should prob

Re: Defining which code changes target which release types

2021-09-01 Thread Joshua McKenzie
ossible. > Furthermore, my understanding of a stable trunk is that its success will be > validated by how few patch versions we release, and how quiet our release > branches end up being. This will have the benefit that our (very limited) > reviewing capacity can focus more on trunk. And i

Re: [VOTE] Release Apache Cassandra 4.0.1

2021-09-01 Thread Joshua McKenzie
+1 On Wed, Sep 1, 2021 at 11:16 AM Yifan Cai wrote: > +1 > > > - Yifan > > > On Sep 1, 2021, at 7:57 AM, C. Scott Andreas > wrote: > > > > +1nb > > > >> On Sep 1, 2021, at 6:54 AM, Jeff Jirsa wrote: > >> > >> +1 > >> > >> > On Wed, Sep 1, 2021 at 4:54 AM Sam Tunnicliffe > wrote: > >>>

  1   2   3   4   5   >