Re: Measuring Release Quality

2018-09-22 Thread kurt greaves
ote: > >>> > >>>> Hi everyone, > >>>> > >>>> Now that many teams have begun testing and validating Apache Cassandra > >>>> 4.0, it’s useful to think about what “progress” looks like. While > >> metrics > >>&g

Re: Measuring Release Quality

2018-09-22 Thread Benedict Elliott Smith
t good metrics are actionable, visible, predictive, and >>>> consequent: >>>> >>>> – Actionable: We know what to do based on them – where to invest, what >> to >>>> fix, what’s fine, etc. >>>> – Visible: Everyone who has a stake in a metric has

Re: Measuring Release Quality

2018-09-22 Thread kurt greaves
> >> “consistent performance test results against build abc predict an x% > >> reduction in 99%ile read latency for this workload in prod". > >> – Consequent: We take actions based on them (e.g., not shipping if tests > >> are failing). > >> > >>

Re: Measuring Release Quality

2018-09-21 Thread Scott Andreas
t; – Consequent: We take actions based on them (e.g., not shipping if tests >> are failing). >> >> Here are some notes in Confluence toward metrics that may be useful to >> track beginning in this phase of the development + release cycle. I’m >> interested in your though

Re: Measuring Release Quality

2018-09-20 Thread Benedict Elliott Smith
he development + release cycle. I’m >> interested in your thoughts on these. They’re also copied inline for easier >> reading in your mail client. >> >> Link: >> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=93324430 >> >> Cheers, >>

Re: Measuring Release Quality

2018-09-20 Thread Joshua McKenzie
lopment + release cycle. I’m > interested in your thoughts on these. They’re also copied inline for easier > reading in your mail client. > > Link: > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=93324430 > > Cheers, > > – Scott > > –– > >

Measuring Release Quality

2018-09-19 Thread Scott Andreas
lient. Link: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=93324430 Cheers, – Scott –––––– Measuring Release Quality: [ This document is a draft + sketch of ideas. It is located in the "discussion" section of this wiki to indicate that it is an active draft –