Hi Israel, I don't think a KIP is required. We evolved our release process few times without KIPs, IIRC.
Subtasks in JIRA seem like a good place to track this right now. Regarding the specific tasks: - Most of the sample scripts and environment setup can/should be completely decoupled from the release itself. There is a release.py ( http://release.py/ ) script that generates the "community email", it can be modified to link to these instructions and scripts. - Things like documenting versions should be updated every release. We can add them to the docs and add a step to revisit before releasing new doc version to the release process wiki. Gwen Gwen Shapira Engineering Manager | Confluent 650.450.2760 | @gwenshap Follow us: Twitter | blog On Mon, Apr 13, 2020 at 2:59 PM, Israel Ekpo < israele...@gmail.com > wrote: > > Hi Everyone, > > > I have created [KAFKA-9861] as a process improvement and I have started > work on it. > https:/ / issues. apache. org/ jira/ browse/ KAFKA-9861 ( > https://issues.apache.org/jira/browse/KAFKA-9861 ) > > > I understand that KIPs are generally reserved for code improvements or > changes but I wanted to find out if something like this is better as a KIP > rather than a JIRA issue. > > > When you have a moment, please let me know and I can either submit the KIP > or add subtasks or related tasks to this current issue. > > > Thanks in advance for any feedback or guidance. > > > > On Tue, Mar 17, 2020 at 11:00 AM David Arthur < mumrah@ gmail. com ( > mum...@gmail.com ) > wrote: > > >> Thanks, Israel. I agree with Gwen, this is a great list and would be >> useful to add to our release candidate boilerplate. Since we found a >> blocker bug on RC1, I'll go ahead and close voting. RC2 will be announced >> shortly. >> >> >> -David >> >> On Tue, Mar 17, 2020 at 10:46 AM Israel Ekpo < israelekpo@ gmail. com ( >> israele...@gmail.com ) > wrote: >> >> >>> Thanks for the feedback, Gwen. I will create JIRA tasks to track the items >>> >>> shortly. >>> >>> The JIRA tasks will document the goals, expectations and relevant Kafka >>> versions for each resource. >>> >>> I will volunteer for some of them and update the JIRA tasks accordingly. >>> >>> >>> On Tue, Mar 17, 2020 at 12:51 AM Gwen Shapira < gwen@ confluent. io ( >>> g...@confluent.io ) > wrote: >>> >>> > Oh wow, I love this checklist. I don't think we'll have time to create >>> one >>> > for this release, but will be great to track this via JIRA and see if we >>> >>> > can get all those contributed before 2.6... >>> > >>> > Gwen Shapira >>> > Engineering Manager | Confluent >>> > 650.450.2760 | @gwenshap >>> > Follow us: Twitter | blog >>> > >>> > On Mon, Mar 16, 2020 at 3:02 PM, Israel Ekpo < israelekpo@ gmail. com ( >>> israele...@gmail.com ) > >>> > wrote: >>> > >>> > > >>> > > >>> > > >>> > > - Download artifacts successfully >>> > > - Verified signatures successfully >>> > > - All tests have passed so far for Scala 2.12. Have not run it on 2.13 >>> >>> > yet >>> > > >>> > > >>> > > >>> > > >>> > > +1 (non-binding) for the release >>> > > >>> > > >>> > > >>> > > I do have some feedback so I think we should include in the RC >>> > > announcement a link for how the community should test and include >>> > > information like: >>> > > >>> > > >>> > > >>> > > - How to set up test environment for unit and functional tests >>> > > - Java version(s) needed for the tests >>> > > - Scala version(s) needed for the tests >>> > > - Gradle version needed >>> > > - Sample script for running sanity checks and unit tests >>> > > - Sample Helm Charts for running all the basic components on a >>> Kubernetes >>> > > - Sample Ansible Script for running all the basic components on >>> Virtual >>> > > Machines >>> > > >>> > > >>> > > >>> > > It takes a bit of time for newcomers to investigate why the tests are >>> not >>> > > running successfully in the beginning and providing guidance for these >>> >>> > > categories of contributors will be great. If I did not know where to >>> look >>> > > (kafka-2.5.0-src/gradle/dependencies.gradle) it would take longer to >>> > > figure out why the tests are not working/running >>> > > >>> > > >>> > > >>> > > Thanks. >>> > > >>> > > >>> > > >>> > > On Thu, Mar 12, 2020 at 11:21 AM Bill Bejeck < bbejeck@ gmail. com ( >>> > > bbejeck@ gmail. com ( bbej...@gmail.com ) ) > wrote: >>> > > >>> > > >>> > >> >>> > >> >>> > >> Hi David, >>> > >> >>> > >> >>> > >> >>> > >> 1. Scanned the Javadoc, looks good >>> > >> 2. Downloaded kafka_2.12-2.5.0 and ran the quickstart and streams >>> > >> quickstart >>> > >> 3. Verified the signatures >>> > >> >>> > >> >>> > >> >>> > >> +1 (non-binding) >>> > >> >>> > >> >>> > >> >>> > >> Thanks for running the release David! >>> > >> >>> > >> >>> > >> >>> > >> -Bill >>> > >> >>> > >> >>> > >> >>> > >> On Tue, Mar 10, 2020 at 4:01 PM David Arthur < david. arthur@ >>> > confluent. io >>> > >> ( david. arthur@ confluent. io ( david.art...@confluent.io ) ) > >>> wrote: >>> > >> >>> > >> >>> > >>> >>> > >>> >>> > >>> Thanks for the test failure reports, Tom. Tracking (and fixing) >>> these >>> > is >>> > >>> important and will make future release managers have an easier time >>> :) >>> > >>> >>> > >>> >>> > >>> >>> > >>> -David >>> > >>> >>> > >>> >>> > >>> >>> > >>> On Tue, Mar 10, 2020 at 10:16 AM Tom Bentley < tbentley@ redhat. com >>> ( >>> > >>> tbentley@ redhat. com ( tbent...@redhat.com ) ) > wrote: >>> > >>> >>> > >>> >>> > >>>> >>> > >>>> >>> > >>>> Hi David, >>> > >>>> >>> > >>>> >>> > >>>> >>> > >>>> I verified signatures, built the tagged branch and ran unit and >>> > >>>> integration >>> > >>>> tests. I found some flaky tests, as follows: >>> > >>>> >>> > >>>> >>> > >>>> >>> > >>>> https:/ / issues. apache. org/ jira/ browse/ KAFKA-9691 ( >>> > >>>> https:/ / issues. apache. org/ jira/ browse/ KAFKA-9691 ( >>> https://issues.apache.org/jira/browse/KAFKA-9691 ) ) (new) https:/ / >>> > issues. >>> > >>>> apache. org/ jira/ browse/ KAFKA-9692 ( >>> > >>>> https:/ / issues. apache. org/ jira/ browse/ KAFKA-9692 ( >>> https://issues.apache.org/jira/browse/KAFKA-9692 ) ) (new) https:/ / >>> > issues. >>> > >>>> apache. org/ jira/ browse/ KAFKA-9283 ( >>> > >>>> https:/ / issues. apache. org/ jira/ browse/ KAFKA-9283 ( >>> https://issues.apache.org/jira/browse/KAFKA-9283 ) ) (already reported) >>> > >>>> >>> > >>>> >>> > >>>> >>> > >>>> Many thanks, >>> > >>>> >>> > >>>> >>> > >>>> >>> > >>>> Tom >>> > >>>> >>> > >>>> >>> > >>>> >>> > >>>> On Tue, Mar 10, 2020 at 3:28 AM David Arthur < mumrah@ gmail. com ( >>> >>> > >>>> mumrah@ gmail. com ( mum...@gmail.com ) ) > wrote: >>> > >>>> >>> > >>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> Hello Kafka users, developers and client-developers, >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> This is the second candidate for release of Apache Kafka 2.5.0. >>> The >>> > >>>>> >>> > >>>>> >>> > >>>> >>> > >>>> >>> > >>>> >>> > >>>> first >>> > >>>> >>> > >>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> release candidate included an erroneous NOTICE file, so another RC >>> >>> > was >>> > >>>>> needed to fix that. >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> This is a major release of Kafka which includes many new features, >>> >>> > >>>>> improvements, and bug fixes including: >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * TLS 1.3 support (1.2 is now the default) >>> > >>>>> * Co-groups for Kafka Streams >>> > >>>>> * Incremental rebalance for Kafka Consumer >>> > >>>>> * New metrics for better operational insight >>> > >>>>> * Upgrade Zookeeper to 3.5.7 >>> > >>>>> * Deprecate support for Scala 2.11 >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> Release notes for the 2.5.0 release: >>> > >>>>> >>> > >>>>> >>> > >>>> >>> > >>>> >>> > >>>> >>> > >>>> https:/ / home. apache. org/ ~davidarthur/ kafka-2. 5. 0-rc1/ >>> > RELEASE_NOTES. >>> > >>>> html ( >>> > >>>> >>> > https:/ / home. apache. org/ ~davidarthur/ kafka-2. 5. 0-rc1/ >>> > RELEASE_NOTES. >>> html ( >>> https://home.apache.org/~davidarthur/kafka-2.5.0-rc1/RELEASE_NOTES.html ) ) >>> >>> > >>>> >>> > >>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> *** Please download, test and vote by Monday, March 16th 2020 5pm >>> PT >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> Kafka's KEYS file containing PGP keys we use to sign the release: >>> > https:/ / >>> > >>>>> kafka. apache. org/ KEYS ( https:/ / kafka. apache. org/ KEYS ( >>> https://kafka.apache.org/KEYS ) ) >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * Release artifacts to be voted upon (source and binary): https:/ >>> / >>> > home. apache. >>> > >>>>> org/ ~davidarthur/ kafka-2. 5. 0-rc1/ ( >>> > >>>>> https:/ / home. apache. org/ ~davidarthur/ kafka-2. 5. 0-rc1/ ( >>> https://home.apache.org/~davidarthur/kafka-2.5.0-rc1/ ) ) >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * Maven artifacts to be voted upon: >>> > >>>>> https:/ / repository. apache. org/ content/ groups/ staging/ org/ >>> > apache/ kafka/ >>> > >>>>> ( >>> > https:/ / repository. apache. org/ content/ groups/ staging/ org/ apache/ >>> kafka/ ( >>> https://repository.apache.org/content/groups/staging/org/apache/kafka/ ) ) >>> >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * Javadoc: >>> > >>>>> https:/ / home. apache. org/ ~davidarthur/ kafka-2. 5. 0-rc1/ >>> > javadoc/ ( >>> > >>>>> https:/ / home. apache. org/ ~davidarthur/ kafka-2. 5. 0-rc1/ >>> > >>>>> javadoc/ >>> ( https://home.apache.org/~davidarthur/kafka-2.5.0-rc1/javadoc/ ) ) >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * Tag to be voted upon (off 2.5 branch) is the 2.5.0 tag: https:/ >>> / >>> > github. >>> > >>>>> com/ apache/ kafka/ releases/ tag/ 2. 5. 0-rc1 ( >>> > >>>>> https:/ / github. com/ apache/ kafka/ releases/ tag/ 2. 5. 0-rc1 ( >>> https://github.com/apache/kafka/releases/tag/2.5.0-rc1 ) ) >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * Documentation: >>> > >>>>> https:/ / kafka. apache. org/ 25/ documentation. html ( >>> > >>>>> https:/ / kafka. apache. org/ 25/ documentation. html ( >>> https://kafka.apache.org/25/documentation.html ) ) >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * Protocol: >>> > >>>>> https:/ / kafka. apache. org/ 25/ protocol. html ( >>> > >>>>> https:/ / kafka. apache. org/ 25/ protocol. html ( >>> https://kafka.apache.org/25/protocol.html ) ) >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> * Links to successful Jenkins builds for the 2.5 branch to follow >>> > >>>>> >>> > >>>>> >>> > >>>>> >>> > >>>>> Thanks, >>> > >>>>> David Arthur >>> > >>>>> >>> > >>>>> >>> > >>>> >>> > >>>> >>> > >>> >>> > >>> >>> > >>> >>> > >>> -- >>> > >>> -David >>> > >>> >>> > >>> >>> > >>> >>> > >>> -- >>> > >>> You received this message because you are subscribed to the Google >>> > Groups >>> > >>> "kafka-clients" group. >>> > >>> To unsubscribe from this group and stop receiving emails from it, >>> send >>> > an >>> > >>> email to kafka-clients+unsubscribe@ googlegroups. com ( >>> > >>> kafka-clients+unsubscribe@ googlegroups. com ( >>> kafka-clients%2bunsubscr...@googlegroups.com ) ). To view this discussion >>> > on >>> > >>> the web visit >>> > >>> https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAGCQu3rbtJgYBkmndKEj3DT2mUK9PfiuQP%3DiUa%2B1gZ%3D0DVVORA%40mail. >>> > >>> gmail. com ( >>> > >>> >>> > https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAGCQu3rbtJgYBkmndKEj3DT2mUK9PfiuQP%3DiUa%2B1gZ%3D0DVVORA%40mail. >>> gmail. com ( >>> https://groups.google.com/d/msgid/kafka-clients/CAGCQu3rbtJgYBkmndKEj3DT2mUK9PfiuQP%3DiUa%2B1gZ%3D0DVVORA%40mail.gmail.com >>> ) >>> > >>> ) >>> > >>> < https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAGCQu3rbtJgYBkmndKEj3DT2mUK9PfiuQP%3DiUa%2B1gZ%3D0DVVORA%40mail. >>> > >>> gmail. com?utm_medium=email&utm_source=footer ( >>> > >>> >>> > https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAGCQu3rbtJgYBkmndKEj3DT2mUK9PfiuQP%3DiUa%2B1gZ%3D0DVVORA%40mail. >>> gmail. com?utm_medium=email&utm_source=footer ( >>> https://groups.google.com/d/msgid/kafka-clients/CAGCQu3rbtJgYBkmndKEj3DT2mUK9PfiuQP%3DiUa%2B1gZ%3D0DVVORA%40mail.gmail.com?utm_medium=email&utm_source=footer >>> ) >>> > >>> ) > >>> > >>> . >>> > >>> >>> > >>> >>> > >> >>> > >> >>> > >> >>> > >> -- >>> > >> You received this message because you are subscribed to the Google >>> > Groups >>> > >> "kafka-clients" group. >>> > >> To unsubscribe from this group and stop receiving emails from it, >>> send >>> > an >>> > >> email to kafka-clients+unsubscribe@ googlegroups. com ( >>> > >> kafka-clients+unsubscribe@ googlegroups. com ( >>> kafka-clients%2bunsubscr...@googlegroups.com ) ). To view this discussion >>> > on >>> > >> the web visit >>> > >> https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAF7WS%2BpwVkaLjjTOZ_MnXOhL%3DwCsM3STkhAkKjxxcxrzpG3ybg%40mail. >>> > >> gmail. com ( >>> > >> >>> > https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAF7WS%2BpwVkaLjjTOZ_MnXOhL%3DwCsM3STkhAkKjxxcxrzpG3ybg%40mail. >>> gmail. com ( >>> https://groups.google.com/d/msgid/kafka-clients/CAF7WS%2BpwVkaLjjTOZ_MnXOhL%3DwCsM3STkhAkKjxxcxrzpG3ybg%40mail.gmail.com >>> ) >>> > >> ) >>> > >> < https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAF7WS%2BpwVkaLjjTOZ_MnXOhL%3DwCsM3STkhAkKjxxcxrzpG3ybg%40mail. >>> > >> gmail. com?utm_medium=email&utm_source=footer ( >>> > >> >>> > https:/ / groups. google. com/ d/ msgid/ kafka-clients/ >>> > CAF7WS%2BpwVkaLjjTOZ_MnXOhL%3DwCsM3STkhAkKjxxcxrzpG3ybg%40mail. >>> gmail. com?utm_medium=email&utm_source=footer ( >>> https://groups.google.com/d/msgid/kafka-clients/CAF7WS%2BpwVkaLjjTOZ_MnXOhL%3DwCsM3STkhAkKjxxcxrzpG3ybg%40mail.gmail.com?utm_medium=email&utm_source=footer >>> ) >>> > >> ) > >>> > >> . >>> > >> >>> > >> >>> > > >>> > > >>> > > >>> >> >> >> >> >> >> -- >> David Arthur >> >> >> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "kafka-clients" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to kafka-clients+unsubscribe@ googlegroups. com ( >> kafka-clients+unsubscr...@googlegroups.com ). >> To view this discussion on the web visit https:/ / groups. google. com/ d/ >> msgid/ kafka-clients/ >> CA%2B0Ze6pykE_oLf_mJOVxnaZ6hzK1UxQs4MK%2BwG3q4wmUUb8MKQ%40mail. >> gmail. com ( >> https://groups.google.com/d/msgid/kafka-clients/CA%2B0Ze6pykE_oLf_mJOVxnaZ6hzK1UxQs4MK%2BwG3q4wmUUb8MKQ%40mail.gmail.com?utm_medium=email&utm_source=footer >> ). > > >
