Hey Randall, We just discovered another regression in 2.6: https://issues.apache.org/jira/browse/KAFKA-10249
The fix is extremely straightforward -- only about two lines of actual code -- and low risk. It is a new regression introduced in 2.6 and affects all Streams apps with any suppression or other in-memory state. The PR is already ready here: https://github.com/apache/kafka/pull/8996 Best, Sophie On Wed, Jul 8, 2020 at 10:59 AM John Roesler <vvcep...@apache.org> wrote: > Hi Randall, > > While developing system tests, I've just unearthed a new 2.6 regression: > https://issues.apache.org/jira/browse/KAFKA-10247 > > I've got a PR in progress. Hoping to finish it up today: > https://github.com/apache/kafka/pull/8994 > > Sorry for the trouble, > -John > > On Mon, Jun 29, 2020, at 09:29, Randall Hauch wrote: > > Thanks for raising this, David. I agree it makes sense to include this > fix > > in 2.6, so I've adjusted the "Fix Version(s)" field to include '2.6.0'. > > > > Best regards, > > > > Randall > > > > On Mon, Jun 29, 2020 at 8:25 AM David Jacot <dja...@confluent.io> wrote: > > > > > Hi Randall, > > > > > > We have discovered an annoying issue that we introduced in 2.5: > > > > > > Describing topics with the command line tool fails if the user does not > > > have the > > > privileges to access the ListPartitionReassignments API. I believe that > > > this is the > > > case for most non-admin users. > > > > > > I propose to include the fix in 2.6. The fix is trivial so low risk. > What > > > do you think? > > > > > > JIRA: https://issues.apache.org/jira/browse/KAFKA-10212 > > > PR: https://github.com/apache/kafka/pull/8947 > > > > > > Best, > > > David > > > > > > On Sat, Jun 27, 2020 at 4:39 AM John Roesler <vvcep...@apache.org> > wrote: > > > > > > > Hi Randall, > > > > > > > > I neglected to notify this thread when I merged the fix for > > > > https://issues.apache.org/jira/browse/KAFKA-10185 > > > > on June 19th. I'm sorry about that oversight. It is marked with > > > > a fix version of 2.6.0. > > > > > > > > On a side node, I have a fix for KAFKA-10173, which I'm merging > > > > and backporting right now. > > > > > > > > Thanks for managing the release, > > > > -John > > > > > > > > On Thu, Jun 25, 2020, at 10:23, Randall Hauch wrote: > > > > > Thanks for the update, folks! > > > > > > > > > > Based upon Jira [1], we currently have 4 issues that are considered > > > > > blockers for the 2.6.0 release and production of RCs: > > > > > > > > > > - https://issues.apache.org/jira/browse/KAFKA-10134 - High CPU > > > issue > > > > > during rebalance in Kafka consumer after upgrading to 2.5 > > > (unassigned) > > > > > - https://issues.apache.org/jira/browse/KAFKA-10143 - Can no > longer > > > > > change replication throttle with reassignment tool (Jason G) > > > > > - https://issues.apache.org/jira/browse/KAFKA-10166 - Excessive > > > > > TaskCorruptedException seen in testing (Sophie, Bruno) > > > > > - https://issues.apache.org/jira/browse/KAFKA-10173 > > > > > - BufferUnderflowException during Kafka Streams Upgrade (John R) > > > > > > > > > > and one critical issue that may be a regression that at this time > will > > > > not > > > > > block production of RCs: > > > > > > > > > > - https://issues.apache.org/jira/browse/KAFKA-10017 - Flaky > Test > > > > > EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta > > > > (Matthias) > > > > > > > > > > and one build/release issue we'd like to fix if possible but will > not > > > > block > > > > > RCs or the release: > > > > > > > > > > - https://issues.apache.org/jira/browse/KAFKA-9381 > > > > > - kafka-streams-scala: Javadocs + Scaladocs not published on > maven > > > > central > > > > > (me) > > > > > > > > > > I'm working with the assignees and reporters of these issues (via > > > > comments > > > > > on the issues) to identify an ETA and to track progress. Anyone is > > > > welcome > > > > > to chime in on those issues. > > > > > > > > > > At this time, no other changes (other than PRs that only > fix/improve > > > > tests) > > > > > should be merged to the `2.6` branch. If you think you've > identified a > > > > new > > > > > blocker issue or believe another existing issue should be treated > as a > > > > > blocker for 2.6.0, please mark the issue's `fix version` as `2.6.0` > > > _and_ > > > > > respond to this thread with details, and I will work with you to > > > > determine > > > > > whether it is indeed a blocker. > > > > > > > > > > As always, let me know here if you have any questions/concerns. > > > > > > > > > > Best regards, > > > > > > > > > > Randall > > > > > > > > > > [1] > https://issues.apache.org/jira/projects/KAFKA/versions/12346918 > > > > > > > > > > On Thu, Jun 25, 2020 at 8:27 AM Mario Molina <mmoli...@gmail.com> > > > wrote: > > > > > > > > > > > Hi Randal, > > > > > > > > > > > > Ticket https://issues.apache.org/jira/browse/KAFKA-9018 is not a > > > > blocker > > > > > > so > > > > > > it can be moved to the 2.7.0 version. > > > > > > > > > > > > Mario > > > > > > > > > > > > On Wed, 24 Jun 2020 at 20:22, Boyang Chen < > > > reluctanthero...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > Hey Randal, > > > > > > > > > > > > > > There was another spotted blocker: > > > > > > > https://issues.apache.org/jira/browse/KAFKA-10173 > > > > > > > As of current, John is working on a fix. > > > > > > > > > > > > > > Boyang > > > > > > > > > > > > > > On Wed, Jun 24, 2020 at 4:08 PM Sophie Blee-Goldman < > > > > sop...@confluent.io > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > Hey all, > > > > > > > > > > > > > > > > Just a heads up that we discovered a new blocker. The fix is > > > pretty > > > > > > > > straightforward > > > > > > > > and there's already a PR for it so it should be resolved > quickly. > > > > > > > > > > > > > > > > Here's the ticket: > > > > https://issues.apache.org/jira/browse/KAFKA-10198 > > > > > > > > > > > > > > > > On Sat, May 30, 2020 at 12:52 PM Randall Hauch < > rha...@gmail.com > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > Hi, Kowshik, > > > > > > > > > > > > > > > > > > Thanks for the update on KIP-584. This is listed on the > > > > "Postponed" > > > > > > > > section > > > > > > > > > of the AK 2.6.0 release plan ( > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=152113430 > > > > > > > > > ). > > > > > > > > > > > > > > > > > > Best regards, > > > > > > > > > > > > > > > > > > Randall > > > > > > > > > > > > > > > > > > On Fri, May 29, 2020 at 4:51 PM Kowshik Prakasam < > > > > > > > kpraka...@confluent.io > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Hi Randall, > > > > > > > > > > > > > > > > > > > > We have to remove KIP-584 from the release plan, as this > item > > > > will > > > > > > > not > > > > > > > > be > > > > > > > > > > completed for 2.6 release (although KIP is accepted). We > plan > > > > to > > > > > > > > include > > > > > > > > > it > > > > > > > > > > in a next release. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Cheers, > > > > > > > > > > Kowshik > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, May 29, 2020 at 11:43 AM Maulin Vasavada < > > > > > > > > > > maulin.vasav...@gmail.com> > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > Hi Randall Hauch > > > > > > > > > > > > > > > > > > > > > > Can we add KIP-519 to 2.6? It was merged to Trunk > already > > > in > > > > > > April > > > > > > > - > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=128650952 > > > > > > > > > > > . > > > > > > > > > > > > > > > > > > > > > > Thanks > > > > > > > > > > > Maulin > > > > > > > > > > > > > > > > > > > > > > On Fri, May 29, 2020 at 11:01 AM Randall Hauch < > > > > rha...@gmail.com > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > Here's an update on the AK 2.6.0 release. > > > > > > > > > > > > > > > > > > > > > > > > Code freeze was Wednesday, and the release plan [1] > has > > > > been > > > > > > > > updated > > > > > > > > > to > > > > > > > > > > > > reflect all of the KIPs that made the release. We've > also > > > > cut > > > > > > the > > > > > > > > > `2.6` > > > > > > > > > > > > branch that we'll use for the release; see separate > email > > > > > > > > announcing > > > > > > > > > > the > > > > > > > > > > > > new branch. > > > > > > > > > > > > > > > > > > > > > > > > The next important date for the 2.6.0 release is CODE > > > > FREEZE on > > > > > > > > JUNE > > > > > > > > > > 10, > > > > > > > > > > > > and until that date all bug fixes are still welcome > on > > > the > > > > > > > release > > > > > > > > > > > branch. > > > > > > > > > > > > But after that, only blocker bugs can be merged to > the > > > > release > > > > > > > > > branch. > > > > > > > > > > > > > > > > > > > > > > > > If you have any questions or concerns, please > contact me > > > or > > > > > > > (better > > > > > > > > > > yet) > > > > > > > > > > > > reply to this thread. > > > > > > > > > > > > > > > > > > > > > > > > Thanks, and best regards! > > > > > > > > > > > > > > > > > > > > > > > > Randall > > > > > > > > > > > > > > > > > > > > > > > > [1] AK 2.6.0 Release Plan: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=152113430 > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Wed, May 27, 2020 at 5:53 PM Matthias J. Sax < > > > > > > > mj...@apache.org> > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > Thanks Randall! > > > > > > > > > > > > > > > > > > > > > > > > > > I added missing KIP-594. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > For the postponed KIP section: I removed KIP-441 > and > > > > KIP-444 > > > > > > as > > > > > > > > > both > > > > > > > > > > > are > > > > > > > > > > > > > completed. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -Matthias > > > > > > > > > > > > > > > > > > > > > > > > > > On 5/27/20 2:31 PM, Randall Hauch wrote: > > > > > > > > > > > > > > Hey everyone, just a quick update on the 2.6.0 > > > release. > > > > > > > > > > > > > > > > > > > > > > > > > > > > Based on the release plan ( > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=152113430 > > > > > > > > > > > > > ), > > > > > > > > > > > > > > today (May 27) is feature freeze. Any major > feature > > > > work > > > > > > that > > > > > > > > is > > > > > > > > > > not > > > > > > > > > > > > > > already complete will need to push out to the > next > > > > release > > > > > > > > > (either > > > > > > > > > > > 2.7 > > > > > > > > > > > > or > > > > > > > > > > > > > > 3.0). There are a few PRs for KIPs that are > nearing > > > > > > > completion, > > > > > > > > > and > > > > > > > > > > > > we're > > > > > > > > > > > > > > having some Jenkins build issues. I will send > another > > > > email > > > > > > > > later > > > > > > > > > > > today > > > > > > > > > > > > > or > > > > > > > > > > > > > > early tomorrow with an update, and I plan to cut > the > > > > > > release > > > > > > > > > branch > > > > > > > > > > > > > shortly > > > > > > > > > > > > > > thereafter. > > > > > > > > > > > > > > > > > > > > > > > > > > > > I have also updated the list of planned KIPs on > the > > > > release > > > > > > > > plan > > > > > > > > > > > page ( > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=152113430 > > > > > > > > > > > > > ), > > > > > > > > > > > > > > and I've moved to the "Postponed" table any KIP > that > > > > looks > > > > > > > like > > > > > > > > > it > > > > > > > > > > is > > > > > > > > > > > > not > > > > > > > > > > > > > > going to be complete today. If any KIP is in the > > > wrong > > > > > > table, > > > > > > > > > > please > > > > > > > > > > > > let > > > > > > > > > > > > > me > > > > > > > > > > > > > > know. > > > > > > > > > > > > > > > > > > > > > > > > > > > > If you have any questions or concerns, please > feel > > > > free to > > > > > > > > reply > > > > > > > > > to > > > > > > > > > > > > this > > > > > > > > > > > > > > thread. > > > > > > > > > > > > > > > > > > > > > > > > > > > > Thanks, and best regards! > > > > > > > > > > > > > > > > > > > > > > > > > > > > Randall > > > > > > > > > > > > > > > > > > > > > > > > > > > > On Wed, May 20, 2020 at 2:16 PM Sophie > Blee-Goldman < > > > > > > > > > > > > sop...@confluent.io > > > > > > > > > > > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > >> Hey Randall, > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> Can you also add KIP-613 which was accepted > > > yesterday? > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> Thanks! > > > > > > > > > > > > > >> Sophie > > > > > > > > > > > > > >> > > > > > > > > > > > > > >> On Wed, May 20, 2020 at 6:47 AM Randall Hauch < > > > > > > > > rha...@gmail.com > > > > > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > >> > > > > > > > > > > > > > >>> Hi, Tom. I saw last night that the KIP had > enough > > > > votes > > > > > > > > before > > > > > > > > > > > > today’s > > > > > > > > > > > > > >>> deadline and I will add it to the roadmap > today. > > > > Thanks > > > > > > for > > > > > > > > > > driving > > > > > > > > > > > > > this! > > > > > > > > > > > > > >>> > > > > > > > > > > > > > >>> On Wed, May 20, 2020 at 6:18 AM Tom Bentley < > > > > > > > > > tbent...@redhat.com > > > > > > > > > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > >>> > > > > > > > > > > > > > >>>> Hi Randall, > > > > > > > > > > > > > >>>> > > > > > > > > > > > > > >>>> Can we add KIP-585? (I'm not quite sure of the > > > > protocol > > > > > > > > here, > > > > > > > > > > but > > > > > > > > > > > > > >> thought > > > > > > > > > > > > > >>>> it better to ask than to just add it myself). > > > > > > > > > > > > > >>>> > > > > > > > > > > > > > >>>> Thanks, > > > > > > > > > > > > > >>>> > > > > > > > > > > > > > >>>> Tom > > > > > > > > > > > > > >>>> > > > > > > > > > > > > > >>>> On Tue, May 5, 2020 at 6:54 PM Randall Hauch < > > > > > > > > > rha...@apache.org > > > > > > > > > > > > > > > > > > > > > > > > >> wrote: > > > > > > > > > > > > > >>>> > > > > > > > > > > > > > >>>>> Greetings! > > > > > > > > > > > > > >>>>> > > > > > > > > > > > > > >>>>> I'd like to volunteer to be release manager > for > > > the > > > > > > next > > > > > > > > > > > time-based > > > > > > > > > > > > > >>>> feature > > > > > > > > > > > > > >>>>> release which will be 2.6.0. I've published a > > > > release > > > > > > > plan > > > > > > > > at > > > > > > > > > > > > > >>>>> > > > > > > > > > > > > > >>>> > > > > > > > > > > > > > >>> > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=152113430 > > > > > > > > > > > > > >>>>> , > > > > > > > > > > > > > >>>>> and have included all of the KIPs that are > > > > currently > > > > > > > > approved > > > > > > > > > > or > > > > > > > > > > > > > >>> actively > > > > > > > > > > > > > >>>>> in discussion (though I'm happy to adjust as > > > > > > necessary). > > > > > > > > > > > > > >>>>> > > > > > > > > > > > > > >>>>> To stay on our time-based cadence, the KIP > freeze > > > > is on > > > > > > > May > > > > > > > > > 20 > > > > > > > > > > > > with a > > > > > > > > > > > > > >>>>> target release date of June 24. > > > > > > > > > > > > > >>>>> > > > > > > > > > > > > > >>>>> Let me know if there are any objections. > > > > > > > > > > > > > >>>>> > > > > > > > > > > > > > >>>>> Thanks, > > > > > > > > > > > > > >>>>> Randall Hauch > > > > > > > > > > > > > >>>>> > > > > > > > > > > > > > >>>> > > > > > > > > > > > > > >>> > > > > > > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >