[VOTE] 3.4.1 RC3

[Luke Chen]

Hello Kafka users, developers and client-developers,

This is the 4th candidate for release of Apache Kafka 3.4.1.

This is a bugfix release with several fixes since the release of 3.4.0. A
few of the major issues include:
- core
KAFKA-14644  Process
should stop after failure in raft IO thread
KAFKA-14946  KRaft
controller node shutting down while renouncing leadership
KAFKA-14887  ZK session
timeout can cause broker to shutdown
- client
KAFKA-14639  Kafka
CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle
- connect
KAFKA-12558  MM2 may not
sync partition offsets correctly
KAFKA-14666  MM2 should
translate consumer group offsets behind replication flow
- stream
KAFKA-14172  bug: State
stores lose state when tasks are reassigned under EOS


Release notes for the 3.4.1 release:
https://home.apache.org/~showuon/kafka-3.4.1-rc3/RELEASE_NOTES.html

*** Please download, test and vote by Jun 2, 2023

Kafka's KEYS file containing PGP keys we use to sign the release:
https://kafka.apache.org/KEYS

* Release artifacts to be voted upon (source and binary):
https://home.apache.org/~showuon/kafka-3.4.1-rc3/

* Maven artifacts to be voted upon:
https://repository.apache.org/content/groups/staging/org/apache/kafka/

* Javadoc:
https://home.apache.org/~showuon/kafka-3.4.1-rc3/javadoc/

* Tag to be voted upon (off 3.4 branch) is the 3.4.1 tag:
https://github.com/apache/kafka/releases/tag/3.4.1-rc3

* Documentation: (will be updated after released)
https://kafka.apache.org/34/documentation.html

* Protocol: (will be updated after released)
https://kafka.apache.org/34/protocol.html

The most recent build has had test failures. These all appear to be due to
flakiness, but it would be nice if someone more familiar with the failed
tests could confirm this. I may update this thread with passing build links
if I can get one, or start a new release vote thread if test failures must
be addressed beyond re-running builds until they pass.

Unit/integration tests:
https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/141/

System tests:
Will update the results later

Thank you
Luke

Re: [VOTE] 3.4.1 RC3

[Josep Prat]

Hi Luke,

Thanks again for running this!

I ran the following validation steps:
- Built from source with Java 11 and Scala 2.13
- Signatures and hashes of the artifacts generated
- Navigated through Javadoc including links to JDK classes
- Run the unit tests
- Run integration tests
- Run the quickstart in KRaft and Zookeeper mode
-- For KRaft, I looked at the process running Kafka and confirmed that the
spamming log message is not present anymore ("Generated a metadata delta
between...")
- Checked that the diff in LICENSE-binary is identical than previous RC
-- For each difference of the previous one I checked the binary on the
scala 2.13 package had the version specified in the file

This gets a +1 from me.

Best

On Fri, May 26, 2023 at 9:33 AM Luke Chen  wrote:

> Hello Kafka users, developers and client-developers,
>
> This is the 4th candidate for release of Apache Kafka 3.4.1.
>
> This is a bugfix release with several fixes since the release of 3.4.0. A
> few of the major issues include:
> - core
> KAFKA-14644  Process
> should stop after failure in raft IO thread
> KAFKA-14946  KRaft
> controller node shutting down while renouncing leadership
> KAFKA-14887  ZK session
> timeout can cause broker to shutdown
> - client
> KAFKA-14639  Kafka
> CooperativeStickyAssignor revokes/assigns partition in one rebalance cycle
> - connect
> KAFKA-12558  MM2 may
> not
> sync partition offsets correctly
> KAFKA-14666  MM2 should
> translate consumer group offsets behind replication flow
> - stream
> KAFKA-14172  bug: State
> stores lose state when tasks are reassigned under EOS
>
>
> Release notes for the 3.4.1 release:
> https://home.apache.org/~showuon/kafka-3.4.1-rc3/RELEASE_NOTES.html
>
> *** Please download, test and vote by Jun 2, 2023
>
> Kafka's KEYS file containing PGP keys we use to sign the release:
> https://kafka.apache.org/KEYS
>
> * Release artifacts to be voted upon (source and binary):
> https://home.apache.org/~showuon/kafka-3.4.1-rc3/
>
> * Maven artifacts to be voted upon:
> https://repository.apache.org/content/groups/staging/org/apache/kafka/
>
> * Javadoc:
> https://home.apache.org/~showuon/kafka-3.4.1-rc3/javadoc/
>
> * Tag to be voted upon (off 3.4 branch) is the 3.4.1 tag:
> https://github.com/apache/kafka/releases/tag/3.4.1-rc3
>
> * Documentation: (will be updated after released)
> https://kafka.apache.org/34/documentation.html
>
> * Protocol: (will be updated after released)
> https://kafka.apache.org/34/protocol.html
>
> The most recent build has had test failures. These all appear to be due to
> flakiness, but it would be nice if someone more familiar with the failed
> tests could confirm this. I may update this thread with passing build links
> if I can get one, or start a new release vote thread if test failures must
> be addressed beyond re-running builds until they pass.
>
> Unit/integration tests:
> https://ci-builds.apache.org/job/Kafka/job/kafka/job/3.4/141/
>
> System tests:
> Will update the results later
>
> Thank you
> Luke
>


-- 
[image: Aiven] 

*Josep Prat*
Open Source Engineering Director, *Aiven*
josep.p...@aiven.io   |   +491715557497
aiven.io    |   
     
*Aiven Deutschland GmbH*
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1871

[Apache Jenkins Server]

See 

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1872

[Apache Jenkins Server]

See 

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.5 #7

[Apache Jenkins Server]

See 

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1873

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 569642 lines...]
[2023-05-26T22:45:06.207Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldProcessDataFromStoresWithLoggingDisabled(boolean) > [2] false PASSED
[2023-05-26T22:45:06.207Z] 
[2023-05-26T22:45:06.207Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > shouldRestoreNullRecord() STARTED
[2023-05-26T22:45:38.311Z] 
[2023-05-26T22:45:38.311Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 180 > RestoreIntegrationTest > 
shouldRecycleStateFromStandbyTaskPromotedToActiveTaskAndNotRestore(boolean) > 
[2] false PASSED
[2023-05-26T22:45:38.311Z] 
[2023-05-26T22:45:38.311Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 180 > RestoreIntegrationTest > 
shouldProcessDataFromStoresWithLoggingDisabled(boolean) > [1] true STARTED
[2023-05-26T22:45:38.311Z] 
[2023-05-26T22:45:38.311Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 180 > RestoreIntegrationTest > 
shouldProcessDataFromStoresWithLoggingDisabled(boolean) > [1] true PASSED
[2023-05-26T22:45:38.311Z] 
[2023-05-26T22:45:38.311Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 180 > RestoreIntegrationTest > 
shouldProcessDataFromStoresWithLoggingDisabled(boolean) > [2] false STARTED
[2023-05-26T22:45:39.261Z] 
[2023-05-26T22:45:39.261Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 180 > RestoreIntegrationTest > 
shouldProcessDataFromStoresWithLoggingDisabled(boolean) > [2] false PASSED
[2023-05-26T22:45:39.261Z] 
[2023-05-26T22:45:39.261Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 180 > RestoreIntegrationTest > shouldRestoreNullRecord() STARTED
[2023-05-26T22:45:56.139Z] 
[2023-05-26T22:45:56.139Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > shouldRestoreNullRecord() PASSED
[2023-05-26T22:45:56.139Z] 
[2023-05-26T22:45:56.139Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromSourceTopic(boolean) > [1] true STARTED
[2023-05-26T22:45:56.139Z] 
[2023-05-26T22:45:56.139Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromSourceTopic(boolean) > [1] true PASSED
[2023-05-26T22:45:56.139Z] 
[2023-05-26T22:45:56.139Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromSourceTopic(boolean) > [2] false STARTED
[2023-05-26T22:45:57.915Z] 
[2023-05-26T22:45:57.915Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromSourceTopic(boolean) > [2] false PASSED
[2023-05-26T22:45:57.915Z] 
[2023-05-26T22:45:57.915Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldSuccessfullyStartWhenLoggingDisabled(boolean) > [1] true STARTED
[2023-05-26T22:46:00.036Z] 
[2023-05-26T22:46:00.036Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldSuccessfullyStartWhenLoggingDisabled(boolean) > [1] true PASSED
[2023-05-26T22:46:00.036Z] 
[2023-05-26T22:46:00.036Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldSuccessfullyStartWhenLoggingDisabled(boolean) > [2] false STARTED
[2023-05-26T22:46:01.983Z] 
[2023-05-26T22:46:01.983Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldSuccessfullyStartWhenLoggingDisabled(boolean) > [2] false PASSED
[2023-05-26T22:46:01.983Z] 
[2023-05-26T22:46:01.983Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromChangelogTopic(boolean) > [1] true STARTED
[2023-05-26T22:46:05.088Z] 
[2023-05-26T22:46:05.088Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromChangelogTopic(boolean) > [1] true PASSED
[2023-05-26T22:46:05.088Z] 
[2023-05-26T22:46:05.088Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromChangelogTopic(boolean) > [2] false STARTED
[2023-05-26T22:46:07.984Z] 
[2023-05-26T22:46:07.984Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > RestoreIntegrationTest > 
shouldRestoreStateFromChangelogTopic(boolean) > [2] false PASSED
[2023-05-26T22:46:12.737Z] 
[2023-05-26T22:46:12.737Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 179 > SmokeTestDriverIntegrationTest > 
shouldWorkWithRebalance(boolean) > [1] true STARTED
[2023-05-26T22:46:30.191Z] 
[2023-05-26T22:46:30.191Z] Gradle Test Run :streams:integrat

[jira] [Created] (KAFKA-15030) Add connect-plugin-path command line tool

[Greg Harris (Jira)]

Greg Harris created KAFKA-15030:
---

 Summary: Add connect-plugin-path command line tool
 Key: KAFKA-15030
 URL: https://issues.apache.org/jira/browse/KAFKA-15030
 Project: Kafka
  Issue Type: New Feature
  Components: KafkaConnect, tools
Reporter: Greg Harris
Assignee: Greg Harris


Add the connect-plugin-path command line script as described in KIP-898



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.5 #8

[Apache Jenkins Server]

See 

[jira] [Created] (KAFKA-15031) Add plugin.discovery worker configuration

[Greg Harris (Jira)]

Greg Harris created KAFKA-15031:
---

 Summary: Add plugin.discovery worker configuration
 Key: KAFKA-15031
 URL: https://issues.apache.org/jira/browse/KAFKA-15031
 Project: Kafka
  Issue Type: New Feature
  Components: KafkaConnect
Reporter: Greg Harris
Assignee: Greg Harris


Add the worker configuration plugin.discovery as described in KIP-898.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1874

[Apache Jenkins Server]

See