Hi David, Thanks for discovering the issue reported in KAFKA-13266. I'm tentatively approving it if we can review the PR this week, since we are going to have a new RC due to KAFKA-13270 anyways. This is not a change of a few lines of code though and while most of it seems to be shuffling around existing code and has additional test coverage, would you mind commenting on the risk of this change at this point? I'll be checking the PR reviews as well. Again, for now, this is approved for 3.0.0 unless we decide otherwise this week.
Konstantine On Fri, Sep 3, 2021 at 3:45 PM David Jacot <dja...@confluent.io.invalid> wrote: > Hi Konstantine, > > I'd like to raise a potential blocker: > https://issues.apache.org/jira/browse/KAFKA-13266. > > When this bug is hit, the partition remains failed until the broker is > restated or > the partition is updated (e.g. its epoch is bumped). It only affects the > KRaft mode. > > The PR is ready: https://issues.apache.org/jira/browse/KAFKA-13266. > > Best, > David > > On Fri, Sep 3, 2021 at 3:17 AM Ron Dagostino <rndg...@gmail.com> wrote: > > > Hi Konstantine. I have opened a probable blocker ticket > > https://issues.apache.org/jira/browse/KAFKA-13270. I will work on a PR > > shortly. The description on that ticket is as follows: > > > > The implementation of > https://issues.apache.org/jira/browse/ZOOKEEPER-3593 > > in > > ZooKeeper version 3.6.0 decreased the default value for the ZooKeeper > > client's `jute.maxbuffer` configuration from 4MB to 1MB. This can cause a > > problem if Kafka tries to retrieve a large amount of data across many > > znodes – in such a case the ZooKeeper client will repeatedly emit a > message > > of the form "java.io.IOException: Packet len <####> is out of range" and > > the Kafka broker will never connect to ZooKeeper and fail to make > progress > > on the startup sequence. We can avoid the potential for this issue to > occur > > by explicitly setting the value to 4MB whenever we create a new ZooKeeper > > client as long as no explicit value has been set via the `jute.maxbuffer` > > system property. > > > > Ron > > > > On Thu, Sep 2, 2021 at 5:52 PM Israel Ekpo <israele...@gmail.com> wrote: > > > > > Magnus, > > > > > > Please could you share the machine and network specs? > > > > > > How much CPU, RAM is available on each node? > > > > > > What JDK, JRE version are you using? > > > > > > What are your broker and client configuration values? Please could you > > > share this info if possible? > > > > > > Thanks. > > > > > > > > > > > > On Wed, Sep 1, 2021 at 10:25 AM Magnus Edenhill <mag...@edenhill.se> > > > wrote: > > > > > > > Hi Konstantine, > > > > > > > > Some findings from running 3.0.0-RC1 with the librdkafka test suite: > > > > > > > > * Compaction seems to take slightly longer to kick in when segment > > sizes > > > > exceed their threshold. (Used to take less than 20 seconds, now > takes > > > > 20..30 seconds.) > > > > > > > > * CreateTopic seems to take slightly longer to propagate through the > > > > cluster, > > > > e.g., before a new topic is available in metadata from other > brokers. > > > > > > > > * CreateTopics seems to take longer when the Admin request timeout is > > > set, > > > > looks like a plateau at 10 seconds: > > > > https://imgur.com/a/n6y76sj > > > > > > > > (This is a 3 broker cluster with identical configs between 2.8 and > > > 3.0.0.) > > > > > > > > Nothing critical, but could be an indication of regression so I > thought > > > I'd > > > > mention it. > > > > > > > > Regards, > > > > Magnus > > > > > > > > > > > > Den tis 31 aug. 2021 kl 17:51 skrev Konstantine Karantasis < > > > > kkaranta...@apache.org>: > > > > > > > > > Small correction to my previous email. > > > > > The actual link for public preview of the 3.0.0 blog post draft is: > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache6 > > > > > > > > > > (see also the email thread with title: [DISCUSS] Please review the > > > 3.0.0 > > > > > blog post) > > > > > > > > > > Best, > > > > > Konstantine > > > > > > > > > > On Tue, Aug 31, 2021 at 6:34 PM Konstantine Karantasis < > > > > > kkaranta...@apache.org> wrote: > > > > > > > > > > > > > > > > > Hello Kafka users, developers and client-developers, > > > > > > > > > > > > This is the second release candidate for Apache Kafka 3.0.0. > > > > > > It corresponds to a major release that includes many new > features, > > > > > > including: > > > > > > > > > > > > * The deprecation of support for Java 8 and Scala 2.12. > > > > > > * Kafka Raft support for snapshots of the metadata topic and > > > > > > other improvements in the self-managed quorum. > > > > > > * Deprecation of message formats v0 and v1. > > > > > > * Stronger delivery guarantees for the Kafka producer enabled by > > > > default. > > > > > > * Optimizations in OffsetFetch and FindCoordinator requests. > > > > > > * More flexible Mirror Maker 2 configuration and deprecation of > > > > > > Mirror Maker 1. > > > > > > * Ability to restart a connector's tasks on a single call in > Kafka > > > > > Connect. > > > > > > * Connector log contexts and connector client overrides are now > > > enabled > > > > > > by default. > > > > > > * Enhanced semantics for timestamp synchronization in Kafka > > Streams. > > > > > > * Revamped public API for Stream's TaskId. > > > > > > * Default serde becomes null in Kafka Streams and several > > > > > > other configuration changes. > > > > > > > > > > > > You may read and review a more detailed list of changes in the > > 3.0.0 > > > > blog > > > > > > post draft here: > > > > > > > > > > > > > > > > > > > > > > > > > > > https://blogs.apache.org/roller-ui/authoring/preview/kafka/?previewEntry=what-s-new-in-apache6 > > > > > > > > > > > > Release notes for the 3.0.0 release: > > > > > > > > > > > > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc1/RELEASE_NOTES.html > > > > > > > > > > > > *** Please download, test and vote by Wednesday, September 8, > 2021 > > > *** > > > > > > > > > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > > > > > https://kafka.apache.org/KEYS > > > > > > > > > > > > * Release artifacts to be voted upon (source and binary): > > > > > > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc1/ > > > > > > > > > > > > * Maven artifacts to be voted upon: > > > > > > > > > https://repository.apache.org/content/groups/staging/org/apache/kafka/ > > > > > > > > > > > > * Javadoc: > > > > > > https://home.apache.org/~kkarantasis/kafka-3.0.0-rc1/javadoc/ > > > > > > > > > > > > * Tag to be voted upon (off 3.0 branch) is the 3.0.0 tag: > > > > > > https://github.com/apache/kafka/releases/tag/3.0.0-rc1 > > > > > > > > > > > > * Documentation: > > > > > > https://kafka.apache.org/30/documentation.html > > > > > > > > > > > > * Protocol: > > > > > > https://kafka.apache.org/30/protocol.html > > > > > > > > > > > > * Successful Jenkins builds for the 3.0 branch: > > > > > > Unit/integration tests: > > > > > > > > > > > > > > > > > > > > > https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka/detail/3.0/121/pipeline/ > > > > > > (only few flaky failures) > > > > > > System tests: > > > > > > https://jenkins.confluent.io/job/system-test-kafka/job/3.0/57/ > > > > > > > > > > > > /************************************** > > > > > > > > > > > > Thanks, > > > > > > Konstantine > > > > > > > > > > > > > > > > > > > > >
