Hi Konstantine, I just noticed that the new public DescribeConsumerGroupsResult constructor refers to the non-public API KafkaFutureImpl. If the constructor has to be public I think it should use the public KafkaFuture. TBH I don't know if we'd consider a change to the signature after 3.0 to be a compatibility break given that KafkaFutureImpl is non-public, so people shouldn't be using it. I opened https://issues.apache.org/jira/browse/KAFKA-13276 and tagged it as a 3.0 blocker, but if you disagree feel free to remove. PR to remove use a KafkaFutureImpl from all *Result class constructors available: https://github.com/apache/kafka/pull/11301
Kind regards, Tom On Fri, Sep 3, 2021 at 5:10 PM Gary Russell <gruss...@vmware.com> wrote: > This [1] is a blocker for me. > > Also, the documentation link [2] returns a 404. > > [1]: https://issues.apache.org/jira/browse/KAFKA-13262 > [2]: https://kafka.apache.org/30/documentation.html > ________________________________ > From: Ron Dagostino <rndg...@gmail.com> > Sent: Thursday, September 2, 2021 9:16 PM > To: dev@kafka.apache.org <dev@kafka.apache.org> > Cc: Users <us...@kafka.apache.org>; kafka-clients < > kafka-clie...@googlegroups.com> > Subject: [Suspected Spam] Re: [VOTE] 3.0.0 RC1 > > Hi Konstantine. I have opened a probable blocker ticket > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FKAFKA-13270&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=DmGTJeScZXxP5WoszUhdqsJodj%2FCiHuFPXhSwkedR%2BI%3D&reserved=0. > I will work on a PR > shortly. The description on that ticket is as follows: > > The implementation of > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FZOOKEEPER-3593&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=5LV9W5CWAQD%2BnnBIcRXXsLUjhN6%2BqQ8ZjSNEZOlprOg%3D&reserved=0 > in > ZooKeeper version 3.6.0 decreased the default value for the ZooKeeper > client's `jute.maxbuffer` configuration from 4MB to 1MB. This can cause a > problem if Kafka tries to retrieve a large amount of data across many > znodes – in such a case the ZooKeeper client will repeatedly emit a message > of the form "java.io.IOException: Packet len <####> is out of range" and > the Kafka broker will never connect to ZooKeeper and fail to make progress > on the startup sequence. We can avoid the potential for this issue to occur > by explicitly setting the value to 4MB whenever we create a new ZooKeeper > client as long as no explicit value has been set via the `jute.maxbuffer` > system property. > > Ron > > On Thu, Sep 2, 2021 at 5:52 PM Israel Ekpo <israele...@gmail.com> wrote: > > > Magnus, > > > > Please could you share the machine and network specs? > > > > How much CPU, RAM is available on each node? > > > > What JDK, JRE version are you using? > > > > What are your broker and client configuration values? Please could you > > share this info if possible? > > > > Thanks. > > > > > > > > On Wed, Sep 1, 2021 at 10:25 AM Magnus Edenhill <mag...@edenhill.se> > > wrote: > > > > > Hi Konstantine, > > > > > > Some findings from running 3.0.0-RC1 with the librdkafka test suite: > > > > > > * Compaction seems to take slightly longer to kick in when segment > sizes > > > exceed their threshold. (Used to take less than 20 seconds, now takes > > > 20..30 seconds.) > > > > > > * CreateTopic seems to take slightly longer to propagate through the > > > cluster, > > > e.g., before a new topic is available in metadata from other brokers. > > > > > > * CreateTopics seems to take longer when the Admin request timeout is > > set, > > > looks like a plateau at 10 seconds: > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fimgur.com%2Fa%2Fn6y76sj&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=1wARQVJ%2BycVR1GLla70EbZ9o4hPNpmey4wpGcWfzHvI%3D&reserved=0 > > > > > > (This is a 3 broker cluster with identical configs between 2.8 and > > 3.0.0.) > > > > > > Nothing critical, but could be an indication of regression so I thought > > I'd > > > mention it. > > > > > > Regards, > > > Magnus > > > > > > > > > Den tis 31 aug. 2021 kl 17:51 skrev Konstantine Karantasis < > > > kkaranta...@apache.org>: > > > > > > > Small correction to my previous email. > > > > The actual link for public preview of the 3.0.0 blog post draft is: > > > > > > > > > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblogs.apache.org%2Fpreview%2Fkafka%2F%3FpreviewEntry%3Dwhat-s-new-in-apache6&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=%2F12fmUzsupiMAZy%2FZktR56j6F7njNiUVqNMo6LG6jvQ%3D&reserved=0 > > > > > > > > (see also the email thread with title: [DISCUSS] Please review the > > 3.0.0 > > > > blog post) > > > > > > > > Best, > > > > Konstantine > > > > > > > > On Tue, Aug 31, 2021 at 6:34 PM Konstantine Karantasis < > > > > kkaranta...@apache.org> wrote: > > > > > > > > > > > > > > Hello Kafka users, developers and client-developers, > > > > > > > > > > This is the second release candidate for Apache Kafka 3.0.0. > > > > > It corresponds to a major release that includes many new features, > > > > > including: > > > > > > > > > > * The deprecation of support for Java 8 and Scala 2.12. > > > > > * Kafka Raft support for snapshots of the metadata topic and > > > > > other improvements in the self-managed quorum. > > > > > * Deprecation of message formats v0 and v1. > > > > > * Stronger delivery guarantees for the Kafka producer enabled by > > > default. > > > > > * Optimizations in OffsetFetch and FindCoordinator requests. > > > > > * More flexible Mirror Maker 2 configuration and deprecation of > > > > > Mirror Maker 1. > > > > > * Ability to restart a connector's tasks on a single call in Kafka > > > > Connect. > > > > > * Connector log contexts and connector client overrides are now > > enabled > > > > > by default. > > > > > * Enhanced semantics for timestamp synchronization in Kafka > Streams. > > > > > * Revamped public API for Stream's TaskId. > > > > > * Default serde becomes null in Kafka Streams and several > > > > > other configuration changes. > > > > > > > > > > You may read and review a more detailed list of changes in the > 3.0.0 > > > blog > > > > > post draft here: > > > > > > > > > > > > > > > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblogs.apache.org%2Froller-ui%2Fauthoring%2Fpreview%2Fkafka%2F%3FpreviewEntry%3Dwhat-s-new-in-apache6&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=2FkRhhFa25hPsFpsmmdykpBwJ8gyhjtMprYcDJdYAig%3D&reserved=0 > > > > > > > > > > Release notes for the 3.0.0 release: > > > > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhome.apache.org%2F~kkarantasis%2Fkafka-3.0.0-rc1%2FRELEASE_NOTES.html&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=cxER6I5H49zHgOlNtBTazzWynt5tiM81o6XvIrezVPo%3D&reserved=0 > > > > > > > > > > *** Please download, test and vote by Wednesday, September 8, 2021 > > *** > > > > > > > > > > Kafka's KEYS file containing PGP keys we use to sign the release: > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkafka.apache.org%2FKEYS&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=xCODs9z81Ja7zFMJgUey%2BGFce38yD9djSxkV99FxDMg%3D&reserved=0 > > > > > > > > > > * Release artifacts to be voted upon (source and binary): > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhome.apache.org%2F~kkarantasis%2Fkafka-3.0.0-rc1%2F&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=WL0A4vvZ8jT5CYopAAGCoXWB9pfaItxEPSCEptA283M%3D&reserved=0 > > > > > > > > > > * Maven artifacts to be voted upon: > > > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Fgroups%2Fstaging%2Forg%2Fapache%2Fkafka%2F&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=Lsc0Uz9GcEo9mYHp7OCj2Ii6bMGlcwsA%2BRE2esl%2FKKw%3D&reserved=0 > > > > > > > > > > * Javadoc: > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhome.apache.org%2F~kkarantasis%2Fkafka-3.0.0-rc1%2Fjavadoc%2F&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=Tfys%2Fk8rmqZ8gUaQbYvlwU5Lh69%2F4QDs%2FW3bXt4YJZY%3D&reserved=0 > > > > > > > > > > * Tag to be voted upon (off 3.0 branch) is the 3.0.0 tag: > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkafka%2Freleases%2Ftag%2F3.0.0-rc1&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=Tisu%2FNQ6EiI7tgWrhXZVfQhJqUqgPnyJtse27ZldG1o%3D&reserved=0 > > > > > > > > > > * Documentation: > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkafka.apache.org%2F30%2Fdocumentation.html&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=9qtwMRr48c2CWYbZYeODw4yenaexqfhzo7Cq8d85LFw%3D&reserved=0 > > > > > > > > > > * Protocol: > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkafka.apache.org%2F30%2Fprotocol.html&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=%2FFFwlpeIVyMIYcIulLKjRevvxfzsZu1Hp64XqYrdSBo%3D&reserved=0 > > > > > > > > > > * Successful Jenkins builds for the 3.0 branch: > > > > > Unit/integration tests: > > > > > > > > > > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fci-builds.apache.org%2Fblue%2Forganizations%2Fjenkins%2FKafka%252Fkafka%2Fdetail%2F3.0%2F121%2Fpipeline%2F&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=PCQ3NJC0HDoJ4e74qy7gMCrG4t3R%2FAZCgB%2F9YEYvnOs%3D&reserved=0 > > > > > (only few flaky failures) > > > > > System tests: > > > > > > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fjenkins.confluent.io%2Fjob%2Fsystem-test-kafka%2Fjob%2F3.0%2F57%2F&data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287415477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=G%2FIJVIpMEzaPZmUhOXKFjPz2MwSOl3BKvr2dPrtHvdk%3D&reserved=0 > > > > > > > > > > /************************************** > > > > > > > > > > Thanks, > > > > > Konstantine > > > > > > > > > > > > > > >
