[jira] [Resolved] (KAFKA-18442) Downgrades to 3.3.2 will fail from versions 3.6.0 and above when JBOD is enabled

2025-01-29 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-18442. -- Resolution: Won't Fix So firstly, this is a real bug, which we cannot fix since 3.3

Re: [DISCUSS] Apache Kafka 4.0.0 release

2025-01-27 Thread Colin McCabe
Just as an update, we found a new blocker related to ELR, and the PR to fix it is under review. https://issues.apache.org/jira/browse/KAFKA-18649 best, Colin On Mon, Jan 27, 2025, at 10:08, Greg Harris wrote: > Hi all, > > I just backported > https://issues.apache.org/jira/pr

Re: [DISCUSS] Apache Kafka 4.0.0 release

2025-01-23 Thread Colin McCabe
P-890 and KIP-1075 in Apache Kafka 4.0? If so, we will need to mark IBP_4_0_IV2 and IBP_4_0_IV3 as stable metadata versions. If not, of course, we should bump those metadata versions to 4.1. best, Colin On Mon, Jan 20, 2025, at 03:55, David Jacot wrote: > Hi all, > > We are now past t

[jira] [Created] (KAFKA-18635) Re-enable the unclean shutdown detection when in ELR mode

2025-01-23 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18635: Summary: Re-enable the unclean shutdown detection when in ELR mode Key: KAFKA-18635 URL: https://issues.apache.org/jira/browse/KAFKA-18635 Project: Kafka

[jira] [Created] (KAFKA-18634) Fix ELR metadata version issues

2025-01-23 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18634: Summary: Fix ELR metadata version issues Key: KAFKA-18634 URL: https://issues.apache.org/jira/browse/KAFKA-18634 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-17972) Default all JUnit tests to KRaft

2025-01-15 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17972. -- Resolution: Fixed All tests are now KRaft > Default all JUnit tests to KR

[jira] [Created] (KAFKA-18459) Use ZooKeeper 3.4 in ducktape in order to support AK 2.1

2025-01-09 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18459: Summary: Use ZooKeeper 3.4 in ducktape in order to support AK 2.1 Key: KAFKA-18459 URL: https://issues.apache.org/jira/browse/KAFKA-18459 Project: Kafka

Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-12-10 Thread Colin McCabe
reVote field) by feature freeze > Part 2 <https://github.com/ahuang98/kafka/pull/2> (new internal Prospective > QuorumState and response handling) by code freeze > > Best, > Alyssa > +1 frorm me. What do you think David? Colin > > On Fri, Dec 6, 2024 at 1:51 AM Andrew

[jira] [Resolved] (KAFKA-18106) Brokers should be removed from the ISR if possible on unclean restart

2024-12-09 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-18106. -- Resolution: Fixed > Brokers should be removed from the ISR if possible on unclean rest

[jira] [Resolved] (KAFKA-18001) KafkaNetworkChannel missing UpdateRaftVoterRequestData logic

2024-12-03 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-18001. -- Assignee: Alyssa Huang Resolution: Fixed > KafkaNetworkChannel miss

[jira] [Created] (KAFKA-18147) kraft version of standalone controller should be 1 not 0

2024-12-03 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18147: Summary: kraft version of standalone controller should be 1 not 0 Key: KAFKA-18147 URL: https://issues.apache.org/jira/browse/KAFKA-18147 Project: Kafka

[jira] [Created] (KAFKA-18146) tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft

2024-12-03 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18146: Summary: tests/kafkatest/tests/core/upgrade_test.py needs to be re-added as KRaft Key: KAFKA-18146 URL: https://issues.apache.org/jira/browse/KAFKA-18146 Project

[jira] [Created] (KAFKA-18138) The controller must add all extant brokers to BrokerHeartbeatTracker when activating

2024-12-02 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18138: Summary: The controller must add all extant brokers to BrokerHeartbeatTracker when activating Key: KAFKA-18138 URL: https://issues.apache.org/jira/browse/KAFKA-18138

[jira] [Created] (KAFKA-18108) De-flake DynamicBrokerReconfigurationTest.testUncleanLeaderElectionEnable

2024-11-27 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18108: Summary: De-flake DynamicBrokerReconfigurationTest.testUncleanLeaderElectionEnable Key: KAFKA-18108 URL: https://issues.apache.org/jira/browse/KAFKA-18108 Project

[jira] [Created] (KAFKA-18106) Brokers should be removed from the ISR if possible on unclean restart

2024-11-27 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18106: Summary: Brokers should be removed from the ISR if possible on unclean restart Key: KAFKA-18106 URL: https://issues.apache.org/jira/browse/KAFKA-18106 Project: Kafka

[jira] [Resolved] (KAFKA-18051) Disallow creating ACLs with principals that do not contain a colon

2024-11-22 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-18051. -- Resolution: Fixed > Disallow creating ACLs with principals that do not contain a co

[jira] [Created] (KAFKA-18070) Update kafka-metadata-quorum.sh output in docs to match post-KIP-853 appearance

2024-11-22 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18070: Summary: Update kafka-metadata-quorum.sh output in docs to match post-KIP-853 appearance Key: KAFKA-18070 URL: https://issues.apache.org/jira/browse/KAFKA-18070

[jira] [Resolved] (KAFKA-18063) SnapshotRegistry should not leak memory

2024-11-21 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-18063. -- Resolution: Fixed > SnapshotRegistry should not leak mem

[jira] [Created] (KAFKA-18063) SnapshotRegistry should not leak memory

2024-11-21 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18063: Summary: SnapshotRegistry should not leak memory Key: KAFKA-18063 URL: https://issues.apache.org/jira/browse/KAFKA-18063 Project: Kafka Issue Type: Bug

Re: [ANNOUNCE] Apache Kafka 3.9.0

2024-11-20 Thread Colin McCabe
, yes, all subsequent 3.9 fixes should be 3.9.1. best, Colin On Thu, Nov 14, 2024, at 03:00, Chia-Ping Tsai wrote: > hi Divij > > Nice find. I've updated the fix version to 3.9.1, and I'll test it on the > trunk and 3.9 branch tomorrow. > > Best, > Chia-Ping &g

Re: [VOTE] KIP-1081: Graduation Steps for KIPs

2024-11-20 Thread Colin McCabe
something, and pre-production is the last chance for that. best, Colin On Sun, Nov 10, 2024, at 03:02, Josep Prat wrote: > Hi Ismael, > > Having levels instead of names helped us discuss the content of each level > without entering the bike shedding of what name is better. > Le

[jira] [Created] (KAFKA-18051) Disallow creating ACLs with principals that do not contain a colon

2024-11-20 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-18051: Summary: Disallow creating ACLs with principals that do not contain a colon Key: KAFKA-18051 URL: https://issues.apache.org/jira/browse/KAFKA-18051 Project: Kafka

[jira] [Resolved] (KAFKA-16657) KIP-848 does not work well on Zookeeper Mode

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-16657. -- Resolution: Won't Fix ZK mode is deprecated and will be removed in the upcoming 4.0 re

[jira] [Resolved] (KAFKA-14327) Unify KRaft snapshot generation between broker and controller

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14327. -- Fix Version/s: 3.4.0 Resolution: Fixed > Unify KRaft snapshot generation betw

[jira] [Created] (KAFKA-17987) Remove assorted ZK-related files

2024-11-11 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17987: Summary: Remove assorted ZK-related files Key: KAFKA-17987 URL: https://issues.apache.org/jira/browse/KAFKA-17987 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-12733) KRaft: always bump leader epoch when changing the ISR for a controlled shutdown

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12733. -- Resolution: Won't Fix > KRaft: always bump leader epoch when changing the I

[jira] [Resolved] (KAFKA-13083) In KRaft mode, ISR is set incorrectly when creating a manual partition assignment with fenced broker(s)

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13083. -- Fix Version/s: 3.0.0 Resolution: Fixed > In KRaft mode, ISR is set incorrectly w

[jira] [Resolved] (KAFKA-12886) Enable request forwarding by default

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12886. -- Resolution: Won't Fix At this point we won't be changing the behavior of ZK mode.

[jira] [Resolved] (KAFKA-9837) New RPC for notifying controller of failed replica

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-9837. - Fix Version/s: 3.7.0 Resolution: Fixed > New RPC for notifying controller of fai

[jira] [Resolved] (KAFKA-15430) Kafla create replca partition on controller node

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15430. -- Resolution: Invalid Replicas aren't created "on the controller." However, the

[jira] [Resolved] (KAFKA-13502) Support configuring BROKER_LOGGER on controller-only KRaft nodes

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13502. -- Fix Version/s: 3.7.0 Assignee: Colin McCabe Resolution: Fixed KIP-919 made it

[jira] [Resolved] (KAFKA-14290) Fix bugs that could block KRaft controlled shutdown indefinitely

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14290. -- Resolution: Fixed > Fix bugs that could block KRaft controlled shutdown indefinit

[jira] [Resolved] (KAFKA-13841) Fix a case where we were unable to place on fenced brokers In KRaft mode

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13841. -- Fix Version/s: 3.3.0 Assignee: Colin McCabe Resolution: Fixed > Fix a c

[jira] [Resolved] (KAFKA-13515) Fix KRaft config validation issues

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13515. -- Fix Version/s: 3.2.0 Assignee: Colin McCabe Resolution: Fixed > Fix KR

[jira] [Resolved] (KAFKA-13245) KIP 771: Change behavior of how controller metrics are exposed when using KRaft.

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13245. -- Resolution: Won't Fix We decided to have standby KRaft controllers expose their me

Re: [VOTE] KIP-866 ZooKeeper to KRaft Migration

2024-11-11 Thread Colin McCabe
Hi all, I was doing some JIRA cleanup and noticed someone commenting about the language in KIP-866 referencing an offline KRaft -> ZK conversion tool. Since we never ended up implementing this, I have removed it from the KIP. best, Colin On Wed, Nov 30, 2022, at 12:27, David Arthur wr

[jira] [Resolved] (KAFKA-15509) KRaft Controller doesn't consider brokers that are shutting down during topic creating

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15509. -- Resolution: Duplicate > KRaft Controller doesn't consider brokers that are shutt

[jira] [Resolved] (KAFKA-13142) KRaft brokers do not validate dynamic configs before forwarding them to controller

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13142. -- Fix Version/s: 3.2.0 Resolution: Fixed This was fixed in Kafka 3.2 > KRaft brokers

[jira] [Resolved] (KAFKA-15861) In Kraft mode, "ssl.keystore.key" private keys are accesible to all the controllers and brokers

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15861. -- Resolution: Won't Fix If you want to distributed keys separately, consider using a key

[jira] [Resolved] (KAFKA-12806) KRaft: Confusing leadership status exposed in metrics for controller without quorum

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-12806. -- Fix Version/s: 3.0.0 Resolution: Fixed I think this was one of many metrics bugs we

[jira] [Resolved] (KAFKA-13835) Fix two bugs related to dynamic broker configs in KRaft

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13835. -- Fix Version/s: 3.2.0 Resolution: Fixed This was merged a long time ago, in Kafka 3.2

[jira] [Resolved] (KAFKA-14313) Kraft: immediately producing to new topics occasionally returns NOT_LEADER_FOR_PARTITION

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14313. -- Resolution: Won't Fix This isn't a bug. It results from metadata propagation d

[jira] [Resolved] (KAFKA-14312) Kraft + ProducerStateManager: produce requests to new partitions with a non-zero sequence number should be rejected

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14312. -- Resolution: Won't Fix Based on the discussion, this behavior isn't unique to KRaft,

[jira] [Resolved] (KAFKA-14129) KRaft must check manual assignments for createTopics are contiguous

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14129. -- Fix Version/s: 3.3.0 Resolution: Fixed This was implemented in Kafka 3.3 > KRaft m

[jira] [Resolved] (KAFKA-16370) offline rollback procedure from kraft mode to zookeeper mode.

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-16370. -- Resolution: Won't Fix I don't think there are any plans to implement offlin

[jira] [Resolved] (KAFKA-14057) Support dynamic reconfiguration in KRaft remote controllers

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14057. -- Fix Version/s: 3.5.0 Resolution: Fixed This was fixed a long time ago, starting in 3.5

[jira] [Resolved] (KAFKA-14182) KRaft and ACL + GSSAPI

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14182. -- Resolution: Fixed This was fixed a long time ago, probably in 3.2 > KRaft and ACL + GSS

[jira] [Resolved] (KAFKA-14538) Implement KRaft metadata transactions

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14538. -- Fix Version/s: 3.7.0 Resolution: Fixed > Implement KRaft metadata transacti

[jira] [Resolved] (KAFKA-13827) Data Loss on moving to KRAFT mode from v3.1

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13827. -- Fix Version/s: 3.0.0 Resolution: Won't Fix This related to the kraft support i

[jira] [Resolved] (KAFKA-15749) KRaft support in KafkaMetricReporterClusterIdTest

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-15749. -- Resolution: Not A Problem > KRaft support in KafkaMetricReporterClusterIdT

[jira] [Resolved] (KAFKA-14077) KRaft should support recovery from failed disk

2024-11-11 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14077. -- Fix Version/s: 3.9.0 Resolution: Fixed KIP-853 shipped in Apache Kafka 3.9 > KR

[jira] [Created] (KAFKA-17986) Fix ConsumerRebootstrapTest and ProducerRebootstrapTest

2024-11-11 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17986: Summary: Fix ConsumerRebootstrapTest and ProducerRebootstrapTest Key: KAFKA-17986 URL: https://issues.apache.org/jira/browse/KAFKA-17986 Project: Kafka

[jira] [Created] (KAFKA-17972) Annotate all tests that still require ZK

2024-11-08 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17972: Summary: Annotate all tests that still require ZK Key: KAFKA-17972 URL: https://issues.apache.org/jira/browse/KAFKA-17972 Project: Kafka Issue Type: Sub

Re: [VOTE] KIP-1081: Graduation Steps for KIPs

2024-11-07 Thread Colin McCabe
h regard to "preview", I think "use in production: maybe" doesn't give very clear guidance. Is it better to just say no or "not recommended"? Or someone otherwise indicate that preview is mostly about testing the feature. best, Colin On Wed, Nov 6, 2024, at 02:

Re: [DISCUSS] Require KIPs to include "How to teach this section"

2024-11-07 Thread Colin McCabe
Yeah, I agree, we should unify these! I'm not sure which of the paths you described are better. Is there any advantage to the "actual template" instead of the wiki page named template? The latter seems easier for me to understand, but maybe others feel differently? best, Colin

[ANNOUNCE] Apache Kafka 3.9.0

2024-11-07 Thread Colin McCabe
, Chia-Ping Tsai, ChickenchickenLove, Chirag Wadhwa, Chris Egerton, Christo Lolov, Ming-Yen Chung, Colin P. McCabe, Cy, David Arthur, David Jacot, demo...@csie.io, dengziming, Dimitar Dimitrov, Dmitry Werner, Dongnuo Lyu, dujian0068, Edoardo Comar, Farbod Ahmadian, Federico Valeri, Fiore Mario Vitale

Re: [VOTE] 3.9.0 RC5

2024-11-07 Thread Colin McCabe
Thanks, Josep. best, Colin On Wed, Nov 6, 2024, at 23:58, Josep Prat wrote: > Hi Colin, > I see that you made 3.9 the default docs version in Kafka-Site. However, as > your doc changes were pushed before the 3.8.1 release, now the upgrade.html > page doesn't mention 3.8.1 at all

[jira] [Created] (KAFKA-17955) Add 3.9 to the releases tested in kafkatest/version.py and related

2024-11-06 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17955: Summary: Add 3.9 to the releases tested in kafkatest/version.py and related Key: KAFKA-17955 URL: https://issues.apache.org/jira/browse/KAFKA-17955 Project: Kafka

[jira] [Resolved] (KAFKA-17870) Disallow creating too many partitions before using ReplicaPlacer

2024-11-05 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17870. -- Fix Version/s: 4.0.0 Resolution: Fixed > Disallow creating too many partitions bef

Re: [DISCUSS] Require KIPs to include "How to teach this section"

2024-11-04 Thread Colin McCabe
omplains. best, Colin On Fri, Nov 1, 2024, at 19:10, Matthias J. Sax wrote: > The KIP already has a section "Documentation Plan" > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=50859709#KIPTemplate-DocumentationPlan > > If it's not used properly, comm

Re: Advice on how to comprehend Kafka source code

2024-11-04 Thread Colin McCabe
hat people will be deploying in the next few years. best, Colin On Fri, Nov 1, 2024, at 21:58, Xiang Zhang wrote: > Hi community, > > After being a Kafka user for several years, I want to know Kafka better > maybe on a code level. I am wondering if anyone can give me any advice. To &g

Re: [VOTE] 3.9.0 RC5

2024-11-01 Thread Colin McCabe
Argh. That should read "5 +1 votes". :) Thanks, everyone. Colin On Fri, Nov 1, 2024, at 14:58, Colin McCabe wrote: > Hi all, > > This vote passes with 7 +1 votes (3 bindings) and no 0 or -1 votes. > > +1 votes > PMC Members: > * Justine Olshan > * Bill Bej

Re: [VOTE] 3.9.0 RC5

2024-11-01 Thread Colin McCabe
/og8l24z8oj87x0zsoqddfxo54qsj4d1o I'll continue with the release process and the release announcement will follow in the next few days. best, Colin On Thu, Oct 31, 2024, at 21:03, Luke Chen wrote: > Hi Colin, > > Thanks for the update. > I've ran a sanity check as Mickael suggested for the mave

Re: [DISCUSS] Require KIPs to include "How to teach this section"

2024-11-01 Thread Colin McCabe
change. It can be done incrementally if necessary. Hopefully having the section in the KIP would help remind us to do it, though! And motivate discussion about what kind of documentation would be best. best, Colin > Claude > > On Thu, Oct 31, 2024 at 12:21 PM Anton Agestam > wrote

[jira] [Created] (KAFKA-17913) Fix KRaft controller count recommendations

2024-10-31 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17913: Summary: Fix KRaft controller count recommendations Key: KAFKA-17913 URL: https://issues.apache.org/jira/browse/KAFKA-17913 Project: Kafka Issue Type: Bug

Re: [VOTE] 3.9.0 RC5

2024-10-31 Thread Colin McCabe
gradlewAll script seems a bit confusing (or maybe that's just me?) best, Colin On Wed, Oct 30, 2024, at 11:02, David Arthur wrote: > Should there be Scala 2.12 artifacts in the Maven staging? > > I see these for 2.13: > * > https://repository.apache.org/content/groups/stag

Re: [VOTE] 3.9.0 RC5

2024-10-30 Thread Colin McCabe
chekafka-1826/ Hopefully these should now show up in Maven as expected. best, Colin On Tue, Oct 29, 2024, at 23:51, Luke Chen wrote: > Hi Colin, > > I was trying to test the RC, but I found the artifacts in Maven artifacts > to be voted upon are not up-to-date. > Not only the "L

Re: [VOTE] 3.9.0 RC5

2024-10-29 Thread Colin McCabe
Thanks, Anton. And thanks Chia-Ping Tsai for taking a look at how we can improve the docs here... best, Colin On Tue, Oct 29, 2024, at 02:39, Anton Agestam wrote: > Hi Chia-Ping, > > Thanks for pointing those two fields out. I retract my -1. > > Cheers, > Anton > > De

Re: [DISCUSS] Require KIPs to include "How to teach this section"

2024-10-29 Thread Colin McCabe
t be all of the documentation. We should update protocol.html and possibly other docs in cases where we're changing the protocol. I don't think it necessary needs to be done before the change itself, but it should be done so that the release that includes the protocol changes also includes t

Re: [VOTE] 3.9.0 RC2

2024-10-29 Thread Colin McCabe
explicit, we would have to introduce a richer syntax for initializing some types, like UUIDs, collections, etc. Collections alone would be daunting since the problem is recursive (I can have a collection containing other collections, etc.) best, Colin > > Cheers, > Anton > >

Re: [VOTE] 3.9.0 RC2

2024-10-28 Thread Colin McCabe
On Sun, Oct 27, 2024, at 01:44, Anton Agestam wrote: > Colin > > I have presented four reasons, I'll list them again below. Please let me > know which ones there isn't already enough information on the thread > already. > > - The behavior is new. Hi Anton, Thi

Re: [VOTE] 3.9.0 RC2

2024-10-26 Thread Colin McCabe
along with feature freeze, code freeze, and every other freeze.) best, Colin On Sat, Oct 26, 2024, at 09:45, Anton Agestam wrote: > Hi Colin, > >> The current behavior is older than 3.9 > > No it is not. The *Java implementation* is older than 3.9. But the behavior > is a su

[VOTE] 3.9.0 RC5

2024-10-26 Thread Colin McCabe
gards, Colin

Re: [VOTE] 3.9.0 RC4

2024-10-25 Thread Colin McCabe
Sorry, please ignore this. I failed to include a commit that should have been in here! I will respin this momentarily. best, Colin On Fri, Oct 25, 2024, at 16:57, Colin McCabe wrote: > This is the fourth candidate for the release of Apache Kafka 3.9.0. I > have titled it rc4 since I

[VOTE] 3.9.0 RC4

2024-10-25 Thread Colin McCabe
Test Pipeline (Native): https://github.com/apache/kafka/actions/runs/11526859627 Thanks to everyone who helped with this release candidate, either by contributing code, testing, or documentation. Regards, Colin

Re: [VOTE] 3.9.0 RC2

2024-10-25 Thread Colin McCabe
ad done differently about the protocol generator, this isn't one of them. Maybe this is a matter of opinion, though, that we might have to agree to disagree about... best, Colin On Fri, Oct 25, 2024, at 01:37, Anton Agestam wrote: > Hi again Colin, > >> The implicit defaults ha

Re: [VOTE] 3.9.0 RC3

2024-10-25 Thread Colin McCabe
Hi Luke, Thanks for the docs PR. I pushed some changes to add a better description of static vs. dynamic quorums, and how the user can tell which one they're running. Take a look. best, Colin On Fri, Oct 25, 2024, at 05:27, Luke Chen wrote: > Hi Colin, > > I opened a PR <h

[jira] [Resolved] (KAFKA-17868) Do not ignore --feature flag in kafka-storage.sh

2024-10-25 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17868. -- Resolution: Fixed > Do not ignore --feature flag in kafka-storage

[jira] [Created] (KAFKA-17870) Disallow creating too many partitions before using ReplicaPlacer

2024-10-24 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17870: Summary: Disallow creating too many partitions before using ReplicaPlacer Key: KAFKA-17870 URL: https://issues.apache.org/jira/browse/KAFKA-17870 Project: Kafka

Re: [VOTE] 3.9.0 RC3

2024-10-24 Thread Colin McCabe
Hi Luke, Unfortunately, we don't have a way to upgrade from static quorums to dynamic quorums yet. We are hoping to include this in the next release. We're trakcing it under https://issues.apache.org/jira/browse/KAFKA-16538 . best, Colin On Thu, Oct 24, 2024, at 05:25, Luke Chen w

Re: [VOTE] 3.9.0 RC3

2024-10-24 Thread Colin McCabe
hanks, Colin On Thu, Oct 24, 2024, at 10:10, Colin McCabe wrote: > On Wed, Oct 23, 2024, at 23:22, Justine Olshan wrote: >> Hey Colin, >> >> Thanks for running the release. >> >> I checked the keys and scanned the docs >> I built from source, used kraft quicks

[jira] [Resolved] (KAFKA-17866) kraft.version/dirID is not updated after upgrading to MV 3.9

2024-10-24 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17866. -- Resolution: Duplicate > kraft.version/dirID is not updated after upgrading to MV

[jira] [Created] (KAFKA-17868) Do not ignore --feature flag in kafka-storage.sh

2024-10-24 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17868: Summary: Do not ignore --feature flag in kafka-storage.sh Key: KAFKA-17868 URL: https://issues.apache.org/jira/browse/KAFKA-17868 Project: Kafka Issue Type

Re: [VOTE] 3.9.0 RC3

2024-10-24 Thread Colin McCabe
On Wed, Oct 23, 2024, at 23:22, Justine Olshan wrote: > Hey Colin, > > Thanks for running the release. > > I checked the keys and scanned the docs > I built from source, used kraft quickstart, ran a transactions workload, > played around with a few other things includin

Re: [VOTE] 3.9.0 RC2

2024-10-24 Thread Colin McCabe
is that untagged fields are always present except in older versions, whereas tagged fields may not be present even in the most recent version. Perhaps there is something we could do to improve these docs? Or somehow make them easier to find? best, Colin On Wed, Oct 23, 2024, at 00:19, An

Re: Cluster ID starting with hyphen, docs not exactly in sync

2024-10-22 Thread Colin McCabe
generate-uuid not create cluster IDs that started with a hyphen. best, Colin On Tue, Oct 22, 2024, at 06:44, Samuli Ruohola wrote: > Hi! > > Thank you for the Apache Kafka! We are grateful for it. > > In our root cause analysis process discussions, we were asked to share > followi

Re: [VOTE] 3.9.0 RC2

2024-10-21 Thread Colin McCabe
Hi all, I have posted a new release candidate, RC3. See the RC3 thread. best, Colin On Mon, Oct 21, 2024, at 11:31, Colin McCabe wrote: > Hi Anton, > > I replied on the JIRA. I do not think this is a bug, you just failed to > account for implicit defaults in your protocol code. T

[VOTE] 3.9.0 RC3

2024-10-21 Thread Colin McCabe
Test Pipeline (Native): https://github.com/apache/kafka/actions/runs/11448338981 Thanks to everyone who helped with this release candidate, either by contributing code, testing, or documentation. Regards, Colin

[jira] [Resolved] (KAFKA-17845) UpdateRaftVoterResponse has incorrect default value fallbacks

2024-10-21 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17845. -- Resolution: Invalid > UpdateRaftVoterResponse has incorrect default value fallba

Re: [VOTE] 3.9.0 RC2

2024-10-21 Thread Colin McCabe
Hi Anton, I replied on the JIRA. I do not think this is a bug, you just failed to account for implicit defaults in your protocol code. That is, 0 is the default of numeric fields if no other default is specified, etc. best, Colin On Mon, Oct 21, 2024, at 08:07, Anton Agestam wrote: >

[jira] [Resolved] (KAFKA-17031) Make configurations public

2024-10-21 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17031. -- Resolution: Fixed > Make configurations pub

[jira] [Resolved] (KAFKA-17794) kafka-storage format must require KIP-853 flags unless controller.quorum.voters is set

2024-10-21 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17794. -- Resolution: Fixed > kafka-storage format must require KIP-853 flags unl

Re: [VOTE] 3.9.0 RC2

2024-10-20 Thread Colin McCabe
Hi Chia-Ping Tsai, Yes, let’s take the jetty CVE fix for 3.9.0. Best, Colin On Wed, Oct 16, 2024, at 08:51, Chia-Ping Tsai wrote: > hi Colin > > Do you think KAFKA-17810 is a blocker for 3.9.0 since it's related to a > CVE? The PR (https://github.com/apache/kafka/pull/17

Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-10-20 Thread Colin McCabe
Hi TengYao Chi, The KIP freeze for Apache Kafka 4.0 is. November 20th. So if KIP-1092 has been accepted already, it should make it into 4.0 without any further discussion (assuming the code is ready by feature freeze.) Cheers, Colin On Fri, Oct 18, 2024, at 20:32, TengYao Chi wrote: >

[jira] [Resolved] (KAFKA-17790) Document that control.plane.listener should be removed before ZK migration is finished

2024-10-15 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17790. -- Fix Version/s: 3.9.0 Resolution: Fixed > Document that control.plane.listener sho

[jira] [Resolved] (KAFKA-17788) During ZK migration, always include control.plane.listener.name in advertisedBrokerListeners

2024-10-15 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17788. -- Fix Version/s: 3.9.0 Reviewer: Luke Chen Resolution: Fixed > During

Re: [VOTE] 3.9.0 RC2

2024-10-14 Thread Colin McCabe
controllers to be initialized in this case (since otherwise, it does not work). best, Colin On Mon, Oct 14, 2024, at 16:34, Colin McCabe wrote: > On Mon, Oct 14, 2024, at 15:04, Jakub Scholz wrote: >> Hi Colin, >> >> So, how exactly does this major misconfiguration that was not d

[jira] [Reopened] (KAFKA-17788) Migration fails in Kafka 3.9.0-RC2 when control plane listener is used

2024-10-14 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe reopened KAFKA-17788: -- Assignee: Colin McCabe > Migration fails in Kafka 3.9.0-RC2 when control plane listener

Re: [VOTE] 3.9.0 RC2

2024-10-14 Thread Colin McCabe
On Mon, Oct 14, 2024, at 15:04, Jakub Scholz wrote: > Hi Colin, > > So, how exactly does this major misconfiguration that was not documented > for over a year and nobody complained manifest itself? What should I look > for in the logs? What are the problems it manifests itself throu

[jira] [Created] (KAFKA-17794) kafka-storage format must require KIP-853 flags unless controller.quorum.voters is set

2024-10-14 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17794: Summary: kafka-storage format must require KIP-853 flags unless controller.quorum.voters is set Key: KAFKA-17794 URL: https://issues.apache.org/jira/browse/KAFKA-17794

  1   2   3   4   5   6   7   8   9   10   >