[jira] [Resolved] (KAFKA-17748) Remove scala-java8-compat

[ https://issues.apache.org/jira/browse/KAFKA-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17748. Resolution: Fixed > Remove scala-java8-compat > -- > >

[jira] [Resolved] (KAFKA-17693) Remove testCheckEarliestLocalTimestampVersion and testCheckLatestTieredTimestampVersion

[ https://issues.apache.org/jira/browse/KAFKA-17693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17693. Fix Version/s: 4.0.0 Resolution: Fixed > Remove testCheckEarliestLocalTimestampVers

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #87

See

Re: [VOTE] 3.9.0 RC2

Hi Colin, > BrokerServer will try to open the ports that belong to the broker; ControllerServer will try to open the ports that belong to the controller. You obviously can't open the same port twice (in standard UNIX, at least) or if you somehow did, the result would be nonsense. This isn't such a

Re: [VOTE] 3.9.0 RC2

While messing around with the release candidate, I found a separate blocker bug: KAFKA-17794. Basically, our behavior is confusing when we format the storage directory with KIP-853 (dynamic controller quorum), but no initial controllers are supplied. I have a PR which requires the initial contr

[jira] [Reopened] (KAFKA-17788) Migration fails in Kafka 3.9.0-RC2 when control plane listener is used

[ https://issues.apache.org/jira/browse/KAFKA-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe reopened KAFKA-17788: -- Assignee: Colin McCabe > Migration fails in Kafka 3.9.0-RC2 when control plane listener is u

Re: [VOTE] 3.9.0 RC2

On Mon, Oct 14, 2024, at 15:04, Jakub Scholz wrote: > Hi Colin, > > So, how exactly does this major misconfiguration that was not documented > for over a year and nobody complained manifest itself? What should I look > for in the logs? What are the problems it manifests itself through? There > are

Re: [VOTE] 3.9.0 RC2

Hi Colin, So, how exactly does this major misconfiguration that was not documented for over a year and nobody complained manifest itself? What should I look for in the logs? What are the problems it manifests itself through? There are plenty of users who went through the migration with this "major

[jira] [Created] (KAFKA-17794) kafka-storage format must require KIP-853 flags unless controller.quorum.voters is set

Colin McCabe created KAFKA-17794: Summary: kafka-storage format must require KIP-853 flags unless controller.quorum.voters is set Key: KAFKA-17794 URL: https://issues.apache.org/jira/browse/KAFKA-17794

Re: [VOTE] 3.9.0 RC2

Hi Jakub, It has always been required to separate control plane listeners and controller listeners. Failing to do this is a major misconfiguration. It may not have been caught sometimes, but that is a bug. It should be simple to fix the configuration you posted -- simply have a different name

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #89

See

Re: [DISCUSS] KIP-1088: Replace KafkaClientSupplier with KafkaClientInterceptor

HI All, Matthias - thanks for the KIP! I'm in favor of this proposal, but I'd like to summarize my understanding to ensure I'm getting everything. 1. KafkaStreams will remain in control of creating the client unless the user overrides that behavior (I think this would be a rare case). Although w

[jira] [Created] (KAFKA-17793) Improve kcontroller robustness against long delays

Colin McCabe created KAFKA-17793: Summary: Improve kcontroller robustness against long delays Key: KAFKA-17793 URL: https://issues.apache.org/jira/browse/KAFKA-17793 Project: Kafka Issue Type

Re: [VOTE] 3.9.0 RC2

The different name of the controller listener for KRaft controllers and control plane listener in ZooKeeper-based cluster was not required before and it is not simple to change to handle now at the "last minute". So given that this is called production-ready already for some time, I think this is b

Re: [VOTE] 3.9.0 RC2

Thanks, Federico. best, Colin On Mon, Oct 14, 2024, at 09:23, Federico Valeri wrote: > On Mon, Oct 14, 2024 at 5:11 PM Colin McCabe wrote: >> >> Hi Federico, >> >> Thanks for taking a look! Can you please file a JIRA for the documentation >> changes you'd like to make? >> > > There was already

Re: [VOTE] 3.9.0 RC2

I also posted a PR to add removing control.plane.listener to the docs: https://github.com/apache/kafka/pull/17501 This needs to be done for each broker process before before it is restarted in KRaft mode. (However, it is fine to BEGIN the migration process with control plane listeners enabled.)

Re: [VOTE] 3.9.0 RC2

Hi Jakub, After looking through the attached file on the JIRA, I can say that this is a misconfiguration. control.plane.listener is a totally separate concept from control.plane.listener.name. They should never be set to the same value. The controller listener must have a different name and val

[jira] [Resolved] (KAFKA-17788) Migration fails in Kafka 3.9.0-RC2 when control plane listener is used

[ https://issues.apache.org/jira/browse/KAFKA-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17788. -- Resolution: Invalid > Migration fails in Kafka 3.9.0-RC2 when control plane listener is used >

[jira] [Created] (KAFKA-17792) header parsing ends up timing out and using large quantities of memory if the string looks like a number

Martin Sillence created KAFKA-17792: --- Summary: header parsing ends up timing out and using large quantities of memory if the string looks like a number Key: KAFKA-17792 URL: https://issues.apache.org/jira/browse

Re: [VOTE] 3.9.0 RC2

On Mon, Oct 14, 2024 at 5:11 PM Colin McCabe wrote: > > Hi Federico, > > Thanks for taking a look! Can you please file a JIRA for the documentation > changes you'd like to make? > There was already a Jira about this, which was closed my mistake: https://issues.apache.org/jira/browse/KAFKA-17031

[jira] [Resolved] (KAFKA-17520) align the low bound of ducktape version

[ https://issues.apache.org/jira/browse/KAFKA-17520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17520. Resolution: Fixed > align the low bound of ducktape version > ---

[jira] [Reopened] (KAFKA-17031) Make configurations public

[ https://issues.apache.org/jira/browse/KAFKA-17031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Federico Valeri reopened KAFKA-17031: - > Make configurations public > -- > > Key: KAFKA-170

Re: [VOTE] 3.9.0 RC2

Hi Colin, I have tested 3.9 RC2 with Amazon Corretto 8-21 and Zulu 8-21, and everything seems to be working fine. Therefore, I am +1 on this RC (non-binding). Best regards, TengYao Colin McCabe 於 2024年10月14日 週一 下午11:42寫道： > Hi Chia-Ping Tsai, > > Thanks for looking into this. I approved the PR

[jira] [Created] (KAFKA-17791) Dockerfile should use `requirements.txt` to ensure dependencies

Chia-Ping Tsai created KAFKA-17791: -- Summary: Dockerfile should use `requirements.txt` to ensure dependencies Key: KAFKA-17791 URL: https://issues.apache.org/jira/browse/KAFKA-17791 Project: Kafka

Re: [VOTE] 3.9.0 RC2

Hi Chia-Ping Tsai, Thanks for looking into this. I approved the PR. best, Colin On Mon, Oct 14, 2024, at 08:34, Chia-Ping Tsai wrote: >> Apache Kafka 3.9 uses ducktape 0.8.14, which is well behind what trunk seems >> to be using now (ducktape 0.11.4) We will not advance the version of >> duckt

Re: [VOTE] 3.9.0 RC2

> Apache Kafka 3.9 uses ducktape 0.8.14, which is well behind what trunk seems > to be using now (ducktape 0.11.4) We will not advance the version of ducktape > in the 3.x branch, I think. Yes, I agree not to advance the version of Ducktape, but the Ducktape version was unpinned from 3.2 (see

Re: [VOTE] 3.9.0 RC2

> control.plane.listener is not (and never has been) supported in KRaft mode. You mean control.plane.listener.name is not supported in KRaft I guess? Well, this is not KRaft, this is migration, so it uses the settings that it used before for the Zoo-based cluster and that includes using dedicated

Re: [VOTE] 3.9.0 RC2

Hi Jakub, Thanks for testing. control.plane.listener is not (and never has been) supported in KRaft mode. You have to remove control.plane.listener configurations before migrating. I filed KAFKA-17790 to document this in the migration instructions. (This is not a blocker for the release, though

[jira] [Created] (KAFKA-17790) Document that control.plane.listener should be removed before ZK migration

Colin McCabe created KAFKA-17790: Summary: Document that control.plane.listener should be removed before ZK migration Key: KAFKA-17790 URL: https://issues.apache.org/jira/browse/KAFKA-17790 Project: K

Re: [VOTE] 3.9.0 RC2

Hi Federico, Thanks for taking a look! Can you please file a JIRA for the documentation changes you'd like to make? best, Colin On Sun, Oct 13, 2024, at 09:21, Federico Valeri wrote: > Hi Colin, thanks for putting out the new RC. > > According to KIP-950, remote.log.manager.thread.pool.size sh

Re: [VOTE] 3.9.0 RC2

Hi Chia-Ping Tsai, Apache Kafka 3.9 uses ducktape 0.8.14, which is well behind what trunk seems to be using now (ducktape 0.11.4) We will not advance the version of ducktape in the 3.x branch, I think. cheers, Colin On Sat, Oct 12, 2024, at 01:49, Chia-Ping Tsai wrote: > hi Colin > > I'm send

[jira] [Created] (KAFKA-17789) State updater stuck when starting with empty state folder

Antoine Michaud created KAFKA-17789: --- Summary: State updater stuck when starting with empty state folder Key: KAFKA-17789 URL: https://issues.apache.org/jira/browse/KAFKA-17789 Project: Kafka

[jira] [Resolved] (KAFKA-17374) add bootstrap.controller to kafka-reassign-partitions.sh

[ https://issues.apache.org/jira/browse/KAFKA-17374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17374. Fix Version/s: 4.0.0 Resolution: Fixed > add bootstrap.controller to kafka-reassign

[jira] [Resolved] (KAFKA-17765) Remove TestUtils.toSet

[ https://issues.apache.org/jira/browse/KAFKA-17765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17765. Fix Version/s: 4.0.0 Resolution: Fixed > Remove TestUtils.toSet > -

[jira] [Resolved] (KAFKA-17782) Fix ConsumerProtocolTest#deserializeOldSubscriptionVersion

[ https://issues.apache.org/jira/browse/KAFKA-17782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Siyuan resolved KAFKA-17782. Resolution: Done > Fix ConsumerProtocolTest#deserializeOldSubscriptionVersion > --

Re: [VOTE] 3.9.0 RC2

Hi Colin, Thanks for the RC. I did some testing of it and run into https://issues.apache.org/jira/browse/KAFKA-17788 which seems to be a regression in the migration to KRaft process. Can someone who understands this part of the codebase look into it please? Thanks & Regards Jakub On Thu, Oct 10

[jira] [Created] (KAFKA-17788) Migration fails in Kafka 3.9.0-RC2 when control plane listener is used

Jakub Scholz created KAFKA-17788: Summary: Migration fails in Kafka 3.9.0-RC2 when control plane listener is used Key: KAFKA-17788 URL: https://issues.apache.org/jira/browse/KAFKA-17788 Project: Kafka

[jira] [Created] (KAFKA-17787) Remove --zookeeper option and logic from ConfigCommand

Mickael Maison created KAFKA-17787: -- Summary: Remove --zookeeper option and logic from ConfigCommand Key: KAFKA-17787 URL: https://issues.apache.org/jira/browse/KAFKA-17787 Project: Kafka Is

[jira] [Resolved] (KAFKA-17746) Replace JavaConverters with CollectionConverters

[ https://issues.apache.org/jira/browse/KAFKA-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17746. Fix Version/s: 4.0.0 Resolution: Fixed > Replace JavaConverters with CollectionConv

[jira] [Resolved] (KAFKA-17617) New GitHub Actions build builds Java 8 with 2.13 instead of 2.12

[ https://issues.apache.org/jira/browse/KAFKA-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17617. Fix Version/s: (was: 3.7.2) (was: 3.9.1) Resolution: Won'

Re: [DISCUSS] KIP-1088: Replace KafkaClientSupplier with KafkaClientInterceptor

Hi, Thanks for the KIP! BC1. I echo point S3 from Sophie. I find it quite confusing having those methods return an interceptor that is used as a client in the Streams code. Naming might already do the trick. Something like Intercepted(Admin|StreamsConsumer|Consumer|Producer) or Wrapped(Admi

[jira] [Created] (KAFKA-17786) align the low bound of ducktape version for 3.8.x

Josep Prat created KAFKA-17786: -- Summary: align the low bound of ducktape version for 3.8.x Key: KAFKA-17786 URL: https://issues.apache.org/jira/browse/KAFKA-17786 Project: Kafka Issue Type: Sub

[jira] [Resolved] (KAFKA-17786) align the low bound of ducktape version for 3.8.x

[ https://issues.apache.org/jira/browse/KAFKA-17786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josep Prat resolved KAFKA-17786. Resolution: Fixed Done via https://github.com/apache/kafka/pull/17482 > align the low bound of du

[jira] [Resolved] (KAFKA-17763) Remove Utils.covariantCast

[ https://issues.apache.org/jira/browse/KAFKA-17763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17763. Fix Version/s: 4.0.0 Resolution: Fixed > Remove Utils.covariantCast > -