Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #278

See

Re: [VOTE] KIP-1152: Add transactional ID pattern filter to ListTransactions API

Yay, +1 from me. Thanks Calvin! On Thu, Apr 24, 2025 at 10:12 AM Jun Rao wrote: > Hi, Calvin, > > Thanks for the KIP. +1 > > Jun > > On Thu, Apr 24, 2025 at 8:30 AM Calvin Liu > wrote: > > > Hi, > > I would like to start a vote on KIP-1152, thank you! > > KIP: > > > > > https://cwiki.apache.or

Re: [VOTE] KIP-1152: Add transactional ID pattern filter to ListTransactions API

+1 (non-binding) Thanks! On Thu, Apr 24, 2025, at 10:11 AM, Jun Rao wrote: > Hi, Calvin, > > Thanks for the KIP. +1 > > Jun > > On Thu, Apr 24, 2025 at 8:30 AM Calvin Liu > wrote: > > > Hi, > > I would like to start a vote on KIP-1152, thank you! > > KIP: > > > > https://cwiki.apache.org/con

Re: [DISCUSS] KIP-1139: Add support for OAuth jwt-bearer grant type

Hi Manikumar, Update on the use of Keycloak for integration testing. It turns out it doesn't support the JWT Bearer grant type anyway, so it can't be used for testing the new code :( I also looked into Apache Shiro, but it also doesn't support the JWT Bearer grant type. Thanks, Kirk On Tue,

[jira] [Resolved] (KAFKA-19081) Share session capacity and eviction

[ https://issues.apache.org/jira/browse/KAFKA-19081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-19081. --- Fix Version/s: 4.1.0 Resolution: Duplicate > Share session capacity and eviction > --

Re: [DISCUSS] KIP-1153: Kafka Streams `CloseOptions` should not have a public constructor

Thanks for the KIP! This looks good but a few comments about the API: I think we actually want more of a fluent pattern than a literal builder pattern, to be consistent with other APIs in Kafka Streams. You can criticize Matthias for saying "builder pattern" in the ticket, he means a fluent style

[jira] [Resolved] (KAFKA-19192) Old bootstrap.metadata files cause problems with post-KAFKA-18601 servers

[ https://issues.apache.org/jira/browse/KAFKA-19192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-19192. Resolution: Fixed > Old bootstrap.metadata files cause problems wi

Re: [VOTE] KIP-1131: Improved controller-side monitoring of broker states

LGTM. +1 (binding) Thanks, -- -José

Re: [DISCUSS] KIP-1131: Controller-side monitoring for broker shutdown and startup

Hey Jose, Yeah, that was an initial discussion point that isn't going to be implemented. I'll move it to "rejected alternatives" and remove the "proposed changes" section. Thanks for the feedback. Best, Kevin On Mon, Apr 14, 2025 at 4:31 PM Kevin Wu wrote: > Hey Colin, > > > How about somethin

Re: [DISCUSS] KIP-1131: Controller-side monitoring for broker shutdown and startup

Hi Kevin, The KIP says the following: "However, if we want to add another value to BrokerRegistrationState that maps to starting up brokers (i.e. never unfenced), this would require adding a boolean to the broker's registration record. Additionally, if we want to track is a broker has been unclean

Re: [VOTE] KIP-877: Mechanism for plugins and connectors to register metrics

Hi, Jiunn-Yang, Thanks for the explanation. The change sounds good to me then. Jun On Wed, Apr 23, 2025 at 4:57 AM 黃竣陽 wrote: > Hello Jun, > > At this stage, KAFKA-18390 only involves modifications to internal data > structures. Interface-level changes > are currently out of scope. If any inte

[jira] [Created] (KAFKA-19199) Add broker side handling for 2PC with keepPrepared logic

Ritika Reddy created KAFKA-19199: Summary: Add broker side handling for 2PC with keepPrepared logic Key: KAFKA-19199 URL: https://issues.apache.org/jira/browse/KAFKA-19199 Project: Kafka Issu

Potential setup directions for windows

Hi, We had a few problems getting started using windows. Maybe some info could be added to the docs. The first issue we had was that the setup did not seem to like the default distribution directory e.g. kafka_2.13-4.0.0 so we renamed that to kafka. "The input line is too long. The syntax of th

Re: [DISCUSS] KIP-1166: Improve high-watermark replication

Hi, Jose, The follower of regular topic could have fetched to the end of the log from the leader, but need to wait 500ms for the true HWM to be propagated. This will delay the consumption of the consumer on the follower by 500ms since it's gated by HWM, right? Also, in FetchResponse, we use -1 as

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi, Jiunn-Yang, "The main behavioral difference introduced by this change is that a ConfigException will now be thrown during the storage format validation phase, rather than during server startup." It seems that currently formating the storage already fails if group.coordinator.rebalance.protoc

Re: [VOTE] KIP-1152: Add transactional ID pattern filter to ListTransactions API

Hi, Calvin, Thanks for the KIP. +1 Jun On Thu, Apr 24, 2025 at 8:30 AM Calvin Liu wrote: > Hi, > I would like to start a vote on KIP-1152, thank you! > KIP: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1152%3A+Add+transactional+ID+pattern+filter+to+ListTransactions+API > Discussio

[jira] [Created] (KAFKA-19198) Deletion of topic assigned to a share group can result in NPE

Andrew Schofield created KAFKA-19198: Summary: Deletion of topic assigned to a share group can result in NPE Key: KAFKA-19198 URL: https://issues.apache.org/jira/browse/KAFKA-19198 Project: Kafka

[jira] [Created] (KAFKA-19196) Check whether FakeLocalMetadataStore#addACLs needs to be thread-safe.

Nick Guo created KAFKA-19196: Summary: Check whether FakeLocalMetadataStore#addACLs needs to be thread-safe. Key: KAFKA-19196 URL: https://issues.apache.org/jira/browse/KAFKA-19196 Project: Kafka

Re: [DISCUSS] KIP-1043: Administration of groups

hi Andrew Sorry for making noise on this accepted KIP, but inspired by KIP-1152, have you considered adding support for pattern filters? It seems to me that the issue encountered by KIP-1152 could also happen with group IDs. Best, Chia-Ping On 2024/06/04 17:08:10 Andrew Schofield wrote: > Hi,

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

Hi Luke, thanks for having the time to look into the KIP > 2. It's not clear how the "retry count" comes into play in the KIP. It > needs more explanation. My initial thinking is the retry configs are a must for all blob stores, so we can provide them, and validate them for free for all blob store

Re: [VOTE] KIP-1152: Add transactional ID pattern filter to ListTransactions API

+1 (binding) and thanks for this KIP! David Jacot 於 2025年4月25日 週五 上午12:11寫道： > +1 (binding). Thanks for the KIP! > > On Thu, Apr 24, 2025 at 5:30 PM Calvin Liu > wrote: > > > Hi, > > I would like to start a vote on KIP-1152, thank you! > > KIP: > > > > > https://cwiki.apache.org/confluence/dis

Re: [VOTE] KIP-1152: Add transactional ID pattern filter to ListTransactions API

+1 (binding). Thanks for the KIP! On Thu, Apr 24, 2025 at 5:30 PM Calvin Liu wrote: > Hi, > I would like to start a vote on KIP-1152, thank you! > KIP: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1152%3A+Add+transactional+ID+pattern+filter+to+ListTransactions+API > Discussion threa

[VOTE] KIP-1152: Add transactional ID pattern filter to ListTransactions API

Hi, I would like to start a vote on KIP-1152, thank you! KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1152%3A+Add+transactional+ID+pattern+filter+to+ListTransactions+API Discussion thread: https://lists.apache.org/thread/m5n934wlwmqploz6ox8t1xo9sp50x11h Thanks Calvin

Re: [DISCUSS] KIP-1152: Add transactional ID prefix filter to ListTransactions API

Hi Thanks for the comments so far. Since they mainly involve minor changes, I'd like to start a vote for this KIP. Thanks! https://lists.apache.org/thread/nwongf7bptvo6z1dfbo0ro63y48sxzqb On Wed, Apr 23, 2025 at 8:27 AM Calvin Liu wrote: > Hi > Just coming back from my vacation. Sorry for the la

[jira] [Resolved] (KAFKA-18671) Failed handling of fetch response should log an error message

[ https://issues.apache.org/jira/browse/KAFKA-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-18671. Resolution: Fixed > Failed handling of fetch response should log a

[jira] [Resolved] (KAFKA-19191) Don't load bootstrap.checkpoint files if the cluster is already bootstrapped

[ https://issues.apache.org/jira/browse/KAFKA-19191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-19191. Resolution: Duplicate > Don't load bootstrap.checkpoint files if t

[jira] [Resolved] (KAFKA-18992) kafka-features.sh wronly output `upgraded kraft.version to 1`

[ https://issues.apache.org/jira/browse/KAFKA-18992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-18992. Resolution: Fixed > kafka-features.sh wronly output `upgraded kraf

[jira] [Resolved] (KAFKA-16538) Support UpdateFeatures for kraft.version so we can go from static quorums to dynamic

[ https://issues.apache.org/jira/browse/KAFKA-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-16538. Resolution: Fixed > Support UpdateFeatures for kraft.version so we

[jira] [Created] (KAFKA-19197) Automatic generate metric list in document

PoAn Yang created KAFKA-19197: - Summary: Automatic generate metric list in document Key: KAFKA-19197 URL: https://issues.apache.org/jira/browse/KAFKA-19197 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-19110) Add missing unit test for Streams-consumer integration

[ https://issues.apache.org/jira/browse/KAFKA-19110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PoAn Yang resolved KAFKA-19110. --- Fix Version/s: 4.1.0 Resolution: Fixed > Add missing unit test for Streams-consumer integrati

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi Jun, chia, Thanks for your feedback. I add a new section for this change: - Validation for group.coordinator.rebalance.protocols and process.roles will be moved from the server startup phase to the storage format phase. - For cleanup.policy, setting an empty list will now be considered inv

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

Hi Omnia, Thanks for proposing this feature that many users expected. Some comments: 1. It's quite interesting to see the idea of chained serializer/deserializer used here. I like it. 2. It's not clear how the "retry count" comes into play in the KIP. It needs more explanation. 3. What does "La

Re: [VOTE] KIP-1131: Improved controller-side monitoring of broker states

+1 (non-binding) From: dev@kafka.apache.org At: 04/22/25 17:35:25 UTC-4:00To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-1131: Improved controller-side monitoring of broker states +1 (binding) thanks, Colin On Tue, Apr 15, 2025, at 02:25, Federico Valeri wrote: > +1 non binding > > Thanks

[jira] [Created] (KAFKA-19195) Group describe operations are forwarded to all group coordinator shards.

Lucas Brutschy created KAFKA-19195: -- Summary: Group describe operations are forwarded to all group coordinator shards. Key: KAFKA-19195 URL: https://issues.apache.org/jira/browse/KAFKA-19195 Project:

Re: [VOTE] 3.9.1 RC1

Hello TengYao, I've completed the following tests on my local machine: - Built from source using JDK 21 & JDK 17 (Zulu) - Executed all unit and integration tests - Ran the quickstart successfully - test console consumer and producer Best Regards Jiunn-Yang > Luke Chen 於 2025年4月24日 下午2:32 寫道：

[jira] [Resolved] (KAFKA-18170) Periodic snapshots for cold share partitions

[ https://issues.apache.org/jira/browse/KAFKA-18170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-18170. --- Fix Version/s: 4.1.0 Resolution: Fixed > Periodic snapshots for cold share partitions

[jira] [Resolved] (KAFKA-18879) Formatter for share group specific records in __consumer_offsets

[ https://issues.apache.org/jira/browse/KAFKA-18879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-18879. --- Fix Version/s: 4.1.0 Resolution: Duplicate > Formatter for share group specific recor

[jira] [Created] (KAFKA-19194) IOException thrown while starting Kafka broker if a file is present inside kafka data directory.

Srinath PS created KAFKA-19194: -- Summary: IOException thrown while starting Kafka broker if a file is present inside kafka data directory. Key: KAFKA-19194 URL: https://issues.apache.org/jira/browse/KAFKA-19194

Re: [DISCUSS] KIP-1150 Diskless Topics

Dear Luke, Your suggestion to write a KIP for this proposal is excellent. I will be submitting a KIP within the next week or two, and will start a separate thread for discussion. Best regards, Xiaorui On Thu, Apr 24, 2025 at 3:10 PM Luke Chen wrote: > > Hi Xiaorui, > > It's great to hear that

Re: [DISCUSS] KIP-1150 Diskless Topics

Hi Xiaorui, It's great to hear that the AutoMQ team is also interested in contributing to Apache Kafka. Of course the AutoMQ's solution is also an option for the community to consider. It would be good if you can write a KIP for your solution, and we can discuss it in the community. Let me know i