[jira] [Created] (KAFKA-19038) Migrate GroupAssignment to record class

2025-03-25 Thread TengYao Chi (Jira)
TengYao Chi created KAFKA-19038: --- Summary: Migrate GroupAssignment to record class Key: KAFKA-19038 URL: https://issues.apache.org/jira/browse/KAFKA-19038 Project: Kafka Issue Type: Sub-task

Re: KIP-1141: Simplifying MetadataQuorumCommand by Leveraging Admin API for Controller Management

2025-03-25 Thread Federico Valeri
Hi, thanks for the KIP. This is a nice improvement IMO. Some minor notes: - the Jira link needs to be fixed - usually discussion threads starts with [DISCUSS] prefix - have you considered deprecating the old way of adding/removing controllers? On Mon, Mar 10, 2025 at 2:27 AM Kuan Po Tseng wrote

[PR] MINOR: add missing link for KIP-1104 [kafka-site]

2025-03-25 Thread via GitHub
FrankYang0529 opened a new pull request, #680: URL: https://github.com/apache/kafka-site/pull/680 Add KIP-1104 link to stream upgrade guide. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[jira] [Resolved] (KAFKA-19040) Fail test BrokerApiVersionsCommandTest#testAdminSendNoBlock

2025-03-25 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-19040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 resolved KAFKA-19040. - Resolution: Won't Fix This issue won't fix after test in different enviroment. > Fail test BrokerApiVersionsCom

Re: [PR] MINOR: add missing link for KIP-1104 [kafka-site]

2025-03-25 Thread via GitHub
fvaleri commented on PR #680: URL: https://github.com/apache/kafka-site/pull/680#issuecomment-2751042590 Thanks for the fix. I think it would be better to remove unrelated changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] MINOR: add missing link for KIP-1104 [kafka-site]

2025-03-25 Thread via GitHub
FrankYang0529 commented on PR #680: URL: https://github.com/apache/kafka-site/pull/680#issuecomment-2751049336 @fvaleri You're right. Sorry for that. Updated it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [DISCUSS] - KIP-1064: Upgrade slf4j to 2.x

2025-03-25 Thread TengYao Chi
Hi Federico, > - I would expand the motivation section rather than linking to the discussion I just reviewed it, and I think we could remove this reference since it doesn't provide much value to this KIP. >- I think we should now update the `log4j2.properties` reference to `log4j2.yaml` Thanks

[jira] [Resolved] (KAFKA-18736) Add Streams group heartbeat request manager

2025-03-25 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-18736. --- Resolution: Fixed > Add Streams group heartbeat request manager > --

[jira] [Created] (KAFKA-19037) Integrate consumer-side code with Streams

2025-03-25 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-19037: - Summary: Integrate consumer-side code with Streams Key: KAFKA-19037 URL: https://issues.apache.org/jira/browse/KAFKA-19037 Project: Kafka Issue Type: Sub-

Re: [DISCUSS] KIP-1143: Deprecated Optional and return String from public Endpoint#listenerName

2025-03-25 Thread Chia-Ping Tsai
hi Kirk > KT2. Is the intention that the client layer will still use Endpoint? If so, > the new listener() method will return null, yes? My concern is that > developers of the client will lose the Optional safeguard with this change. Given that the client layer utilizes org.apache.kafka.common.

[jira] [Created] (KAFKA-19039) The refresh_collaborators.py script messes .asf.yaml

2025-03-25 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-19039: -- Summary: The refresh_collaborators.py script messes .asf.yaml Key: KAFKA-19039 URL: https://issues.apache.org/jira/browse/KAFKA-19039 Project: Kafka Issu

Re: [DISCUSS] - KIP-1064: Upgrade slf4j to 2.x

2025-03-25 Thread Federico Valeri
Hi TengYao, this change makes sense for a major release. Some comments: - I would expand the motivation section rather than linking to the discussion - I think we should now update the `log4j2.properties` reference to `log4j2.yaml` On Mon, Mar 10, 2025 at 7:36 AM TengYao Chi wrote: > > Hi Ismael

[jira] [Created] (KAFKA-19041) Automatically run refresh_collaborators.py quarterly

2025-03-25 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-19041: -- Summary: Automatically run refresh_collaborators.py quarterly Key: KAFKA-19041 URL: https://issues.apache.org/jira/browse/KAFKA-19041 Project: Kafka Issu

Re: [DISCUSS] KIP-1144: Exposing a new public REST API for MirrorMaker2

2025-03-25 Thread Kondrát Bertalan
Hi Team, I appreciate any feedback on this KIP, KIP-1144: Exposing a new public REST API for MirrorMaker2 . Thank you! On Fri, Mar 14, 2025 at 4:07 PM Kondrát Bertalan wrote: > Hi

[DISCUSS] Git commits and metadata

2025-03-25 Thread David Arthur
Hello Kafka community! I wanted to start a discussion around our Git commits and the metadata we keep in them. We have historically used the "Reviewers" Git trailer [1] to indicate who had reviewed a commit. Originally, it seems we used this field to indicate the committer who approved the change

Re: [PR] MINOR: add missing link for KIP-1104 [kafka-site]

2025-03-25 Thread via GitHub
FrankYang0529 commented on PR #680: URL: https://github.com/apache/kafka-site/pull/680#issuecomment-2751001372 https://github.com/user-attachments/assets/1e921beb-6e25-446d-b783-5e64f988a2b2"; /> -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [VOTE] KIP-1131: Improved controller-side monitoring of broker states

2025-03-25 Thread Kevin Wu
Hello all, I am manually bumping this thread. Any feedback or votes would be appreciated. Best regards, Kevin Wu On Thu, Mar 13, 2025 at 1:54 PM Kevin Wu wrote: > Hello all, > > I would like to call a vote for KIP-1131: Improved controller-side > monitoring of broker states. > > https://cwiki.

Re: [VOTE] KIP-1064 - Upgrade slf4j to 2.x

2025-03-25 Thread Federico Valeri
Hi Clayton, thanks for raising this point. I think it's easier to keep slf4j because it is widely adopted. Anyway, regardless of the final choice, the alternative deserves a mention in the rejected alternatives with some motivation. On Mon, Mar 24, 2025 at 9:42 PM Clayton Wohl wrote: > > Thank y

Re: [PR] MINOR: add missing link for KIP-1104 [kafka-site]

2025-03-25 Thread via GitHub
chia7712 merged PR #680: URL: https://github.com/apache/kafka-site/pull/680 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache

[jira] [Created] (KAFKA-19040) Fail test BrokerApiVersionsCommandTest#testAdminSendNoBlock

2025-03-25 Thread Jira
黃竣陽 created KAFKA-19040: --- Summary: Fail test BrokerApiVersionsCommandTest#testAdminSendNoBlock Key: KAFKA-19040 URL: https://issues.apache.org/jira/browse/KAFKA-19040 Project: Kafka Issue Type: Test

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #248

2025-03-25 Thread Apache Jenkins Server
See

Re: software architecture questions about Kafka

2025-03-25 Thread Glenn Engstrand
Not sure what that means Hamze. I indexed the code at commit 94a1bfb1281f06263976b1ba8bba8c5ac5d7f2ce from origin/trunk. I indexed the documentation at about the same time (late January). Here is the link to the web SPA. It asks for an email address to verify the question and to receive the ans

[jira] [Created] (KAFKA-19044) Handle tasks that are not present in the current topology

2025-03-25 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19044: -- Summary: Handle tasks that are not present in the current topology Key: KAFKA-19044 URL: https://issues.apache.org/jira/browse/KAFKA-19044 Project: Kafka

software architecture questions about Kafka

2025-03-25 Thread Glenn Engstrand
I have been exploring how effective RAG-focused LLMs can be in accurately answering questions concerning the software architecture of various popular open source projects. Kafka is one of those projects. With over a decade of experience as a software architect, I have formed some opinions about

Re: software architecture questions about Kafka

2025-03-25 Thread Hamze HAMZE
Hello Mr. Engstrand, this sounds interesting. Does it reply with the configuration of the current Apache Kafka architecture or does it explain the general architecture? Thanks in advance. Am Di., 25. März 2025 um 16:42 Uhr schrieb Glenn Engstrand < gl...@glennengstrand.info>: > I have been explo

Re: [VOTE] KIP-1064 - Upgrade slf4j to 2.x

2025-03-25 Thread Farid Zakaria
Logging always seem "easy" but then I remember reading https://google.github.io/flogger/anatomy.html Even the variadic approach of some logging implementations comes at a non-negative cost On Tue, Mar 25, 2025 at 6:12 AM Federico Valeri wrote: > > Hi Clayton, thanks for raising this point. I thin

[jira] [Resolved] (KAFKA-18914) Migrate ConsumerRebootstrapTest to use new test infra

2025-03-25 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18914. Fix Version/s: 4.1.0 Resolution: Fixed > Migrate ConsumerRebootstrapTest to use new

[jira] [Created] (KAFKA-19045) ByteBufferUnmapper should not use the deprecated sun.misc.Unsafe#invokeCleaner()

2025-03-25 Thread Houston Putman (Jira)
Houston Putman created KAFKA-19045: -- Summary: ByteBufferUnmapper should not use the deprecated sun.misc.Unsafe#invokeCleaner() Key: KAFKA-19045 URL: https://issues.apache.org/jira/browse/KAFKA-19045

[jira] [Created] (KAFKA-19043) Move DelayedRemoteListOffsets to the storage module

2025-03-25 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-19043: -- Summary: Move DelayedRemoteListOffsets to the storage module Key: KAFKA-19043 URL: https://issues.apache.org/jira/browse/KAFKA-19043 Project: Kafka Issue

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

2025-03-25 Thread Ismael Juma
Using an interface is less effective than making the constructor private and the class final though. Ismael On Mon, Mar 24, 2025, 9:12 PM Chia-Ping Tsai wrote: > hi All, > > > Matthias J. Sax 於 2025年3月5日 凌晨4:20 寫道: > > > > To me, the main thing is really, that currently user can call `new` wha

[jira] [Created] (KAFKA-19042) Move kafka.api test cases to client-integration-tests module

2025-03-25 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-19042: - Summary: Move kafka.api test cases to client-integration-tests module Key: KAFKA-19042 URL: https://issues.apache.org/jira/browse/KAFKA-19042 Project: Kafka Issue

Re: [DISCUSS] KIP-1123: Rack-aware partitioning for Kafka Producer

2025-03-25 Thread Federico Valeri
Hi, thanks for the KIP and sorry for the late reply. Should we also highlight the reduced latency in the motivation section? On Mon, Mar 10, 2025 at 9:24 PM Ivan Yurchenko wrote: > > Hi all, > > I took the pause with this KIP while Kafka 4.0 was in making to not distract > the folks. Now let's