Re: [DISCUSS] KAFKA-15300: add local log size and remote log separately in kafka-log-dirs tool

Hi Kamal, Thanks for the clarification. I will take a look at the proposal. Also, are there any tickets under Tiered Storage V2 I can work on meanwhile? Looks to me some of 'em are stale On Thu, Jul 17, 2025 at 1:37 PM Kamal Chandraprakash < kama

Re: [VOTE] 4.1.0 RC0

Hi Mickael, done. Cheers, Lucas On Thu, Jul 17, 2025 at 2:18 PM Mickael Maison wrote: > > Hi Lucas, > > Ok, let me know once you're done. > > Thanks, > Mickael > > On Thu, Jul 17, 2025 at 11:08 AM Lucas Brutschy > wrote: > > > > Hi Mickael, > > > > we have been seeing a race condition happenin

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hello Jun, Chia-Ping, Thanks for the reply. JR28: You're right. If the user passes a null value, it will be converted to an empty list. I’ve updated the KIP accordingly. JR29: For early.start.listeners, the exception is thrown during Kafka’s internal validation, and it’s not caused by a null

Re: [VOTE] 4.1.0 RC0

Hi Lucas, Ok, let me know once you're done. Thanks, Mickael On Thu, Jul 17, 2025 at 11:08 AM Lucas Brutschy wrote: > > Hi Mickael, > > we have been seeing a race condition happening in the initialization > of the state updater. We'd like to revert 4d6cf3efef > which changed the initialization o

RE: [DISCUSS] KIP-1187: Support to retrieve remote log size via DescribeLogDirs RPC

On 2025/06/16 14:32:34 PoAn Yang wrote: > Hi all, > > I would like to start a discussion thread about KIP-1187. > > Please take a look and feel free to share any thought. > > https://cwiki.apache.org/confluence/x/sYkhFg > > Thanks, > PoAn Minor comment: *describeLogDirs *literally means describing

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

Thanks for the KIP Rajani. `BrokerNotFoundException` is unused for a long time, and I am happy to get rid of it. However, I am not sure, if we can remove it directly -- at least, that would not be regular protocol. We usually first deprecate interfaces/classes/methods we want to remove, and

Re: [DISCUSS] KIP-1172: Improve EndToEndLatency tool

hi Junwang chia00: Could you please add discuss/vote link to the KIP? chia01: Have you considering add "record-header-key-size"? Best, Chia-Ping On 2025/07/08 08:33:51 Junwang Guo wrote: > Hi everyone, > > Just giving this thread a gentle nudge. If there's no further feedback, I > plan to star

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

> there is also no damage if we only deprecate it for now, and wait for 5.0 release to remove it. agreed. Keeping it in 4.x won't burn out the kafka server, so let's follow the deprecation cycle. Matthias J. Sax 於 2025年7月18日 週五 上午12:17寫道： > Thanks for the KIP Rajani. > > `BrokerNotFoundExceptio

[jira] [Resolved] (KAFKA-19377) Update /streams/developer-guide/security.html for KIP-1071

[ https://issues.apache.org/jira/browse/KAFKA-19377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haozhong Ma resolved KAFKA-19377. - Resolution: Done > Update /streams/developer-guide/security.html for KIP-1071 >

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

Hi Andrew, thanks for this useful KIP. This is something that I also though while working on tools migration from Scala to Java, but that wasn't the right time. On Mon, Jul 14, 2025 at 6:18 PM Andrew Schofield wrote: > > Hi Kirk, > Thanks for your email. > > KT01: During the migration period, us

Re: [VOTE] 4.1.0 RC0

Hi Mickael, we have been seeing a race condition happening in the initialization of the state updater. We'd like to revert 4d6cf3efef which changed the initialization of the state updater and is anyway linked to KAFKA-18913 that was moved to 4.2. Let me know if you accept the change. Cheers, Luc

[DISCUSS] KAFKA-15300: add local log size and remote log separately in kafka-log-dirs tool

Hi everyone, I'm currently working on KAFKA-15300 . The kafka-log-dirs.sh tool currently provides output like this: {"brokers":[{"broker":1,"logDirs":[{"partitions":[{"partition":"tieredTopic-0","size":0,"offsetLag":0,"isFuture":false}],"error":n

[jira] [Resolved] (KAFKA-15300) Include remotelog size in complete log size and also add local log size and remote log size separately in kafka-log-dirs tool.

[ https://issues.apache.org/jira/browse/KAFKA-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Chandraprakash resolved KAFKA-15300. -- Resolution: Duplicate > Include remotelog size in complete log size and also a

Re: [DISCUSS] KAFKA-15300: add local log size and remote log separately in kafka-log-dirs tool

Hi ally, Thanks for working on this! The change needs the KIP-1187 to be approved. Please follow the KIP discussion. KAFKA-15300 is a duplicate of KAFKA-19368 ticket. -- Kam

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

ok, agree on the deprecation cycle. I will mark BrokerNotFoundException as deprecated and raise a PR which can be merged to master for the next 4.x release. How do we handle other deprecated methods from the exception handlers? Should I raise a PR and keep it unmerged until the 5.x release cycle st

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

Updated KIP to reflect deprecation in 4.2 and removal in the next major release. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=373886192 Thanks, ~ Rajani On Fri, Jul 18, 2025 at 9:23 AM Rajani Karuturi wrote: > ok, agree on the deprecation cycle. I will mark BrokerNotFoundE

[jira] [Resolved] (KAFKA-19509) Improve error message when release version is wrong

[ https://issues.apache.org/jira/browse/KAFKA-19509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TengYao Chi resolved KAFKA-19509. - Resolution: Fixed > Improve error message when release version is wrong > --

[jira] [Created] (KAFKA-19517) LoadSummary#numBytes include the size of all records, but LoadSummary#numRecords only includes non-controller records

Chia-Ping Tsai created KAFKA-19517: -- Summary: LoadSummary#numBytes include the size of all records, but LoadSummary#numRecords only includes non-controller records Key: KAFKA-19517 URL: https://issues.apache.org/

[jira] [Created] (KAFKA-19518) Remove the usage of KafkaMetricsGroup(Class klass)

Chia-Ping Tsai created KAFKA-19518: -- Summary: Remove the usage of KafkaMetricsGroup(Class klass) Key: KAFKA-19518 URL: https://issues.apache.org/jira/browse/KAFKA-19518 Project: Kafka Issue

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi, Jiunn-Yang, Thanks for the reply. JR31. This is fine then. JR33. StreamsConfig: bootstrap.servers can't be empty. bootstrap.controllers is not available in Streams. It's only available in AdminClient. JR34. If there are more MM instances than partitions, it seems that it's possible for task

Re: [DISCUSS] KIP-1172: Improve EndToEndLatency tool

Hi Chia-Ping, Thanks for your discussion. chia00: Updated. Thanks! chia01: Initially, I think using a single argument like ‘record-header-size’ would make it simpler for users. However, this approach does not allow users to configure ‘key-size’ and ‘value-size’ separately within the header, wh

Re: [DISCUSS] KIP-1100: Consider renaming org.apache.kafka.server:type=AssignmentsManager

hi Jiunn-Yang I think this KIP is ready for a VOTE thread. thanks, Chia-Ping 黃竣陽 於 2025年5月30日 週五 上午11:17寫道： > Hi all, > > I’d like to manually bump this thread. If there’s no further feedback, > I’ll start the vote tomorrow. > > Best Regards, > Jiunn-Yang > > > 黃竣陽 於 2025年5月11日 下午4:29 寫道： > >