[jira] [Created] (KAFKA-19531) Add an end-to-end integration test for the DLQ feature

2025-07-21 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19531: -- Summary: Add an end-to-end integration test for the DLQ feature Key: KAFKA-19531 URL: https://issues.apache.org/jira/browse/KAFKA-19531 Project: Kafka

[jira] [Created] (KAFKA-19529) State updater does not always seem to remove all metrics

2025-07-21 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19529: -- Summary: State updater does not always seem to remove all metrics Key: KAFKA-19529 URL: https://issues.apache.org/jira/browse/KAFKA-19529 Project: Kafka

Re: [VOTE] 4.1.0 RC0

2025-07-17 Thread Lucas Brutschy
Hi Mickael, done. Cheers, Lucas On Thu, Jul 17, 2025 at 2:18 PM Mickael Maison wrote: > > Hi Lucas, > > Ok, let me know once you're done. > > Thanks, > Mickael > > On Thu, Jul 17, 2025 at 11:08 AM Lucas Brutschy > wrote: > > > > Hi Mickae

Re: [VOTE] 4.1.0 RC0

2025-07-17 Thread Lucas Brutschy
Hi Mickael, we have been seeing a race condition happening in the initialization of the state updater. We'd like to revert 4d6cf3efef which changed the initialization of the state updater and is anyway linked to KAFKA-18913 that was moved to 4.2. Let me know if you accept the change. Cheers, Luc

[jira] [Created] (KAFKA-19510) Kafka Streams does not always release lock when adding or removing threads multiple times

2025-07-15 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19510: -- Summary: Kafka Streams does not always release lock when adding or removing threads multiple times Key: KAFKA-19510 URL: https://issues.apache.org/jira/browse/KAFKA-19510

Re: [ANNOUNCE] New Kafka Committer: PoAn Yang

2025-07-14 Thread Lucas Brutschy
Congrats! Very well deserved. Cheers, Lucas On Mon, Jul 14, 2025 at 9:26 AM Bruno Cadonna wrote: > > Congrats! Well deserved! > > Best, > Bruno > > On 14.07.25 07:42, 龚宣璋 wrote: > > Congratulations PoAn! > > > > Luke Chen 于2025年7月14日周一 08:04写道: > > > >> Congratulations PoAn! > >> > >> On Mon, J

[jira] [Created] (KAFKA-19478) Optimize sticky assignor

2025-07-07 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19478: -- Summary: Optimize sticky assignor Key: KAFKA-19478 URL: https://issues.apache.org/jira/browse/KAFKA-19478 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-19477) Sticky Assignor JMH Benchmark

2025-07-07 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19477: -- Summary: Sticky Assignor JMH Benchmark Key: KAFKA-19477 URL: https://issues.apache.org/jira/browse/KAFKA-19477 Project: Kafka Issue Type: Sub-task

Re: [ANNOUNCE] New Kafka Committer: Omnia Ibrahim

2025-06-26 Thread Lucas Brutschy
Congrats Omnia! On Thu, Jun 26, 2025 at 12:54 PM Yash Mayya wrote: > > Congratulations Omnia! > > On Wed, Jun 25, 2025 at 20:53 Justine Olshan > wrote: > > > Hi, > > > > The Project Management Committee (PMC) for Apache Kafka is pleased to > > announce Omnia Ibrahim as a new Kafka committer. > >

[jira] [Created] (KAFKA-19429) Deflake streams_smoke_test

2025-06-23 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19429: -- Summary: Deflake streams_smoke_test Key: KAFKA-19429 URL: https://issues.apache.org/jira/browse/KAFKA-19429 Project: Kafka Issue Type: Bug

Re: [ANNOUNCE] New Kafka PMC Member: José Armando García Sancio

2025-06-23 Thread Lucas Brutschy
Congratulations! On Sun, Jun 22, 2025 at 8:35 AM wrote: > > Congratulations José > > > On Jun 16, 2025, at 2:29 PM, Bill Bejeck wrote: > > > > Congrats José, well deserved! > > > >> On Mon, Jun 16, 2025 at 9:05 AM Mickael Maison wrote: > >> > >> Hi, > >> > >> José has been a Kafka committer si

[jira] [Created] (KAFKA-19423) Deflake streams_broker_bounce_test

2025-06-20 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19423: -- Summary: Deflake streams_broker_bounce_test Key: KAFKA-19423 URL: https://issues.apache.org/jira/browse/KAFKA-19423 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-19422) Deflake streams_application_upgrade_test

2025-06-20 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19422: -- Summary: Deflake streams_application_upgrade_test Key: KAFKA-19422 URL: https://issues.apache.org/jira/browse/KAFKA-19422 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-19421) Deflake streams_broker_down_resilience_test

2025-06-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19421: -- Summary: Deflake streams_broker_down_resilience_test Key: KAFKA-19421 URL: https://issues.apache.org/jira/browse/KAFKA-19421 Project: Kafka Issue Type

[jira] [Created] (KAFKA-19412) Extended AuthorizerIntegrationTest to cover StreamsGroupHeartbeat

2025-06-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19412: -- Summary: Extended AuthorizerIntegrationTest to cover StreamsGroupHeartbeat Key: KAFKA-19412 URL: https://issues.apache.org/jira/browse/KAFKA-19412 Project: Kafka

[jira] [Created] (KAFKA-19413) Extended AuthorizerIntegrationTest to cover StreamsGroupDescribe

2025-06-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19413: -- Summary: Extended AuthorizerIntegrationTest to cover StreamsGroupDescribe Key: KAFKA-19413 URL: https://issues.apache.org/jira/browse/KAFKA-19413 Project: Kafka

Re: [VOTE] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

2025-06-12 Thread Lucas Brutschy
Thanks! +1 (binding) Cheers, Lucas On Thu, Jun 12, 2025 at 1:07 AM Bill Bejeck wrote: > > Thanks for the KIP! > > +1 (binding) > > -Bill > > > On Wed, Jun 11, 2025 at 6:41 PM Sophie Blee-Goldman > wrote: > > > +1 (binding) > > > > thanks for the KIP! > > > > On Tue, Jun 10, 2025 at 4:16 AM Seb

Re: [DISCUSS] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

2025-06-11 Thread Lucas Brutschy
; > > based > > > > configuration, rather than forcing KafkaStreams to allow StreamsConfig > > > > constructors > > > > > > > > So as of this time I'm still personally in favor of having only the > > > > Map/Propert

[jira] [Created] (KAFKA-19397) TransactionManager.handleCompletedBatch throws NPE

2025-06-10 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19397: -- Summary: TransactionManager.handleCompletedBatch throws NPE Key: KAFKA-19397 URL: https://issues.apache.org/jira/browse/KAFKA-19397 Project: Kafka Issue

Re: [VOTE] KIP-1175: Fix the typo `PARTITIONER_ADPATIVE_PARTITIONING_ENABLE` in ProducerConfig

2025-06-05 Thread Lucas Brutschy
+1 (binding) On Thu, Jun 5, 2025 at 6:06 PM TengYao Chi wrote: > > +1 (binding) > > Best, > TYC > > Chia-Ping Tsai 於 2025年6月5日 週四,下午11:25寫道: > > > +1 (binding) > > > > Lianet M. 於 2025年6月5日 週四 下午11:16寫道: > > > > > Thanks for the updates Ming! Good to finally see this clean-up. > > > > > > +1 (bi

[jira] [Created] (KAFKA-19380) Update streams/developer-guide/app-reset-tool.html

2025-06-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19380: -- Summary: Update streams/developer-guide/app-reset-tool.html Key: KAFKA-19380 URL: https://issues.apache.org/jira/browse/KAFKA-19380 Project: Kafka Issue

[jira] [Created] (KAFKA-19379) Update /streams/upgrade-guide for KIP-1071

2025-06-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19379: -- Summary: Update /streams/upgrade-guide for KIP-1071 Key: KAFKA-19379 URL: https://issues.apache.org/jira/browse/KAFKA-19379 Project: Kafka Issue Type

[jira] [Created] (KAFKA-19378) Add group protocol config to developer-guide/config-streams.html

2025-06-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19378: -- Summary: Add group protocol config to developer-guide/config-streams.html Key: KAFKA-19378 URL: https://issues.apache.org/jira/browse/KAFKA-19378 Project: Kafka

[jira] [Created] (KAFKA-19377) Update /streams/developer-guide/security.html to describe required ACLs for streams groups

2025-06-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19377: -- Summary: Update /streams/developer-guide/security.html to describe required ACLs for streams groups Key: KAFKA-19377 URL: https://issues.apache.org/jira/browse/KAFKA-19377

[jira] [Created] (KAFKA-19376) Throw an error message if any unsupported feature is used with KIP-1071

2025-06-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19376: -- Summary: Throw an error message if any unsupported feature is used with KIP-1071 Key: KAFKA-19376 URL: https://issues.apache.org/jira/browse/KAFKA-19376 Project

[jira] [Created] (KAFKA-19372) StreamsGroup should not be subscribed to a topic when it is empty

2025-06-04 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19372: -- Summary: StreamsGroup should not be subscribed to a topic when it is empty Key: KAFKA-19372 URL: https://issues.apache.org/jira/browse/KAFKA-19372 Project: Kafka

[jira] [Resolved] (KAFKA-19256) Only send IQ information on assignment changes

2025-06-03 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-19256. Resolution: Fixed > Only send IQ information on assignment chan

[jira] [Created] (KAFKA-19335) Streams group heartbeat sometimes fails with INVALID_REQUEST

2025-05-26 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19335: -- Summary: Streams group heartbeat sometimes fails with INVALID_REQUEST Key: KAFKA-19335 URL: https://issues.apache.org/jira/browse/KAFKA-19335 Project: Kafka

[jira] [Created] (KAFKA-19280) NoSuchElementException in UnifiedLog.fetchLastStableOffsetMetadata

2025-05-14 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19280: -- Summary: NoSuchElementException in UnifiedLog.fetchLastStableOffsetMetadata Key: KAFKA-19280 URL: https://issues.apache.org/jira/browse/KAFKA-19280 Project

[jira] [Created] (KAFKA-19276) Trigger rebalance when assignment related configurations are updated

2025-05-13 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19276: -- Summary: Trigger rebalance when assignment related configurations are updated Key: KAFKA-19276 URL: https://issues.apache.org/jira/browse/KAFKA-19276 Project

[jira] [Created] (KAFKA-19271) Private interface for injecting test wrappers for KIP-1071 enabled consumers

2025-05-12 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19271: -- Summary: Private interface for injecting test wrappers for KIP-1071 enabled consumers Key: KAFKA-19271 URL: https://issues.apache.org/jira/browse/KAFKA-19271

[jira] [Created] (KAFKA-19202) Enable KIP-1071 in streams system tests where it makes sense

2025-04-25 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19202: -- Summary: Enable KIP-1071 in streams system tests where it makes sense Key: KAFKA-19202 URL: https://issues.apache.org/jira/browse/KAFKA-19202 Project: Kafka

[jira] [Created] (KAFKA-19195) Group describe operations are forwarded to all group coordinator shards.

2025-04-24 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19195: -- Summary: Group describe operations are forwarded to all group coordinator shards. Key: KAFKA-19195 URL: https://issues.apache.org/jira/browse/KAFKA-19195 Project

[jira] [Resolved] (KAFKA-19118) Enable KIP-1071 in existing streams integration tests

2025-04-23 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-19118. Resolution: Fixed > Enable KIP-1071 in existing streams integration te

[jira] [Created] (KAFKA-19190) StreamsUncaughtExceptionHandlerIntegrationTest fails

2025-04-23 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19190: -- Summary: StreamsUncaughtExceptionHandlerIntegrationTest fails Key: KAFKA-19190 URL: https://issues.apache.org/jira/browse/KAFKA-19190 Project: Kafka

[jira] [Created] (KAFKA-19162) Topology description sent to broker contains non-determinstically ordered topic configs

2025-04-16 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19162: -- Summary: Topology description sent to broker contains non-determinstically ordered topic configs Key: KAFKA-19162 URL: https://issues.apache.org/jira/browse/KAFKA-19162

[jira] [Created] (KAFKA-19155) Update docs/security.html for streams-related RPCs

2025-04-16 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19155: -- Summary: Update docs/security.html for streams-related RPCs Key: KAFKA-19155 URL: https://issues.apache.org/jira/browse/KAFKA-19155 Project: Kafka Issue

Re: [VOTE] KIP-1101: Trigger rebalance on rack topology changes

2025-04-16 Thread Lucas Brutschy
+1 (binding) On Tue, Dec 17, 2024 at 2:08 AM 郭骏旺 wrote: > > +1 (non-binding) > > On Mon, Dec 16, 2024 at 5:01 PM PoAn Yang wrote: > > > Hi All, > > > > I would like to start vote on KIP-1101: > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1101%3A+Trigger+rebalance+on+rack+topology

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

2025-04-15 Thread Lucas Brutschy
nd we recommend custom ones to > >>>> also > >>>>>>>>>> be. > > With `group.version` change, we need to maintain two code in 4.1. One is > subscription > metadata without rack and another is group hash. Another drawback is that &g

Re: [ANNOUNCE] New committer: TengYao Chi

2025-04-10 Thread Lucas Brutschy
Congrats! On Thu, Apr 10, 2025 at 5:59 PM Chia-Ping Tsai wrote: > > You are the best! TengYao > > Matthias J. Sax 於 2025年4月10日 週四 下午11:55寫道: > > > The Project Management Committee (PMC) for Apache Kafka is pleased to > > announce TengYao Chi as a new Kafka committer. > > > > TengYao has been act

Re: [ANNOUNCE] New committer: Apoorv Mittal

2025-04-10 Thread Lucas Brutschy
Congrats! Well deserved, Apoorv! On Thu, Apr 10, 2025 at 5:59 PM Chia-Ping Tsai wrote: > > Welcome Apoorv as a committer! You deserve it! > > Matthias J. Sax 於 2025年4月10日 週四 下午11:56寫道: > > > The Project Management Committee (PMC) for Apache Kafka is pleased to > > announce Apoorv Mittal as a new

[jira] [Created] (KAFKA-19118) Enable KIP-1071 in existing streams integration tests

2025-04-09 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19118: -- Summary: Enable KIP-1071 in existing streams integration tests Key: KAFKA-19118 URL: https://issues.apache.org/jira/browse/KAFKA-19118 Project: Kafka

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

2025-04-09 Thread Lucas Brutschy
Hi PoAn, LB01: please add the removal of StreamsGroupPartitionMetadataKey / StreamsGroupPartitionMetadataValue to the KIP. Since these were not yet included in 4.0, we can just remove them as long as this KIP hits 4.1. I can help with the integration into the `streamsGroupHeartbeat`, as it will be

[jira] [Created] (KAFKA-19077) Propagate shutdownRequested field

2025-04-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19077: -- Summary: Propagate shutdownRequested field Key: KAFKA-19077 URL: https://issues.apache.org/jira/browse/KAFKA-19077 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-19044) Handle tasks that are not present in the current topology

2025-03-25 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19044: -- Summary: Handle tasks that are not present in the current topology Key: KAFKA-19044 URL: https://issues.apache.org/jira/browse/KAFKA-19044 Project: Kafka

Re: [DISCUSS] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

2025-03-24 Thread Lucas Brutschy
Hi, I agree with the KIP, it makes sense to reduce the number of ways the configs get passed. I agree with Sophie that it doesn't make sense to rewrite the topology compilation just to delay reading the configs. The question StreamsConfig vs. Map/Properties is less clear-cut to me. The immutabili

Re: [ANNOUNCE] Apache Kafka 4.0.0

2025-03-18 Thread Lucas Brutschy
t; > Comar, Eric Chang, Federico Valeri, Frederik Rouleau, GangHuo, > > > Gantigmaa Selenge, Gaurav Narula, Greg Harris, Guozhang Wang, Hailey > > > Ni, Hongten, Hyunsang Han, Ian McDonald, Igor Soarez, Ismael Juma, > > > Ivan Yurchenko, Jakub Scholz, Jason Gustafso

[jira] [Created] (KAFKA-19001) Use streams group-level configurations in heartbeat

2025-03-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19001: -- Summary: Use streams group-level configurations in heartbeat Key: KAFKA-19001 URL: https://issues.apache.org/jira/browse/KAFKA-19001 Project: Kafka

[jira] [Created] (KAFKA-18986) Properly handle configured topology soft-state using KIP-1101

2025-03-14 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18986: -- Summary: Properly handle configured topology soft-state using KIP-1101 Key: KAFKA-18986 URL: https://issues.apache.org/jira/browse/KAFKA-18986 Project: Kafka

[jira] [Resolved] (KAFKA-18887) Implement Admin API extensions beyond list/describe group (delete group, offset-related APIs)

2025-03-05 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-18887. Resolution: Fixed > Implement Admin API extensions beyond list/describe group (del

[jira] [Created] (KAFKA-18925) Add streams groups support in `Admin.listGroups`.

2025-03-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18925: -- Summary: Add streams groups support in `Admin.listGroups`. Key: KAFKA-18925 URL: https://issues.apache.org/jira/browse/KAFKA-18925 Project: Kafka Issue

Re: [DISCUSS] Apache Kafka 4.0.0 release

2025-03-04 Thread Lucas Brutschy
We discovered a regression in a specific Kafka Streams API. I filed a ticket here: https://issues.apache.org/jira/browse/KAFKA-18917 and a fix here: https://github.com/apache/kafka/pull/19089. The fix is small, I would suggest we include this fix in 4.0. On Tue, Mar 4, 2025 at 12:19 PM David Jacot

[jira] [Created] (KAFKA-18917) TransformValues with unnamed Materialized instance throws NPE

2025-03-04 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18917: -- Summary: TransformValues with unnamed Materialized instance throws NPE Key: KAFKA-18917 URL: https://issues.apache.org/jira/browse/KAFKA-18917 Project: Kafka

Re: [VOTE] KIP-1127: Flexible Windows for Late Arriving Data

2025-02-18 Thread Lucas Brutschy
+1 (binding) Thanks for the KIP! On Wed, Feb 5, 2025 at 8:06 AM Sophie Blee-Goldman wrote: > > +1 (binding) > > Thanks for the KIP! Neat and practical idea > > On Tue, Feb 4, 2025 at 10:52 AM Almog Gavra wrote: > > > Hello All, > > > > I'd like to start a vote on KIP-1127. Please take a look at

[jira] [Created] (KAFKA-18819) StreamsGroupHeartbeat API and StreamsGroupDescribe API must check topic describe

2025-02-18 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18819: -- Summary: StreamsGroupHeartbeat API and StreamsGroupDescribe API must check topic describe Key: KAFKA-18819 URL: https://issues.apache.org/jira/browse/KAFKA-18819

Re: [VOTE] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2025-02-12 Thread Lucas Brutschy
Tue, Dec 10, 2024 at 9:26 AM Bill Bejeck wrote: > > > >> Hi Sébastien, > >> > >> Thanks for the KIP! > >> > >> +1(binding) > >> > >> Regards, > >> Bill > >> > >> On Fri, Dec 6, 2024 at 4:33 AM Bruno Cadonn

[jira] [Created] (KAFKA-18739) Group-level streams configuration

2025-02-05 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18739: -- Summary: Group-level streams configuration Key: KAFKA-18739 URL: https://issues.apache.org/jira/browse/KAFKA-18739 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18730) Add replaying streams group state from offset topic

2025-02-04 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18730: -- Summary: Add replaying streams group state from offset topic Key: KAFKA-18730 URL: https://issues.apache.org/jira/browse/KAFKA-18730 Project: Kafka

Re: [DISCUSS] KIP-1124: Flexible Windows for Late Arriving Data

2025-01-28 Thread Lucas Brutschy
Hi Almog, this seems useful to me. I don't see anything wrong with the details of the proposal. More generally, I'd like to hear your thoughts on this vs. batching. Given the motivation section, it sounds we actually want something that I'd call "batching" rather than "windowing". If you do not r

[jira] [Created] (KAFKA-18652) Extended set of streams-specific broker configurations

2025-01-27 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18652: -- Summary: Extended set of streams-specific broker configurations Key: KAFKA-18652 URL: https://issues.apache.org/jira/browse/KAFKA-18652 Project: Kafka

[jira] [Created] (KAFKA-18651) Core streams-specific broker configurations

2025-01-27 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18651: -- Summary: Core streams-specific broker configurations Key: KAFKA-18651 URL: https://issues.apache.org/jira/browse/KAFKA-18651 Project: Kafka Issue Type

[jira] [Created] (KAFKA-18621) Add StreamsCoordinatorRecordHelpers

2025-01-22 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18621: -- Summary: Add StreamsCoordinatorRecordHelpers Key: KAFKA-18621 URL: https://issues.apache.org/jira/browse/KAFKA-18621 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18614) Add StreamsGroupDescribe handler in group coordinator

2025-01-21 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18614: -- Summary: Add StreamsGroupDescribe handler in group coordinator Key: KAFKA-18614 URL: https://issues.apache.org/jira/browse/KAFKA-18614 Project: Kafka

[jira] [Created] (KAFKA-18613) Add StreamsGroupHeartbeat handler in the group coordinator

2025-01-21 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18613: -- Summary: Add StreamsGroupHeartbeat handler in the group coordinator Key: KAFKA-18613 URL: https://issues.apache.org/jira/browse/KAFKA-18613 Project: Kafka

Re: [VOTE] KIP-1034: Dead letter queue in Kafka Streams

2025-01-03 Thread Lucas Brutschy
sponse { > >>> > >>> private ProductionExceptionHandlerResponse() { }; > >>> > >>> public static ProductionExceptionHandlerResponse continue(); > >>> public static ProductionExceptionHandlerResponse continue(List); > >>> > >>> p

[jira] [Resolved] (KAFKA-17946) Flaky test DeafultStateUpdaterTest::shouldResumeStandbyTask due to concurrency issue

2025-01-03 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-17946. Resolution: Fixed > Flaky test DeafultStateUpdaterTest::shouldResumeStandbyTask due

[jira] [Created] (KAFKA-18398) Log a warning if actual topic configs are inconsistent with the required topic configs

2025-01-03 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18398: -- Summary: Log a warning if actual topic configs are inconsistent with the required topic configs Key: KAFKA-18398 URL: https://issues.apache.org/jira/browse/KAFKA-18398

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2025-01-02 Thread Lucas Brutschy
ed field "Subtopology" to "SubtopologyId" since the field is > > the ID of the subtopology but that was not clear from the name. > > > > Best, > > Bruno > > > > > > On 8/28/24 2:06 PM, Lucas Brutschy wrote: > > > Hi Sophie, > >

[jira] [Created] (KAFKA-18325) Add TargetAssignmentBuilder

2024-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18325: -- Summary: Add TargetAssignmentBuilder Key: KAFKA-18325 URL: https://issues.apache.org/jira/browse/KAFKA-18325 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18324) Add CurrentAssignmentBuilder

2024-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18324: -- Summary: Add CurrentAssignmentBuilder Key: KAFKA-18324 URL: https://issues.apache.org/jira/browse/KAFKA-18324 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18323) Add StreamsGroup class

2024-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18323: -- Summary: Add StreamsGroup class Key: KAFKA-18323 URL: https://issues.apache.org/jira/browse/KAFKA-18323 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18322) Add StickyTaskAssignor

2024-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18322: -- Summary: Add StickyTaskAssignor Key: KAFKA-18322 URL: https://issues.apache.org/jira/browse/KAFKA-18322 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18321) Add StreamsGroupMember, MemberState and Assignment classes

2024-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18321: -- Summary: Add StreamsGroupMember, MemberState and Assignment classes Key: KAFKA-18321 URL: https://issues.apache.org/jira/browse/KAFKA-18321 Project: Kafka

[jira] [Created] (KAFKA-18319) Add task assignor interfaces

2024-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18319: -- Summary: Add task assignor interfaces Key: KAFKA-18319 URL: https://issues.apache.org/jira/browse/KAFKA-18319 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

2024-12-19 Thread Lucas Brutschy
Hi, I'm following this discussion thread. I may have more comments later, but for now - with KIP-1071 being accepted, could we just include the updates to KIP-1071 in this KIP? They'd be mostly identical, except that we don't have to use tagged versions, because no version of the records were rele

[jira] [Created] (KAFKA-18311) Port tooling to configure topologies to broker

2024-12-19 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18311: -- Summary: Port tooling to configure topologies to broker Key: KAFKA-18311 URL: https://issues.apache.org/jira/browse/KAFKA-18311 Project: Kafka Issue

[jira] [Created] (KAFKA-18287) Add support for kafka-streams-groups.sh --list

2024-12-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18287: -- Summary: Add support for kafka-streams-groups.sh --list Key: KAFKA-18287 URL: https://issues.apache.org/jira/browse/KAFKA-18287 Project: Kafka Issue

[jira] [Created] (KAFKA-18288) Add support kafka-streams-groups.sh --describe

2024-12-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18288: -- Summary: Add support kafka-streams-groups.sh --describe Key: KAFKA-18288 URL: https://issues.apache.org/jira/browse/KAFKA-18288 Project: Kafka Issue

[jira] [Created] (KAFKA-18286) Add support for streams groups to kafka-group.sh

2024-12-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18286: -- Summary: Add support for streams groups to kafka-group.sh Key: KAFKA-18286 URL: https://issues.apache.org/jira/browse/KAFKA-18286 Project: Kafka Issue

[jira] [Created] (KAFKA-18285) Add Admin.describeStreamsGroups

2024-12-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18285: -- Summary: Add Admin.describeStreamsGroups Key: KAFKA-18285 URL: https://issues.apache.org/jira/browse/KAFKA-18285 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18282) Implement StreamsGroupHeartbeat RPC

2024-12-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18282: -- Summary: Implement StreamsGroupHeartbeat RPC Key: KAFKA-18282 URL: https://issues.apache.org/jira/browse/KAFKA-18282 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18283) Implement StreamsGroupDescribe RPC

2024-12-17 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-18283: -- Summary: Implement StreamsGroupDescribe RPC Key: KAFKA-18283 URL: https://issues.apache.org/jira/browse/KAFKA-18283 Project: Kafka Issue Type: Sub-task

Re: [VOTE]: KIP-1071: Streams Rebalance Protocol

2024-12-13 Thread Lucas Brutschy
Thank you all for voting! The KIP is now accepted with: 3 binding +1 (Sophie, Andrew, Bill). 2 non-binding +1 (Alieh, Colt). No -1 or 0 votes. We will target 4.1 for a non-production opt-in implementation of this KIP. On Tue, Dec 10, 2024 at 1:18 AM Sophie Blee-Goldman wrote: > > +1 (binding)

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-12-06 Thread Lucas Brutschy
upType instead. > > Thanks, > Andrew > ____ > From: Lucas Brutschy > Sent: 04 December 2024 16:08 > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol > > Hi Andrew, > > thanks for the comments! > > You

Re: [VOTE] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-12-06 Thread Lucas Brutschy
Thanks for the KIP! +1 (binding) Cheers, Lucas On Fri, Dec 6, 2024 at 9:41 AM Sebastien Viale wrote: > > Hi, > > I'd like to start the vote on KIP- - Enforcing Explicit Naming for Kafka > Streams Internal Topics: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-%3A+Enforcing+E

Re: [VOTE] KIP-1034: Dead letter queue in Kafka Streams

2024-12-05 Thread Lucas Brutschy
Hi Sebastien, I believe the new proposal has a similar problem (since fields in interfaces are always static). Would you consider adding an overload of `handle` instead that passes a collection of DLQ records that can be mutated? That wouldn't be as clean as returning it in the return value, but w

Re: [DISCUSS] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-12-05 Thread Lucas Brutschy
gt;> > > >> - For repartition topics, they are all created in the > > >> KStreamImpl.createRepartitionedSource(...) static method. > > >> The method either receives a name explicitly provided by the user or > > >> null and builds the final repartition t

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-12-04 Thread Lucas Brutschy
s Rebalance Protocol > > Thanks Lucas! That all sounds good to me. > > I think I officially have nothing left to say or ask about this KIP, so > once you've > updated the doc with what we've discussed in the past few messages then > I'm personally fe

Re: [ANNOUNCE] New committer: Andrew Schofield

2024-12-02 Thread Lucas Brutschy
Congrats! Well deserved. Cheers, Lucas On Mon, Dec 2, 2024 at 4:20 PM Bill Bejeck wrote: > > Congrats Andrew! Well deserved. > > -Bill > > On Mon, Dec 2, 2024 at 10:11 AM Yash Mayya wrote: > > > Congrats Andrew! > > > > On Mon, 2 Dec, 2024, 20:26 PoAn Yang, wrote: > > > > > Congratulations And

Re: [VOTE] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

2024-11-28 Thread Lucas Brutschy
Hi PoAn, a minor follow-up question. The isClassic boolean in the Admin API, seems to use a boxed type `Boolean` instead of an unboxed boolean. It seems we could use the unboxed type here. Cheers, Lucas On Tue, Nov 26, 2024 at 1:55 AM PoAn Yang wrote: > > Hi everyone, > > Thanks for your voting

Re: [DISCUSS] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-11-28 Thread Lucas Brutschy
Hi all, Thanks for the KIP! Super useful. No new comments, let me just voice my opinion on the suggestions being made. A1: When I read `require.auto.generated.topic.names`, it sounds like explicit naming is not allowed if the config is true. This is not what we are doing here. So to avoid the ne

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-11-19 Thread Lucas Brutschy
ogy with member.topology_ID for purposes of > verification (eg detecting the STREAMS_INVALID_TOPOLOGY_EPOCH case) and get > verification on every heartbeat without all the extra bytes. Probably not > an issue most of the time but people can run some truly huge topologies. > > On Tue,

Re: [VOTE] KIP-655: Add deduplication processor in kafka-streams

2024-11-19 Thread Lucas Brutschy
Hi, thanks for the KIP! +1 (binding) Cheers, Lucas Ayoub Omari schrieb am Di., 19. Nov. 2024, 13:40: > Hi everyone, > > I would like to start a vote on KIP-655 which adds deduplication processor > in kafka-streams: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-655%3A+Windowed+Dist

Re: [DISCUSS] KIP-1112: allow custom processor wrapping

2024-11-19 Thread Lucas Brutschy
Hey, I'm a bit confused since the motivation promises a cleanup of topologyconfig/streams config, but this doesn't seem to be part of this kip. But on the whole, this change looks fine for me. Thanks for the KIP! Cheers, Lucas, Sophie Blee-Goldman schrieb am Di., 19. Nov. 2024, 00:48: > One m

Re: [VOTE] KIP-1112: allow custom processor wrapping

2024-11-19 Thread Lucas Brutschy
Thanks! +1 (binding) Lucas Bill Bejeck schrieb am Di., 19. Nov. 2024, 00:06: > Thanks for the KIP, Sophie, seems like a useful addition. > > +1(binding) > > -Bill > > On Mon, Nov 18, 2024 at 3:23 PM Sophie Blee-Goldman > > wrote: > > > Since there have been no concerns about this proposal I'm

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-11-19 Thread Lucas Brutschy
och is not valid, that means > >> > the topology ID is an old one and the group coordinator does not > >> > re-initialize the topology. > >> > > >> > The current topology epoch can be retrieved with the describe RPC. > >> > > >> > Acc

Re: [DISCUSS] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

2024-11-12 Thread Lucas Brutschy
Hi, 1. I don't think we can/should break backwards compatibility. 2. Have you considered using `BiFunction foreignKeyExtractor` ? This should work without renaming the method. 3. I don't see the benefit of deprecating it. I agree, we wouldn't add both overloads normally, but the value-only overloa

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-11-07 Thread Lucas Brutschy
> building off 848 vs introducing a separate Streams group protocol. This > > really helped me understand the motivations behind this decision. No notes! > > > > On Fri, Sep 6, 2024 at 7:17 AM Lucas Brutschy > > wrote: > > > >> Hi Sophie, > >&

Re: [VOTE] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

2024-11-07 Thread Lucas Brutschy
Hi, thanks for the KIP! +1 (binding) Cheers, Lucas On Thu, Nov 7, 2024 at 7:31 AM Chu Cheng Li wrote: > > Hi all, > > I'd like to call for a vote on KIP-1104 > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1104%3A+Allow+Foreign+Key+Extraction+from+Both+Key+and+Value+in+KTable+Joins > <

Re: [DISCUSS] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

2024-11-06 Thread Lucas Brutschy
Hey, this makes sense to me! Thank you for the KIP. I think the change is straightforward, and I think we can just vote this through. The only thing we could discuss is whether we want to keep the old overloads. I thought about it, but I think I agree that it's nicer to simplify the API a bit eve

  1   2   3   >