Re: [DISCUSS] KIP-1124: Flexible Windows for Late Arriving Data

One minor suggestion: use BatchWindows instead of BatchedWindows. The version without the "ed" matches up with the established naming pattern and grammar used by other Windows classes: eg TimeWindows, SessionWindows, SlidingWindows Not a big deal though, won't redact my +1 on the voting thread if

Re: [VOTE] KIP-1127: Flexible Windows for Late Arriving Data

+1 (binding) Thanks for the KIP! Neat and practical idea On Tue, Feb 4, 2025 at 10:52 AM Almog Gavra wrote: > Hello All, > > I'd like to start a vote on KIP-1127. Please take a look at the KIP and > Discussion thread and let me know what you think. > > Note that the discussion thread was incorr

[jira] [Created] (KAFKA-18731) KStream-GlobalKTabel ValueJoinerWithKey passed incorrect key

Matthias J. Sax created KAFKA-18731: --- Summary: KStream-GlobalKTabel ValueJoinerWithKey passed incorrect key Key: KAFKA-18731 URL: https://issues.apache.org/jira/browse/KAFKA-18731 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #200

See

[jira] [Resolved] (KAFKA-18635) Re-enable the unclean shutdown detection when in ELR mode

[ https://issues.apache.org/jira/browse/KAFKA-18635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu resolved KAFKA-18635. Resolution: Fixed > Re-enable the unclean shutdown detection when in ELR mode > --

[jira] [Resolved] (KAFKA-16540) Update partitions when the min isr config is updated.

[ https://issues.apache.org/jira/browse/KAFKA-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu resolved KAFKA-16540. Resolution: Fixed > Update partitions when the min isr config is updated. > --

[jira] [Resolved] (KAFKA-18649) Complete ClearElrRecord handling in topic delta

[ https://issues.apache.org/jira/browse/KAFKA-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu resolved KAFKA-18649. Resolution: Fixed > Complete ClearElrRecord handling in topic delta >

[PR] Add Reddit as powered by Kafka [kafka-site]

nickgarvey opened a new pull request, #662: URL: https://github.com/apache/kafka-site/pull/662 This adds Reddit to the powered-by.html page as a business which is powered by Kafka. We make heavy use of Kafka heavily internally, thank you! https://kafka.apache.org/powered-by -- This

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #159

See

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

Hi All, Just a quick update on the KIP. After doing some work with IQv2 we will need to explicitly return the standby partitions in the `PartitionsByUserEndpoint` struct. This update involves adding a field `StandbyPartitions` of type `[]TopicPartition` in the `IQ-related` section of the response

[VOTE] KIP-1127: Flexible Windows for Late Arriving Data

Hello All, I'd like to start a vote on KIP-1127. Please take a look at the KIP and Discussion thread and let me know what you think. Note that the discussion thread was incorrectly prefixed with KIP-1124 instead of KIP-1127 (oops!). Link to KIP: https://cwiki.apache.org/confluence/display/KAFKA/

Re: [DISCUSS] KIP-1124: Flexible Windows for Late Arriving Data

Thanks for the discussion everyone! I've updated the Wiki with the following changes: - Renamed to BatchedWindows - Add a note in rejected alternatives about more general purpose (micro-)batching functionality since the scope of that is much wider. Since it looks like we've stabilized the discuss

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hi David, Thanks again for being the release manager for 4.0.0. I have this bug that I would like to include in 4.0.0: https://issues.apache.org/jira/browse/KAFKA-18723. I explained in a comment that it is not a regression but it would be good to include the fix if it makes the RC. What do you t

[jira] [Created] (KAFKA-18730) Add replaying streams group state from offset topic

Lucas Brutschy created KAFKA-18730: -- Summary: Add replaying streams group state from offset topic Key: KAFKA-18730 URL: https://issues.apache.org/jira/browse/KAFKA-18730 Project: Kafka Issue

[jira] [Resolved] (KAFKA-18691) Flaky test testFencingOnTransactionExpiration

[ https://issues.apache.org/jira/browse/KAFKA-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-18691. Fix Version/s: 4.0.0 Resolution: Fixed > Flaky test testFencingOnTransactionExpirat

[jira] [Reopened] (KAFKA-18635) Re-enable the unclean shutdown detection when in ELR mode

[ https://issues.apache.org/jira/browse/KAFKA-18635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu reopened KAFKA-18635: > Re-enable the unclean shutdown detection when in ELR mode >

[jira] [Reopened] (KAFKA-16540) Update partitions when the min isr config is updated.

[ https://issues.apache.org/jira/browse/KAFKA-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu reopened KAFKA-16540: > Update partitions when the min isr config is updated. >

[jira] [Reopened] (KAFKA-18649) Complete ClearElrRecord handling in topic delta

[ https://issues.apache.org/jira/browse/KAFKA-18649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu reopened KAFKA-18649: > Complete ClearElrRecord handling in topic delta > --- >

[jira] [Resolved] (KAFKA-18538) Add Streams membership manager

[ https://issues.apache.org/jira/browse/KAFKA-18538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-18538. --- Resolution: Fixed > Add Streams membership manager > -- > >

[jira] [Resolved] (KAFKA-18635) Re-enable the unclean shutdown detection when in ELR mode

[ https://issues.apache.org/jira/browse/KAFKA-18635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu resolved KAFKA-18635. Resolution: Fixed > Re-enable the unclean shutdown detection when in ELR mode > --

[jira] [Created] (KAFKA-18729) Improve consumer check for assigned topics from regex

Lianet Magrans created KAFKA-18729: -- Summary: Improve consumer check for assigned topics from regex Key: KAFKA-18729 URL: https://issues.apache.org/jira/browse/KAFKA-18729 Project: Kafka Iss

Re: [DISCUSS] KIP-1126: Serialize changes to Kafka with a build queue

Hi David, Setting the repo config to always be PR title & body would be good as it's a lot more predictable (most PRs have more than one commit by the end of the PR review, but there are exceptions and it's harder for a committer to update the commit message in such cases). The reviewers verifica

Re: [DISCUSS] KIP-1126: Serialize changes to Kafka with a build queue

Ismael, thanks for taking a look! We would need to alter the default commit message setting for the repository. The default (which we currently use) is PR title + PR body if there are multiple commits, or the commit subject and body if it's a single commit PR. We can change this to always be the P

Re: Manage dynamic members through java admin client

hi Armando Thanks for your question and contribution. Few questions are listed below. PTAL > I'm working in a java service that allows managing consumer group's members, specially to pause/resume them on demand. Out of curiosity, could you elaborate on how the removeMembersFromConsumerGroup meth

[jira] [Resolved] (KAFKA-18725) Fix test_bounce.py sys test

[ https://issues.apache.org/jira/browse/KAFKA-18725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18725. Resolution: Won't Fix duplicate to https://github.com/apache/kafka/pull/18798 > Fix test_

[jira] [Created] (KAFKA-18728) Move ListOffsetsPartitionStatus to server module

黃竣陽 created KAFKA-18728: --- Summary: Move ListOffsetsPartitionStatus to server module Key: KAFKA-18728 URL: https://issues.apache.org/jira/browse/KAFKA-18728 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18727) Move RequestChannel to server module

黃竣陽 created KAFKA-18727: --- Summary: Move RequestChannel to server module Key: KAFKA-18727 URL: https://issues.apache.org/jira/browse/KAFKA-18727 Project: Kafka Issue Type: Sub-task Reporter:

Re: Tagged fields constraint to start from tagId: 0

Got it. Thanks for clearing that up! -- Kamal On Tue, Feb 4, 2025 at 4:40 PM David Jacot wrote: > Hi Kamal, > > It is fine to relax the constraint in StructSpec for your internal tags. > For instance, you could allow your internal tags to start from id 1. It > is very unlikely that we will

Manage dynamic members through java admin client

Hi there, I'm working in a java service that allows managing consumer group's members, specially to pause/resume them on demand. After checking here and there it seems that the actual AdminClient makes this feasible through removeMembersFromConsumerGroup method [ https://kafka.apache.org/38/javado

[jira] [Created] (KAFKA-18726) Support for root cause exception as a nested exception to TimeoutException for Producer framework

Vineet Kumar created KAFKA-18726: Summary: Support for root cause exception as a nested exception to TimeoutException for Producer framework Key: KAFKA-18726 URL: https://issues.apache.org/jira/browse/KAFKA-18726

[jira] [Created] (KAFKA-18725) Fix test_bounce.py sys test

Chia-Ping Tsai created KAFKA-18725: -- Summary: Fix test_bounce.py sys test Key: KAFKA-18725 URL: https://issues.apache.org/jira/browse/KAFKA-18725 Project: Kafka Issue Type: Sub-task

Re: Tagged fields constraint to start from tagId: 0

Hi Kamal, It is fine to relax the constraint in StructSpec for your internal tags. For instance, you could allow your internal tags to start from id 1. It is very unlikely that we will ever have tags as part of the official protocol reaching that. Best, David On Mon, Feb 3, 2025 at 6:36 PM K

Re: [DISCUSS] KIP-1126: Serialize changes to Kafka with a build queue

This looks good to me. My only comment is that merge queues have a weird limitation: you cannot edit the commit message (unlike the traditional flow). I worry that this will result in lower quality commit messages. Is there a way to configure where the commit message comes from (PR title/descripti