Re: KRaft Observer node unable to recover after (re-)bootstrapping to Follower node

2025-05-29 Thread Alyssa Huang
I may have reproduced the issue with a test, but will give another update tomorrow. Best, Alyssa On Thu, May 29, 2025 at 3:30 PM Alyssa Huang wrote: > Thanks Justin, > > It's hard to say from the current details if it's simply a network issue > (e.g. broker never receives th

Re: KRaft Observer node unable to recover after (re-)bootstrapping to Follower node

2025-05-29 Thread Alyssa Huang
Thanks Justin, It's hard to say from the current details if it's simply a network issue (e.g. broker never receives the response with the leaderId), bug (broker does receive response with leaderId, never transitions to follower), or something else. Could you potentially send over logs from the mis

[jira] [Created] (KAFKA-19319) Don't reset election timeout for prospective on transition to prospectiveVoted

2025-05-20 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-19319: Summary: Don't reset election timeout for prospective on transition to prospectiveVoted Key: KAFKA-19319 URL: https://issues.apache.org/jira/browse/KAFKA-

Re: [VOTE] KIP-1166: Improve high-watermark replication

2025-05-05 Thread Alyssa Huang
Hey Jose, KIP looks good to me as well! On Mon, May 5, 2025 at 10:08 AM Jun Rao wrote: > Hi, Jose, > > Thanks for the KIP. +1 > > Jun > > On Fri, May 2, 2025 at 8:42 AM José Armando García Sancio > wrote: > > > Hi all, > > > > Thanks for the discussion. I would like to start the voting thread

Re: [DISCUSS] KIP-1166: Improve high-watermark replication

2025-04-30 Thread Alyssa Huang
Thanks José for the edits, just one more clarification on the wording of this section The current implementation parks the FETCH request if all of these > conditions are true: fetch request has a wait time, fetch request has a > wait time, fetch request requires data, fetch request doesn't have en

Re: [DISCUSS] KIP-1166: Improve high-watermark replication

2025-04-29 Thread Alyssa Huang
Hi José, Wondering if there is perhaps a typo - under *KRaft Handling *the wording mentions parking the request if the HWM in the request is >= to the leader's > If the response is empty and the remote replica's HWM is greater than or > equal to the leader's HWM, the FETCH request is parked. Und

[jira] [Created] (KAFKA-19047) Broker registrations are slow if previously fenced or shutdown

2025-03-26 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-19047: Summary: Broker registrations are slow if previously fenced or shutdown Key: KAFKA-19047 URL: https://issues.apache.org/jira/browse/KAFKA-19047 Project: Kafka

[jira] [Created] (KAFKA-18967) Additional MetadataSchemaCheckerTool tests

2025-03-12 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18967: Summary: Additional MetadataSchemaCheckerTool tests Key: KAFKA-18967 URL: https://issues.apache.org/jira/browse/KAFKA-18967 Project: Kafka Issue Type

[jira] [Created] (KAFKA-18955) MetadataSchemaCheckerTool bug fixes

2025-03-11 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18955: Summary: MetadataSchemaCheckerTool bug fixes Key: KAFKA-18955 URL: https://issues.apache.org/jira/browse/KAFKA-18955 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-17644) TLA+ spec modifications

2025-02-07 Thread Alyssa Huang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alyssa Huang resolved KAFKA-17644. -- Resolution: Fixed > TLA+ spec modifications > --- > >

[jira] [Created] (KAFKA-18563) move RaftClientTestContext xyzRpcVersion methods into RaftProtocol

2025-01-15 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18563: Summary: move RaftClientTestContext xyzRpcVersion methods into RaftProtocol Key: KAFKA-18563 URL: https://issues.apache.org/jira/browse/KAFKA-18563 Project: Kafka

[jira] [Created] (KAFKA-18562) standardize election/fetch timeout between Unattached and Followers

2025-01-15 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18562: Summary: standardize election/fetch timeout between Unattached and Followers Key: KAFKA-18562 URL: https://issues.apache.org/jira/browse/KAFKA-18562 Project: Kafka

[jira] [Created] (KAFKA-18561) remove withKip853Rpc and replace with withRaftProtocol

2025-01-15 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18561: Summary: remove withKip853Rpc and replace with withRaftProtocol Key: KAFKA-18561 URL: https://issues.apache.org/jira/browse/KAFKA-18561 Project: Kafka Issue

[jira] [Created] (KAFKA-18560) raft HW metric resets after transition to leader

2025-01-15 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18560: Summary: raft HW metric resets after transition to leader Key: KAFKA-18560 URL: https://issues.apache.org/jira/browse/KAFKA-18560 Project: Kafka Issue Type

[jira] [Created] (KAFKA-18439) Add invariant to Raft simulation test for prevote

2025-01-07 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18439: Summary: Add invariant to Raft simulation test for prevote Key: KAFKA-18439 URL: https://issues.apache.org/jira/browse/KAFKA-18439 Project: Kafka Issue Type

[jira] [Created] (KAFKA-18438) Pre-Vote followups

2025-01-07 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18438: Summary: Pre-Vote followups Key: KAFKA-18438 URL: https://issues.apache.org/jira/browse/KAFKA-18438 Project: Kafka Issue Type: Task Reporter

[jira] [Created] (KAFKA-18394) Formalize durable and in-memory election state changes

2025-01-02 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18394: Summary: Formalize durable and in-memory election state changes Key: KAFKA-18394 URL: https://issues.apache.org/jira/browse/KAFKA-18394 Project: Kafka Issue

[jira] [Created] (KAFKA-18389) Do not lose votedKey on transition to LeaderState

2025-01-01 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18389: Summary: Do not lose votedKey on transition to LeaderState Key: KAFKA-18389 URL: https://issues.apache.org/jira/browse/KAFKA-18389 Project: Kafka Issue Type

[jira] [Created] (KAFKA-18379) Enforce resigned cannot transition to any other state in same epoch

2024-12-30 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18379: Summary: Enforce resigned cannot transition to any other state in same epoch Key: KAFKA-18379 URL: https://issues.apache.org/jira/browse/KAFKA-18379 Project: Kafka

[jira] [Created] (KAFKA-18378) standardize raft quorum state transitions

2024-12-30 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18378: Summary: standardize raft quorum state transitions Key: KAFKA-18378 URL: https://issues.apache.org/jira/browse/KAFKA-18378 Project: Kafka Issue Type

[jira] [Created] (KAFKA-18377) pollResigned can short circuit to unattached on receiving all endquorum acks

2024-12-30 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18377: Summary: pollResigned can short circuit to unattached on receiving all endquorum acks Key: KAFKA-18377 URL: https://issues.apache.org/jira/browse/KAFKA-18377 Project

[jira] [Created] (KAFKA-18345) Investigate if binaryExponentialElectionBackoffMs can be removed or improved

2024-12-23 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18345: Summary: Investigate if binaryExponentialElectionBackoffMs can be removed or improved Key: KAFKA-18345 URL: https://issues.apache.org/jira/browse/KAFKA-18345 Project

[jira] [Created] (KAFKA-18333) Simulation test should include invariant that quorum state never loses state

2024-12-20 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18333: Summary: Simulation test should include invariant that quorum state never loses state Key: KAFKA-18333 URL: https://issues.apache.org/jira/browse/KAFKA-18333 Project

[jira] [Created] (KAFKA-18332) Fix KafkaRaftClient complexity

2024-12-20 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18332: Summary: Fix KafkaRaftClient complexity Key: KAFKA-18332 URL: https://issues.apache.org/jira/browse/KAFKA-18332 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-12-09 Thread Alyssa Huang
t; > > > >>>>> Regards, > > > > > > > >>>>> Tina > > > > > > > >>>>> > > > > > > > >>>>> On Tue, Nov 19, 2024 at 12:14 PM Luke Chen < > > >

[jira] [Created] (KAFKA-18187) Replicas that receive EndQuorum should grant preVotes in that epoch

2024-12-08 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18187: Summary: Replicas that receive EndQuorum should grant preVotes in that epoch Key: KAFKA-18187 URL: https://issues.apache.org/jira/browse/KAFKA-18187 Project: Kafka

[jira] [Created] (KAFKA-18149) Docs improvement for 3.9

2024-12-03 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18149: Summary: Docs improvement for 3.9 Key: KAFKA-18149 URL: https://issues.apache.org/jira/browse/KAFKA-18149 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-18039) Test all versions of quorum responses in RequestResponseTest

2024-11-19 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18039: Summary: Test all versions of quorum responses in RequestResponseTest Key: KAFKA-18039 URL: https://issues.apache.org/jira/browse/KAFKA-18039 Project: Kafka

[jira] [Created] (KAFKA-18001) KafkaNetworkChannel missing UpdateRaftVoterRequestData logic

2024-11-12 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-18001: Summary: KafkaNetworkChannel missing UpdateRaftVoterRequestData logic Key: KAFKA-18001 URL: https://issues.apache.org/jira/browse/KAFKA-18001 Project: Kafka

Re: [DISCUSS] Apache Kafka 4.0.0 release

2024-11-06 Thread Alyssa Huang
Thanks David for being the release manager for 4.0! I noticed the release plan does not yet have KIP-996 (Pre-Vote) listed, can I edit the page to add it? Best, Alyssa On Sun, Oct 20, 2024 at 11:36 AM Colin McCabe wrote: > H

[jira] [Created] (KAFKA-17675) Add tests to RaftEventSimulationTest

2024-10-01 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17675: Summary: Add tests to RaftEventSimulationTest Key: KAFKA-17675 URL: https://issues.apache.org/jira/browse/KAFKA-17675 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-17642) Add ProspectiveState and ProspectiveStateTest

2024-09-27 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17642: Summary: Add ProspectiveState and ProspectiveStateTest Key: KAFKA-17642 URL: https://issues.apache.org/jira/browse/KAFKA-17642 Project: Kafka Issue Type

[jira] [Created] (KAFKA-17641) Update vote RPC with new pre-vote field

2024-09-27 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17641: Summary: Update vote RPC with new pre-vote field Key: KAFKA-17641 URL: https://issues.apache.org/jira/browse/KAFKA-17641 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-17644) TLA+ spec modifications

2024-09-27 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17644: Summary: TLA+ spec modifications Key: KAFKA-17644 URL: https://issues.apache.org/jira/browse/KAFKA-17644 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-17643) Response handling for pre-vote set to True

2024-09-27 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17643: Summary: Response handling for pre-vote set to True Key: KAFKA-17643 URL: https://issues.apache.org/jira/browse/KAFKA-17643 Project: Kafka Issue Type: Sub

[jira] [Created] (KAFKA-17604) Describe quorum output missing added voters endpoints

2024-09-24 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17604: Summary: Describe quorum output missing added voters endpoints Key: KAFKA-17604 URL: https://issues.apache.org/jira/browse/KAFKA-17604 Project: Kafka Issue

[jira] [Created] (KAFKA-17282) pollUnattachedAsObserver should not consider electionTimeoutMs

2024-08-06 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17282: Summary: pollUnattachedAsObserver should not consider electionTimeoutMs Key: KAFKA-17282 URL: https://issues.apache.org/jira/browse/KAFKA-17282 Project: Kafka

[jira] [Created] (KAFKA-17243) MetadataQuorumCommand describe to include CommittedVoters

2024-08-01 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17243: Summary: MetadataQuorumCommand describe to include CommittedVoters Key: KAFKA-17243 URL: https://issues.apache.org/jira/browse/KAFKA-17243 Project: Kafka

[jira] [Created] (KAFKA-17206) Use v1 of LeaderChangeMessage when kraft.version is 1

2024-07-26 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-17206: Summary: Use v1 of LeaderChangeMessage when kraft.version is 1 Key: KAFKA-17206 URL: https://issues.apache.org/jira/browse/KAFKA-17206 Project: Kafka Issue

Re: [DISCUSS] Apache Kafka 3.9.0 release

2024-06-14 Thread Alyssa Huang
Thanks Colin, +1 from me. On Fri, Jun 14, 2024 at 10:55 AM Colin McCabe wrote: > Hi all, > > Based on the discussion in the 3.8 release thread, we will need a 3.9 > release. I guess I should create a new email thread to discuss this. > > I'd like to volunteer as release manager for the Apache Ka

[jira] [Created] (KAFKA-16927) Adding tests for restarting followers receiving leader endpoint correctly

2024-06-10 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16927: Summary: Adding tests for restarting followers receiving leader endpoint correctly Key: KAFKA-16927 URL: https://issues.apache.org/jira/browse/KAFKA-16927 Project

[jira] [Created] (KAFKA-16926) Optimize BeginQuorumEpoch heartbeat

2024-06-10 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16926: Summary: Optimize BeginQuorumEpoch heartbeat Key: KAFKA-16926 URL: https://issues.apache.org/jira/browse/KAFKA-16926 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-16833) PartitionInfo missing equals and hashCode methods

2024-05-23 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16833: Summary: PartitionInfo missing equals and hashCode methods Key: KAFKA-16833 URL: https://issues.apache.org/jira/browse/KAFKA-16833 Project: Kafka Issue

[jira] [Created] (KAFKA-16655) deflake ZKMigrationIntegrationTest.testDualWrite

2024-05-01 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16655: Summary: deflake ZKMigrationIntegrationTest.testDualWrite Key: KAFKA-16655 URL: https://issues.apache.org/jira/browse/KAFKA-16655 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16616) refactor mergeWith in MetadataSnapshot

2024-04-24 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16616: Summary: refactor mergeWith in MetadataSnapshot Key: KAFKA-16616 URL: https://issues.apache.org/jira/browse/KAFKA-16616 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16427) KafkaConsumer#position() does not respect timeout when group protocol is CONSUMER

2024-03-26 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16427: Summary: KafkaConsumer#position() does not respect timeout when group protocol is CONSUMER Key: KAFKA-16427 URL: https://issues.apache.org/jira/browse/KAFKA-16427

Re: [DISCUSS] KIP-996: Pre-Vote

2024-02-13 Thread Alyssa Huang
Thank you Ziming, I guess it's misleading to say "Raft paper" when I'm actually referring to the extended version of the paper (Ongaro's PHD thesis). I have that version linked but I'll update the language to be more specific! On Wed, Feb 7, 2024 at 7:16 PM ziming deng wrote: > Hi Alyssa, > > I

[jira] [Created] (KAFKA-16164) Pre-Vote

2024-01-18 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-16164: Summary: Pre-Vote Key: KAFKA-16164 URL: https://issues.apache.org/jira/browse/KAFKA-16164 Project: Kafka Issue Type: Improvement Reporter

Re: [VOTE] KIP-996: Pre-Vote

2023-12-12 Thread Alyssa Huang
Hello! Thank you all for your votes. I'm closing the vote as it's been 72 hours since the start of the voting thread. KIP-996 has PASSED with 3 binding votes. Best, Alyssa On Fri, Dec 8, 2023 at 12:58 PM Jun Rao wrote: > Hi, Alyssa, > > Thanks for the KIP. +1 > > Jun > > On Fri, Dec 8, 2023 at

[VOTE] KIP-996: Pre-Vote

2023-12-07 Thread Alyssa Huang
Hey folks, I would like to start a vote on Pre-vote 😉 Thank you Jose, Jason, Luke, and Jun for your comments on the discussion thread! Here's the link to the proposal - https://cwiki.apache.org/confluence/display/KAFKA/KIP-996%3A+Pre-Vote

Re: [DISCUSS] KIP-996: Pre-Vote

2023-12-06 Thread Alyssa Huang
er scenarios" voters 4 and 5 > are partitioned from the majority of the voters. We don't want voters > 4 and 5 increasing their epoch and transitioning to the candidate > state else they would disrupt the quorum established by voters 1, 2 > and 3. > Yes, this is basically the sce

Re: [DISCUSS] KIP-996: Pre-Vote

2023-12-05 Thread Alyssa Huang
o Candidate phase once it hits the exception, and send standard vote requests to all servers. Any PreVote responses received while in Candidate phase would be ignored. On Tue, Dec 5, 2023 at 10:10 AM Alyssa Huang wrote: > Hey folks, thanks for the reviews! > Addressing them one by one. From Lu

Re: [DISCUSS] KIP-996: Pre-Vote

2023-12-05 Thread Alyssa Huang
Hey folks, thanks for the reviews! Addressing them one by one. From Luke - Some comments: > 1. Follower transitions to: Prospective: After expiration of the election > timeout > -> Is this the fetch timeout, not election timeout? > Yes, thanks for this catch! > 2. I also agree we don't bump the

Re: [DISCUSS] KIP-996: Pre-Vote

2023-11-28 Thread Alyssa Huang
Thanks Jose, I've updated the KIP to reflect your and Jason's suggestions! On Tue, Nov 28, 2023 at 9:54 AM José Armando García Sancio wrote: > Hi Alyssa > > On Mon, Nov 27, 2023 at 1:40 PM Jason Gustafson > wrote: > > 2. Do you think the pretend epoch bump is necessary? Would it be simpler > to

Re: [DISCUSS] KIP-996: Pre-Vote

2023-11-27 Thread Alyssa Huang
the prevote acceptance check to assert a greater than or equal > epoch? > > Best, > Jason > > > On Wed, Nov 22, 2023 at 11:51 AM Alyssa Huang > > wrote: > > > Hey folks, > > > > Starting a discussion thread for Pre-Vote design. Appreciate your > comments > > in advance! > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-996%3A+Pre-Vote > > > > Best, > > Alyssa > > >

[DISCUSS] KIP-996: Pre-Vote

2023-11-22 Thread Alyssa Huang
Hey folks, Starting a discussion thread for Pre-Vote design. Appreciate your comments in advance! https://cwiki.apache.org/confluence/display/KAFKA/KIP-996%3A+Pre-Vote Best, Alyssa

Re: Requesting to be added to Kafka project

2023-10-12 Thread Alyssa Huang
> > -Bill > > On Fri, Apr 30, 2021 at 5:26 PM Alyssa Huang > wrote: > > > Oops, yes I'd like to be added to JIRA, my username is alyssahuang. > > > > Thanks! > > > > On Fri, Apr 30, 2021 at 2:06 PM Justine Olshan > > > > wrote: >

[jira] [Created] (KAFKA-14992) Add partition limit or improve error msg for adminzkclient

2023-05-11 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-14992: Summary: Add partition limit or improve error msg for adminzkclient Key: KAFKA-14992 URL: https://issues.apache.org/jira/browse/KAFKA-14992 Project: Kafka

[jira] [Created] (KAFKA-14153) UnknownTopicOrPartitionException should include the topic/partition in the returned exception message

2022-08-09 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-14153: Summary: UnknownTopicOrPartitionException should include the topic/partition in the returned exception message Key: KAFKA-14153 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-13665) Null pointer exception testPollReturnsNoRecords

2022-02-10 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-13665: Summary: Null pointer exception testPollReturnsNoRecords Key: KAFKA-13665 URL: https://issues.apache.org/jira/browse/KAFKA-13665 Project: Kafka Issue Type

Re: Requesting to be added to Kafka project

2021-04-30 Thread Alyssa Huang
Oops, yes I'd like to be added to JIRA, my username is alyssahuang. Thanks! On Fri, Apr 30, 2021 at 2:06 PM Justine Olshan wrote: > Hi Alyssa, > Are you asking to be added to JIRA? If so, can you provide your jira > username? > > Thanks, > Justine > > On Fri, A

Requesting to be added to Kafka project

2021-04-30 Thread Alyssa Huang
Hello, I'm interested in contributing to Kafka! Can I be added to the project? Best, Alyssa

[jira] [Created] (KAFKA-10558) Fetch Session Cache Performance Improvement

2020-09-30 Thread Alyssa Huang (Jira)
Alyssa Huang created KAFKA-10558: Summary: Fetch Session Cache Performance Improvement Key: KAFKA-10558 URL: https://issues.apache.org/jira/browse/KAFKA-10558 Project: Kafka Issue Type