Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2025-02-18 Thread De Gao
community project and the vote is already open. So let the community decide what is the way. Thank you for your efforts to review this KIP. De Gao On 18 February 2025 18:14:27 GMT, Greg Harris wrote: >Hi De Gao, > >Thanks for your explanation. It sounds like this feature is appropriate in &g

Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2025-02-17 Thread De Gao
hese answer your concerns. Thanks again for your review! De Gao On 16 February 2025 23:43:30 GMT, Greg Harris wrote: >Hi De Gao, > >Thanks for the KIP! > >I'd like to re-raise the concerns that David and Justine have made, >especially the alternative of Tiered Storage and t

[VOTE] KIP-1114: Introducing Chunk in Partition

2025-02-16 Thread De Gao
Hi All: I would like to call for a vote for KIP-1114: Introducing Chunk in Partition https://cwiki.apache.org/confluence/display/KAFKA/KIP-1114%3A+Introducing+Chunk+in+Partition Discussion thread: https://lists.apache.org/thread/g000qyyd6ljbs6poqrodb7cog8mswf6v Thanks for all the reviews! De

Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2025-01-25 Thread De Gao
Hi All: I have updated the KIP to be more specific on the motivation based on the comments.Please review as you can. Appreciated. If no more review to follow I will submit the KIP for vote. Thank you! On 3 January 2025 22:36:06 GMT, De Gao wrote: >Thanks for the review. >This is an inter

Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2025-01-03 Thread De Gao
ion time/size. >Currently, Kafka supports only the earliest-offset strategy during >reassignment. And, this strategy will only work for topics >with cleanup policy set to "delete". > >-- >Kamal > >On Thu, Jan 2, 2025 at 10:23 PM David Arthur wrote: > >>

Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2025-01-03 Thread De Gao
ll be an enabler for many many smart ideas that will make Kafka more flexible and more powerful. Hope this answers your question. Thanks again for your review! On 2 January 2025 16:53:04 GMT, David Arthur wrote: >Hey De Gao, thanks for the KIP! > >As you’re probably aware, a Partiti

Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2024-12-31 Thread De Gao
ts of tier storage was that clusters >don't have to replicate tiered data anymore. Could you perhaps extend the >motivation of the KIP to include tier storage in the reflexion? > >Best, >David > >On Tue, Dec 10, 2024 at 10:46 PM De Gao wrote: > >> Hi All: >&g

Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2024-12-11 Thread De Gao
ribute on that while waiting for reviews. Regards De Gao On 11 December 2024 08:51:43 GMT, David Jacot wrote: >Hi, > >Thanks for the KIP. The community is pretty busy with the Apache Kafka 4.0 >release so I suppose that no one really had the time to engage in reviewing >the KIP yet.

Re: [DISCUSS] KIP-1114 Introducing Chunk in Partition

2024-12-10 Thread De Gao
Hi All: There were no discussion in the past week. Just want to double check if I missed anything? What should be the expectations on KIP discussion? Thank you! De Gao On 1 December 2024 19:36:37 GMT, De Gao wrote: >Hi All: > >I would like to start the discussion of KIP-1114 In

[DISCUSS] KIP-1114 Introducing Chunk in Partition

2024-12-01 Thread De Gao
Hi All: I would like to start the discussion of KIP-1114 Introducing Chunk in Partition. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1114%3A+Introducing+Chunk+in+Partition This KIP is complicated so I expect discussion will take longer time. Thank you in advance. De Gao

Request permission to contribute

2024-11-19 Thread De Gao
Hi: I want to propose a KIP. Could somebody grant me permission to contribute? Jira Id: gaode Confluence Id: gaode Thank you De Gao

Re: How Kafka handle partition leader change?

2023-11-21 Thread De Gao
is not about fix the message loss. Will share when ready. Thanks Andrew. From: Andrew Grant Sent: 21 November 2023 12:35 To: dev@kafka.apache.org Subject: Re: How Kafka handle partition leader change? Hey De Gao, Message loss or duplication can actually happen

Re: How Kafka handle partition leader change?

2023-11-20 Thread De Gao
I am asking this because I want to propose a change to Kafka. But looks like in certain scenario it is very hard to not loss or duplication messages. Wonder in what scenario we can accept that and where to draw the line? From: De Gao Sent: 21 November 2023 6:25

Re: How Kafka handle partition leader change?

2023-11-20 Thread De Gao
ntegration guarantee upon metadata change? From: Andrew Grant Sent: 20 November 2023 12:26 To: dev@kafka.apache.org Subject: Re: How Kafka handle partition leader change? Hey De Gao, The controller is the one that always elects a new leader. When that hap

How Kafka handle partition leader change?

2023-11-19 Thread De Gao
ynced between B1, B2, C, and Px that it is guaranteed that all the parties acknowledged the leadership change in the right order? Was there a break of produce flow in between? Any chance of message lost? Thanks De Gao