Kafka EOL policy

Hi, I have a question about the EOL policy in the link at the end. The paragraph below from the link says the releases in the past year will be supported. The 3 releases from last year 2020 are 2.5 in Mar, 2.6 in June and 2.7 in Nov. We have in this year 2021 2.8 in April, 3.0 in July and maybe

kafka streams application design on state stores

ble inputs. ChienHsing Wu

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

well enough. --CH -Original Message- From: Colin McCabe Sent: Tuesday, January 29, 2019 4:00 PM To: dev@kafka.apache.org Subject: Re: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer On Mon, Jan 28, 2019, at 06:57, ChienHsing Wu wrote

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

So... Does this non-response mean I should drop this topic after almost one month, folks? -Original Message- From: ChienHsing Wu Sent: Monday, January 21, 2019 12:47 PM To: dev@kafka.apache.org Subject: RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Hi all, not sure what to do next as weeks have gone by, guys. --CH -Original Message- From: ChienHsing Wu Sent: Monday, January 14, 2019 9:13 AM To: dev@kafka.apache.org Subject: RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer Hi, I

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Hi, I know everyone is busy. But I would appreciate someone letting me know what to do next. I started this effort back in last year early November... Thanks, CH -Original Message- From: ChienHsing Wu Sent: Monday, January 07, 2019 9:24 AM To: dev@kafka.apache.org Subject: RE

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Hi guys, I am not sure what to do next in this KIP process. Could anyone please help/advise me on what to do next? Thanks, CH -Original Message- From: ChienHsing Wu Sent: Wednesday, January 02, 2019 12:55 PM To: dev@kafka.apache.org Subject: RE: [EXTERNAL] - Re: [DISCUSS] KIP-387

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Consumption Across Partitions in KafkaConsumer Hi ChienHsing Wu, Maybe I'm misunderstanding something, but I'm not sure I see the need for a KIP here. You can just set max.partition.fetch.bytes to a very small value. That will cause Kafka to fetch only one message from each partition.

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

email when going through code contribution process. I am not sure what to do next in this KIP process. Could anyone please help/advise me on what to do next? Thanks! CH -Original Message- From: ChienHsing Wu Sent: Wednesday, December 12, 2018 1:05 PM To: dev@kafka.apache.org Subject: RE

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

, Mayuresh On Wed, Dec 12, 2018 at 6:01 AM ChienHsing Wu wrote: > Hi Mayuresh, > > Thanks for the input! > > Pausing and Resuming are cumbersome and has some undesirable > performance impact since pausing will in effect clean up the completed > fetch and resuming will cal

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

On Tue, Dec 11, 2018 at 11:03 AM ChienHsing Wu wrote: > Hi Mayuresh, > > To serve one poll call the logic greedily gets records from one > completed fetch before including records from the next completed fetch > from the queue, as you described. > > The algorithm remembers t

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

also moves the TopicPartition to the end of the assignment queue, once it has received data from broker for that TopicPartition, to maintain round robin fetch sequence for fairness. Thanks, Mayuresh On Tue, Dec 11, 2018 at 9:13 AM ChienHsing Wu wrote: > Jason, > > > > KIP 41 was

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

<https://cwiki.apache.org/confluence/display/KAFKA/KIP-387%3A+Fair+Message+Consumption+Across+Partitions+in+KafkaConsumer> would be very valuable. Thanks, ChienHsing -Original Message- From: ChienHsing Wu Sent: Tuesday, December 04, 2018 11:43 AM To: dev@kafka.apache.org Subject: R

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Hi, Any comments/updates? I am not sure the next steps if no one has any further comments. Thanks, CH -Original Message- From: ChienHsing Wu Sent: Tuesday, November 20, 2018 2:46 PM To: dev@kafka.apache.org Subject: RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption

RE: [EXTERNAL] - Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

partitions with records. What do you think? On Mon, Nov 19, 2018 at 9:11 AM ChienHsing Wu wrote: > Hi, could anyone please review this KIP? > > Thanks, ChienHsing > > From: ChienHsing Wu > Sent: Friday, November 09, 2018 1:10 PM > To: dev@kafka.apache.org > Subject: RE:

RE: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Hi, could anyone please review this KIP? Thanks, ChienHsing From: ChienHsing Wu Sent: Friday, November 09, 2018 1:10 PM To: dev@kafka.apache.org Subject: RE: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer Just to check: Will anyone review this? It's been s

RE: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Just to check: Will anyone review this? It's been silent for a week... Thanks, ChienHsing From: ChienHsing Wu Sent: Monday, November 05, 2018 4:18 PM To: 'dev@kafka.apache.org' Subject: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer Hi I just p

[DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

Hi I just put together the KIP page as requested. This email is to start the discussion thread. KIP: KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer Pull

request for wiki permission to create KIP

Hi, my ID is chienhsw. Please enable me to add KIP pages using this URL: https://cwiki.apache.org/confluence?templateId=54329345&spaceKey=KAFKA&newSpaceKey=KAFKA&title=KIP-NEXT%3A+Insert+Title+Here. I would like to add a KIP to discuss Kafak-3932 design. Thanks, CH

RE: [EXTERNAL] - Re: KAFKA-3932 - Consumer fails to consume in a round robin fashion

, why. Overall, this change seems to require a KIP anyway. Hope this helps. -Matthias On 10/30/18 9:38 AM, ChienHsing Wu wrote: > I just looked at the release schedule. I guess the 2.2 is around > Feb/2019, right? --CH > > -Original Message- > From: ChienHsing Wu > Se

RE: [EXTERNAL] - Re: KAFKA-3932 - Consumer fails to consume in a round robin fashion

I just looked at the release schedule. I guess the 2.2 is around Feb/2019, right? --CH -Original Message- From: ChienHsing Wu Sent: Tuesday, October 30, 2018 10:56 AM To: dev@kafka.apache.org Subject: RE: [EXTERNAL] - Re: KAFKA-3932 - Consumer fails to consume in a round robin

RE: [EXTERNAL] - Re: KAFKA-3932 - Consumer fails to consume in a round robin fashion

e released with 2.2.0 version, but _not_ with a potential 0.10.0.2 release. Does this make sense? -Matthias On 10/24/18 6:27 AM, ChienHsing Wu wrote: > I don't see any comments/concerns. I would like to implement and commit to > this ticket. Could anyone let me know how to request

RE: KAFKA-3932 - Consumer fails to consume in a round robin fashion

I don't see any comments/concerns. I would like to implement and commit to this ticket. Could anyone let me know how to request for the permission to assign that ticket to me? Thanks, CH From: ChienHsing Wu Sent: Monday, October 22, 2018 1:40 PM To: 'dev@kafka.apache.org' Subj

KAFKA-3932 - Consumer fails to consume in a round robin fashion

Hi, I encountered the issue documented in the jira KAFKA-3932. Upon studying the source code and the PIP, I t