Re: First time patch submitter advice

Hi Michael, The failed unit test has already handled here: https://issues.apache.org/jira/browse/KAFKA-10155 https://issues.apache.org/jira/browse/KAFKA-10147 So, maybe you can ignore the test errors and mention the issue number in PR. Thanks. Luke On Mon, Jun 15, 2020 at 3:23 PM Michael Carter

Re: New Website Layout

When entering streams doc, it'll always show: *You're viewing documentation for an older version of Kafka - check out our current documentation here.* On Wed, Aug 5, 2020 at 6:44 PM Ben Stopford wrote: > Thanks for the PR and feedback Michael. Appreciated. > > On Wed, 5 Aug 2020 at 10:49, Mick

Re: New Website Layout

the new layout is the tags are > > > empty, > > > > and no longer enclose the config name, > > > > > > > > > > > > > > > > batch.size > > > > > > > > > > > > meaning you can

Re: [DISCUSS] KIP-930: Tiered Storage Metrics

Hi Abhijeet, Thanks for the KIP! I don't have much preference for the name changing. But if it could confuse other people, it's good to make it clear. Thank you. Luke On Tue, Jul 25, 2023 at 2:53 PM Abhijeet Kumar wrote: > Hi Kamal, > > As we discussed offline, I will rename this KIP so that i

Re: KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum

Hi Colin, Some more comments: 1. In the KIP, we mentioned "controller heartbeats", but it is not explained anywhere. I think "controller heartbeats" = controller registration", is that correct? If no, please explain more about it in the KIP. 2. Following this question: > Which endpoint will the i

Re: [VOTE] KIP-930: Tiered Storage Metrics

+1 (binding) from me. Thanks. Luke On Tue, Jul 25, 2023 at 7:51 PM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > +1 (non-binding) > > Thanks, Abhijeet! > > > On Tue, 25 Jul 2023 at 14:22, Abhijeet Kumar > wrote: > > > Please find the updated link to the KIP: > > > > > https:

Re: [VOTE] KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add Controller Registration

+1 (binding) from me. Thanks for the KIP! Luke On Tue, Jul 25, 2023 at 1:24 AM Colin McCabe wrote: > Hi all, > > I'd like to start the vote for KIP-919: Allow AdminClient to Talk Directly > with the KRaft Controller Quorum and add Controller Registration. > > The KIP is here: https://cwiki.apa

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

gt; > > >> > > > uses PreferredReadReplica. So as long as leader is available, > > > >> > > > PreferredReadReplica would be found in subsequent fetches. > > > >> > > > > > > >> > > > Also, under this case,

Re: Request permission to contribute

Hi Qichao, Your accounts are all set up. Thanks. Luke On Mon, Jul 31, 2023 at 1:19 PM Qichao Chu wrote: > Hi Bruno, > > Is it ok for you to set me up for contribution too? I would like to create > a KIP. > My account ID in Confluence and JIRA is ex172000 and my email is > ex172...@gmail.com. >

Re: Request permission to contribute

Hi Adrian, Your account is all set. Thanks. Luke On Thu, Aug 3, 2023 at 4:25 PM Adrian Preston wrote: > Hello, > Please could my JIRA account (prestona) be given the permissions required > to contribute to Kafka? > Thanks, > Adrian > > Unless otherwise stated above: > > IBM United Kingdom Limi

Re: [DISCUSS] Apache Kafka 3.4.1 release

Hi José, Thanks for the reminder. Yes, I did miss that. Already updated and pushed. Thanks. Luke On Wed, Aug 9, 2023 at 8:08 AM José Armando García Sancio wrote: > Hey Luke, > > Thanks for working on the release for 3.4.1. I was working on some > cherry picks and I noticed that branch 3.4 does

Re: Requesting permissions to contribute to Apache Kafka

Hi Animesh, Your accounts are all set. Thanks. Luke On Tue, Aug 22, 2023 at 9:25 PM Animesh Kumar wrote: > Hi Team, > Please provide access to contribute to Apache Kafka > JIRA id -- akanimesh7 > Wiki Id -- akanimesh7 > -- > Animesh Kumar > 8120004556 >

Re: [REVIEW REQUEST] Move ReassignPartitionsCommandArgsTest to java

Hi, Sorry that we're mostly working on features for v3.6.0, which is expected to be released in the following weeks. I'll review your PR after releasing. (Please ping me then if I forget it!) Also, it'd be good if the devs in the community can help on PR review when available. That'll help a lot.

Re: FYI - CI failures due to Apache Infra (Issue with creating launcher for agent)

Thanks for the info, Divij! Luke On Mon, Aug 28, 2023 at 6:01 PM Divij Vaidya wrote: > Hey folks > > During you CI runs, you may notice that some test pipelines fail to > start with messages such as: > > "ERROR: Issue with creating launcher for agent builds38. The agent is > being disconnected"

Kafka jenkins is unavailable now

Hi all, Just found Kafka jenkins is unavailable currently. Filed an INFRA issue: https://issues.apache.org/jira/browse/INFRA-24940 FYI. Thanks. Luke

Re: Apache Kafka 3.6.0 release

Hi Satish, Since this PR: https://github.com/apache/kafka/pull/14366 only changes the doc, I've backported to 3.6 branch. FYI. Thanks. Luke On Thu, Sep 14, 2023 at 12:15 AM Justine Olshan wrote: > Hey Satish -- yes, you are correct. KAFKA-15459 only affects 3.6. > PR should be finalized soon.

Re: Help to the community with review

Hi nizhikov, Thank you for your consideration and help! Yes, we really need the community developers to help review PRs to share the loading. One thing to note, PR review is also counted as one of the contribution! Please do that soon if you have spare cycle. :) BTW, I'll review your PRs this wee

Re: Help to the community with review

Hi Taras, Thank you very much for your offers. Really appreciate it! For KIPs review, it's also great if the community can help review them if available. I'll also try my best to have a look when available. Thank you for your contribution! Luke On Tue, Sep 19, 2023 at 3:08 PM Taras Ledkov wrot

Re: [ANNOUNCE] New committer: Lucas Brutschy

Congratulations, Lukas! Luke On Fri, Sep 22, 2023 at 6:53 AM Tom Bentley wrote: > Congratulations! > > On Fri, 22 Sept 2023 at 09:11, Sophie Blee-Goldman > > wrote: > > > Congrats Lucas! > > >

Re: [ANNOUNCE] New committer: Yash Mayya

Congratulations, Yash! Luke On Fri, Sep 22, 2023 at 7:16 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) < hgerald...@bloomberg.net> wrote: > Congrats! Well deserved > > From: dev@kafka.apache.org At: 09/21/23 17:05:01 UTC-4:00To: > dev@kafka.apache.org > Cc: r...@confluent.io.invalid > Subject: Re:

Re: question

Hi 殿杰 In short, we don't support it now. But welcome to submit a PR to fix the gap. You can check this ticket for more information: https://issues.apache.org/jira/browse/KAFKA-7025 Thanks. Luke On Sat, Sep 23, 2023 at 2:14 AM shidian...@mxnavi.com wrote: > > hello， > > I‘m working inKafika

[ANNOUNCE] New Kafka PMC Member: Justine Olshan

Hi, Everyone, Justine Olshan has been a Kafka committer since Dec. 2022. She has been very active and instrumental to the community since becoming a committer. It's my pleasure to announce that Justine is now a member of Kafka PMC. Congratulations Justine! Luke on behalf of Apache Kafka PMC

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Satish, I found the current KRaft implementation will have "split brain" issue when network partition happens, which will cause inconsistent metadata returned from the controller. Filed KAFKA-15489 for this issue, and PR

Re: [kafka-clients] [VOTE] 3.6.0 RC1

; critical paths? > > > > 1. https://issues.apache.org/jira/browse/KAFKA-15489 > > > > Thanks, > > Satish. > > > > On Sat, 23 Sept 2023 at 03:08, Luke Chen wrote: > > > > > > Hi Satish, > > > > > > I found the current

Re: [kafka-clients] [VOTE] 3.6.0 RC1

> > > > > - Verified signature and checksum > > > - Built from source with Java 17 and Scala 2.13 > > > - Ran all unit and integration tests > > > - Spot checked release notes and documentation > > > - Ran a custom client using staging artifacts on

Re: [kafka-clients] [VOTE] 3.6.0 RC1

sues.apache.org/jira/browse/KAFKA-15001 > > > > 2. I was hoping you could post the results of system tests before I > > vote on this. I am particularly interested in looking at > > producer/consumer performance results since we have quite a few > > changes in this re

Re: [kafka-clients] [VOTE] 3.6.0 RC1

Hi Jose, Sounds good to me. Let's have further discussion in JIRA/PR, and target to v3.6.1/v3.7.0. Thanks. Luke On Tue, Sep 26, 2023 at 1:35 AM José Armando García Sancio wrote: > On Sat, Sep 23, 2023 at 3:08 AM Luke Chen wrote: > > > > Hi Satish, > > >

Re: [VOTE] 3.6.0 RC2

Hi Satish, I verified with: 1. Ran quick start in KRaft for scala 2.12 artifact 2. Making sure the checksum are correct 3. Browsing release notes, documents, javadocs, protocols. 4. Verified the tiered storage feature works well. +1 (binding). Thanks. Luke On Mon, Oct 2, 2023 at 5:23 AM Jakub

Re: [VOTE] 3.6.0 RC2

gt; > > > > > > > > > > https://github.com/apache/kafka/commit/2f71708955b293658cec3b27e9a5588d39c38d7e > > > > > > aren't available in the documentation (cc: Justine). I don't > > consider > > > > > this >

Re: Apache Kafka 3.7.0 Release

Thanks Stanislav! On Tue, Oct 10, 2023 at 3:05 AM Josep Prat wrote: > Thanks Stanislav! > > ——— > Josep Prat > > Aiven Deutschland GmbH > > Alexanderufer 3-7, 10117 Berlin > > Amtsgericht Charlottenburg, HRB 209739 B > > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen > > m: +491715557497 > >

Re: [ANNOUNCE] Apache Kafka 3.6.0

Gustafson, > Jeff Kim, Jim Galasyn, John Roesler, Joobi S B, Jorge Esteban Quilcate > Otoya, Josep Prat, Joseph (Ting-Chou) Lin, José Armando García Sancio, > Jun Rao, Justine Olshan, Kamal Chandraprakash, Keith Wall, Kirk True, > Lianet Magrans, LinShunKang, Liu Zeyu, lixy, Lucas Bradstre

[DISCUSS] Road to Kafka 4.0

Hi all, While Kafka 3.6.0 is released, I’d like to start the discussion for the “road to Kafka 4.0”. Based on the plan in KIP-833 , the next release 3.7 will be t

Re: [DISCUSS] 3.5.2 Release

Hi Levani and Divij, I can work on the 3.5.2 release. I'll start a new thread for volunteering it maybe next week. Thanks. Luke On Thu, Oct 12, 2023 at 5:07 PM Divij Vaidya wrote: > Hello Levani > > From a process perspective, there is no fixed schedule for bug fix > releases. If we have a vol

[DISCUSS] Apache Kafka 3.5.2 release

Hi all, I'd like to volunteer as release manager for the Apache Kafka 3.5.2, to have an important bug/vulnerability fix release for 3.5.1. If there are no objections, I'll start building a release plan in thewiki in the next couple of weeks. Thanks, Luke

Re: [DISCUSS] Apache Kafka 3.5.2 release

; Thanks Luke for volunteering for 3.5.2 release. > >>> > >>> On Tue, 17 Oct 2023 at 11:58, Josep Prat > >>> wrote: > >>>> > >>>> Hi Luke, > >>>> > >>>> Thanks for taking this one! > >>>> &

Re: Re: [DISCUSS] Apache Kafka 3.5.2 release

Tue, 17 Oct 2023 at 11:58, Josep Prat > wrote: > > > > Hi Luke, > > > > Thanks for taking this one! > > > > Best, > > > > On Tue, Oct 17, 2023 at 8:12 AM Luke Chen wrote: > > > > > Hi all, > > > > > > I'd like to

Re: [DISCUSS] Apache Kafka 3.5.2 release

nch, what would take at least > one week; we could do the cherry-pick on Monday and start testing. > > Please let us know if such a delay for 3.5.2 is acceptable or not. > > Thanks. > > -Matthias > > > On 10/20/23 5:44 AM, Luke Chen wrote: > > Hi Ryan, >

Re: UncleanLeaderElectionsPerSec metric and Raft

Hi Justine, Thanks for the response. I also agree that even if after KIP-966 the unclean leader election might be changed, we should still figure out if it's a missing feature or not, and what's our plan for it. Thanks. Luke On Mon, Oct 23, 2023 at 11:48 PM Justine Olshan wrote: > Hey Neil, >

Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

Congrats Satish! Luke On Sat, Oct 28, 2023 at 11:16 AM ziming deng wrote: > Congratulations Satish! > > > On Oct 27, 2023, at 23:03, Jun Rao wrote: > > > > Hi, Everyone, > > > > Satish Duggana has been a Kafka committer since 2022. He has been very > > instrumental to the community since becom

Re: [DISCUSS] Apache Kafka 3.5.2 release

Hi Matthias, Is there any update about the test status for RocksDB versions bumps? Could I create a 3.5.2 RC build next week? Thanks. Luke On Sat, Oct 21, 2023 at 1:01 PM Luke Chen wrote: > Hi Matthias, > > I agree it's indeed a blocker for 3.5.2 to address CVE in RocksDB. &

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

Hi Christo, Thanks for the KIP! Some comments: 1. I agree with Kamal that a metric to cover the time taken to read data from remote storage is helpful. 2. I can see there are some metrics are only on topic level, but some are on partition level. Could you explain why some of them are only on top

Re: [DISCUSS] Apache Kafka 3.5.2 release

e finished our testing, and think we are go. > > Thanks for giving us the opportunity to get the RocksDB version bump in. > Let's ship it! > > > -Matthias > > On 11/2/23 4:37 PM, Luke Chen wrote: > > Hi Matthias, > > > > Is there any update about the test

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

ation, it will have an effect on RLM task leading > to > > > > > > remote log copy and delete lags. > > > > > > > > > > > > RLMM and RSM implementations can always add more metrics for > > > > > > observability based on the res

Re: [VOTE] KIP-963: Additional metrics in Tiered Storage

+1 (binding) from me. Thanks for the KIP. Luke On Tue, Nov 21, 2023 at 11:53 AM Satish Duggana wrote: > +1 (binding) > Thanks for the KIP and the discussion. > > Discussion mail thread for the KIP: > https://lists.apache.org/thread/40vsyc240hyody37mf2f0pn90shkzb45 > > > > On Tue, 21 Nov 2023 at

[VOTE] 3.5.2 RC1

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.5.2. This is a bugfix release with several fixes since the release of 3.5.1, including dependency version bumps for CVEs. Release notes for the 3.5.2 release: https://home.apache.org/~s

Re: [DISCUSS] Road to Kafka 4.0

k8s controlling the DNS, you simply remap c.local > to point > >> >> >> ot the IP address of your new pod for controller 102, and you're > done. No > >> >> >> need to update controller.quorum.voters. > >> >> >> > >>

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

Hi Abhijeet, Thanks for the KIP! This is an important feature for tiered storage. Some comments: 1. Will we introduce new metrics for this tiered storage quotas? This is important because the admin can know the throttling status by checking the metrics while the remote write/read are slow, like t

Re: [DISCUSS] KIP-996: Pre-Vote

Hi Alyssa, Thanks for the KIP! This is an important improvement for KRaft quorum. Some comments: 1. Follower transitions to: Prospective: After expiration of the election timeout -> Is this the fetch timeout, not election timeout? 2. I also agree we don't bump the epoch in prospective state. A

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

rage data is deleted, or we need an additional >>> mechanism to handle the remote stray data. >>> >>> The existing topic deletion, for instance, handles stray logs on disk by >>> detecting them on KafkaBroker startup and deleting before the >>> ReplicaMana

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

Also, I think using `stopReplicas` request is a good idea because it won't cause any problems while migrating to KRaft mode. The stopReplicas request is one of the request that KRaft controller will send to ZK brokers during migration. Thanks. Luke On Fri, May 3, 2024 at 11:48 AM Luke

Re: [DISCUSS] KIP-1018: Introduce max remote fetch timeout config

Hi Kamal, Thanks for the KIP! Sorry for the late review. Overall LGTM! Just 1 question: If one fetch request contains 2 partitions: [p1, p2] fetch.max.wait.ms: 500, remote.fetch.max.wait.ms: 1000 And now, p1 fetch offset is the log end offset and has no new data coming, and p2 fetch offset is t

Re: request permissions to contribute to Kafka

Hi Zhisheng, I've granted your permission. Thank you. Luke On Tue, May 7, 2024 at 10:25 AM Zhisheng Zhang <31791909...@gmail.com> wrote: > Hi > > I'd like to request permissions to contribute to Kafka to propose a KIP > > Wiki ID：zhangzhisheng > Jira ID：zhangzhisheng > > Thank you >

Re: [VOTE] KIP-1018: Introduce max remote fetch timeout config

Hi Kamal, Thanks for the KIP! +1 from me. Thanks. Luke On Mon, May 6, 2024 at 5:03 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi all, > > We would like to start a voting thread for KIP-1018: Introduce > max remote fetch timeout config for DelayedRemoteFetch requests. > >

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

> >> > > >> 1. In the ZK mode, how will the transition from DISABLING to DISABLED > > >> state happen? > > >> For the "retain" policy, until we delete all the remote-log segments, > > the > > >> state will be > > >> D

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

aim to start a VOTE tomorrow > so we can get at least part of this KIP in 3.8. > > Best, > Christo > > On Fri, 10 May 2024 at 11:11, Luke Chen wrote: > > > Hi Christo, > > > > > 1. I am not certain I follow the question. From DISABLED you can only > go &

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hi Christo, In addition to the minor comments left in the discussion thread, it LGTM. +1 from me. Thank you. Luke On Tue, May 14, 2024 at 11:21 PM Christo Lolov wrote: > Heya! > > I would like to start a vote on KIP-950: Tiered Storage Disablement in > order to catch the last Kafka release ta

Re: [DISCUSS] Apache Kafka 3.7.1 release

Hi Igor, Thanks for volunteering! +1 Luke On Wed, May 15, 2024 at 11:15 PM Mickael Maison wrote: > Hi Igor, > > Thanks for volunteering, +1 > > Mickael > > On Thu, Apr 25, 2024 at 11:09 AM Igor Soarez wrote: > > > > Hi everyone, > > > > I'd like to volunteer to be the release manager for a 3.

Re: [VOTE] KIP-950: Tiered Storage Disablement

Thanks Chia-Ping! Since ZK is going to be removed, I agree the KRaft part has higher priority. But if Christo or the community contributor has spare time, it's good to have ZK part, too! Thanks. Luke On Thu, May 16, 2024 at 5:45 PM Chia-Ping Tsai wrote: > +1 but I prefer to ship it to KRaft onl

Re: [DISCUSS] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

LGTM! Thanks for raising this improvement. Luke On Thu, May 23, 2024 at 12:52 AM Chia-Ping Tsai wrote: > Thanks for Josep's response > > > We can add this to 3.8.0, but keep in mind the KIP is not voted yet (as > far > as I can see), so I would highly encourage to start the vote thread ASAP > a

Re: Inquire about a bug issue

Hi Jianbin, Thanks for asking. I'll review the PR this week or next week. Let's target this bug fix for v3.7.1 and v3.8.0. Thanks. Luke On Fri, May 24, 2024 at 11:20 AM Jianbin Chen wrote: > I would like to inquire if anyone is paying attention to this issue > https://issues.apache.org/jira/br

Re: [VOTE] KIP 1047 - Introduce new org.apache.kafka.tools.api.Decoder to replace kafka.serializer.Decoder

+1 (binding) Thanks Frank! Luke On Fri, May 24, 2024 at 5:21 PM Josep Prat wrote: > Hi Frank, > > thanks for the KIP. > +1 (binding) > > Best, > > On Fri, May 24, 2024 at 11:11 AM Kuan Po Tseng > wrote: > > > +1 (non-binding) > > > > On 2024/05/23 16:26:42 Frank Yang wrote: > > > Hi all, > > >

Kafka jenkins is unable to run and view old builds.

Hi all, Currently, the Kafka jenkins is unable to run and view old builds. I've filed INFRA-25824 to infra team. Thanks. Luke

Re: Action requested: Changes to CI for JDK 11 & 17 builds on Pull Requests

> I did not see build failure that happens in 11 and 17 but not in 8 or 21, and also it can save more CI resources and make our CI be thinner. Same here. I've never seen build passed in jdk 21 but failed in 11 or 17. But even if it happened, it is rare. I think we are just making a trade-off to mak

Re: Action requested: Changes to CI for JDK 11 & 17 builds on Pull Requests

Wow! I've never seen this beautiful green on jenkins for years! Thanks Greg!! Luke On Tue, May 28, 2024 at 4:12 PM Chia-Ping Tsai wrote: > Please take a look at following QA. ALL PASS!!! > > > https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-15889/25/pipeline >

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep, Thanks for raising this. I'm +1 for delaying some time to have features completed. But I think we might need to make it clear, what's the updated feature freeze date/code freeze date? Is this correct? - Feature freeze is on May 12th - Code freeze is June 26th Thanks. Luke On Wed, May

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Justine, In the KIP-1012 discussion thread , our conclusion should be having an "automatic" unclean leader election in KRaft, even if KIP-966 cannot complete in time. > We should specify in KIP-1012 that we need to have some way

Re: Build hanging

Hi Haruki, Thanks for identifying this blocking test. Could you help quickly open a PR to disable this test to unblock the CI build? Thanks. Luke On Sat, Jun 8, 2024 at 8:20 AM Haruki Okada wrote: > Hi > > I found that the hanging can be reproduced locally. > The blocking test is > > "org.apac

Re: Build hanging

eed to fix it anyways not only disabling test before 3.8 release. > Let's disable for now to unblock builds, and revert later if we can't solve > it until code freeze? > > 2024年6月8日(土) 9:31 Luke Chen : > > > Hi Haruki, > > > > Thanks for identifying this b

Re: [DISCUSS] Apache Kafka 3.8.0 release

Hi Josep For KIP-966, I think Calvin had mentioned he won't complete in v3.8.0. https://lists.apache.org/thread/fsnr8wy5fznzfso7jgk90skgyo277fmw For unclean leader election, all we need is this PR: https://github.com/apache/kafka/pull/16284 For this PR, I think it needs one more week to be comple

Re: [DISCUSS] Apache Kafka 3.8.0 release

I'm also +1 to have 3.8 release on time, and have a shorter release cycle for v3.9. But we have to explicitly define what "shorter release cycle" means. I agree with Greg's suggestion: cutting the 3.9 branch immediately after the Kraft KIPS are feature-complete, or 4 months after the 3.8 release, w

Re: [VOTE] 3.7.1 RC1

Hi all, After running system tests, here are failing tests: 1. kafkatest.tests.core.upgrade_test failed at lz4 and snappy tests: KAFKA-16962 2. StreamsUpgradeTest failed at "fromVersion"=2.2 ~ 2.5, but passed for the rest of the versions: KAFKA

Re: [VOTE] 3.7.1 RC1

se > fixes. > > Justine > > On Fri, Jun 14, 2024 at 6:19 PM Matthias J. Sax wrote: > > > Replied on https://issues.apache.org/jira/browse/KAFKA-16960 > > > > On 6/14/24 6:05 AM, Luke Chen wrote: > > > Hi all, > > > > > > After runnin

Re: [DISCUSS] KIP-1057: Add remote log metadata flag to the dump log tool

Hi Federico, Thanks for the KIP! It's helpful for debugging the tiered storage issues. +1 from me. Thanks. Luke On Tue, Jun 18, 2024 at 12:18 AM Satish Duggana wrote: > Thanks Federico for the KIP. > > This feature is helpful for developers while debugging tiered storage > related issues. > >

Re: [VOTE] 3.7.1 RC2

Hi Igor, I had run system tests against this RC2, and all passed except: kafkatest.tests.core.upgrade_test failed at lz4 and snappy tests: KAFKA-16962 --> This test tested the upgrade from version [0.9 ~ 3.6] to v3.7, and only v0.9 failed, others

Re: [DISCUSS] KIP-1052: Enable warmup in producer performance test

Hi Matt, Thanks for the KIP! I agree having the warm-up records could help correctly analyze the performance. Some questions: 1. It looks like we will add 2 more options to producer perf tool: - --warmup-records - --combined-summary Is this correct? In the "public interface" section, only 1 is

Re: [VOTE] KIP-1057: Add remote log metadata flag to the dump log tool

Hi Fede, Thanks for the KIP! +1 from me. Luke On Fri, Jun 21, 2024 at 6:44 PM Federico Valeri wrote: > Hi all, I'd like to kick off a vote on KIP-1057. > > Design doc: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1057%3A+Add+remote+log+metadata+flag+to+the+dump+log+tool > > Discus

Re: [VOTE] 3.7.1 RC2

Hi Igor, I think we've passed the vote for the release. Are we waiting for anything to release v3.7.1? Please let me know if you need help. Thanks. Luke On Wed, Jun 26, 2024 at 5:17 AM Justine Olshan wrote: > Hey folks, > > Sorry for the delay. I have done the following: > > > 1. Checked sign

Re: [ANNOUNCE] Apache Kafka 3.7.1

Katona, Andrew Schofield, Anna > Sophie Blee-Goldman, Anton Liauchuk, Apoorv Mittal, Ayoub Omari, Bill > Bejeck, Bruno Cadonna, Calvin Liu, Cameron Redpath, Cheng-Kai Zhang, > Chia-Ping Tsai, Chris Egerton, Colin Patrick McCabe, David Arthur, David > Jacot, Divij Vaidya, Dmitry Werner

Re: [DISCUSS] Apache Kafka 3.8.0 release

>> > > pinging > >>> >>> >>> > > >>>>> KIPs > >>> >>> >>> > > >>>>>>> and Jira reporters asking for their status as some > >>> Jiras > >>> >>> >>> se

Re: [DISCUSS] Apache Kafka 3.8.0 release

"/home/jlprat/projects/kafka/tests/venv39/lib64/python3.9/site-packages/ducktape-0.8.14-py3.9.egg/ducktape/services/service.py", > line 293, in wait > raise TimeoutError("Timed out waiting %s seconds for service nodes > to finish. " % str(timeout_sec) > ducktape.errors.TimeoutEr

Re: [DISCUSS] KIP-1066: Mechanism to cordon brokers and log directories

Hi Mickael, Thanks for the KIP! This is a long waiting feature for many users! Questions: 1. I think piggyback the "BrokerHeartbeatRequest" to forward the corden log dir to controller makes sense to me. We already did similar things for fence, controller shutdown, failed log dir...etc. 2. In the

Re: [DISCUSS] KIP-1066: Mechanism to cordon brokers and log directories

> update. > > > > The benefit is to let users have their optimized policy for specific > > scenario. Also, it can avoid that we add more and more mechanism to our > > code base. Of course we can merge the mechanism which can be used by 99% > > users :smile > > &g

Re: [DISCUSS] KAFKA-17094: How should unregistered broker nodes be handled in KRaft quorum state?

Hi Tina, Thanks for starting the discussion thread. This is indeed a problem if users don't know which node ID need to be unregistered. I'm +1 for adding another field in the response to include registered observer nodes that are inactive. That will make it clear and won't confuse existing users.

Re: [VOTE] KIP-1067: Remove ReplicaVerificationTool in 4.0 (deprecate in 3.9)

+1 (binding) from me. Thanks Dongjin. Luke On Thu, Jul 11, 2024 at 12:23 AM Justine Olshan wrote: > +1 (binding) > > Thanks, > Justine > > On Mon, Jul 8, 2024 at 1:59 AM Chia-Ping Tsai wrote: > > > > > > > Note that we already have this tracker for tools deprecations, but I'm > > > fine to hav

Re: [VOTE] 3.8.0 RC0

Thanks Mickael! +1 for increasing the test coverage for admin clients. But I don't think this should be the blocker for v3.8.0, given the delay of v3.8.0 and we already have many releases with this state. What do you think? Thanks. Luke On Mon, Jul 15, 2024 at 4:57 PM Mickael Maison wrote: > Hi

Re: [VOTE] 3.8.0 RC0

Sounds good! Thank you. Luke On Mon, Jul 15, 2024 at 5:11 PM Mickael Maison wrote: > Yeah I've not marked it as a blocker for 3.8.0. It's just something we > need to do in the background. > > On Mon, Jul 15, 2024 at 11:05 AM Luke Chen wrote: > > > > Thanks

Re: Getting Started: requesting permissions to contribute to Apache Kafka

Hi Rich, Your accounts are all set. Thanks. Luke On Mon, Jul 22, 2024 at 12:37 AM Rich C. wrote: > Hi team, > > Following Getting Started #4 > < > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals > >, > I would like to request permission to contribute to Apache Kaf

Re: Wiki Kafka Kip access

Hi Mason, Your accounts are all set. Thanks. Luke On Sun, Jul 21, 2024 at 6:25 PM Mason Chen wrote: > Hi there, > > I would like to have the right access permission to create Kip. My wiki id > and jira id are both masonc. Thank you for the help! > > Best regards, > Mason >

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hi all, While implementing the feature in KRaft mode, I found something we need to change the original proposal: (1) In the KIP of "Disablement - KRaft backed Cluster

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hi all, I just found the table is not able to be displayed correctly in the email. I've put the table content in google doc here <https://docs.google.com/document/d/1Y_cSkXr-qQiFFlFoGqfzGHE9m9MnIvZSgGpFP5l5o4I/edit?usp=sharing> . Thanks. Luke On Thu, Jul 25, 2024 at 6:30 PM Luke

Re: [VOTE] KIP-950: Tiered Storage Disablement

to keep the > remote.log.disable.policy, but only allow it to take a value of "delete". > > What are your thoughts? > > Best, > Christo > > > On Thu, 25 Jul 2024 at 12:10, Luke Chen wrote: > > > Hi all, > > > > I just found the ta

Re: [VOTE] KIP-950: Tiered Storage Disablement

>> > >> Pardon me, I'm a bit confused. > >> > >> when `remote.storage.enable=true`, `remote.log.delete.on.disable=false` > is > >> no-op > >> when `remote.storage.enable=false`, `remote.log.delete.on.disable=false` > >> is > >

Re: [VOTE] KIP-950: Tiered Storage Disablement

ot; for the desired > topic, indicating the disablement of tiered storage. > > 2. Can we clarify in the public interface that the StopReplica v5, > tiered_epoch, and tiered_state changes are required only for ZK mode and > won't be implemented? > > Thanks, > Kamal > >

Re: New release branch 3.9

Hi Colin and all, If KIP-853 can complete in v3.9.0 in time (or a little delay), I agree we should try to keep v3.9.0 as the last release before v4.0. This way, it will let all Kafka ecosystem projects have a clear (and certain) picture about what will happen in Apache Kafka. Hi Colin, For KIP-95

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 3.8.0

shwin Pankaj, Ayoub Omari, Bruno Cadonna, Calvin > > Liu, > > > > >> Cameron Redpath, charliecheng630, Cheng-Kai, Zhang, Cheryl > Simmons, > > > > Chia > > > > >> Chuan Yu, Chia-Ping Tsai, ChickenchickenLove, Chris Egerton, Chris > >

Re: [VOTE] KIP-950: Tiered Storage Disablement

.byes` or -2 (which means `retention.ms` value to be used) So, basically, we don't change the original design, just want to make sure users are aware of the retention policy change after disabling remote log copy. Let me know if you have any comments. Thank you. Luke On Fri, Jul 26, 2024 at 8:17 

Re: [VOTE] KIP-950: Tiered Storage Disablement

ed a guardrail to make sure user understands that disabling > > tiered storage will delete the remote storage data. This is by setting > > "remote.log.delete.on.disable" should be true before setting > > "remote.storage.enable" as false. > > > > >

Re: [DISCUSS] KIP-1073 Return inactive observer nodes in DescribeQuorum response

Hi Gantigmaa, Thanks for the KIP! The motivation and change looks good to me. Some comments: 1. typo: When a KRaft broker node shuts down, it is in "fenced" state, not "unfenced" state 2. Will the "–include-inactive-observers" option apply to " kafka-metadata-quorum.sh describe --replication"? I

Re: [VOTE] KIP-877: Mechanism for plugins and connectors to register metrics

Hi Mickael, Thanks for the KIP. +1 (binding) from me. Thanks. Luke On Fri, Aug 2, 2024 at 4:57 AM Tom Bentley wrote: > +1 (binding). > > Thanks Mickael! > > On Thu, 1 Aug 2024 at 05:12, Mickael Maison > wrote: > > > Hi, > > > > Bumping this thread to get some more votes and/or feedback. > > >

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

Hi Kamal, Thanks for the KIP! I think it is a good improvement to avoid users making many list_offset requests to starve other high priority requests. Questions: 1. When consumer poll the partitions first time, it'll also try to call list_offset to get the offset to fetch. If this offset is locat

  1   2   3   4   5   6   7   8   9   10   >