Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

Hi Lucas and all others, Thanks for the proposals regarding the topology upgrades! I have an additional proposal: We introduce a topology epoch alongside the topology ID. The topology epoch is set to 0 on the group coordinator for a new group. The topology epoch is also a config within the St

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #101

See

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

Hi all, I have updated the KIP with some details around how we handle the cases when essential topics required by the topology are not present. This is described in a new section "Handling topic topology mismatches". The short summary is that we enter a state where the group member's heartbeats wi

Re: [DISCUSS] KIP-1102: Enable clients to rebootstrap based on timeout or error code

Hi, Rajini, Thanks for the explanation. The KIP looks good to me now. Also, it seems that metadata.recovery.strategy is missing for AdminClientConfigs in https://kafka.apache.org/documentation/#adminclientconfigs. Not sure why this is happening since it's autogenerated. Jun On Thu, Nov 7, 2024

Re: [VOTE] KIP-1102: Enable clients to rebootstrap based on timeout or error code

Hi, Rajini, Thanks for the KIP. +1 Jun On Tue, Nov 5, 2024 at 1:26 AM Rajini Sivaram wrote: > Hi everyone, > > I would like to start vote on KIP-1102 ( > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1102%3A+Enable+clients+to+rebootstrap+based+on+timeout+or+error+code > ). > This KIP

Re: Kafka cache node not in use to be removed.

Gavin, I would still like to pursue this for Kafka. While we don't need the remote cache for our builds (we make do with the GitHub Actions Cache currently), I think the Develocity remote build cache would still be useful for speeding up local development. At least, I would like to be able to kick

Re: [DISCUSS] KIP-1103: Additional metrics for cooperative consumption

Hi, Apoorv, Thanks for the updated KIP. A few more minor comments. 10. Should InFlightMessageCount be Gauge to match InFlightBatchCount? 11. It seems that FetchLockTimeMs should be Histogram since we care about the distribution over time instead of just the current value. Also, it might be useful

Re: [DISCUSS] KIP-1103: Additional metrics for cooperative consumption

hi Apoorv sorry for late response: AS0: How can users distinguish between the group and topic in the format share-partition={group-topic-partition} since `-` is a valid character in both group and topic? AS1: Why do we only have metrics for failed AcknowledgementRequests? Aren't successful Ac

[jira] [Resolved] (KAFKA-17913) Fix KRaft controller count recommendations

[ https://issues.apache.org/jira/browse/KAFKA-17913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17913. Fix Version/s: 4.0.0 Resolution: Fixed > Fix KRaft controller count recommendations

[DISCUSS] KIP-1108 Publish skipped record metrics in Connect

Howdy, I would like to propose a new (hopefully not too controversial) KIP to publish new metrics to accurately report the number of skipped records in Kafka Connect. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1108%3A+Publish+metrics+for+skipped+records+in+Kafka+Connect I look

Re: [DISCUSS] Require KIPs to include "How to teach this section"

Oh I see... The link actually goes to a "template" (this is wiki feature), while there is also a "KIP Template" wiki page (https://cwiki.apache.org/confluence/display/KAFKA/KIP-Template) -- this is not a "template" but just a regular wiki page... Sounds like a split brain problem... We have

[jira] [Created] (KAFKA-17958) Publish metrics for skipped records in Kafka Connect

Hector Geraldino created KAFKA-17958: Summary: Publish metrics for skipped records in Kafka Connect Key: KAFKA-17958 URL: https://issues.apache.org/jira/browse/KAFKA-17958 Project: Kafka

Re: [DISCUSS] KIP-1106: Add duration based offset reset option for consumer clients

Hi, Manikumar, Thanks for the KIP. A couple of comments. JR1. It doesn't seem that we need earliest_local. Intuitively, it makes sense for a consumer app to bootstrap based on time. The time that a topic is kept locally seems irrelevant to a consumer application. JR2. I took a look at the propos

Re: [DISCUSS] KIP-1103: Additional metrics for cooperative consumption

Hi, Apoorv, 11. I was thinking that it would be useful to know if there is any tension when acquiring the share partition lock. This is not quite captured by FetchLockTimeMs. Perhaps we could add another metric that measures the amount of time that a request needs to wait before acquiring a lock.

[jira] [Created] (KAFKA-17959) Avoid Reverse DNS Lookup for IP-Based SSL Authentication in Kraft Mode

Arushi Helms created KAFKA-17959: Summary: Avoid Reverse DNS Lookup for IP-Based SSL Authentication in Kraft Mode Key: KAFKA-17959 URL: https://issues.apache.org/jira/browse/KAFKA-17959 Project: Kafka

Re: [VOTE] 3.9.0 RC5

Thanks, Josep. best, Colin On Wed, Nov 6, 2024, at 23:58, Josep Prat wrote: > Hi Colin, > I see that you made 3.9 the default docs version in Kafka-Site. However, as > your doc changes were pushed before the 3.8.1 release, now the upgrade.html > page doesn't mention 3.8.1 at all. I'll update the

Re: [DISCUSS] KIP-1102: Enable clients to rebootstrap based on timeout or error code

Thanks Jun! Looks like the configs are not ordered alphabetically, but metadata.recovery.strategy is included here: https://kafka.apache.org/documentation/#adminclientconfigs_metadata.recovery.strategy . Regards, Rajini On Thu, Nov 7, 2024 at 6:51 PM Jun Rao wrote: > Hi, Rajini, > > Thanks f

[jira] [Resolved] (KAFKA-17576) Fix all references to kraft/server.properties to use reconfig-server.properties

[ https://issues.apache.org/jira/browse/KAFKA-17576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17576. Fix Version/s: 4.0.0 Resolution: Fixed > Fix all references to kraft/server.propert

[jira] [Resolved] (KAFKA-7108) "Exactly-once" stream breaks production exception handler contract

[ https://issues.apache.org/jira/browse/KAFKA-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7108. Resolution: Duplicate > "Exactly-once" stream breaks production exception handler contract

[jira] [Resolved] (KAFKA-17805) Deprecate named topologies

[ https://issues.apache.org/jira/browse/KAFKA-17805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-17805. - Resolution: Fixed > Deprecate named topologies > -- > >

Re: [PR] Add dash0 to powered-by [kafka-site]

mjsax merged PR #637: URL: https://github.com/apache/kafka-site/pull/637 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.or

Re: [VOTE] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

+1 (binding) On 11/7/24 3:51 AM, Lucas Brutschy wrote: Hi, thanks for the KIP! +1 (binding) Cheers, Lucas On Thu, Nov 7, 2024 at 7:31 AM Chu Cheng Li wrote: Hi all, I'd like to call for a vote on KIP-1104 https://cwiki.apache.org/confluence/display/KAFKA/KIP-1104%3A+Allow+Foreign+Key+Ext

Re: [DISCUSS] KIP-1103: Additional metrics for cooperative consumption

Hi Jun and Chia, Thanks for the feedback. 10. Done. 11. I have moved FetchLockTimeMs to Histogram. I didn't understand which ratio shall FetchLockRatio Metric should hold i.e. against what value we should compare the partitions locked. Though I have added Metric RequestTopicPartitionsFetchRatio w

Re: How to Rate limit number of messages while writing Spark DataFrame to kafka topic

You cannot throttle via configs producer side, but maybe Kafka quotas can help? -Matthias On 11/7/24 2:53 AM, Divyanshu kumar wrote: 0 I have a spark dataframe which I am writing to Kafka topic using the below script. val ProducerConfig: Ma

Re: Issue with kafka, where to discuss

I would recommend the user mailing list. On 11/6/24 10:02 PM, Divyanshu kumar wrote: Hi, I am facing an issue with kafka requirements. where to discuss them with community ?

Re: [DISCUSS] KIP-1102: Enable clients to rebootstrap based on timeout or error code

Thanks, Rajini. Yes, it's there for AdminClientConfig. I missed it. Jun On Thu, Nov 7, 2024 at 11:56 AM Rajini Sivaram wrote: > Thanks Jun! > > Looks like the configs are not ordered alphabetically, but > metadata.recovery.strategy is included here: > > https://kafka.apache.org/documentation/#a

Re: [DISCUSS] KIP-1103: Additional metrics for cooperative consumption

Hi Jun, 11. Got it, agree. I was thinking either to have FetchLockRatio or FetchLockIdleRatio, though both of them should convey the same information. I have added FetchLockRatio as per your suggestion. Also I have added TopicPartitionsAcquireTimeMs which can track the time spent by any share fetc

Re: [PR] Add blog entry for Kafka 3.9 [kafka-site]

cmccabe merged PR #641: URL: https://github.com/apache/kafka-site/pull/641 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.

[ANNOUNCE] Apache Kafka 3.9.0

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.9.0 - This is a major release, the final one in the 3.x line. (There may of course be other minor releases in this line, such as 3.9.1.) - Tiered storage will be considered production-ready in this release. - This w

Re: [DISCUSS] Require KIPs to include "How to teach this section"

Yeah, I agree, we should unify these! I'm not sure which of the paths you described are better. Is there any advantage to the "actual template" instead of the wiki page named template? The latter seems easier for me to understand, but maybe others feel differently? best, Colin On Thu, Nov 7,

Re: [VOTE] KIP-1081: Graduation Steps for KIPs

Hi Josep, Continuing the discussion from the other thread: I'm still not 100% convinced that we need a distinction between "in development" and "experimental." In both cases, end-users can't make use of the feature. So why not condense them into one step? With regard to "preview", I think "use

[jira] [Created] (KAFKA-17960) PlaintextAdminIntegrationTest.testConsumerGroups fails when using AsyncKafkaConsumer

Kirk True created KAFKA-17960: - Summary: PlaintextAdminIntegrationTest.testConsumerGroups fails when using AsyncKafkaConsumer Key: KAFKA-17960 URL: https://issues.apache.org/jira/browse/KAFKA-17960 Projec

[jira] [Created] (KAFKA-17961) TransactionsBounceTest.testWithGroupId fails with CONSUMER group protocol

Kirk True created KAFKA-17961: - Summary: TransactionsBounceTest.testWithGroupId fails with CONSUMER group protocol Key: KAFKA-17961 URL: https://issues.apache.org/jira/browse/KAFKA-17961 Project: Kafka

Re: [DISCUSS] Require KIPs to include "How to teach this section"

It'a not a huge difference. Maybe just try it our yourself and click the link "Create KIP" in step (1) here: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=50859233#KafkaImprovementProposals-Process It just uses the actual template to create a new wiki page, and opens it in e

Re: [PR] Add blog entry for Kafka 3.9 [kafka-site]

satishd commented on code in PR #641: URL: https://github.com/apache/kafka-site/pull/641#discussion_r1832377617 ## blog.html: ## @@ -22,6 +22,122 @@ Blog + + + +Apache Kafka 3.9

[VOTE] KIP-1103: Additional metrics for cooperative consumption

Hi All, I would like to start vote on KIP-1103: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1103%3A+Additional+metrics+for+cooperative+consumption Discussion thread: https://lists.apache.org/thread/cfh2n46918b573vqlqj3v7q06nsyorb5 Regards, Apoorv Mittal

Re: [DISCUSS] KIP-1105: Make remote log manager thread-pool configs dynamic

Thanks Kamal for the KIP. This is useful for dynamically changing the thread pool configurations, especially in production environments. We can skip remote.log.manager.thread.pool.size as it is already deprecated, and remote.log.manager.copier.thread.pool.size, remote.log.manager.expiration.thread.

[jira] [Resolved] (KAFKA-17933) Add ShareRoundTripWorker for ShareConsumers.

[ https://issues.apache.org/jira/browse/KAFKA-17933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivsundar R resolved KAFKA-17933. -- Resolution: Fixed > Add ShareRoundTripWorker for ShareConsumers. > ---

[jira] [Resolved] (KAFKA-17743) Add minBytes implementation to DelayedShareFetch

[ https://issues.apache.org/jira/browse/KAFKA-17743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-17743. - Fix Version/s: 4.0.0 Resolution: Fixed merged the PR to trunk > Add minBytes implementation to D

Re: [PR] MINOR: Add rolling upgrade instructions for 3.9 [kafka-site]

jlprat merged PR #644: URL: https://github.com/apache/kafka-site/pull/644 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.o

Re: [VOTE] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

Hi, thanks for the KIP! +1 (binding) Cheers, Lucas On Thu, Nov 7, 2024 at 7:31 AM Chu Cheng Li wrote: > > Hi all, > > I'd like to call for a vote on KIP-1104 > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1104%3A+Allow+Foreign+Key+Extraction+from+Both+Key+and+Value+in+KTable+Joins > <

[jira] [Created] (KAFKA-17956) Remove Admin.listShareGroups in favour of Admin.listGroups

Andrew Schofield created KAFKA-17956: Summary: Remove Admin.listShareGroups in favour of Admin.listGroups Key: KAFKA-17956 URL: https://issues.apache.org/jira/browse/KAFKA-17956 Project: Kafka

[jira] [Resolved] (KAFKA-17329) Implement DefaultShareStatePersister

[ https://issues.apache.org/jira/browse/KAFKA-17329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-17329. -- Resolution: Fixed > Implement DefaultShareStatePersister > ---

How to Rate limit number of messages while writing Spark DataFrame to kafka topic

0 I have a spark dataframe which I am writing to Kafka topic using the below script. val ProducerConfig: Map[String, String] = Map( s"kafka.${ProducerConfig.REQUEST_TIMEOUT_MS_CONFIG}" -> Integer.MAX_VALUE.toString, s"kafka.${ProducerCon

[jira] [Created] (KAFKA-17957) Console share consumer unable to consume all messages when using multiple brokers

Abhinav Dixit created KAFKA-17957: - Summary: Console share consumer unable to consume all messages when using multiple brokers Key: KAFKA-17957 URL: https://issues.apache.org/jira/browse/KAFKA-17957 P

Re: [DISCUSS] KIP-1105: Make remote log manager thread-pool configs dynamic

Thanks for updating the KIP by addressing with the review comments. On Thu, 7 Nov 2024 at 21:38, Kamal Chandraprakash wrote: > > Hi Satish, > > Thanks for the review! Yes, we won't be enabling the deprecated config as > dynamic. > Removed the remote.log.manager.thread.pool.size config from the KI

Re: [DISCUSS] KIP-1105: Make remote log manager thread-pool configs dynamic

Hi Satish, Thanks for the review! Yes, we won't be enabling the deprecated config as dynamic. Removed the remote.log.manager.thread.pool.size config from the KIP. Currently, the config is not marked as deprecated which was already proposed in KIP-950, we can mark that config as deprecated in the

Re: [VOTE] KIP-1105: Make remote log manager thread-pool configs dynamic

+1 (binding) On Thu, 7 Nov 2024 at 13:55, Federico Valeri wrote: > > +1 (non binding) > > Thanks > > On Thu, Nov 7, 2024 at 5:46 AM Chu Cheng Li wrote: > > > > +1 > > > > On Thu, Nov 7, 2024 at 12:39 PM Kamal Chandraprakash < > > kamal.chandraprak...@gmail.com> wrote: > > > > > Hi all, > > > > >

Extending SinkConnectorConfig

Greetings, Please excuse any ignorance but my reading of the code indicates that SinkConnectorConfig should be used for the configuration of sink connectors. However, there is no mechanism to add additional items to the configuration as the ConfigDef is created during construction and passed as a

[PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

jlprat opened a new pull request, #643: URL: https://github.com/apache/kafka-site/pull/643 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

showuon commented on PR #643: URL: https://github.com/apache/kafka-site/pull/643#issuecomment-2461590064 @jlprat , for 3.8.1's section, I've added in this PR: https://github.com/apache/kafka-site/pull/642 . Please take a look first. Thanks. -- This is an automated message from the Apache

Re: [PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

jlprat commented on PR #643: URL: https://github.com/apache/kafka-site/pull/643#issuecomment-2461593132 We can take yours and add anything missing in there -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [DISCUSS] KIP-1098: Reverse Checkpointing in MirrorMaker

Gentle bump - any comments are welcome. This could fill an important gap in MM2, and would be nice to fix. TIA Daniel Dániel Urbán ezt írta (időpont: 2024. nov. 4., H, 11:00): > Hi Vidor, > > Thank you for your comments! > > 1. I think the optimization sounds nice, but would not work well with >

Re: [PR] MINOR: Improve doc for controller membership change [kafka-site]

jlprat commented on code in PR #642: URL: https://github.com/apache/kafka-site/pull/642#discussion_r1832238970 ## 39/upgrade.html: ## @@ -41,6 +41,81 @@ Notable changes in 3 See https://cwiki.apache.org/confluence/display/KAFKA/KIP-956+Tiered+Storage+Quotas"

Re: [PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

jlprat commented on PR #643: URL: https://github.com/apache/kafka-site/pull/643#issuecomment-2461592658 My PR is not needed then. By the title of it I didn't think it included this change. My bad! -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

showuon commented on PR #643: URL: https://github.com/apache/kafka-site/pull/643#issuecomment-2461599732 But I didn't include the 3.9.0 upgrade guide as in your PR. My thought is to merge my PR first, and then merge yours. WDYT? -- This is an automated message from the Apache Git Service.

Re: [PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

jlprat commented on PR #643: URL: https://github.com/apache/kafka-site/pull/643#issuecomment-2461601586 Let's do it. Yours is approved already -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [VOTE] KIP-1105: Make remote log manager thread-pool configs dynamic

+1 (non binding) Thanks On Thu, Nov 7, 2024 at 5:46 AM Chu Cheng Li wrote: > > +1 > > On Thu, Nov 7, 2024 at 12:39 PM Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > Hi all, > > > > I'd like to call for a vote on KIP-1105 > > > > https://cwiki.apache.org/confluence/display/

Re: [PR] MINOR: Improve doc for controller membership change [kafka-site]

showuon merged PR #642: URL: https://github.com/apache/kafka-site/pull/642 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.

Re: [PR] Add blog entry for Kafka 3.9 [kafka-site]

mimaison commented on code in PR #641: URL: https://github.com/apache/kafka-site/pull/641#discussion_r1832259141 ## blog.html: ## @@ -22,6 +22,122 @@ Blog + + + +Apache Kafka 3.

Re: [PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

jlprat commented on PR #643: URL: https://github.com/apache/kafka-site/pull/643#issuecomment-2461627491 I'll reopen the PR something is strange in this one. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions [kafka-site]

jlprat closed pull request #643: MINOR: Add 3.8.1 to upgrade for 3.9 docs. Also aadd rolling upgrade …nstructions URL: https://github.com/apache/kafka-site/pull/643 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] MINOR: Add rolling upgrade instructions for 3.9 [kafka-site]

jlprat opened a new pull request, #644: URL: https://github.com/apache/kafka-site/pull/644 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [PR] MINOR: Add rolling upgrade instructions for 3.9 [kafka-site]

jlprat commented on PR #644: URL: https://github.com/apache/kafka-site/pull/644#issuecomment-2461634566 @showuon This is the right PR now :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [DISCUSS] KIP-1102: Enable clients to rebootstrap based on timeout or error code

Hi Jun, Thanks for reviewing the KIP. 1) When we need metadata, leastLoadedNode() attempts connection to node1 and if that fails, node1 is in reconnection backoff for a second. So leastLoadedNode() attempts connection to node2. If the connection attempt to node2 takes 5 seconds and fails, we try

Jenkins build became unstable: Kafka » Kafka PowerPC Daily » test-powerpc #111

See

Re: [DISCUSS] KIP-1106: Add duration based offset reset option for consumer clients

Hi Matthias, Thanks for the comments. > I am personally not convinced that adding a new config `auto.offset.reset.by.duration` is the best way. I think in this case, we felt it's better to add the strategy name to auto.offset.reset config and add additional strategy specific configs. This will b

Re: [ANNOUNCE] Apache Kafka 3.9.0

Thanks Colin for all your hard work on running the 3.9.0 release. Thanks to all the contributors to this release. ~Satish. ~Satish. On Fri, 8 Nov 2024 at 04:42, Colin McCabe wrote: > > The Apache Kafka community is pleased to announce the release for Apache > Kafka 3.9.0 > > - This is a major

[jira] [Created] (KAFKA-17964) TransactionsTest.testSendOffsetsWithGroupId fails with CONSUMER group protocol

Kirk True created KAFKA-17964: - Summary: TransactionsTest.testSendOffsetsWithGroupId fails with CONSUMER group protocol Key: KAFKA-17964 URL: https://issues.apache.org/jira/browse/KAFKA-17964 Project: Kaf

Re: [ANNOUNCE] Apache Kafka 3.9.0

Hi Colin, Thanks for running the release!! Best, -- Josep Prat Open Source Engineering Director, Aiven josep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin Geschäftsführer: Oskari Saarenmaa, Hannu Valtonen, Anna Richardson, Ken

Re: [DISCUSS] KIP-1106: Add duration based offset reset option for consumer clients

Thanks for updating the KIP. I am personally not convinced that adding a new config `auto.offset.reset.by.duration` is the best way. Kafka in general has way too many configs and trying to avoid adding more configs seems to be desirable? -- It seems this might be a point of contention, and if

Re: [ANNOUNCE] Apache Kafka 3.9.0

Hi Colin, Thanks for all the hard work for the release! Luke On Fri, Nov 8, 2024 at 7:12 AM Colin McCabe wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 3.9.0 > > - This is a major release, the final one in the 3.x line. (There may of > course be other

Re: [ANNOUNCE] Apache Kafka 3.9.0

Thanks for running the release, Colin! -- Kamal On Fri, Nov 8, 2024 at 8:01 AM Luke Chen wrote: > Hi Colin, > > Thanks for all the hard work for the release! > > Luke > > On Fri, Nov 8, 2024 at 7:12 AM Colin McCabe wrote: > > > The Apache Kafka community is pleased to announce the release for

[jira] [Created] (KAFKA-17963) Considering replacing LogCaptureAppender with ListAppender

TengYao Chi created KAFKA-17963: --- Summary: Considering replacing LogCaptureAppender with ListAppender Key: KAFKA-17963 URL: https://issues.apache.org/jira/browse/KAFKA-17963 Project: Kafka Issu

[jira] [Created] (KAFKA-17962) test_pause_and_resume_sink fails with "Failed to consume messages after resuming sink connector" with CONSUMER group protocol

Kirk True created KAFKA-17962: - Summary: test_pause_and_resume_sink fails with "Failed to consume messages after resuming sink connector" with CONSUMER group protocol Key: KAFKA-17962 URL: https://issues.apache.org/ji

Re: [DISCUSS] KIP-1106: Add duration based offset reset option for consumer clients

Hi Jun, Thanks for the Review. JR1: makes sense. We felt earliest_local can be useful in certain use cases. I think we can ignore it for now and add back when we have a clear use case. JR2: Agree. KIP-842 additionally allows to set different reset strategies for initial offset missing and out of

Re: [VOTE] KIP-1102: Enable clients to rebootstrap based on timeout or error code

+1 (binding). Thanks for the KIP! On Thu, Nov 7, 2024 at 7:51 PM Jun Rao wrote: > Hi, Rajini, > > Thanks for the KIP. +1 > > Jun > > On Tue, Nov 5, 2024 at 1:26 AM Rajini Sivaram > wrote: > > > Hi everyone, > > > > I would like to start vote on KIP-1102 ( > > > > > https://cwiki.apache.org/conf