Re: [VOTE] 3.8.0 RC2

2024-07-22 Thread Jakub Scholz
+1 (non-binding). I used the staged Scala 2.13 binaries and the staged Maven artifacts. All seems to work fine. Thanks! Jakub On Thu, Jul 18, 2024 at 11:19 AM Josep Prat wrote: > Hello Kafka users, developers and client-developers, > > This is the third candidate for release of Apache Kafka 3.8

Subscribe to Kafka dev mailing list

2024-07-22 Thread 徐植君
Dear Kafka Team, I'd like to subscribe to the Kafka development mailing list. Please find my email below for subscription. Best regards, 徐植君 xuzhi...@gmail.com

[jira] [Created] (KAFKA-17179) Don't add `integration` tag when using `ClusterTestExtensions`

2024-07-22 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17179: -- Summary: Don't add `integration` tag when using `ClusterTestExtensions` Key: KAFKA-17179 URL: https://issues.apache.org/jira/browse/KAFKA-17179 Project: Kafka

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-07-22 Thread Alieh Saeedi
Hi Greg, I appreciate your concerns and comprehensive answer. I am not sure whether I fully understood what you meant or not. You mean, at the end, the user can go for one of the following scenarios: Either 1) `beginTxn()` and `send(record)` and `commitTxn()` or 2) `beginTxn()` and `prepare(

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686393013 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686442326 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686443757 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686443788 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686443757 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686446175 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686444663 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686448577 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-07-22 Thread Andrew Schofield
Hi Lianet, I have a comment on your comment. I think that’s allowed. LM3. I quite like the idea of having an INVALID_GROUP_TYPE error code for RPCs which were applied to a group which turned out to be the wrong type. We might even be able to use INCONSISTENT_GROUP_PROTOCOL for this purpose. Howev

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686444663 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686495626 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
soarez commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686536228 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [DISCUSS] KIP-1062: Introduce Pagination for some requests used by Admin API

2024-07-22 Thread Omnia Ibrahim
Hi David, thanks for the feedback and sorry for taking long to respond as I was off for a week. > DA1: In "Public Interfaces" you say "max.request.pagination.size.limit" > controls the max items to return by default. It's not clear to me if this > is just a default, or if it is a hard limit. In

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686550070 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686558361 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686558361 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686561076 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686561076 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

[jira] [Created] (KAFKA-17180) Upgrade gradle from 8.8 to 8.9

2024-07-22 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17180: -- Summary: Upgrade gradle from 8.8 to 8.9 Key: KAFKA-17180 URL: https://issues.apache.org/jira/browse/KAFKA-17180 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-16519) Expose the supported and finalized kraft.version in ApiVersions response

2024-07-22 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-16519. Resolution: Duplicate This was resolved as part of another issue a

[jira] [Resolved] (KAFKA-16772) Introduce a type for kraft.version

2024-07-22 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-16772. Resolution: Fixed > Introduce a type for kraft.version > -

[jira] [Resolved] (KAFKA-17166) Use `NoOpScheduler` to rewrite LogManagerTest#testLogRecoveryMetrics

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17166. Fix Version/s: 3.9.0 Resolution: Fixed > Use `NoOpScheduler` to rewrite LogManagerT

[jira] [Resolved] (KAFKA-17165) Revisit LeaderEpochFileCache#writeToFileForTruncation

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17165. Fix Version/s: 3.9.0 Resolution: Fixed > Revisit LeaderEpochFileCache#writeToFileFo

[jira] [Created] (KAFKA-17181) Fix possible partial write in writing snapshot (ProducerStateManager)

2024-07-22 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17181: -- Summary: Fix possible partial write in writing snapshot (ProducerStateManager) Key: KAFKA-17181 URL: https://issues.apache.org/jira/browse/KAFKA-17181 Project: Ka

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
mimaison commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686644487 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686658050 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686672928 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

2024-07-22 Thread Christopher Shannon
We still need another binding vote so I am bumping this vote. On Tue, Jul 9, 2024 at 6:15 PM Chris Egerton wrote: > +1 (binding), thanks for the KIP! > > On Tue, Jul 9, 2024 at 11:35 AM Greg Harris > wrote: > > > While breaking compatibility is always undesirable, this is > unfortunately a > >

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686703063 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [DISCUSS] Apache Kafka 3.9.0 release

2024-07-22 Thread Loic Greffier
Hello, Can KIP-1033 https://cwiki.apache.org/confluence/display/KAFKA/KIP-1033%3A+Add+Kafka+Streams+exception+handler+for+exceptions+occurring+during+processing be included in this release? Most of the PRs related to this KIP have been reviewed and merged. There are 3 additional less complex P

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

2024-07-22 Thread Mickael Maison
Hi Christopher, +1 (binding) Thanks for the KIP! Mickael On Mon, Jul 22, 2024 at 5:01 PM Christopher Shannon wrote: > > We still need another binding vote so I am bumping this vote. > > On Tue, Jul 9, 2024 at 6:15 PM Chris Egerton > wrote: > > > +1 (binding), thanks for the KIP! > > > > On Tu

[jira] [Resolved] (KAFKA-15359) Support log.dir.failure.timeout.ms configuration for JBOD

2024-07-22 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-15359. - Resolution: Fixed > Support log.dir.failure.timeout.ms configuration for JBOD >

[jira] [Resolved] (KAFKA-15368) Test ZK JBOD to KRaft migration

2024-07-22 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-15368. - Resolution: Fixed This was done as part of https://github.com/apache/kafka/pull/15394 > Test ZK

Re: [VOTE]: KIP-1032: Upgrade to Jakarta and JavaEE 10 in Kafka 4.0

2024-07-22 Thread Christopher Shannon
Hi Everyone, I forgot to add my explicit +1 (non-binding) as well. The vote passes with: * 3 binding votes (Chris Egerton, Mickael Maison, Greg Harris) * 1 non-binding vote (Christopher Shannon) I'll update the wiki. I should have some time coming up to work on a PR for this if no one else take

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
soarez commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686799171 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686804388 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache Kafka 3.8.0

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
jlprat commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1686806813 ## 38/upgrade.html: ## @@ -28,7 +28,8 @@ Notable changes in 3 If READ is not authorized, checkpointing is limited to offsets mirrorred after the start of

Re: [DISCUSS] KIP-1065: Add "retry" return-option to ProductionExceptionHandler

2024-07-22 Thread Alieh Saeedi
Hi all, Thanks for the KIP, Matthias. Yes, adding the `RETRY` option to `ProductionExceptionhandler` enables us to have a further fix in order to make KAFKA-16508 backward compatible. @Sophie: Regarding other built-in handlers: Do you mean 1) adding `RETRY` to `DeserializationExceptionHandler` i

Re: [VOTE] 3.8.0 RC2

2024-07-22 Thread Chia-Ping Tsai
hi Josep, Sorry for bringing this news. There is a correctness issue (https://github.com/apache/kafka/pull/16641) and the fix should be backport to 3.8. Thanks, Chia-Ping On 2024/07/18 09:19:06 Josep Prat wrote: > Hello Kafka users, developers and client-developers, > > This is the third cand

Re: [VOTE] 3.8.0 RC2

2024-07-22 Thread Josep Prat
Thanks Chia-Ping, I'm cancelling this Vote thread. I'll be generating the next RC tomorrow morning CEST. Best, -- Josep Prat Open Source Engineering Director, Aiven josep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin Geschäfts

[jira] [Resolved] (KAFKA-17159) Make sure kafka-cluster-test-kit-executor get down when closing KafkaClusterTestKit

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17159. Fix Version/s: 3.9.0 Resolution: Fixed > Make sure kafka-cluster-test-kit-executor

Re: [VOTE] KIP-939: Support Participation in 2PC

2024-07-22 Thread Jun Rao
Hi, Artem, Thanks for the KIP. +1 from me. Jun On Wed, May 29, 2024 at 9:41 AM Jason Gustafson wrote: > +1 Thanks for the KIP! > > On Wed, Mar 13, 2024 at 5:13 AM Omnia Ibrahim > wrote: > > > I had a look at the discussion thread and the KIP looks exciting. > > +1 non-binding > > > > Best > >

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-07-22 Thread Greg Harris
Hi Alieh, Yes, I think you understand my intent for the prepare() method. Thanks, Greg On Mon, Jul 22, 2024 at 2:54 AM Alieh Saeedi wrote: > Hi Greg, > > > I appreciate your concerns and comprehensive answer. > > > I am not sure whether I fully understood what you meant or not. You mean, > at

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3130

2024-07-22 Thread Apache Jenkins Server
See

Re: Subscribe to Kafka dev mailing list

2024-07-22 Thread Justine Olshan
Hey there, Please send a message to dev-subscr...@kafka.apache.org to subscribe. After sending an email, be on the lookout for a follow up to confirm the subscription. Thanks, Justine On Mon, Jul 22, 2024 at 1:59 AM 徐植君 wrote: > Dear Kafka Team, > > I'd like to subscribe to the Kafka developme

[jira] [Created] (KAFKA-17183) New consumer system tests pass for subset of tests, but fail if running all tests

2024-07-22 Thread Kirk True (Jira)
Kirk True created KAFKA-17183: - Summary: New consumer system tests pass for subset of tests, but fail if running all tests Key: KAFKA-17183 URL: https://issues.apache.org/jira/browse/KAFKA-17183 Project:

[jira] [Created] (KAFKA-17182) Consumer's fetch sessions are evicted too quickly

2024-07-22 Thread Kirk True (Jira)
Kirk True created KAFKA-17182: - Summary: Consumer's fetch sessions are evicted too quickly Key: KAFKA-17182 URL: https://issues.apache.org/jira/browse/KAFKA-17182 Project: Kafka Issue Type: Bug

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-22 Thread via GitHub
soarez commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1687161313 ## blog.html: ## @@ -22,6 +22,98 @@ Blog + + + +Apache Kafka 3.8.0

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-07-22 Thread Matthias J. Sax
Thanks Greg, Apologize if we gave the impression that we did not try to address your concerns. It was not my intention to just minimize them. Of course, I just don't see it your way, but that's ok. We don't have to agree. That's why we have a DISCUSS thread to begin with. I don't know the pr

RE: [DISCUSS] KIP-1052: Enable warmup in producer performance test

2024-07-22 Thread Welch, Matt
Hi Federico, Bumping for visibility. I've had some additional thoughts on below over the last couple weeks. I really don't think we need the option to have combined/separated stats and I think printing warmup-only, followed by steady-state only at the end of the run would be my preferred choi

[DISCUSS] KIP-512: make Record Headers available in onAcknowledgement

2024-07-22 Thread Rich C.
Hi Everyone, I hope this email finds you well. I would like to start a discussion on KIP-512. The initial version of KIP-512 was created in 2019, and I have resurrected it in 2024 with more details about the motivation behind it. You can view the current version of the KIP here: KIP-512: Make Re

[jira] [Resolved] (KAFKA-16791) Add thread detection to ClusterTestExtensions

2024-07-22 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16791. Fix Version/s: 3.9.0 Resolution: Fixed > Add thread detection to ClusterTestExtensi

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #73

2024-07-22 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3132

2024-07-22 Thread Apache Jenkins Server
See