Re: [VOTE] 3.9.0 RC5

2024-10-30 Thread Luke Chen
Hi Justine, > As a side note, I was looking into how to configure kip-853 and it took me a moment to find the instructions in the documentation, I wonder if it could be included in the notable changes section of the upgrade notes. Not a blocker as I believe we can still update documentation. Good

Re: [VOTE] 3.9.0 RC5

2024-10-30 Thread Federico Valeri
Hi, I did the following tests: - Built from source - Ran all unit and integration tests - Spot checked the documentation - Tried Maven dependencies - Tested KIP-853, KIP-950, KIP-956 and KIP-1057 I also noticed that Maven artifacts were not updated. +1 (non binding) Thanks Fede On Wed, Oct 30,

[jira] [Resolved] (KAFKA-17622) Kafka Streams Timeout During Partition Rebalance

2024-10-30 Thread Alieh Saeedi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alieh Saeedi resolved KAFKA-17622. -- Resolution: Fixed > Kafka Streams Timeout During Partition Rebalance > --

[jira] [Created] (KAFKA-17899) Add more unit tests for NetworkReceive

2024-10-30 Thread TengYao Chi (Jira)
TengYao Chi created KAFKA-17899: --- Summary: Add more unit tests for NetworkReceive Key: KAFKA-17899 URL: https://issues.apache.org/jira/browse/KAFKA-17899 Project: Kafka Issue Type: Test

Re: [DISCUSS] Minimum constraint for segment.ms

2024-10-30 Thread Divij Vaidya
Thanks Tommi. I have again started documenting these changes in https://cwiki.apache.org/confluence/display/KAFKA/KIP-1030%3A+Change+constraints+and+default+values+for+various+configurations and will try to get this KIP out of draft stage next week (so that we can hit the 4.0 KIP freeze timeline o

[jira] [Reopened] (KAFKA-15918) Flaky test - OffsetsApiIntegrationTest.testResetSinkConnectorOffsets

2024-10-30 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur reopened KAFKA-15918: -- https://ge.apache.org/scans/tests?search.names=CI%20workflow%2CGit%20repository&search.rootProject

[jira] [Created] (KAFKA-17902) Flaky Test kafka.admin.DeleteTopicTest testAddPartitionDuringDeleteTopic

2024-10-30 Thread David Arthur (Jira)
David Arthur created KAFKA-17902: Summary: Flaky Test kafka.admin.DeleteTopicTest testAddPartitionDuringDeleteTopic Key: KAFKA-17902 URL: https://issues.apache.org/jira/browse/KAFKA-17902 Project: Kaf

Re: [DISCUSS] KIP-1102: Enable clients to rebootstrap based on timeout or error code

2024-10-30 Thread Rajini Sivaram
Hi Andrew, Thanks for reviewing the KIP. AS1: Updated to KIP-559. Thanks for pointing that out. AS2: Yes, that is correct. The error code is a performance optimization to avoid unavailability for 5 minutes when a proxy may be able to tell the client to rebootstrap immediately. Regards, Rajini

[jira] [Created] (KAFKA-17900) Consider async resolution for client-side regex in new consumer

2024-10-30 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-17900: -- Summary: Consider async resolution for client-side regex in new consumer Key: KAFKA-17900 URL: https://issues.apache.org/jira/browse/KAFKA-17900 Project: Kafka

[jira] [Created] (KAFKA-17901) Handle fenced exception while acquiring fetch lock

2024-10-30 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-17901: - Summary: Handle fenced exception while acquiring fetch lock Key: KAFKA-17901 URL: https://issues.apache.org/jira/browse/KAFKA-17901 Project: Kafka Issue Ty

[jira] [Created] (KAFKA-17903) Remove KafkaFuture#Function and KafkaFuture#thenApply

2024-10-30 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17903: -- Summary: Remove KafkaFuture#Function and KafkaFuture#thenApply Key: KAFKA-17903 URL: https://issues.apache.org/jira/browse/KAFKA-17903 Project: Kafka Iss

[DISCUSS] KIP-1098: Reverse Checkpointing in MirrorMaker

2024-10-30 Thread Vidor Kanalas
Hi Daniel, This would indeed greatly reduce the duplicate processing on failbacks. Few questions: 1. Adding another offset sync store might be memory intensive. Would it make sense (if possible) to filter the topics in it based on the reverseCheckpointingTopicFilter? 2. Would it make sen

[PR] MINOR: fix links pointing to wrong version [kafka-site]

2024-10-30 Thread via GitHub
jlprat opened a new pull request, #639: URL: https://github.com/apache/kafka-site/pull/639 I didn't properly search-and-replace. Now it should be good. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [VOTE] 3.9.0 RC5

2024-10-30 Thread David Arthur
Should there be Scala 2.12 artifacts in the Maven staging? I see these for 2.13: * https://repository.apache.org/content/groups/staging/org/apache/kafka/kafka_2.13/3.9.0/ * https://repository.apache.org/content/groups/staging/org/apache/kafka/kafka-streams-scala_2.13/3.9.0/ but I don't see 2.12 f

Re: [PR] MINOR: fix links pointing to wrong version [kafka-site]

2024-10-30 Thread via GitHub
jlprat merged PR #639: URL: https://github.com/apache/kafka-site/pull/639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.o

Re: [VOTE] 3.9.0 RC5

2024-10-30 Thread Colin McCabe
Thanks for checking, Luke. I did actually visit https://repository.apache.org/#stagingRepositories and hit close on the artifacts as the release.py script says to do. I don't know why they ended up not showing up. Today I dropped all the maven artifacts for previous 3.9 RCs, switched to java 8

[jira] [Resolved] (KAFKA-17903) Remove KafkaFuture#Function and KafkaFuture#thenApply

2024-10-30 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17903. Fix Version/s: 4.0.0 Resolution: Fixed > Remove KafkaFuture#Function and KafkaFutur

RE: Re: [DISCUSS] KIP-1098: Reverse Checkpointing in MirrorMaker

2024-10-30 Thread Vidor Kanalas
Hi Daniel, This would indeed greatly reduce the duplicate processing on failbacks. Few questions: Adding another offset sync store might be memory intensive. Would it make sense (if possible) to filter the topics in it based on the reverseCheckpointingTopicFilter? Would it make sense to add a

Re: [DISCUSS] Minimum constraint for segment.ms

2024-10-30 Thread Tommi Vainikainen
Hi, I've noticed that similar to these already mentioned settings also segment.index.bytes has a minimum value of 4. This conflicts with OffsetIndex, which throws `java.lang.IllegalArgumentException: Invalid max index size: 4` with such settings, because hard-coded entry size in OffsetIndex is 8.

[jira] [Resolved] (KAFKA-17867) Consider using zero-copy for PushTelemetryRequest

2024-10-30 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17867. Fix Version/s: 4.0.0 Resolution: Fixed > Consider using zero-copy for PushTelemetry

[jira] [Resolved] (KAFKA-17873) Add description to all packages in the public API

2024-10-30 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-17873. Fix Version/s: 4.0.0 Resolution: Fixed > Add description to all packages in the pub

Re: [DISCUSS] KIP-1102: Enable clients to rebootstrap based on timeout or error code

2024-10-30 Thread Andrew Schofield
Hi Rajini, Thanks for the KIP. It looks like a useful improvement for rebootstrapping. I really like using the new major release as a way to change the default so rebootstrapping can be taken for granted in the future. A couple of comments. AS1: (nit) KIP-559, not KIP-599, was the proxy-friendline

[jira] [Resolved] (KAFKA-17002) Integrate partition leader epoch in Share Partition

2024-10-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-17002. - Fix Version/s: 4.0.0 Resolution: Fixed merged the PR to trunk > Integrate partition leader epoch

[jira] [Created] (KAFKA-17904) Flaky testMultiConsumerSessionTimeoutOnClose

2024-10-30 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-17904: -- Summary: Flaky testMultiConsumerSessionTimeoutOnClose Key: KAFKA-17904 URL: https://issues.apache.org/jira/browse/KAFKA-17904 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1098: Reverse Checkpointing in MirrorMaker

2024-10-30 Thread Vidor Kanalas
Hi Daniel, This would indeed greatly reduce the duplicate processing on failbacks. Few questions: 1. Since having a second offset-sync store can be memory intensive, would it make sense to filter the topics in it based on the reverseCheckpointingTopicFilter? 2. Would it make sens

[jira] [Resolved] (KAFKA-17726) New consumer subscribe/subscribeFromPattern in background thread

2024-10-30 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-17726. Reviewer: Lianet Magrans Resolution: Fixed > New consumer subscribe/subscribeFromPat

Re: [DISCUSS] KIP-1103: Additional metrics for cooperative consumption

2024-10-30 Thread Jun Rao
Hi, Apoorv, Thanks for the KIP. A few comments. 1. TotalShareReleaseRequestsPerSec: This is a bit weird since there is no ShareReleaseRequest. 2. RequestTopicPartitionsFetchRatio and InFlightBatchMessageCount: It seems Histogram is more appropriate for them. 3. RequestTopicPartitionsFetchEmptyC

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #103

2024-10-30 Thread Apache Jenkins Server
See

[DISCUSS] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

2024-10-30 Thread Chu Cheng Li
Hi Everyone, I would like to start a discussion on KIP-1104: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1103%3A+Additional+metrics+for+cooperative+consumption This KIP allow foreign key extraction from both key and value in KTable Joins, before this KI

[jira] [Created] (KAFKA-17905) Remove the specified type of using lambda for BaseFunction

2024-10-30 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17905: -- Summary: Remove the specified type of using lambda for BaseFunction Key: KAFKA-17905 URL: https://issues.apache.org/jira/browse/KAFKA-17905 Project: Kafka

Re: [ANNOUNCE] Apache Kafka 3.8.1

2024-10-30 Thread Luke Chen
Hi Josep, Thanks for the effort to run the release! Luke On Wed, Oct 30, 2024 at 2:01 AM 黃竣陽 wrote: > Hello Josep > > Thanks for hard working on running this release! > > Best regards, > Jiunn-Yang > > > TengYao Chi 於 2024年10月30日 凌晨12:35 寫道: > > > > Hi Josep > > Thanks for running this releas