[jira] [Created] (KAFKA-17184) Remote index cache noisy logging

2024-07-23 Thread Francois Visconte (Jira)
Francois Visconte created KAFKA-17184: - Summary: Remote index cache noisy logging Key: KAFKA-17184 URL: https://issues.apache.org/jira/browse/KAFKA-17184 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-07-23 Thread Andrew Schofield
Hi, I’m trying to understand the crux of the discussion here. In systems I’m used to, it’s entirely allowed to attempt to add an operation to a transaction, have that operation unambiguously fail, and continue with the transaction safe in the knowledge that the failed operation didn’t make it, b

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-07-23 Thread Abhijeet Kumar
Hi Divij, Seems like there is some confusion about the new protocol for fetching from tiered offset. The scenario you are highlighting is where, Leader's Log Start Offset = 0 Last Tiered Offset = 10 Following is the sequence of events that will happen: 1. Follower requests offset 0 from the lead

[VOTE] 3.8.0 RC3

2024-07-23 Thread Josep Prat
Hello Kafka users, developers and client-developers, This is the fourth candidate for release of Apache Kafka 3.8.0. Some of the major features included in this release are: * KIP-1028: Docker Official Image for Apache Kafka * KIP-974: Docker Image for GraalVM based Native Kafka Broker * KIP-1036

[jira] [Created] (KAFKA-17185) Make sure a single logger instance is created

2024-07-23 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-17185: -- Summary: Make sure a single logger instance is created Key: KAFKA-17185 URL: https://issues.apache.org/jira/browse/KAFKA-17185 Project: Kafka Issue Type

Re: [PR] Add blog post for 3.8 release [kafka-site]

2024-07-23 Thread via GitHub
stanislavkozlovski commented on code in PR #614: URL: https://github.com/apache/kafka-site/pull/614#discussion_r1687822281 ## blog.html: ## @@ -22,6 +22,94 @@ Blog + + + +Apache

[jira] [Created] (KAFKA-17186) Cannot receive message after stopping Source Mirror Maker 2

2024-07-23 Thread George Yang (Jira)
George Yang created KAFKA-17186: --- Summary: Cannot receive message after stopping Source Mirror Maker 2 Key: KAFKA-17186 URL: https://issues.apache.org/jira/browse/KAFKA-17186 Project: Kafka Is

[jira] [Created] (KAFKA-17187) Add executor-AlterAcls to ClusterTestExtensions#SKIPPED_THREAD_PREFIX

2024-07-23 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-17187: - Summary: Add executor-AlterAcls to ClusterTestExtensions#SKIPPED_THREAD_PREFIX Key: KAFKA-17187 URL: https://issues.apache.org/jira/browse/KAFKA-17187 Project: Kafka

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-07-23 Thread Divij Vaidya
Thank you for your response Abhijeet. You have understood the scenario correctly. For the purpose of discussion, please consider the latter case where offset 11 is not available on the leader anymore (it got cleaned locally since the last tiered offset is 15). In such a case, you mentioned, the fol

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3133

2024-07-23 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-17149) Move ProducerStateManagerTest to storage module

2024-07-23 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17149. Fix Version/s: 3.9.0 Resolution: Fixed > Move ProducerStateManagerTest to storage m

Re: [VOTE] 3.8.0 RC3

2024-07-23 Thread Josep Prat
Here is the link to the system tests: https://confluent-open-source-kafka-system-test-results.s3-us-west-2.amazonaws.com/3.8/2024-07-22--001.ffbb03b2-61f4-4ebb-ae1f-af5c753682fb--1721733000--confluentinc--3.8--9a2b34b68c/report.html The Quota tests are known to fail in this CI system. Regarding th

Re: [DISCUSS] KIP-512: make Record Headers available in onAcknowledgement

2024-07-23 Thread Kevin Lam
Hi, Thanks for starting the discussion. Latency Measurement and Tracing Completeness are both good reasons to support this feature, and would be interested to see this move forward. On Mon, Jul 22, 2024 at 11:15 PM Rich C. wrote: > Hi Everyone, > > I hope this email finds you well. > > I would

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2024-07-23 Thread Bruno Cadonna
Hi Lianet, Thanks for the review! Here my answers: LM1. Is your question whether we need to send a full heartbeat each time the member re-joins the group even if the information in the RPC did not change since the last heartbeat? LM2. Is the reason for sending the instance ID each time that

[jira] [Created] (KAFKA-17188) LoginManager ctro might throw an exception causing login and loginCallbackHandler not being closed properly

2024-07-23 Thread Philip Nee (Jira)
Philip Nee created KAFKA-17188: -- Summary: LoginManager ctro might throw an exception causing login and loginCallbackHandler not being closed properly Key: KAFKA-17188 URL: https://issues.apache.org/jira/browse/KAFKA-

Re: [DISCUSS] KIP-1068: KIP-1068: New JMX Metrics for AsyncKafkaConsumer

2024-07-23 Thread Bruno Cadonna
Hi Brenden, BC1. In his first e-mail Andrew wrote "I would expect that the metrics do not exist at all". I agree with him. I think it would be better to not add those metrics at all if the CLASSIC protocol is used rather than the metrics exist and are all constant 0. This should be possible by

[jira] [Created] (KAFKA-17189) Add Thread::isAlive to DetectThreadLeak#of filter

2024-07-23 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-17189: - Summary: Add Thread::isAlive to DetectThreadLeak#of filter Key: KAFKA-17189 URL: https://issues.apache.org/jira/browse/KAFKA-17189 Project: Kafka Issue Type: Sub-t

Re: [VOTE] KIP-939: Support Participation in 2PC

2024-07-23 Thread Artem Livshits
Thanks everyone! I'm going to close the vote. Martijn Visser +1 Justine Olshan +1 (binding) Omnia Ibrahim +1 Jason Gustafson +1 (binding) Jun Rao +1 (binding) The KIP is accepted. -Artem On Mon, Jul 22, 2024 at 10:57 AM Jun Rao wrote: > Hi, Artem, > > Thanks for the KIP. +1 from me. > > Jun >

Re: [DISCUSS] KIP-1043: Administration of groups

2024-07-23 Thread Lianet M.
Hello Andrew, Bringing here the point I surfaced on the KIP-1071 thread: I wonder if at this point, where we're getting several new group types > added, each with RPCs that are supposed to include groupId of a certain > type, we should be more explicit about this situation. Maybe a kind of > INVA

Re: [DISCUSS] KIP-1061: Allow exporting SCRAM credentials

2024-07-23 Thread kafka
Hi Everyone, Bumping this thread to get some feedback on the proposal. If there are no concerns then I'll request a vote in a couple of weeks. Regards, Gaurav > On 24 Jun 2024, at 09:48, ka...@gnarula.com wrote: > > Hi all, > > I'd like to kick off discussion for KIP-1061 which proposes a way

[jira] [Resolved] (KAFKA-16068) Use TestPlugins in ConnectorValidationIntegrationTest to silence plugin scanning errors

2024-07-23 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-16068. --- Fix Version/s: 3.9.0 Resolution: Fixed > Use TestPlugins in ConnectorValidationIntegr

Fwd: [VOTE] 3.8.0 RC3

2024-07-23 Thread Chris Egerton
Forwarding my response to the other mailing list threads; apologies for missing the reply-all the first time! -- Forwarded message - From: Chris Egerton Date: Tue, Jul 23, 2024 at 3:45 PM Subject: Re: [VOTE] 3.8.0 RC3 To: Hi Josep, Thanks for running this release! I'm +1 (bind

Re: [DISCUSS] KIP-1068: KIP-1068: New JMX Metrics for AsyncKafkaConsumer

2024-07-23 Thread Brenden Deluna
Hi Bruno, Thank you for your comments. BC1. I think that is a great point, I was not aware that we could not add the metrics based on which protocol is being used. I will update the KIP to reflect that change. BC2. There is not any specific reason for this, really it has just never been suggested

Re: [DISCUSS] KIP-1068: KIP-1068: New JMX Metrics for AsyncKafkaConsumer

2024-07-23 Thread Lianet M.
Hey all, Follow-up on Bruno's point BC2. I personally did not suggest background-event-queue-time-max and background-event-queue-time-avg mainly because in practice we only have 2 types of events flowing from the background to the app thread: errorEvents and callbackEvents, (vs the many api-trigge

Re: [VOTE] 3.8.0 RC3

2024-07-23 Thread Greg Harris
Hi Josep, +1 (binding) I performed the following validations: 1. I formatted a new log directory and verified that the stray log message is no longer present (KAFKA-17148) 2. I configured a connect worker with a custom plugin path and plugin.discovery=service_load and verified that plugin scannin

[jira] [Created] (KAFKA-17190) AssignmentsManager gets stuck retrying on deleted topics

2024-07-23 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-17190: Summary: AssignmentsManager gets stuck retrying on deleted topics Key: KAFKA-17190 URL: https://issues.apache.org/jira/browse/KAFKA-17190 Project: Kafka Issu

[jira] [Resolved] (KAFKA-13403) KafkaServer crashes when deleting topics due to the race in log deletion

2024-07-23 Thread Arun Mathew (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Mathew resolved KAFKA-13403. - Resolution: Fixed Raised the Patch and Got it Merged. > KafkaServer crashes when deleting topic