Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2319

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 320393 lines...] > Task :connect:json:testJar > Task :connect:api:copyDependantLibs UP-TO-DATE > Task :connect:json:testSrcJar > Task :connect

Re: [DISCUSS] KIP-975 Docker Image for Apache Kafka

2023-10-23 Thread Vedarth Sharma
Hi Ismael, Thanks for the correction. We will be following the same EOL policy as Apache Kafka, hence we have removed it from the KIP. Thanks and regards, Vedarth On Mon, Oct 23, 2023 at 12:17 PM Ismael Juma wrote: > Sorry, I noticed a typo in my message. I meant "Additionally, we should not

[VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Hailey Ni
Hi all, I'd like to call a vote on KIP-979 that will allow users to independently stop KRaft processes. https://cwiki.apache.org/confluence/display/KAFKA/KIP-979%3A+Allow+independently+stop+KRaft+processes Thanks, Hailey

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Kamal Chandraprakash
+1 (non-binding). Thanks for the KIP! On Mon, Oct 23, 2023, 12:55 Hailey Ni wrote: > Hi all, > > I'd like to call a vote on KIP-979 that will allow users to independently > stop KRaft processes. > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-979%3A+Allow+independently+stop+KRaft+pro

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Federico Valeri
+1 (non binding) Thanks. On Mon, Oct 23, 2023 at 9:48 AM Kamal Chandraprakash wrote: > > +1 (non-binding). Thanks for the KIP! > > On Mon, Oct 23, 2023, 12:55 Hailey Ni wrote: > > > Hi all, > > > > I'd like to call a vote on KIP-979 that will allow users to independently > > stop KRaft processe

[jira] [Created] (KAFKA-15666) Добавить функцию поиска по почте

2023-10-23 Thread Eleonora (Jira)
Eleonora created KAFKA-15666: Summary: Добавить функцию поиска по почте Key: KAFKA-15666 URL: https://issues.apache.org/jira/browse/KAFKA-15666 Project: Kafka Issue Type: Improvement Co

[jira] [Created] (KAFKA-15667) preCheck the invalid configuration for tiered storage replication factor

2023-10-23 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15667: - Summary: preCheck the invalid configuration for tiered storage replication factor Key: KAFKA-15667 URL: https://issues.apache.org/jira/browse/KAFKA-15667 Project: Kafka

[jira] [Created] (KAFKA-15668) Add Opentelemetry Proto library with shadowed classes

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15668: - Summary: Add Opentelemetry Proto library with shadowed classes Key: KAFKA-15668 URL: https://issues.apache.org/jira/browse/KAFKA-15668 Project: Kafka Issue

[jira] [Created] (KAFKA-15669) Implement telemetry naming strategy

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15669: - Summary: Implement telemetry naming strategy Key: KAFKA-15669 URL: https://issues.apache.org/jira/browse/KAFKA-15669 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-15664) Add 3.4.0 streams upgrade/compatibility tests

2023-10-23 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15664. Resolution: Fixed > Add 3.4.0 streams upgrade/compatibility tests > --

[jira] [Resolved] (KAFKA-15457) Add support for OffsetFetch version 9 in admin

2023-10-23 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15457. - Fix Version/s: 3.7.0 Resolution: Fixed > Add support for OffsetFetch version 9 in admin >

[jira] [Created] (KAFKA-15670) KRaft controller using wrong listener to send RPC to brokers in dual-write mode

2023-10-23 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15670: - Summary: KRaft controller using wrong listener to send RPC to brokers in dual-write mode Key: KAFKA-15670 URL: https://issues.apache.org/jira/browse/KAFKA-15670 Project: K

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2320

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 423553 lines...] Gradle Test Run :core:test > Gradle Test Executor 88 > ZkMigrationClientTest > testClaimAbsentController() PASSED Gradle T

[jira] [Resolved] (KAFKA-15093) Add 3.5.0 to broker/client and streams upgrade/compatibility tests

2023-10-23 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15093. Fix Version/s: 3.5.2 3.7.0 3.6.1 Resolution: F

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #85

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 4564 lines...] Required by: project :streams:upgrade-system-tests-35 * Try: > Run with --stacktrace option to get the stack trace.

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #98

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 308045 lines...] > Task :connect:json:testJar > Task :connect:api:generateMetadataFileForMavenJavaPublication > Task :connect:json:copyDependantLi

[jira] [Created] (KAFKA-15671) Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache

2023-10-23 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-15671: Summary: Flaky test RemoteIndexCacheTest.testClearCacheAndIndexFilesWhenResizeCache Key: KAFKA-15671 URL: https://issues.apache.org/jira/browse/KAFKA-15671 Project: K

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Ron Dagostino
Hi Hailey. I'm +1 (binding), but could you add a "Rejected Alternatives" section to the KIP and mention the "--required-config " option that we decided against and the reason why we made the decision to reject it? There were some other small things (dash instead of dot in the parameter names, --n

Re: [VOTE] KIP-988 Streams StandbyUpdateListener

2023-10-23 Thread Bill Bejeck
This is a great addition +1(binding) -Bill On Fri, Oct 20, 2023 at 2:29 PM Almog Gavra wrote: > +1 (non-binding) - great improvement, thanks Colt & Eduwer! > > On Tue, Oct 17, 2023 at 11:25 AM Guozhang Wang > > wrote: > > > +1 from me. > > > > On Mon, Oct 16, 2023 at 1:56 AM Lucas Brutschy >

Re: Re: [DISCUSS] KIP-905: Broker interceptors

2023-10-23 Thread Andrew Otto
FWIW, this would be very useful for the Wikimedia Foundation's Event Platform. We have some requirements for our event stream producers, and not having to re-implement this logic in multiple programming languages and framew

[jira] [Created] (KAFKA-15672) Add 3.6 to streams system tests

2023-10-23 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-15672: --- Summary: Add 3.6 to streams system tests Key: KAFKA-15672 URL: https://issues.apache.org/jira/browse/KAFKA-15672 Project: Kafka Issue Type: Test

[jira] [Resolved] (KAFKA-15666) Добавить функцию поиска по почте

2023-10-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15666. - Resolution: Invalid [~noraverba] – We can only take tickets in English. – Also piped the

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2321

2023-10-23 Thread Apache Jenkins Server
See

Re: [DISCUSS] Road to Kafka 4.0

2023-10-23 Thread Mickael Maison
Hi Luke, Thanks for starting this discussion. I think it's very important that we communicate our plans and progress to send a clear message to users. Regarding KRaft missing features, I tend to agree with Christopher that it would be much better to get them merged and declared production ready b

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #99

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 307422 lines...] > Task :connect:json:jar UP-TO-DATE > Task :connect:api:compileTestJava UP-TO-DATE > Task :connect:api:testClasses UP-TO-DATE > T

Re: [DISCUSS] KIP-992 Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery

2023-10-23 Thread Bill Bejeck
Hey Hanyu, Thanks for the KIP, it's a welcomed addition. Overall, the KIP looks good to me, I just have one comment. Can you discuss the expected behavior when a user executes a timestamped query against a non-timestamped store? I think it should throw an exception vs. using some default value.

Re: UncleanLeaderElectionsPerSec metric and Raft

2023-10-23 Thread Justine Olshan
Hey Neil, I was taking a look at this code, and noticed that some unclean leader election params were not implemented. https://github.com/apache/kafka/blob/4612fe42af0df0a4c1affaf66c55d01eb6267ce3/metadata/src/main/java/org/apache/kafka/controller/ConfigurationControlManager.java#L499 I know you

Development with Git Worktree

2023-10-23 Thread Greg Harris
Hey Kafka Developers, This is a small announcement that the gradle build now supports the git-worktree subcommand [1] on the 3.4, 3.5, 3.6, and trunk branches [2]. If you've needed to check out multiple copies of Kafka concurrently, you previously needed to manage multiple full clones of the repo

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #86

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 5179 lines...] You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or

Re: [VOTE] KIP-967: Support custom SSL configuration for Kafka Connect RestServer

2023-10-23 Thread Greg Harris
Hey Taras, Thanks for the KIP! The design you propose follows the conventions started in KIP-519, and should feel natural to operators familiar with the broker feature. I also like that we're able to clean up some connect-specific functionality and make the codebase more consistent. +1 (binding)

Re: Development with Git Worktree

2023-10-23 Thread Ismael Juma
Greg, Thanks for making the change and sharing the benefit with the overall group. Ismael On Mon, Oct 23, 2023 at 10:03 AM Greg Harris wrote: > Hey Kafka Developers, > > This is a small announcement that the gradle build now supports the > git-worktree subcommand [1] on the 3.4, 3.5, 3.6, and

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2322

2023-10-23 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-10-23 Thread Hailey Ni
Hi Ron, I've added the "Rejected Alternatives" section in the KIP. Thanks for the comments and +1 vote! Thanks, Hailey On Mon, Oct 23, 2023 at 6:33 AM Ron Dagostino wrote: > Hi Hailey. I'm +1 (binding), but could you add a "Rejected > Alternatives" section to the KIP and mention the "--requir

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #170

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 526270 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 176 > KafkaZkClientTest > testLogDirEventNotificationsDeletion()

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #100

2023-10-23 Thread Apache Jenkins Server
See Changes: -- [...truncated 308886 lines...] > Task :connect:json:copyDependantLibs UP-TO-DATE > Task :connect:json:jar UP-TO-DATE > Task :connect:json:generateMetadataFileF

[jira] [Created] (KAFKA-15673) Define new client_metrics resource type configuration to store metric config.

2023-10-23 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15673: - Summary: Define new client_metrics resource type configuration to store metric config. Key: KAFKA-15673 URL: https://issues.apache.org/jira/browse/KAFKA-15673 Proj

[jira] [Resolved] (KAFKA-15656) Frequent INVALID_RECORD on Kafka 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15656. Resolution: Duplicate Closing this as a different manifestation of (and thus, duplicate of

[jira] [Resolved] (KAFKA-15657) Unexpected errors when producing transactionally in 3.6

2023-10-23 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Bischel resolved KAFKA-15657. Resolution: Duplicate Closing this as a different manifestation (and thus, duplicate of) K

[jira] [Created] (KAFKA-15674) Consider making RequestLocal thread safe

2023-10-23 Thread Justine Olshan (Jira)
Justine Olshan created KAFKA-15674: -- Summary: Consider making RequestLocal thread safe Key: KAFKA-15674 URL: https://issues.apache.org/jira/browse/KAFKA-15674 Project: Kafka Issue Type: Impr

[jira] [Created] (KAFKA-15675) Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test

2023-10-23 Thread Kirk True (Jira)
Kirk True created KAFKA-15675: - Summary: Fix flaky ConnectorRestartApiIntegrationTest.testMultiWorkerRestartOnlyConnector() test Key: KAFKA-15675 URL: https://issues.apache.org/jira/browse/KAFKA-15675 Pro

Re: Apache Kafka 3.7.0 Release

2023-10-23 Thread Sophie Blee-Goldman
Can you add the 3.7 plan to the release schedule page? (this --> https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan) Thanks! On Sun, Oct 15, 2023 at 2:27 AM Stanislav Kozlovski wrote: > Hey Chris, > > Thanks for the catch! It was indeed copied and I wasn't sure what to make

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.5 #87

2023-10-23 Thread Apache Jenkins Server
See

Re: Apache Kafka 3.7.0 Release

2023-10-23 Thread Sophie Blee-Goldman
Actually I have a few questions about the schedule: 1. Why is the KIP freeze deadline on a Saturday? Traditionally this has been on a Wednesday, which is nice because it gives people until Monday to kick off the vote and give people a full 3 working days to review and vote on it. Also, 2. Why are

Re: [DISCUSS] KIP-988 Streams Standby Task Update Listener

2023-10-23 Thread Sophie Blee-Goldman
Just want to checkpoint the current state of this KIP and make sure we're on track to get it in to 3.7 (we still have a few weeks) -- looks like there are two remaining open questions, both relating to the middle/intermediate callback: 1. What to name it: seems like the primary candidates are onB

Re: [DISCUSS] KIP-989: RocksDB Iterator Metrics

2023-10-23 Thread Sophie Blee-Goldman
I actually think we could implement Lucas' suggestion pretty easily and without too much additional effort. We have full control over the iterator that is returned by the various range queries, so it would be easy to register a gauge metric for how long it has been since the iterator was created. T

Re: [DISCUSS] KIP-990: Capability to SUSPEND Tasks on DeserializationException

2023-10-23 Thread Sophie Blee-Goldman
Hey Nick, A few high-level thoughts: 1. We definitely don't want to piggyback on the SUSPENDED task state, as this is currently more like an intermediate state that a task passes through as it's being closed/migrated elsewhere, it doesn't really mean that a task is "suspended" and there's no logi

Re: UncleanLeaderElectionsPerSec metric and Raft

2023-10-23 Thread Luke Chen
Hi Justine, Thanks for the response. I also agree that even if after KIP-966 the unclean leader election might be changed, we should still figure out if it's a missing feature or not, and what's our plan for it. Thanks. Luke On Mon, Oct 23, 2023 at 11:48 PM Justine Olshan wrote: > Hey Neil, >