[jira] [Resolved] (KAFKA-14421) OffsetFetchRequest throws NPE Exception

2023-08-10 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14421. --- Resolution: Resolved Resolved in the later release. > OffsetFetchRequest throws NPE Exception > ---

[jira] [Created] (KAFKA-15328) Inter broker partition reassignment triggers offline log dirs randomly

2023-08-10 Thread dgiri (Jira)
dgiri created KAFKA-15328: - Summary: Inter broker partition reassignment triggers offline log dirs randomly Key: KAFKA-15328 URL: https://issues.apache.org/jira/browse/KAFKA-15328 Project: Kafka Iss

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2084

2023-08-10 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15329) Make default `remote.log.metadata.manager.class.name` as topic based RLMM

2023-08-10 Thread Luke Chen (Jira)
Luke Chen created KAFKA-15329: - Summary: Make default `remote.log.metadata.manager.class.name` as topic based RLMM Key: KAFKA-15329 URL: https://issues.apache.org/jira/browse/KAFKA-15329 Project: Kafka

[jira] [Created] (KAFKA-15330) Migration from ZK to KRaft works with 3.4 but fails from 3.5 upwards

2023-08-10 Thread Roland Sommer (Jira)
Roland Sommer created KAFKA-15330: - Summary: Migration from ZK to KRaft works with 3.4 but fails from 3.5 upwards Key: KAFKA-15330 URL: https://issues.apache.org/jira/browse/KAFKA-15330 Project: Kafka

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Florin Akermann
Thank you for the feedback. > Not sure if this is the right phrasing? You are right. I adjusted the phrasing accordingly. Given your description of the current behavior, do I understand correctly that the current documentation for the left join KStream-GlobalKtable is out of date? https://github.

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2085

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 400994 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181 > TableTableJoinIntegrationTest > [caching enabled = fa

Re: [VOTE] KIP-858: Handle JBOD broker disk failure in KRaft

2023-08-10 Thread Igor Soarez
Hi Mickael, Thanks for voting, and for pointing out the mistake. I've corrected it in the KIP now. The proposed name is "QueuedReplicaToDirAssignments". Best, -- Igor

[jira] [Created] (KAFKA-15331) Handle remote log enabled topic deletion when leader is not available

2023-08-10 Thread Kamal Chandraprakash (Jira)
Kamal Chandraprakash created KAFKA-15331: Summary: Handle remote log enabled topic deletion when leader is not available Key: KAFKA-15331 URL: https://issues.apache.org/jira/browse/KAFKA-15331

Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect

2023-08-10 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
Thanks Mickael! The KIP has passed with 3 binding votes (Chris Egerton, Greg Harris, Mickael Maison) and 3 non-binding votes (Andrew Schofield, Yash Mayya, Kamal Chandraprakash). I'll update the KIP status, meanwhile the PR is still pending: https://github.com/apache/kafka/pull/14093 From: de

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Matthias J. Sax
Good catch about the JavaDocs. Seems we missed to update them when we did K10277. Would you like to do a PR to fix them right away for upcoming 3.6 release? If there is no more other comments, I think you can start a VOTE thread. -Matthias On 8/10/23 4:22 AM, Florin Akermann wrote: Thank y

[jira] [Resolved] (KAFKA-15291) Implement Versioned interfaces in common Connect plugins

2023-08-10 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15291. - Resolution: Fixed > Implement Versioned interfaces in common Connect plugins > -

[jira] [Created] (KAFKA-15332) Eligible Leader Replicas

2023-08-10 Thread Calvin Liu (Jira)
Calvin Liu created KAFKA-15332: -- Summary: Eligible Leader Replicas Key: KAFKA-15332 URL: https://issues.apache.org/jira/browse/KAFKA-15332 Project: Kafka Issue Type: New Feature Repo

[jira] [Created] (KAFKA-15333) Flaky build failure throwing Connect Exception: Could not connect to server....

2023-08-10 Thread Philip Nee (Jira)
Philip Nee created KAFKA-15333: -- Summary: Flaky build failure throwing Connect Exception: Could not connect to server Key: KAFKA-15333 URL: https://issues.apache.org/jira/browse/KAFKA-15333 Project:

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-10 Thread Igor Fomenko
I don't mind you being a bit picky. I think it is a great discussion and it helps me too. For example I clearly see now that the problem of aggregation still needs to be solved for this use case. Please see my answers below. I used an example of OrderEvents to OrderItems relationship as 1:1 just t

Re: [DISCUSS] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Florin Akermann
Thanks. Here is the PR for this catch: https://github.com/apache/kafka/pull/14187 On Thu, 10 Aug 2023 at 19:04, Matthias J. Sax wrote: > Good catch about the JavaDocs. > > Seems we missed to update them when we did K10277. Would you like to do > a PR to fix them right away for upcoming 3.6 rele

[VOTE] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Florin Akermann
https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams

[jira] [Resolved] (KAFKA-13187) Replace EasyMock and PowerMock with Mockito for DistributedHerderTest

2023-08-10 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-13187. --- Fix Version/s: 3.6.0 Resolution: Done > Replace EasyMock and PowerMock with Mockito f

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2086

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 403180 lines...] streams-3: SMOKE-TEST-CLIENT-CLOSED streams-0: SMOKE-TEST-CLIENT-CLOSED FAILURE: Build failed with an exception. * What wen

[jira] [Resolved] (KAFKA-15239) producerPerformance system test for old client failed after v3.5.0

2023-08-10 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-15239. - Fix Version/s: 3.6.0 Reviewer: Greg Harris Resolution: Fixed > producerPerforman

[DISCUSS] KIP-966: Eligible Leader Replicas

2023-08-10 Thread Calvin Liu
Hi everyone, I'd like to discuss a series of enhancement to the replication protocol. A partition replica can experience local data loss in unclean shutdown scenarios where unflushed data in the OS page cache is lost - such as an availability zone power outage or a server error. The Kafka replicat

Re: [VOTE] KIP-962 Relax non-null key requirement in Kafka Streams

2023-08-10 Thread Matthias J. Sax
+1 (binding) On 8/10/23 12:31 PM, Florin Akermann wrote: https://cwiki.apache.org/confluence/display/KAFKA/KIP-962%3A+Relax+non-null+key+requirement+in+Kafka+Streams

[jira] [Reopened] (KAFKA-14598) Fix flaky ConnectRestApiTest

2023-08-10 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris reopened KAFKA-14598: - Assignee: (was: Ashwin Pankaj) > Fix flaky ConnectRestApiTest > --

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.5 #57

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 281691 lines...] > Task :core:integrationTest Gradle Test Run :core:integrationTest > Gradle Test Executor 182 > FetchFromFollowerIntegrationTes

Re: [DISCUSS] KIP-955: Add stream-table join on foreign key

2023-08-10 Thread Matthias J. Sax
Thanks. Seems we are on the same page now what the requirement are? That's good progress! This solution was considered when in KIP-213 for the existing table-table FK join. There is a discussion on disadvantages of using this approach in the article related to KIP-213 and I think the same disa

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2087

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 406314 lines...] streams-5: SMOKE-TEST-CLIENT-CLOSED streams-5: SMOKE-TEST-CLIENT-CLOSED streams-1: SMOKE-TEST-CLIENT-CLOSED streams-4: SMOKE-

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #159

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 524853 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 171 > KafkaZkClientTest > testLogDirEventNotificationsDeletion()

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #186

2023-08-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 420679 lines...] org.apache.kafka.streams.integration.TimeWindowedKStreamIntegrationTest > shouldAggregateWindowedWithGrace[ON_WINDOW_CLOSE_fals

What are the biggest issues with Apache Kafka?

2023-08-10 Thread Liam Hodges
I'm working with a small team of engineers looking to contribute to the open source tools for Apache Kafka. What is missing in the Kafka community right now? Are there any problems an open source project could solve for it's developers? Appreciate all feedback.

Re: What are the biggest issues with Apache Kafka?

2023-08-10 Thread Philip Nee
Hey Liam, I think apache jira would be a great place to find lower hanging fruits. We also have lots of flaky tests to resolve. What is you familiarity with Kafka? If you are new, i would suggest looking at the demos and examples in the repo, and maybe try to improve them. There is also a lot of

[GitHub] [kafka-site] lbradstreet commented on pull request #537: MINOR: Add Lucas Bradstreet to committers

2023-08-10 Thread via GitHub
lbradstreet commented on PR #537: URL: https://github.com/apache/kafka-site/pull/537#issuecomment-1674136550 @jolshan if you or someone else is able to merge this it’d be helpful. This PR is what should get me the ability to merge :) -- This is an automated message from the Apache Git Ser

[jira] [Resolved] (KAFKA-15287) Change NodeApiVersions.create() to contains both apis of zk and kraft broker

2023-08-10 Thread Deng Ziming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deng Ziming resolved KAFKA-15287. - Resolution: Fixed > Change NodeApiVersions.create() to contains both apis of zk and kraft broker

Re: What are the biggest issues with Apache Kafka?

2023-08-10 Thread ziming deng
Hi Liam, The Apache Kafka project has several modules, I think you should firstly select a module you are interested in. For example, we are currently working on KIP-500 related features, which includes 1. KIP-856: KRaft Disk Failure Recovery, 2. KIP-642: Dynamic quorum reassignment, 3. kafk

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2088

2023-08-10 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2089

2023-08-10 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-714: Client metrics and observability

2023-08-10 Thread Andrew Schofield
Hi Doguscan, Thanks for your question. If the target broker is unreachable, the client can send the metrics to another broker. It can select any of the other brokers for this purpose. What I expect in practice is that it loses connection to the broker it’s being using for metrics, chooses or esta

[jira] [Created] (KAFKA-15334) DescribeQuorum should not be seen as cluster action

2023-08-10 Thread Deng Ziming (Jira)
Deng Ziming created KAFKA-15334: --- Summary: DescribeQuorum should not be seen as cluster action Key: KAFKA-15334 URL: https://issues.apache.org/jira/browse/KAFKA-15334 Project: Kafka Issue Type