[jira] [Created] (KAFKA-14144) AlterPartition is not idempotent when requests time out

David Mao created KAFKA-14144: - Summary: AlterPartition is not idempotent when requests time out Key: KAFKA-14144 URL: https://issues.apache.org/jira/browse/KAFKA-14144 Project: Kafka Issue Type:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1121

See Changes: -- [...truncated 504100 lines...] [2022-08-04T21:58:52.455Z] > Task :connect:api:testSrcJar [2022-08-04T21:58:52.455Z] > Task :connect:api:publishMavenJavaPub

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Thu, Aug 4, 2022 at 2:33 PM Niket Goel wrote: > I would like to request adding KIP-859 [1] to the 3.3.0 release. The KIP > adds some important metrics to allow visibility into KRaft log processing > related errors. Thanks Niket. Adding these metrics to the 3.3.0 release should be okay since th

Re: [DISCUSS] Apache Kafka 3.3.0 Release

(hit send too soon) KIP -- https://cwiki.apache.org/confluence/display/KAFKA/KIP-859%3A+Add+Metadata+Log+Processing+Error+Related+Metrics JIRA -- https://issues.apache.org/jira/browse/KAFKA-14114 On Thu, Aug 4, 2022 at 2:33 PM Niket Goel wrote: > Hey Jose, > > I would like to request adding KIP-

Re: [DISCUSS] Apache Kafka 3.3.0 Release

Hey Jose, I would like to request adding KIP-859 [1] to the 3.3.0 release. The KIP adds some important metrics to allow visibility into KRaft log processing related errors. The KIP was approved today and I have a PR ready for review, which I hope should get reviewed and merged within next week. T

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

Thanks everyone for the feedback and votes. I have three +1s (David, Colin, Jose). Closing this vote now. On Thu, Aug 4, 2022 at 2:09 PM José Armando García Sancio wrote: > Thanks for the improvement. LGTM. +1 (binding). > > -- > -José > - Niket

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

Thanks for the improvement. LGTM. +1 (binding). -- -José

Re: [DISCISS] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

Thanks Stanislav for the KIP. Seems like a reasonable proposal, preventing users from accidentally altering the replica set under certain conditions. I have couple of comments: > In the case of an already-reassigning partition being reassigned again, the validation compares the targetReplicaSet s

[jira] [Resolved] (KAFKA-14115) Password configs are logged in plaintext in KRaft

[ https://issues.apache.org/jira/browse/KAFKA-14115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-14115. -- Assignee: David Arthur (was: Prem Kamal) Resolution: Fixed > Password configs are logge

[jira] [Resolved] (KAFKA-14136) AlterConfigs in KRaft does not generate records for unchanged values

[ https://issues.apache.org/jira/browse/KAFKA-14136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-14136. -- Resolution: Fixed > AlterConfigs in KRaft does not generate records for unchanged values > ---

Re: Last sprint to finish line: Replace EasyMock/Powermock with Mockito

I will assign myself to 14132 and 14133, thanks for the detailed notes on gotchas for the migration. Regards -- Matthew de Detrich Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +49160370

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

Hey Jose, > How about the inactive controller? Are inactive controllers going to update this metric when they encounter an error when replaying a record? Yes, this metric will be reported for both active and inactive controllers. The Inactive controllers will update this metric when they encount

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #23

See Changes: -- [...truncated 569202 lines...] [2022-08-04T18:33:48.221Z] org.apache.kafka.streams.processor.internals.StreamsAssignmentScaleTest > testFallbackPriorTaskAssig

Re: [VOTE] KIP-859: Add Metadata Log Processing Error Related Metrics

Thanks for the KIP Niket. > kafka.controller:type=KafkaController,name=MetadataErrorCountReports the > number of times this controller node has renounced leadership of the metadata > quorum owing to an error encountered during event processing How about the inactive controller? Are inactive con

Re: Last sprint to finish line: Replace EasyMock/Powermock with Mockito

Hi everyone To provide you with quick updates on the progress. Open PRs (pending review): 1. Streams - https://github.com/apache/kafka/pull/12449 2. Streams - https://github.com/apache/kafka/pull/12465 3. Streams - https://github.com/apache/kafka/pull/12459 4. Connect - https://githu

[jira] [Resolved] (KAFKA-13313) In KRaft mode, CreateTopic should return the topic configs in the response

[ https://issues.apache.org/jira/browse/KAFKA-13313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13313. -- Resolution: Duplicate > In KRaft mode, CreateTopic should return the topic configs in the resp

Re: ARM/PowerPC builds

Hi Matthew, Can you open a JIRA for the test failures you have seen on M1? By the way, I have an M1 myself. best, Colin On Thu, Aug 4, 2022, at 04:12, Matthew Benedict de Detrich wrote: > Quite happy to have this change gone through since the ARM builds were > constantly failing however I iter

Re: 3.3 release date?

I appreciate the update and references José. > On Aug 4, 2022, at 12:06 PM, José Armando García Sancio > wrote: > > On Thu, Aug 4, 2022 at 6:42 AM Gregory M. Foreman > wrote: >> indicates that 3.3 would be the production-ready version of KRaft and >> available this month. Is this month still

Re: 3.3 release date?

On Thu, Aug 4, 2022 at 6:42 AM Gregory M. Foreman wrote: > indicates that 3.3 would be the production-ready version of KRaft and > available this month. Is this month still a valid target? Hi Greg, Thanks for your interest in KRaft and Apache Kafka 3.3.0. You can follow the 3.3.0 release wiki

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Thu, Aug 4, 2022 at 8:37 AM Justine Olshan wrote: > > Hey Jose. > I found a gap in handling ISR changes in ZK mode. We just need to prevent > brokers that are offline from being added to ISR. Since KIP-841 is part of > this release and the fix should be small (a few lines), I propose adding > h

[jira] [Resolved] (KAFKA-6080) Transactional EoS for source connectors

[ https://issues.apache.org/jira/browse/KAFKA-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-6080. -- Fix Version/s: 3.3.0 Resolution: Fixed > Transactional EoS for source connectors > -

[jira] [Resolved] (KAFKA-10000) Atomic commit of source connector records and offsets

[ https://issues.apache.org/jira/browse/KAFKA-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-1. --- Resolution: Done > Atomic commit of source connector records and offsets > -

[jira] [Created] (KAFKA-14143) Exactly-once source system tests

Chris Egerton created KAFKA-14143: - Summary: Exactly-once source system tests Key: KAFKA-14143 URL: https://issues.apache.org/jira/browse/KAFKA-14143 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-14142) Improve information returned about the cluster metadata partition

Jose Armando Garcia Sancio created KAFKA-14142: -- Summary: Improve information returned about the cluster metadata partition Key: KAFKA-14142 URL: https://issues.apache.org/jira/browse/KAFKA-14142

Re: [DISCUSS] Apache Kafka 3.3.0 Release

> On Wed, Jul 13, 2022 at 10:01 AM Sagar wrote: > > Well actually I have 2 approved PRs from Kafka Connect: > > > > https://github.com/apache/kafka/pull/12321 > > https://github.com/apache/kafka/pull/12309 > > > > Not sure how to get these merged though but I think these can go into 3.3 > > releas

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Thu, Jul 28, 2022 at 2:16 PM Chris Egerton wrote: > Would it be okay to backport https://github.com/apache/kafka/pull/12451 to > the current 3.3 branch? It's a strictly cosmetic change that updates a > misleading comment about exactly-once support for source connectors. I'm > hoping it'll ma

Re: [DISCUSS] Apache Kafka 3.3.0 Release

Hey Jose. I found a gap in handling ISR changes in ZK mode. We just need to prevent brokers that are offline from being added to ISR. Since KIP-841 is part of this release and the fix should be small (a few lines), I propose adding https://issues.apache.org/jira/browse/KAFKA-14140 to the 3.3 releas

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Mon, Aug 1, 2022 at 1:51 AM Matthew Benedict de Detrich wrote: > Due to time pressure from the release schedule does it make sense to merge > the PR as is since it already has the necessary approval from Luke or should > we wait for finale reviews from Mickael/Tom as well? Thanks for the upd

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Thu, Jul 21, 2022 at 8:10 PM Luke Chen wrote: > I just found the KIP-831 is not listed in the v3.3 planned KIPs. > It is completed and merged. > Please help add it. Thanks. It should now be in the 3.3.0 release page. -- -José

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Thu, Jul 21, 2022 at 1:56 PM Randall Hauch wrote: > Will you approve me merging the fix to the `3.3` branch for inclusion in > 3.3.0? Yes. I approved this fix for 3.3.0. Randall merged it to the 3.3.0 branch. -- -José

[GitHub] [kafka-site] bbejeck commented on pull request #433: MINOR: Add placeholder images that will load iframe.

bbejeck commented on PR #433: URL: https://github.com/apache/kafka-site/pull/433#issuecomment-1205402084 @mimaison, I've addressed your comments - thanks for the review I think it's important to get back the original look and feel -- This is an automated message from the Apache Git Servi

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Thu, Jul 14, 2022 at 4:55 PM Jason Gustafson wrote: > > Hey Jose, > > Thanks for volunteering to manage the release! KIP-833 is currently slotted > for 3.3. We've been getting some help from Jack Vanlighty to validate the > raft implementation in TLA+ and with frameworks like Jepsen. The > spec

Re: [DISCUSS] Apache Kafka 3.3.0 Release

On Wed, Jul 13, 2022 at 10:01 AM Sagar wrote: > Well actually I have 2 approved PRs from Kafka Connect: > > https://github.com/apache/kafka/pull/12321 > https://github.com/apache/kafka/pull/12309 > > Not sure how to get these merged though but I think these can go into 3.3 > release. Thank you fo

Re: [DISCUSS] Apache Kafka 3.3.0 Release

Excuse the delay in the response. I was busy dealing with some potentially blocking issues for the 3.3.0 release. On Wed, Jul 13, 2022 at 4:33 AM Divij Vaidya wrote: > A few of my PRs are pending review for quite some which I was hoping to > merge into 3.3. I have already marked them with "Fix ve

[jira] [Created] (KAFKA-14141) Unable to abort a stale transaction

Yordan Pavlov created KAFKA-14141: - Summary: Unable to abort a stale transaction Key: KAFKA-14141 URL: https://issues.apache.org/jira/browse/KAFKA-14141 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-844: Transactional State Stores

Hey Bruno, Thank you for the suggestions and the clarifying questions. I believe that they cover the core of this proposal, so it is crucial for us to be on the same page. 1. Don't you want to deprecate StateStore#flush(). Good call! I updated both the proposal and the prototype. 2. I would s

Re: ARM/PowerPC builds

Divij, I believe the ARM node is not managed by Apache but rather access to it is donated by some external entity. I opened an INFRA ticket the last time we had issues and the Infra folks reached out to the owner of the node to resolve the issue. On Thu, Aug 4, 2022 at 7:13 AM Matthew Benedict d

3.3 release date?

Hello: I have a client considering moving to KRaft. The page here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-833%3A+Mark+KRaft+as+Production+Ready indicates that 3.3 would be the production-ready version of KRaft and available this month. Is this month still a valid target? Thank

TopologyTestDriver and IQv2

Hello, what is the approach to unit test the new Queries introduced by Interactive Queries v2? Is the TopologyTestDriver being updated to support it? Regards, Jorge

Re: ARM/PowerPC builds

Quite happy to have this change gone through since the ARM builds were constantly failing however I iterate what Divij Vaidya is saying. I just recently got a new MacBook M1 laptop that has ARM architecture and even locally the tests fail (these are the same tests that also failed in Jenkins).

Re: ARM/PowerPC builds

Thank you. This would greatly improve the PR experience since now, there is higher probability for it to be green. Side question though, do we know why ARM tests are timing out? Should we start a JIRA with Apache Infra to root cause? — Divij Vaidya On Thu, Aug 4, 2022 at 12:42 AM Colin McCabe

[GitHub] [kafka-site] mimaison commented on pull request #433: MINOR: Add placeholder images that will load iframe.

mimaison commented on PR #433: URL: https://github.com/apache/kafka-site/pull/433#issuecomment-1205049698 It does not seem to render quite right for me. The first video is fine: https://user-images.githubusercontent.com/903615/182822374-326f590b-c5bb-4ec8-af0f-9bc2e9e473e3.png";>