Re: [DISCUSS] KIP-864: Add End-To-End Latency Metrics to Connectors

Hi Jorge, Thanks for the changes. With regard to having per batch vs per record metrics, the additional overhead I was referring to wasn't about whether or not we would need to iterate over all the records in a batch. I was referring to the potential additional overhead caused by the higher volume

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1207

See Changes: -- [...truncated 504957 lines...] [2022-09-08T04:22:05.955Z] [2022-09-08T04:22:05.955Z] StreamsAssignmentScaleTest > testStickyTaskAssignorManyStandbys START

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1206

See Changes: -- [...truncated 501968 lines...] [2022-09-08T01:47:23.569Z] StreamsAssignmentScaleTest > testFallbackPriorTaskAssignorManyThreadsPerClient STARTED [2022-09-0

Re: [DISCISS] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

Thanks for the details, Colin. I understand how this can happen. But this API has been out for a long time. Are we saying that we have seen Cruise Control cause this kind of problem? If so, it would be good to mention it in the KIP as evidence that the current approach is brittle. Ismael On Wed,

Re: [DISCISS] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

Hi Ismael, I think this issue comes up when people write software that automatically creates partition reassignments to balance the cluster. Cruise Control is one example; Confluent also has some software that does this. If there is already a reassignment that is going on for some partition and

Re: [VOTE] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

+1 (binding). One nitpick: when the user sets AllowReplicationFactorChange = false, the exception the user gets back from AdminClient should mention that this was the problem. If the exception just says "The broker does not support ALTER_PARTITION_REASSIGNMENTS with version in range [1, 1]. Th

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1205

See Changes: -- [...truncated 513828 lines...] [2022-09-07T20:00:31.590Z] StreamsAssignmentScaleTest > testFallbackPriorTaskAssignorManyThreadsPerClient PASSED [2022-09-07

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #60

See Changes: -- [...truncated 572650 lines...] [2022-09-07T19:31:57.685Z] org.apache.kafka.streams.processor.internals.StreamsAssignmentScaleTest > testStickyTaskAssignorLarg

[jira] [Created] (KAFKA-14207) Add a 6.10 section for KRaft

Jose Armando Garcia Sancio created KAFKA-14207: -- Summary: Add a 6.10 section for KRaft Key: KAFKA-14207 URL: https://issues.apache.org/jira/browse/KAFKA-14207 Project: Kafka Issu

[jira] [Resolved] (KAFKA-14200) kafka-features.sh must exit with non-zero error code on error

[ https://issues.apache.org/jira/browse/KAFKA-14200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14200. -- Reviewer: David Arthur Resolution: Fixed > kafka-features.sh must exit with non-zero err

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1204

See Changes: -- [...truncated 375625 lines...] [2022-09-07T15:45:10.824Z] > Task :connect:json:publishToMavenLocal [2022-09-07T15:45:10.824Z] > Task :connect:api:publishMa

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.2 #78

See Changes: -- [...truncated 458305 lines...] [2022-09-07T15:16:32.161Z] org.apache.kafka.streams.integration.StoreQueryIntegrationTest > shouldQuerySpecificStalePartitionSt

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #132

See Changes: -- [...truncated 381772 lines...] [2022-09-07T15:07:25.626Z] PlaintextConsumerTest > testAsyncCommit() PASSED [2022-09-07T15:07:25.626Z] [2022-09-07T15:07:25.626

Re: [DISCISS] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

Thanks for the KIP. Can we explain a bit more why this is an important use case to address? For example, do we have concrete examples of people running into this? The way the KIP is written, it sounds like a potential problem but no information is given on whether it's a real problem in practice.

Re: Hosting Kafka Videos on ASF YouTube channel

Hi Bill, all, Next steps would be to get the videos ready for posting + we can start uploading them. I'd need them in a central location I can do that from. On Wed, Aug 31, 2022 at 2:45 PM Bill Bejeck wrote: > > This thread has been open for 22 days, so I will close the vote now. > > The questio

Re: [VOTE] KIP-860: Add client-provided option to guard against unintentional replication factor change during partition reassignments

+1 from me. Thanks, Stan! On Tue, Aug 23, 2022 at 12:10 PM Luke Chen wrote: > > Hi Stanislav, > > Thanks for the KIP. > The solution looks reasonable to me. > +1 from me. > > Thank you. > Luke > > On Tue, Aug 23, 2022 at 6:07 AM Stanislav Kozlovski > wrote: > > > Hello, > > > > I'd like to start

[jira] [Created] (KAFKA-14206) Upgrade zookeeper to 3.7.1 to address security vulnerabilities

Valeriy Kassenbayev created KAFKA-14206: --- Summary: Upgrade zookeeper to 3.7.1 to address security vulnerabilities Key: KAFKA-14206 URL: https://issues.apache.org/jira/browse/KAFKA-14206 Project:

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1203

See Changes: -- [...truncated 502802 lines...] [2022-09-07T11:36:50.828Z] KStreamAggregationIntegrationTest > shouldReduce(TestInfo) STARTED [2022-09-07T11:36:57.626Z] [2

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.2 #77

See Changes: -- [...truncated 458042 lines...] [2022-09-07T11:42:35.200Z] Skipping Kafka Streams archetype test for Java 17 [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pip

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #131

See Changes: -- [...truncated 368958 lines...] [2022-09-07T11:13:26.011Z] > Task :connect:json:generateMetadataFileForMavenJavaPublication [2022-09-07T11:13:26.011Z] > Task :

Re: [VOTE] KIP-844: Transactional State Stores

The vote passes with three binding +1s (Bruno, Guozhang, John), one non-binding +1 (Colt), and no -1s. Thanks everyone! Best, Alex On Thu, Sep 1, 2022 at 11:12 PM John Roesler wrote: > Thanks for the KIP, Alex! > > +1 (binding) from me. > > -John > > On Thu, Sep 1, 2022, at 09:51, Guozhang Wan

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1202

See Changes: -- [...truncated 503674 lines...] [2022-09-07T08:47:11.550Z] StreamsAssignmentScaleTest > testHighAvailabilityTaskAssignorManyThreadsPerClient PASSED [2022-09

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

Hi Sagar, I would not drop the support for dropping records. I would also not return null from partitions(). Maybe an Optional can help here. An empty Optional would mean to use the default partitioning behavior of the producer. So we would have: - non-empty Optional, non-empty list of integ