Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #318

See

[jira] [Resolved] (KAFKA-10849) Remove useless ApiKeys#parseResponse and ApiKeys#parseRequest

[ https://issues.apache.org/jira/browse/KAFKA-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10849. Resolution: Duplicate duplicate to https://github.com/apache/kafka/pull/9748 > Remove use

[jira] [Resolved] (KAFKA-10292) fix flaky streams/streams_broker_bounce_test.py

[ https://issues.apache.org/jira/browse/KAFKA-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10292. Fix Version/s: (was: 2.8.0) 2.7.0 Resolution: Fixed > fix fl

[jira] [Resolved] (KAFKA-10858) Convert connect protocol header schemas to use generated protocol

[ https://issues.apache.org/jira/browse/KAFKA-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dengziming resolved KAFKA-10858. Resolution: Duplicate > Convert connect protocol header schemas to use generated protocol > --

[jira] [Created] (KAFKA-10859) add @Test annotation to FileStreamSourceTaskTest.testInvalidFile and reduce the loop count to speedup the test

Chia-Ping Tsai created KAFKA-10859: -- Summary: add @Test annotation to FileStreamSourceTaskTest.testInvalidFile and reduce the loop count to speedup the test Key: KAFKA-10859 URL: https://issues.apache.org/jira/b

[jira] [Reopened] (KAFKA-10292) fix flaky streams/streams_broker_bounce_test.py

[ https://issues.apache.org/jira/browse/KAFKA-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reopened KAFKA-10292: Thanks for the information. Reopen it > fix flaky streams/streams_broker_bounce_test.py > ---

New Contributor

Dear team. Could you please add us as a contributor for Apache Kafka? ・GitHub: zacky9664, JIRA username: zacky ・GitHub: moja0316, JIRA username: moja0316 ・GitHub: runom, JIRA username: mintomio

[GitHub] [kafka-site] acraske opened a new pull request #315: Adding La Redoute as powered by Kafka

acraske opened a new pull request #315: URL: https://github.com/apache/kafka-site/pull/315 From sharing with Anthony and Ale This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [VOTE] voting on KIP-631: the quorum-based Kafka controller

Thanks for the KIP Colin, it does a great job of clearly explaining some pretty complex changes. +1 (non-binding) Tom On Tue, Dec 15, 2020 at 7:13 PM Boyang Chen wrote: > Thanks Colin for the great work to polish the KIP and reach this final > stage. +1 (binding) from me > > On Tue, Dec 15,

Re: [VOTE] 2.6.1 RC3

Hi, +1 (binding) - verified signatures - ran the tests on the source archive with Scala 2.13 - verified the core/connect/streams quickstart with Scala 2.13 binary archive. - verified the artifacts, javadoc Thanks for running the release! Thanks, Manikumar On Tue, Dec 15, 2020 at 9:01 PM Rajini

Re: [VOTE] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

Hi Guozhang, Thank for the feedback! Please find my answers inline. Best, Bruno On 14.12.20 23:33, Guozhang Wang wrote: Hello Bruno, Just a few more questions about the KIP: 1) If the internal topics exist but the calculated num.partitions do not match the existing topics, what would Strea

[jira] [Resolved] (KAFKA-10656) NetworkClient.java: print out the feature flags received at DEBUG level, as well as the other version information

[ https://issues.apache.org/jira/browse/KAFKA-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10656. Fix Version/s: 2.7.0 Resolution: Fixed > NetworkClient.java: print out the feature

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #339

See Changes: [github] KAFKA-10656: Log the feature flags received by the client (#9552) -- [...truncated 13.13 KB...] org.apache.kafka.message.VersionCondit

[jira] [Resolved] (KAFKA-10417) suppress() with cogroup() throws ClassCastException

[ https://issues.apache.org/jira/browse/KAFKA-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah Thomas resolved KAFKA-10417. - Resolution: Fixed > suppress() with cogroup() throws ClassCastException > --

[VOTE] 2.7.0 RC6

Hello Kafka users, developers and client-developers, This is the seventh candidate for release of Apache Kafka 2.7.0. * Configurable TCP connection timeout and improve the initial metadata fetch * Enforce broker-wide and per-listener connection creation rate (KIP-612, part 1) * Throttle Create To

Re: [VOTE] voting on KIP-631: the quorum-based Kafka controller

Went through the changes since the last discussion thread, and it's looking in good shape. Thanks!. + 1 (non-binding) On Wed, Dec 16, 2020 at 4:34 PM Tom Bentley wrote: > Thanks for the KIP Colin, it does a great job of clearly explaining some > pretty complex changes. > > +1 (non-binding) > > T

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

On Tue, Dec 15, 2020, at 13:08, Jun Rao wrote: > Hi, Colin, > > Thanks for the reply. A few more follow up comments. > > 210. initial.broker.registration.timeout.ms: The default value is 90sec, > which seems long. If a broker fails the registration because of incorrect > configs, we want to fail

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

Hi, Colin, Thanks for the reply. A few more comments below. 206. "RemoveTopic is the last step, that scrubs all metadata about the topic. In order to get to that last step, the topic data needs to removed from all brokers (after each broker notices that the topic is being deleted)." Currently, t

Re: [VOTE] voting on KIP-631: the quorum-based Kafka controller

+1 Thanks Colin for all the iterations. My only request is to change "controller.connect" to "controller.quorum.voters." I think it's important to emphasize that this must be the full set of voters unlike "zookeeper.connect." In the future, I think we can consider supporting an additional config li

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #64

See Changes: [Rajini Sivaram] KAFKA-10798; Ensure response is delayed for failed SASL authentication with connection close delay (#9678) -- [...truncated 3.16 M

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi, Satish, Thanks for the reply. A few more followup comments. 6022. For packages used for server plugins, the convention is to use org.apache.kafka.server. See java-based Authorizer as an example. 9100. Do we need DeletePartitionStateRecord in flat_file_format? The flat file captures the state

Re: [VOTE] KIP-695: Improve Streams Time Synchronization

Hi John, Just one question. It wasn't very clear to me exactly when the metadata would be returned in `ConsumerRecords`. Would we /always/ include the metadata for all partitions that are assigned, or would it be based on the latest fetches? Thanks, Jason On Fri, Dec 11, 2020 at 4:07 PM John Roe

[jira] [Created] (KAFKA-10860) JmxTool fails with NPE when object-name contains a wildcard

Bob Barrett created KAFKA-10860: --- Summary: JmxTool fails with NPE when object-name contains a wildcard Key: KAFKA-10860 URL: https://issues.apache.org/jira/browse/KAFKA-10860 Project: Kafka Is

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #340

See

Re: New Contributor

Thanks for your interests. Added all 3 names to the jira contributors list. Jun On Wed, Dec 16, 2020 at 2:25 AM 山崎健史 wrote: > Dear team. Could you please add us as a contributor for Apache Kafka? > > ・GitHub: zacky9664, JIRA username: zacky > ・GitHub: moja0316, JIRA username: moja0316 > ・GitHub

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

On Wed, Dec 16, 2020, at 09:59, Jun Rao wrote: > Hi, Colin, > > Thanks for the reply. A few more comments below. > Hi Jun, Thanks for the comments. > 206. "RemoveTopic is the last step, that scrubs all metadata about the > topic. In order to get to that last step, the topic data needs to remo

Re: [VOTE] voting on KIP-631: the quorum-based Kafka controller

On Wed, Dec 16, 2020, at 10:10, Jason Gustafson wrote: > +1 Thanks Colin for all the iterations. My only request is to change > "controller.connect" to "controller.quorum.voters." I think it's important > to emphasize that this must be the full set of voters unlike > "zookeeper.connect." In the fut

RE: New Contributor

Thanks a lot. -Original Message- From: Jun Rao Sent: Thursday, December 17, 2020 4:33 AM To: dev Subject: Re: New Contributor Thanks for your interests. Added all 3 names to the jira contributors list. Jun On Wed, Dec 16, 2020 at 2:25 AM 山崎健史 wrote: > Dear team. Could you please add

Re: [VOTE] voting on KIP-631: the quorum-based Kafka controller

Thanks for all the work on the KIP. Given the magnitude of the KIP, I expect that some tweaks will be made as the code is implemented, reviewed and tested. I'm overall +1 (binding). A few comments below: 1. It's a bit weird for kafka-storage to output a random uuid. Would it be better to have a de

[GitHub] [kafka-site] vvcephei commented on a change in pull request #314: [minor] Adding many more companies to powered by page

vvcephei commented on a change in pull request #314: URL: https://github.com/apache/kafka-site/pull/314#discussion_r544622598 ## File path: powered-by.html ## @@ -237,6 +292,26 @@ "logo": "ipinyou.png", "logoBgColor": "#ff", "description": "The la

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

Hi, Colin, Thanks for the reply. A few follow up comments. 211. When does the broker send the BrokerRegistration request to the controller? Is it after the recovery phase? If so, at that point, the broker has already caught up on the metadata (in order to clean up deleted partitions). Then, it se

[GitHub] [kafka-site] scott-confluent commented on pull request #314: [minor] Adding many more companies to powered by page

scott-confluent commented on pull request #314: URL: https://github.com/apache/kafka-site/pull/314#issuecomment-747058796 @vvcephei yep, I've rendered the page. happy to provide a screenshot of the updates This is an automat

[GitHub] [kafka-site] vvcephei merged pull request #314: [minor] Adding many more companies to powered by page

vvcephei merged pull request #314: URL: https://github.com/apache/kafka-site/pull/314 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [kafka-site] scott-confluent opened a new pull request #316: Powered by update

scott-confluent opened a new pull request #316: URL: https://github.com/apache/kafka-site/pull/316 Something got weird when merging suggestions with Github's UI. Fixing the duplicate. This is an automated message from the Ap

[GitHub] [kafka-site] vvcephei merged pull request #316: HOTFIX: Fix powered-by duplicate

vvcephei merged pull request #316: URL: https://github.com/apache/kafka-site/pull/316 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Reopened] (KAFKA-10140) Incremental config api excludes plugin config changes

[ https://issues.apache.org/jira/browse/KAFKA-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck reopened KAFKA-10140: - I resolved this by mistake, reopening now > Incremental config api excludes plugin config changes >

Re: [VOTE] voting on KIP-631: the quorum-based Kafka controller

On Wed, Dec 16, 2020, at 13:08, Ismael Juma wrote: > Thanks for all the work on the KIP. Given the magnitude of the KIP, I > expect that some tweaks will be made as the code is implemented, reviewed > and tested. I'm overall +1 (binding). > Thanks, Ismael. > A few comments below: > 1. It's a bit

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #320

See Changes: [github] MINOR: Simplify ApiKeys by relying on ApiMessageType (#9748) -- [...truncated 6.99 MB...] org.apache.kafka.streams.test.MockProcessorCo

[VOTE] KIP-687: Automatic Reloading of Security Store

Hey there, I would like to start the voting for KIP-687: https://cwiki.apache.org/confluence/display/KAFKA/KIP-687 %3A+Automatic+Reloading+of+Security+Store to make the security store reloading automated. Best, Boyang

[jira] [Created] (KAFKA-10861) Flaky test `TransactionsTest.testFencingOnSendOffsets`

Jason Gustafson created KAFKA-10861: --- Summary: Flaky test `TransactionsTest.testFencingOnSendOffsets` Key: KAFKA-10861 URL: https://issues.apache.org/jira/browse/KAFKA-10861 Project: Kafka

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

On Wed, Dec 16, 2020, at 13:40, Jun Rao wrote: > Hi, Colin, > > Thanks for the reply. A few follow up comments. > > 211. When does the broker send the BrokerRegistration request to the > controller? Is it after the recovery phase? If so, at that point, the > broker has already caught up on the me

[jira] [Created] (KAFKA-10862) kafak stream consume from the earliest by default

Yuexi Liu created KAFKA-10862: - Summary: kafak stream consume from the earliest by default Key: KAFKA-10862 URL: https://issues.apache.org/jira/browse/KAFKA-10862 Project: Kafka Issue Type: Bug

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #341

See Changes: [github] KAFKA-9126: KIP-689: StreamJoined changelog configuration (#9708) -- [...truncated 3.49 MB...] org.apache.kafka.streams.test.MockProces

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

Hi, Colin, Thanks for the reply. Just a couple of more comments. 211. Currently, the broker only registers itself in ZK after log recovery. Is there any benefit to change that? As you mentioned, the broker can't do much before completing log recovery. 230. Regarding MetadataResponse, there is a

Re: [VOTE] KIP-665 Kafka Connect Hash SMT

I’d like to give this one another friendly bump. If there are no disagreements I can update my existing Pr with the latest KIP changes. Thanks, -Brandon Brandon Brown > On Oct 26, 2020, at 8:29 PM, Brandon Brown wrote: > > I’ve update the KIP with suggestions from Gunnar. I’d like to bring

[jira] [Resolved] (KAFKA-10861) Flaky test `TransactionsTest.testFencingOnSendOffsets`

[ https://issues.apache.org/jira/browse/KAFKA-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10861. - Resolution: Fixed > Flaky test `TransactionsTest.testFencingOnSendOffsets` > ---

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #321

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #295

See Changes: [github] KAFKA-9126: KIP-689: StreamJoined changelog configuration (#9708) -- [...truncated 6.94 MB...] org.apache.kafka.streams.TopologyTestDriv

Re: [DISCUSS] KIP-700: Add Describe Cluster API

Hi David, This seems reasonable. It would be nice to have an API specifically for describeCluster, so that we could extend this API without adding more fields to the already large MetadataRequest. As you mention in the KIP, KIP-700 would allow us to deprecate MetadataRequest#ClusterAuthorized

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

On Wed, Dec 16, 2020, at 18:13, Jun Rao wrote: > Hi, Colin, > > Thanks for the reply. Just a couple of more comments. > > 211. Currently, the broker only registers itself in ZK after log recovery. > Is there any benefit to change that? As you mentioned, the broker can't do > much before completin

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #342

See