Build failed in Jenkins: kafka-trunk-jdk8 #4633

See Changes: [github] KAFKA-7833: Add Global/StateStore name conflict check (#8825) [github] KAFKA-9441: remove prepareClose() to simplify task management (#8833) [github] KAFKA-9985: Sink connector may exhaust

[jira] [Resolved] (KAFKA-9314) Connect put() and poll() retries not conforming to KIP-298

[ https://issues.apache.org/jira/browse/KAFKA-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Liang resolved KAFKA-9314. Resolution: Duplicate > Connect put() and poll() retries not conforming to KIP-298 > --

Re: KAFKA-10145

Thanks Paul, I will check it. On Thu, Jun 11, 2020 at 1:01 PM Paul Whalen wrote: > Perhaps I’m misunderstanding, but this looks like the cogroup feature: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-150+-+Kafka-Streams+Cogroup. > Do you think that covers your use case? > > Paul > > >

[jira] [Resolved] (KAFKA-9216) Enforce connect internal topic configuration at startup

[ https://issues.apache.org/jira/browse/KAFKA-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9216. -- Reviewer: Randall Hauch Resolution: Fixed Merged to `trunk` the second PR that enforces t

[jira] [Resolved] (KAFKA-9845) plugin.path property does not work with config provider

[ https://issues.apache.org/jira/browse/KAFKA-9845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9845. -- Fix Version/s: 2.7.0 Reviewer: Randall Hauch Resolution: Fixed Merged to `trunk

Re: KAFKA-10145

Perhaps I’m misunderstanding, but this looks like the cogroup feature: https://cwiki.apache.org/confluence/display/KAFKA/KIP-150+-+Kafka-Streams+Cogroup. Do you think that covers your use case? Paul > On Jun 10, 2020, at 10:13 PM, lqjacklee wrote: > > Dear team, > > I have created the JRI

[jira] [Resolved] (KAFKA-6942) Connect connectors api doesn't show versions of connectors

[ https://issues.apache.org/jira/browse/KAFKA-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-6942. -- Resolution: Invalid I'm going to close this as INVALID because the versions are available in th

[jira] [Resolved] (KAFKA-10115) Incorporate errors.tolerance with the Errant Record Reporter

[ https://issues.apache.org/jira/browse/KAFKA-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-10115. --- Reviewer: Randall Hauch Resolution: Fixed Merged to `2.6` rather than `trunk` (acciden

[jira] [Resolved] (KAFKA-9066) Kafka Connect JMX : source & sink task metrics missing for tasks in failed state

[ https://issues.apache.org/jira/browse/KAFKA-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9066. -- Fix Version/s: 2.7.0 Reviewer: Randall Hauch Resolution: Fixed Merged to `trunk

[jira] [Created] (KAFKA-10146) Backport KAFKA-9066 to 2.5 and 2.4 branches

Randall Hauch created KAFKA-10146: - Summary: Backport KAFKA-9066 to 2.5 and 2.4 branches Key: KAFKA-10146 URL: https://issues.apache.org/jira/browse/KAFKA-10146 Project: Kafka Issue Type: Bug

Jenkins build is back to normal : kafka-2.6-jdk8 #36

See

Jenkins build is back to normal : kafka-trunk-jdk14 #208

See

Build failed in Jenkins: kafka-trunk-jdk11 #1559

See Changes: [github] KAFKA-10014; Always try to close all channels in Selector#close (#8685) -- [...truncated 1.89 MB...] kafka.api.SaslPlainSslEndToEndAuthorizationTe

[jira] [Resolved] (KAFKA-9653) Duplicate tasks on workers after rebalance

[ https://issues.apache.org/jira/browse/KAFKA-9653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9653. --- Resolution: Duplicate > Duplicate tasks on workers after rebalance >

KAFKA-10145

Dear team, I have created the JRIA https://issues.apache.org/jira/browse/KAFKA-10145. I want to enhance the join feature to support the multiple join/aggregate for stream. If anyone is interested or have questions can idea, please let me know, thanks.

[jira] [Created] (KAFKA-10145) Enhance to support the multiple join operation

lqjacklee created KAFKA-10145: - Summary: Enhance to support the multiple join operation Key: KAFKA-10145 URL: https://issues.apache.org/jira/browse/KAFKA-10145 Project: Kafka Issue Type: Improvem

Build failed in Jenkins: kafka-2.5-jdk8 #150

See Changes: [konstantine] KAFKA-9969: Exclude ConnectorClientConfigRequest from class loading -- [...truncated 2.93 MB...] org.apache.kafka.streams.test.OutputVerifierTes

[jira] [Created] (KAFKA-10144) Corrupted standby tasks are not always cleaned up

Sophie Blee-Goldman created KAFKA-10144: --- Summary: Corrupted standby tasks are not always cleaned up Key: KAFKA-10144 URL: https://issues.apache.org/jira/browse/KAFKA-10144 Project: Kafka

Can't disable kafka broker on springboot application

Hi, i have an application that use kafka broker, but when i run junit test, springboot try to run kafka listeners, and i am forced to run kafka broker, unnecessary. I question you about how I can disable kafka when test are executed. I have tried with @TypeExcludeFilters(KafkaListenersTypeExclude

Re: [DISCUSS] KIP-595: A Raft Protocol for the Metadata Quorum

Hey all, follow-up on the previous email, we made some more updates: 1. The Alter/DescribeQuorum RPCs are also re-structured to use multi-raft. 2. We add observer status into the DescribeQuorumResponse as we see it is a low hanging fruit which is very useful for user debugging and reassignment.

[jira] [Resolved] (KAFKA-7833) StreamsBuilder should throw an exception if addGlobalStore and addStateStore is called for the same store builder

[ https://issues.apache.org/jira/browse/KAFKA-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7833. Fix Version/s: 2.6.0 Resolution: Fixed > StreamsBuilder should throw an exception if

Build failed in Jenkins: kafka-2.6-jdk8 #35

See Changes: [wangguoz] KAFKA-9991: Fix flaky unit tests (#8843) -- [...truncated 3.13 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest > shouldRequireCustomTo

Build failed in Jenkins: kafka-trunk-jdk14 #207

See Changes: [github] KAFKA-10014; Always try to close all channels in Selector#close (#8685) -- [...truncated 6.31 MB...] org.apache.kafka.streams.TopologyTestDriverTes

[jira] [Created] (KAFKA-10143) Can no longer change replication throttle with reassignment tool

Jason Gustafson created KAFKA-10143: --- Summary: Can no longer change replication throttle with reassignment tool Key: KAFKA-10143 URL: https://issues.apache.org/jira/browse/KAFKA-10143 Project: Kafka

[DISCUSS] KIP-623: Add "internal-topics" option to streams application reset tool

Hi all I would like to start the discussion for KIP-623 which proposes adding an “internal-topics” option to the streams application reset tool: https://cwiki.apache.org/confluence/x/YQt4CQ Thanks Joel

[GitHub] [kafka-site] mjsax commented on pull request #267: Updating upgrade docs for KIP-535 and KIP-562

mjsax commented on pull request #267: URL: https://github.com/apache/kafka-site/pull/267#issuecomment-642270882 Thanks @brary! This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [kafka-site] mjsax merged pull request #267: Updating upgrade docs for KIP-535 and KIP-562

mjsax merged pull request #267: URL: https://github.com/apache/kafka-site/pull/267 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Resolved] (KAFKA-9182) Flaky Test org.apache.kafka.streams.integration.KTableSourceTopicRestartIntegrationTest.shouldRestoreAndProgressWhenTopicWrittenToDuringRestorationWithEosEnabled

[ https://issues.apache.org/jira/browse/KAFKA-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9182. -- Fix Version/s: 2.6.0 Resolution: Fixed Resolved as part of https://issues.apache.org/jir

[jira] [Resolved] (KAFKA-9991) Flaky Test KTableSourceTopicRestartIntegrationTest.shouldRestoreAndProgressWhenTopicWrittenToDuringRestorationWithEosAlphaEnabled

[ https://issues.apache.org/jira/browse/KAFKA-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9991. -- Fix Version/s: 2.6.0 Resolution: Fixed > Flaky Test > KTableSourceTopicRestartIntegrati

[jira] [Created] (KAFKA-10142) Worker can be disabled by blocks in connector version, taskConfigs, or taskClass methods

Chris Egerton created KAFKA-10142: - Summary: Worker can be disabled by blocks in connector version, taskConfigs, or taskClass methods Key: KAFKA-10142 URL: https://issues.apache.org/jira/browse/KAFKA-10142

[jira] [Resolved] (KAFKA-10133) Cannot compress messages in destination cluster with MM2

[ https://issues.apache.org/jira/browse/KAFKA-10133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Jacobs resolved KAFKA-10133. -- Resolution: Not A Problem > Cannot compress messages in destination cluster with MM2 > ---

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

That sounds great, thanks Jun! On Wed, Jun 10, 2020 at 11:44 AM Jun Rao wrote: > Hi, Boyang, > > Thanks for the reply. > > For the metric, we just need to define a metric of meter type and of name > NumRequestsForwardingToControllerPerSec. Meter exposes a few standard JMX > attributes including

[jira] [Resolved] (KAFKA-10119) StreamsResetter fails with TimeoutException for older Brokers

[ https://issues.apache.org/jira/browse/KAFKA-10119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-10119. - Resolution: Duplicate Closing this as a duplicate, the issue is tracked by KAFKA

[jira] [Created] (KAFKA-10141) Add more detail to log segment deletion message

Jason Gustafson created KAFKA-10141: --- Summary: Add more detail to log segment deletion message Key: KAFKA-10141 URL: https://issues.apache.org/jira/browse/KAFKA-10141 Project: Kafka Issue T

[jira] [Resolved] (KAFKA-10014) Always try to close all channels in Selector#close

[ https://issues.apache.org/jira/browse/KAFKA-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10014. - Resolution: Fixed > Always try to close all channels in Selector#close > ---

Re: [VOTE] KIP-597: MirrorMaker2 internal topics Formatters

Hi Mickael, Thanks for the KIP. That looks very useful. I have few small comments/suggestions: 1. I was about the make a similar suggestion than Konstantine did regarding requiring to recompile old formatters. While the formatters are not directly part of the public API, I think that we can argu

Build failed in Jenkins: kafka-2.6-jdk8 #34

See Changes: [vvcephei] KAFKA-10079: improve thread-level stickiness (#8775) -- [...truncated 6.25 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldPunctuateI

[jira] [Created] (KAFKA-10140) Incremental config api excludes plugin config changes

Jason Gustafson created KAFKA-10140: --- Summary: Incremental config api excludes plugin config changes Key: KAFKA-10140 URL: https://issues.apache.org/jira/browse/KAFKA-10140 Project: Kafka I

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Hi, Boyang, Thanks for the reply. For the metric, we just need to define a metric of meter type and of name NumRequestsForwardingToControllerPerSec. Meter exposes a few standard JMX attributes including an accumulated total and rates ( https://metrics.dropwizard.io/2.2.0/apidocs/com/yammer/metric

Re: [VOTE] KIP-572: Improve timeouts and retires in Kafka Streams

Thanks! +1 (binding) from myself. I am closing the vote as accepted with 3 binding and 3 non-binding votes. binding: - John - Guozhang - Matthias non-binding: - Sophie - Boyang - Bruno -Matthias On 6/4/20 5:26 PM, Matthias J. Sax wrote: > Guozhang, > > what you propose makes sense,

Re: [VOTE] KIP-620 Deprecate ConsumerConfig#addDeserializerToConfig(Properties, Deserializer, Deserializer) and ProducerConfig#addSerializerToConfig(Properties, Serializer, Serializer)

Yes, it does. I guess many people are busy wrapping up 2.6 release. Today is code freeze. -Matthias On 6/10/20 12:11 AM, Chia-Ping Tsai wrote: > hi Matthias, > > Does this straightforward KIP still need 3 votes? > > On 2020/06/05 21:27:52, "Matthias J. Sax" wrote: >> +1 (binding) >> >> Th

[jira] [Created] (KAFKA-10139) Add operational guide for failure recovery

Boyang Chen created KAFKA-10139: --- Summary: Add operational guide for failure recovery Key: KAFKA-10139 URL: https://issues.apache.org/jira/browse/KAFKA-10139 Project: Kafka Issue Type: Sub-task

Build failed in Jenkins: kafka-trunk-jdk14 #206

See Changes: [github] KAFKA-10079: improve thread-level stickiness (#8775) -- [...truncated 3.16 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldReturnAllS

Re: [DISCUSS] KIP-590: Redirect Zookeeper Mutation Protocols to The Controller

Thanks Jun for the suggestions! I have addressed suggestion and simplified the metrics part. On Tue, Jun 9, 2020 at 5:46 PM Jun Rao wrote: > Hi, Boyang, > > Thanks for the KIP. Just a few comments on the metrics. > > 1. It would be useful to document the full JMX metric names (package, type, > e

Build failed in Jenkins: kafka-trunk-jdk11 #1558

See Changes: [github] KAFKA-10079: improve thread-level stickiness (#8775) -- [...truncated 3.16 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest > shoul

Re: [VOTE] KIP-597: MirrorMaker2 internal topics Formatters

+1 (non-binding) On Wed, Jun 10, 2020 at 9:47 AM Mickael Maison wrote: > Bumping this thread. Let me know if you have any questions or feedback. > > So far, we have 2 binding and 5 non-binding votes. > > Thanks > > On Tue, May 19, 2020 at 10:56 AM Manikumar > wrote: > > > > +1 (binding) > > > >

[jira] [Created] (KAFKA-10138) Prefer --bootstrap-server for reassign_partitions command in ducktape tests

Vinoth Chandar created KAFKA-10138: -- Summary: Prefer --bootstrap-server for reassign_partitions command in ducktape tests Key: KAFKA-10138 URL: https://issues.apache.org/jira/browse/KAFKA-10138 Proje

Re: [VOTE] KIP-597: MirrorMaker2 internal topics Formatters

Bumping this thread. Let me know if you have any questions or feedback. So far, we have 2 binding and 5 non-binding votes. Thanks On Tue, May 19, 2020 at 10:56 AM Manikumar wrote: > > +1 (binding) > > Thanks for the KIP. > > On Tue, May 19, 2020 at 2:57 PM Mickael Maison > wrote: > > > Thanks

[jira] [Created] (KAFKA-10137) Clean-up retain Duplicate logic in Window Stores

Bruno Cadonna created KAFKA-10137: - Summary: Clean-up retain Duplicate logic in Window Stores Key: KAFKA-10137 URL: https://issues.apache.org/jira/browse/KAFKA-10137 Project: Kafka Issue Type

Jenkins build is back to normal : kafka-2.5-jdk8 #149

See

Re: [VOTE] KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations

Hi Colin and Jun, I have no problem if we have to rewrite part of it when the new controller comes out. I will be more than happy to help out. Regarding KIP-590, I think that we can cope with a principal as a string when the time comes. The user entity name is defined with a string already. Rega

Jenkins build is back to normal : kafka-trunk-jdk11 #1557

See

[DISCUSS] KIP-622 Add currentSystemTimeMs and currentStreamTimeMs to ProcessorContext

Add currentSystemTimeMs and currentStreamTimeMs to ProcessorContext I am extremely new to Kafka, but thank you to John Roesler and Matthias J. Sax for pointing me in t

[jira] [Resolved] (KAFKA-9849) Fix issue with worker.unsync.backoff.ms creating zombie workers when incremental cooperative rebalancing is used

[ https://issues.apache.org/jira/browse/KAFKA-9849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9849. --- Resolution: Fixed > Fix issue with worker.unsync.backoff.ms creating zombie w

[jira] [Resolved] (KAFKA-9848) Avoid triggering scheduled rebalance delay when task assignment fails but Connect workers remain in the group

[ https://issues.apache.org/jira/browse/KAFKA-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-9848. --- Resolution: Fixed > Avoid triggering scheduled rebalance delay when task assi

Re: [VOTE] KIP-620 Deprecate ConsumerConfig#addDeserializerToConfig(Properties, Deserializer, Deserializer) and ProducerConfig#addSerializerToConfig(Properties, Serializer, Serializer)

hi Matthias, Does this straightforward KIP still need 3 votes? On 2020/06/05 21:27:52, "Matthias J. Sax" wrote: > +1 (binding) > > Thanks for the KIP! > > > -Matthias > > On 6/4/20 11:25 PM, Chia-Ping Tsai wrote: > > hi All, > > > > I would like to start the vote on KIP-620: > > > > http

[jira] [Created] (KAFKA-10136) Make option threads of ConsumerPerformance work

jiamei xie created KAFKA-10136: -- Summary: Make option threads of ConsumerPerformance work Key: KAFKA-10136 URL: https://issues.apache.org/jira/browse/KAFKA-10136 Project: Kafka Issue Type: Bug