Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #302

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] throw corresponding invalid producer epoch (#9700) -- [...truncated 3.49 MB...] org.apache.kafka.streams.test.MockProcessorContextStat

Re: [DISCUSS] KIP-690: Add additional configuration to control MirrorMaker 2 internal topics naming convention

2020-12-10 Thread Omnia Ibrahim
Thanks, Ryanne for feedback. Could you please vote on the voting thread https://www.mail-archive.com/dev@kafka.apache.org/msg113575.html thanks Omnia On Fri, Dec 4, 2020 at 4:53 PM Ryanne Dolan wrote: > Thanks Omnia, this looks great. I like the approach of introducing another > policy class. >

[jira] [Resolved] (KAFKA-10747) Implement ClientQuota APIs for altering and describing IP entity quotas

2020-12-10 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-10747. - Fix Version/s: 2.8.0 Resolution: Fixed > Implement ClientQuota APIs for altering and desc

Re: [DISCUSS] KIP-696: Update Streams FSM to clarify ERROR state meaning

2020-12-10 Thread Bruno Cadonna
Thanks for the KIP, Walker! The KIP looks good to me. I have just a minor comment about the KIP document. You talk about SHUTDOWN_CLIENT in the KIP, but never explain that it is a possible action that can be taken in the Streams uncaught exception handler. Could you please clarify that? Be

Re: [VOTE] KIP-696: Update Streams FSM to clarify ERROR state meaning

2020-12-10 Thread Bruno Cadonna
Thanks, Walker! +1 (non-binding) Best, Bruno On 09.12.20 20:07, Leah Thomas wrote: Looks good, thanks Walker! +1 (non-binding) Leah On Wed, Dec 9, 2020 at 1:04 PM John Roesler wrote: Thanks, Walker! I'm also +1 (binding) -John On Wed, 2020-12-09 at 11:03 -0800, Guozhang Wang wrote: +1

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #277

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] throw corresponding invalid producer epoch (#9700) -- [...truncated 3.46 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shou

[jira] [Resolved] (KAFKA-10772) java.lang.IllegalStateException: There are insufficient bytes available to read assignment from the sync-group response (actual byte size 0)

2020-12-10 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-10772. --- Resolution: Duplicate > java.lang.IllegalStateException: There are insufficient bytes availa

[DISCUSS] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

2020-12-10 Thread Bruno Cadonna
Hi, I'd like to start the discussion on KIP-698 that proposes an explicit user initialization of broker-side state for Kafka Streams instead of letting Kafka Streams setting up the broker-side state automatically during rebalance. Such an explicit initialization avoids possible data loss issu

Re: [VOTE] KIP-661: Expose task configurations in Connect REST API

2020-12-10 Thread Mickael Maison
I'm +1 (binding) too The vote passes. Here is the summary: +3 binding votes: Gwen, Bill, Mickael +3 non-binding votes: Brandon, Ning, Tom I'll get a PR ready, thanks! On Thu, Dec 3, 2020 at 10:26 PM Bill Bejeck wrote: > > Hi Mickael, > > This KIP looks like it will be useful. > > +1 (binding) >

[jira] [Created] (KAFKA-10833) KIP-661: Expose task configurations in Connect REST API

2020-12-10 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-10833: -- Summary: KIP-661: Expose task configurations in Connect REST API Key: KAFKA-10833 URL: https://issues.apache.org/jira/browse/KAFKA-10833 Project: Kafka I

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #323

2020-12-10 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-10748) Add IP connection rate throttling metric

2020-12-10 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-10748. - Fix Version/s: 2.8.0 Resolution: Fixed > Add IP connection rate throttling metric > -

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #278

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10747: Extend DescribeClientQuotas and AlterClientQuotas APIs to support IP connection rate quota (KIP-612) (#9628) -- [...trunca

Re: [DISCUSS] KIP-690 Add additional configuration to control MirrorMaker 2 internal topics naming convention

2020-12-10 Thread Mickael Maison
Hi Omnia, Thank you for the reply, it makes sense. A couple more comments: 1) I'm assuming the new interface and default implementation will be in the mirror-client project? as the names of some of these topics are needed by RemoteClusterUtils on the client-side. 2) I'm about to open a KIP to s

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #303

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10747: Extend DescribeClientQuotas and AlterClientQuotas APIs to support IP connection rate quota (KIP-612) (#9628) -- [...trunc

Re: [DISCUSS] KIP-690 Add additional configuration to control MirrorMaker 2 internal topics naming convention

2020-12-10 Thread Omnia Ibrahim
Hi Mickael, 1) That's right the interface and default implementation will in mirror-connect 2) Renaming the interface should be fine too especially if you planning to move other functionality related to the creation there, I can edit this if you are okay with that please vote for the KIP here http

Re: [DISCUSS] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

2020-12-10 Thread John Roesler
Hi Bruno, Thanks for the KIP! This seems like a nice data integrity improvement, and the KIP looks good to me. I’m wondering if we should plan to transition to manual init only in the future. I.e. maybe we log a warning, then later on we switch the default config to manual, and then ultimately

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #279

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10748: Add IP connection rate throttling metric (KIP-612) (#9685) -- [...truncated 3.46 MB...] org.apache.kafka.streams.TopologyTe

Re: [DISCUSS] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

2020-12-10 Thread Bruno Cadonna
Hi John, Thank you for the feedback! I am undecided, because while manual init only makes Kafka Streams safer regarding data loss, it makes first toy apps with Kafka Streams a little bit more complicated. I am a bit more inclined to manual init only, though. Best, Bruno On 10.12.20 15:20,

[jira] [Resolved] (KAFKA-10813) StreamsProducer should catch InvalidProducerEpoch and throw TaskMigrated in all cases

2020-12-10 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-10813. - Resolution: Fixed > StreamsProducer should catch InvalidProducerEpoch and throw TaskMigrated in

[GitHub] [kafka-site] guozhangwang commented on pull request #313: MINOR: remove quickstart-*.html

2020-12-10 Thread GitBox
guozhangwang commented on pull request #313: URL: https://github.com/apache/kafka-site/pull/313#issuecomment-742667050 LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log on t

[jira] [Resolved] (KAFKA-10677) Complete fetches in purgatory immediately after raft leader resigns

2020-12-10 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10677. - Resolution: Fixed > Complete fetches in purgatory immediately after raft leader resigns

[jira] [Resolved] (KAFKA-9552) Stream should handle OutOfSequence exception thrown from Producer

2020-12-10 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-9552. Resolution: Not A Problem > Stream should handle OutOfSequence exception thrown from Producer > ---

Re: [DISCUSS] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

2020-12-10 Thread John Roesler
Thanks, Bruno, I think my feelings are the same as yours. It seems like either call is just a matter of some forward looking statement in the KIP and maybe a warning log if we're leaning toward changing the default in the future. I'm happy with whatever you prefer. Thanks again, -John On Thu, 2

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #304

2020-12-10 Thread Apache Jenkins Server
See

[jira] [Reopened] (KAFKA-9552) Stream should handle OutOfSequence exception thrown from Producer

2020-12-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-9552: > Stream should handle OutOfSequence exception thrown from Producer > -

[jira] [Resolved] (KAFKA-9552) Stream should handle OutOfSequence exception thrown from Producer

2020-12-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9552. Fix Version/s: 2.6.0 Resolution: Fixed > Stream should handle OutOfSequence exceptio

Re: [VOTE] KIP-696: Update Streams FSM to clarify ERROR state meaning

2020-12-10 Thread Sophie Blee-Goldman
KIP looks good to me, thanks Walker! +1 (binding) -Sophie On Thu, Dec 10, 2020 at 1:53 AM Bruno Cadonna wrote: > Thanks, Walker! > > +1 (non-binding) > > Best, > Bruno > > On 09.12.20 20:07, Leah Thomas wrote: > > Looks good, thanks Walker! +1 (non-binding) > > > > Leah > > > > On Wed, Dec 9,

[jira] [Resolved] (KAFKA-10802) Spurious log message when starting consumers

2020-12-10 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10802. Fix Version/s: 2.8.0 2.6.1 Resolution: Fixed > Spurious log mess

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #325

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10748: Add IP connection rate throttling metric (KIP-612) (#9685) -- [...truncated 6.99 MB...] org.apache.kafka.streams.TopologyT

Re: [VOTE] 2.6.1 RC2

2020-12-10 Thread Mickael Maison
Hi, I'm including the fix for https://issues.apache.org/jira/browse/KAFKA-10802 in 2.6.1, so closing this vote. I'll start a new vote once I've built RC3 Thanks On Thu, Dec 3, 2020 at 10:07 AM Mickael Maison wrote: > > Thanks for the report Gary. > > Guozhang, I've opened > https://issues.apach

Re: [DISCUSS] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

2020-12-10 Thread Sophie Blee-Goldman
Hey John, I think we should avoid logging a warning that implies we've committed to changing a default unless we've absolutely committed to it, which it sounds like we have not (fwiw I'm also on the fence, but leaning towards leaving it automatic -- just think of how many people already forget to

Re: [DISCUSS] KIP-687: Automatic Reloading of Security Store

2020-12-10 Thread Boyang Chen
After some offline discussions, we believe that it's the right direction to go by doing a hybrid approach which includes both file-watch trigger and interval based reloading. The former guarantees a swift change in 99% time, while the latter provides a time-based guarantee in the worst case when th

Request to be added as a contributor in Kafka JIRA board

2020-12-10 Thread Lev Zemlyanov
Hi, Please add me as a contributor in Kafka JIRA board and Confluence Wiki. My JIRA Id is levzemlyanov. My Confluence ID is lev. Thanks, Lev - Lev Zemlyanov SWE @ Connect Team Confluent Mountain View, CA -

Re: Request to be added as a contributor in Kafka JIRA board

2020-12-10 Thread Konstantine Karantasis
Added to both. Thanks for joining Lev! -Konstantine On Thu, Dec 10, 2020 at 11:57 AM Lev Zemlyanov wrote: > Hi, > > Please add me as a contributor in Kafka JIRA board and Confluence Wiki. My > JIRA Id is levzemlyanov. My Confluence ID is lev. > > Thanks, Lev > > ---

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #59

2020-12-10 Thread Apache Jenkins Server
See Changes: [Mickael Maison] MINOR: Do not print log4j for memberId required (#9667) -- [...truncated 3.17 MB...] org.apache.kafka.streams.TestTopicsTest > test

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #305

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10677; Complete fetches in purgatory immediately after resigning (#9639) -- [...truncated 3.49 MB...] org.apache.kafka.streams.

[GitHub] [kafka-site] bbejeck merged pull request #313: MINOR: remove quickstart-*.html

2020-12-10 Thread GitBox
bbejeck merged pull request #313: URL: https://github.com/apache/kafka-site/pull/313 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka-site] bbejeck commented on pull request #313: MINOR: remove quickstart-*.html

2020-12-10 Thread GitBox
bbejeck commented on pull request #313: URL: https://github.com/apache/kafka-site/pull/313#issuecomment-742814988 \cc @mimaison This is an automated message from the Apache Git Service. To respond to the message, please log

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #280

2020-12-10 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-10834) Remove redundant type casts in Connect

2020-12-10 Thread Konstantine Karantasis (Jira)
Konstantine Karantasis created KAFKA-10834: -- Summary: Remove redundant type casts in Connect Key: KAFKA-10834 URL: https://issues.apache.org/jira/browse/KAFKA-10834 Project: Kafka Is

[jira] [Created] (KAFKA-10835) Replace Runnable and Callable overrides with lambdas in Connect

2020-12-10 Thread Konstantine Karantasis (Jira)
Konstantine Karantasis created KAFKA-10835: -- Summary: Replace Runnable and Callable overrides with lambdas in Connect Key: KAFKA-10835 URL: https://issues.apache.org/jira/browse/KAFKA-10835 P

[jira] [Created] (KAFKA-10837) Fix javadoc issues and warnings in Connect

2020-12-10 Thread Konstantine Karantasis (Jira)
Konstantine Karantasis created KAFKA-10837: -- Summary: Fix javadoc issues and warnings in Connect Key: KAFKA-10837 URL: https://issues.apache.org/jira/browse/KAFKA-10837 Project: Kafka

[jira] [Created] (KAFKA-10836) Use type inference and cleanup generic type declarations in Connect

2020-12-10 Thread Konstantine Karantasis (Jira)
Konstantine Karantasis created KAFKA-10836: -- Summary: Use type inference and cleanup generic type declarations in Connect Key: KAFKA-10836 URL: https://issues.apache.org/jira/browse/KAFKA-10836

[jira] [Created] (KAFKA-10838) Make member fields final if applicable in Connect

2020-12-10 Thread Konstantine Karantasis (Jira)
Konstantine Karantasis created KAFKA-10838: -- Summary: Make member fields final if applicable in Connect Key: KAFKA-10838 URL: https://issues.apache.org/jira/browse/KAFKA-10838 Project: Kafka

[jira] [Created] (KAFKA-10839) Improve consumer group coordinator unavailable message

2020-12-10 Thread Lucas Bradstreet (Jira)
Lucas Bradstreet created KAFKA-10839: Summary: Improve consumer group coordinator unavailable message Key: KAFKA-10839 URL: https://issues.apache.org/jira/browse/KAFKA-10839 Project: Kafka

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #76

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] throw corresponding invalid producer epoch (#9700) (#9723) -- [...truncated 6.87 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

[VOTE] 2.7.0 RC5

2020-12-10 Thread Bill Bejeck
Hello Kafka users, developers and client-developers, This is the sixth candidate for release of Apache Kafka 2.7.0. * Configurable TCP connection timeout and improve the initial metadata fetch * Enforce broker-wide and per-listener connection creation rate (KIP-612, part 1) * Throttle Create Topi

Request to be added as a contributor in Kafka JIRA board

2020-12-10 Thread Daniel Osvath
Hi, Please add me as a contributor to the Kafka JIRA board and Confluence Wiki. My JIRA ID is dosvath. My Confluence ID is dosvath. Thanks, Daniel - Daniel Osvath SWE @ Connect Team Confluent Mountain View, CA -

[jira] [Created] (KAFKA-10840) Need way to catch auth issues in poll method

2020-12-10 Thread Devin G. Bost (Jira)
Devin G. Bost created KAFKA-10840: - Summary: Need way to catch auth issues in poll method Key: KAFKA-10840 URL: https://issues.apache.org/jira/browse/KAFKA-10840 Project: Kafka Issue Type: Im

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #326

2020-12-10 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #60

2020-12-10 Thread Apache Jenkins Server
See Changes: -- [...truncated 3.17 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldProcessRecordForTopic[Eos enabled = false] STARTED org.apache.kafka.streams

Re: Request to be added as a contributor in Kafka JIRA board

2020-12-10 Thread Konstantine Karantasis
Thanks for your interest Daniel. Added. -Konstantine On Thu, Dec 10, 2020 at 2:34 PM Daniel Osvath wrote: > Hi, > > Please add me as a contributor to the Kafka JIRA board and Confluence > Wiki. My JIRA ID is dosvath. My Confluence ID is dosvath. > > Thanks, > > Daniel > > -

[jira] [Resolved] (KAFKA-7036) Complete the docs of KafkaConsumer#poll

2020-12-10 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-7036. --- Resolution: Won't Fix > Complete the docs of KafkaConsumer#poll > ---

[jira] [Resolved] (KAFKA-10463) the necessary utilities in Dockerfile should include git

2020-12-10 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10463. Fix Version/s: 2.7.0 Resolution: Fixed > the necessary utilities in Dockerfile shou

[jira] [Resolved] (KAFKA-9786) fix flaky MetricsTest.testGeneralBrokerTopicMetricsAreGreedilyRegistered

2020-12-10 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-9786. --- Resolution: Won't Fix > fix flaky MetricsTest.testGeneralBrokerTopicMetricsAreGreedilyRegiste

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #281

2020-12-10 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10017: fix flaky EOS-beta upgrade test (#9688) [github] MINOR: Update jmh to 1.27 for async profiler support (#9129) -- [...trunc

[jira] [Created] (KAFKA-10841) LogReadResult should be able to converted to FetchPartitionData

2020-12-10 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-10841: -- Summary: LogReadResult should be able to converted to FetchPartitionData Key: KAFKA-10841 URL: https://issues.apache.org/jira/browse/KAFKA-10841 Project: Kafka

[jira] [Created] (KAFKA-10842) Refactor raft outbound request channel

2020-12-10 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10842: --- Summary: Refactor raft outbound request channel Key: KAFKA-10842 URL: https://issues.apache.org/jira/browse/KAFKA-10842 Project: Kafka Issue Type: Sub-

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #306

2020-12-10 Thread Apache Jenkins Server
See