[jira] [Resolved] (KAFKA-10736) Convert transaction coordinator metadata schemas to use generated protocol

2020-11-30 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10736. Fix Version/s: 2.8.0 Resolution: Fixed > Convert transaction coordinator metadata s

Re: Contributor permissions request

2020-11-30 Thread Omnia Ibrahim
Hi Any idea how long it take to get response on contributor permission? I wanna create a KIP for MM2 but am blocked on this request. Regards, Omnia Ibrahim  Cloud Infrastructure - Kafka > On 23 Nov 2020, at 10:29, Omnia Ibrahim > wrote: > > JIRA username: (omnia_h_ibrahim) > GitHub usernam

Re: Contributor permissions request

2020-11-30 Thread Bruno Cadonna
Hi Omnia, Bill has already replied to your request and should have already granted you permissions. Maybe his reply went to your spam folder. I put your e-mail address in cc and hope you will get this e-mail. Best, Bruno On 30.11.20 11:24, Omnia Ibrahim wrote: Hi Any idea how long it take

Re: Contributor permissions request

2020-11-30 Thread Bruno Cadonna
Hi Omnia, I forwarded you Bill's reply. Unfortunately, I do not have permissions to check your permissions. Somebody with committer status needs to check. Usually getting permissions to write a KIP is quite fast. I am sorry for the inconvenience. Best, Bruno On 30.11.20 11:57, Omnia Ibra

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #268

2020-11-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10736 Convert transaction coordinator metadata schemas to use g… (#9611) -- [...truncated 3.48 MB...] org.apache.kafka.streams.t

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #292

2020-11-30 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #246

2020-11-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10736 Convert transaction coordinator metadata schemas to use g… (#9611) -- [...truncated 6.89 MB...] org.apache.kafka.streams.To

Sticky Partitioner

2020-11-30 Thread Eevee
Hi all, I've noticed a couple edge cases in the Sticky Partitioner and I'd like to discuss introducing a new KIP to fix it. Behavior 1. Low throughput producers The first edge case occurs when a broker becomes temporarily unavailable for a period less then replica.lag.time.max.ms. If you have

Re: [VOTE] 2.7.0 RC3

2020-11-30 Thread Bill Bejeck
Thanks for the vote, Gwen. Here's an update for Jenkins build * Successful Jenkins builds for the 2.7 branches: Unit/integration tests: https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-2.7-jdk8/detail/kafka-2.7-jdk8/63/ On Sun, Nov 29, 2020 at 2:20 AM Gwen Shapira wrote: >

[DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-11-30 Thread Leah Thomas
Hi all, I'd like to kick-off the discussion for KIP-689: Extend `StreamJoined` to allow more store configs. This builds off the work of KIP-479 to add options to enable/disable both logging and ca

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-11-30 Thread Nikolay Izhikov
Friendly bump. Please, share your feedback. Do we need those feature in the Kafka? > 23 нояб. 2020 г., в 12:09, Nikolay Izhikov > написал(а): > > Hello! > > Any additional feedback on this KIP? > I believe this API can be useful for Kafka users. > > >> 18 нояб. 2020 г., в 14:47, Nikolay Izh

[jira] [Resolved] (KAFKA-8266) Improve `testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup`

2020-11-30 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-8266. Resolution: Fixed > Improve > `testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGr

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-11-30 Thread Leah Thomas
After reading through https://issues.apache.org/jira/browse/KAFKA-9921 I removed the option to enable/disable caching for `StreamJoined`, as caching will always be disabled because we retain duplicates. I updated the KIP accordingly, it now adds only `enableLogging` as a config. On Mon, Nov 30, 2

[jira] [Created] (KAFKA-10777) Add additional configuration to control MM2 internal topics naming convention

2020-11-30 Thread Omnia Ibrahim (Jira)
Omnia Ibrahim created KAFKA-10777: - Summary: Add additional configuration to control MM2 internal topics naming convention Key: KAFKA-10777 URL: https://issues.apache.org/jira/browse/KAFKA-10777 Proje

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-11-30 Thread Walker Carlson
Hello Leah, Thank you for the KIP. I had a couple questions that maybe you can expand on from what is on the KIP. 1) Why are we enabling/disabling the logging by passing in a `WindowBytesStoreSupplier`? It seems to me that these two things should be separate. 2) There is already `withThisStoreS

[jira] [Created] (KAFKA-10778) Stronger log fencing after write failure

2020-11-30 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10778: --- Summary: Stronger log fencing after write failure Key: KAFKA-10778 URL: https://issues.apache.org/jira/browse/KAFKA-10778 Project: Kafka Issue Type: Bu

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-11-30 Thread Leah Thomas
Hey Walker, Thanks for your response. 1. Ah yeah thanks for the catch, that was held over from copy/paste. Both functions should take no parameters, as they just `loggingEnabled` to true or false. I've removed the `WindowBytesStoreSupplier otherStoreSupplier` from the methods in the KIP 2. I thin

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-11-30 Thread Walker Carlson
Ah. That makes sense. Thank you for fixing that. One minor question. If the default is enabled is there any case where a user would turn logging off then back on again? I can see having the enableLoging for completeness so it's not that important probably. Anyways other than that it looks good!

[jira] [Resolved] (KAFKA-10702) Slow replication of empty transactions

2020-11-30 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10702. - Fix Version/s: 2.8.0 Resolution: Fixed > Slow replication of empty transactions >

Re: Contributor permissions request

2020-11-30 Thread Matthias J. Sax
Hi, maybe Bill forgot to hit the "save" button? Added you. Let us know if there are still issues. -Matthias On 11/30/20 3:34 AM, Bruno Cadonna wrote: > Hi Omnia, > > I forwarded you Bill's reply. > > Unfortunately, I do not have permissions to check your permissions. > Somebody with committer

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

2020-11-30 Thread Matthias J. Sax
Thanks for the KIP Leah. Should `withLoggingEnabled()` take a `Map config` similar to the one from `Materialized`? -Matthias On 11/30/20 12:22 PM, Walker Carlson wrote: > Ah. That makes sense. Thank you for fixing that. > > One minor question. If the default is enabled is there any case where

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #64

2020-11-30 Thread Apache Jenkins Server
See Changes: [Bill Bejeck] MINOR: fix listeners doc to close properly (#9655) [Bill Bejeck] MINOR: Remove erroneous extra in design doc (#9657) -- [...truncat

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

2020-11-30 Thread Colin McCabe
On Fri, Oct 23, 2020, at 16:10, Jun Rao wrote: > Hi, Colin, > > Thanks for the reply. A few more comments. Hi Jun, Thanks again for the reply. Sorry for the long hiatus. I was on vacation for a while. > > 55. There is still text that favors new broker registration. "When a broker > first st

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #269

2020-11-30 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-10779) Reassignment tool sets throttles incorrectly when overriding a reassignment

2020-11-30 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10779: --- Summary: Reassignment tool sets throttles incorrectly when overriding a reassignment Key: KAFKA-10779 URL: https://issues.apache.org/jira/browse/KAFKA-10779 Pro

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #247

2020-11-30 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-10780) Rewrite ControllerZNode struct with auto-generated protocol

2020-11-30 Thread dengziming (Jira)
dengziming created KAFKA-10780: -- Summary: Rewrite ControllerZNode struct with auto-generated protocol Key: KAFKA-10780 URL: https://issues.apache.org/jira/browse/KAFKA-10780 Project: Kafka Iss

[jira] [Created] (KAFKA-10781) Rewrite BrokerIdZNode struct with auto-generated protocol

2020-11-30 Thread dengziming (Jira)
dengziming created KAFKA-10781: -- Summary: Rewrite BrokerIdZNode struct with auto-generated protocol Key: KAFKA-10781 URL: https://issues.apache.org/jira/browse/KAFKA-10781 Project: Kafka Issue

[jira] [Created] (KAFKA-10782) Rewrite TopicZNode struct with auto-generated protocol

2020-11-30 Thread dengziming (Jira)
dengziming created KAFKA-10782: -- Summary: Rewrite TopicZNode struct with auto-generated protocol Key: KAFKA-10782 URL: https://issues.apache.org/jira/browse/KAFKA-10782 Project: Kafka Issue Type

[jira] [Created] (KAFKA-10783) Rewrite TopicPartitionStateZNode struct with auto-generated protocol

2020-11-30 Thread dengziming (Jira)
dengziming created KAFKA-10783: -- Summary: Rewrite TopicPartitionStateZNode struct with auto-generated protocol Key: KAFKA-10783 URL: https://issues.apache.org/jira/browse/KAFKA-10783 Project: Kafka

[jira] [Created] (KAFKA-10784) Rewrite ConfigEntityZNode struct with auto-generated protocol

2020-11-30 Thread dengziming (Jira)
dengziming created KAFKA-10784: -- Summary: Rewrite ConfigEntityZNode struct with auto-generated protocol Key: KAFKA-10784 URL: https://issues.apache.org/jira/browse/KAFKA-10784 Project: Kafka Is

[jira] [Created] (KAFKA-10785) Rewrite ConfigEntityChangeNotificationSequenceZNode struct with auto-generated protocol

2020-11-30 Thread dengziming (Jira)
dengziming created KAFKA-10785: -- Summary: Rewrite ConfigEntityChangeNotificationSequenceZNode struct with auto-generated protocol Key: KAFKA-10785 URL: https://issues.apache.org/jira/browse/KAFKA-10785 P

Re: [DISCUSSION] KIP-686: API to ensure Records policy on the broker

2020-11-30 Thread Paul Whalen
Nikolay, I'm not a committer, but perhaps I can start the discussion. I've had the urge for a similar feature after being bitten by writing a poorly formed record to a topic - it's natural to want to push schema validation into the broker, since that's the way regular databases work. But I'm a b

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #270

2020-11-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10702; Skip bookkeeping of empty transactions (#9632) [github] KAFKA-10722: Described the types of the used state stores (#9607) ---

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #248

2020-11-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10702; Skip bookkeeping of empty transactions (#9632) [github] KAFKA-10722: Described the types of the used state stores (#9607)

[jira] [Created] (KAFKA-10786) ReplicaAlterLogDirsThread gets stuck during the reassignment of Kafka partition

2020-11-30 Thread nick song (Jira)
nick song created KAFKA-10786: - Summary: ReplicaAlterLogDirsThread gets stuck during the reassignment of Kafka partition Key: KAFKA-10786 URL: https://issues.apache.org/jira/browse/KAFKA-10786 Project: K

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #294

2020-11-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10702; Skip bookkeeping of empty transactions (#9632) [github] KAFKA-10722: Described the types of the used state stores (#9607) ---

[jira] [Created] (KAFKA-10787) Introduce an import order in Java sources

2020-11-30 Thread Dongjin Lee (Jira)
Dongjin Lee created KAFKA-10787: --- Summary: Introduce an import order in Java sources Key: KAFKA-10787 URL: https://issues.apache.org/jira/browse/KAFKA-10787 Project: Kafka Issue Type: Improveme

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #271

2020-11-30 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10770: Remove duplicate defination of Metrics#getTags (#9659) -- [...truncated 3.48 MB...] org.apache.kafka.streams.test.MockProc