[jira] [Resolved] (KAFKA-6132) KafkaProducer.initTransactions dead locks

[ https://issues.apache.org/jira/browse/KAFKA-6132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski resolved KAFKA-6132. --- Resolution: Duplicate Fix Version/s: 1.0.0 This is probably a duplicate of KAFKA-6042.

[GitHub] kafka pull request #4137: KAFKA-6119: Bump epoch when expiring transactions ...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4137 ---

Jenkins build is back to normal : kafka-1.0-jdk7 #60

See

Fwd: Re: [DISCUSS] KIP-213 Support non-key joining in KTable

Sorry, so used to the users mailing list... Thanks for the remarks. hope I didn't miss any. Not even sure if it makes sense to introduce A and B or just stick with "this ktable", "other ktable" Thank you Jan On 27.10.2017 06:58, Ted Yu wrote: Do you mind addressing my previous comments ? h

[jira] [Resolved] (KAFKA-6134) High memory usage on controller during partition reassignment

[ https://issues.apache.org/jira/browse/KAFKA-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6134. Resolution: Fixed > High memory usage on controller during partition reassignment >

[GitHub] kafka pull request #4141: KAFKA-6134: Read partition reassignment lazily on ...

Github user hachikuji closed the pull request at: https://github.com/apache/kafka/pull/4141 ---

Re: [DISCUSS] KIP-213 Support non-key joining in KTable

Do you mind addressing my previous comments ? http://search-hadoop.com/m/Kafka/uyzND1hzF8SRzUqb?subj=Re+DISCUSS+KIP+213+Support+non+key+joining+in+KTable On Thu, Oct 26, 2017 at 9:38 PM, Jan Filipiak wrote: > Hello everyone, > > this is the new discussion thread after the ID-clash. > > Best > J

[DISCUSS] KIP-213 Support non-key joining in KTable

Hello everyone, this is the new discussion thread after the ID-clash. Best Jan __ Hello Kafka-users, I want to continue with the development of KAFKA-3705, which allows the Streams DSL to perform KTableKTable-Joins when the KTables have a one-to-many relationship. To make sure we cover

Jenkins build is back to normal : kafka-trunk-jdk8 #2171

See

Jenkins build is back to normal : kafka-trunk-jdk9 #154

See

Jenkins build is back to normal : kafka-0.11.0-jdk7 #328

See

Jenkins build is back to normal : kafka-trunk-jdk7 #2926

See

Re: [DISCUSS] KIP-215: Add topic regex support for Connect sinks

It's fine to be more detailed, but ConfigException is already implied for all other config issues as well. Default could be either null or just empty string. re: alternatives, if you wanted to be slightly more detailed (though still a bit vague) re: supported syntax, you could just say that while

Build failed in Jenkins: kafka-1.0-jdk7 #59

See Changes: [ismael] KAFKA-6131; Use atomic putIfAbsent to create txn marker queues -- [...truncated 370.96 KB...] kafka.server.ServerGenerateBrokerIdTest > testUserConfigAn

Re: [DISCUSS] KIP-215: Add topic regex support for Connect sinks

bq. Users may specify only one of 'topics' or 'topics.pattern'. Can you fill in which exception would be thrown if both of them are specified ? Cheers On Thu, Oct 26, 2017 at 6:27 PM, Jeff Klukas wrote: > Looking for feedback on > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 215%

Re: Failed to start Apache Kafka

Hmm. You ran into KAFKA-5077. Can you try 1.0.0 RC3 ? http://search-hadoop.com/m/Kafka/uyzND18Q3Vh1Q5jUV1?subj=+VOTE+1+0+0+RC3 On Thu, Oct 26, 2017 at 10:08 AM, Naren gs wrote: > Hello, > I am starter in Apache Kafka, I downloaded the latest version and on > running the config of zookeeper

Failed to start Apache Kafka

Hello, I am starter in Apache Kafka, I downloaded the latest version and on running the config of zookeeper I get an error as below: [0.001s][warning][gc] -Xloggc is deprecated. Will use -Xlog:gc:/Users/user-mac/Documents/js/kafka_2.11-0.11.0.1/bin/../logs/zookeeper-gc.log instead. Unrecognize

[GitHub] kafka pull request #4142: MINOR: Use Scala Future in CoreUtils test

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4142 MINOR: Use Scala Future in CoreUtils test Also rename UtilsTest to CoreUtilsTest and note that `getOrElseUpdate` has the right behaviour in Scala 2.12. You can merge this pull request into a G

[DISCUSS] KIP-215: Add topic regex support for Connect sinks

Looking for feedback on https://cwiki.apache.org/confluence/display/KAFKA/KIP-215%3A+Add+topic+regex+support+for+Connect+sinks

[GitHub] kafka pull request #4141: KAFKA-6134: Read partition reassignment lazily on ...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/4141 KAFKA-6134: Read partition reassignment lazily on event handling This patch prevents an O(n^2) increase in memory utilization during partition reassignment. Instead of storing the reassigned parti

[jira] [Resolved] (KAFKA-6131) Transaction markers are sometimes discarded if txns complete concurrently

[ https://issues.apache.org/jira/browse/KAFKA-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6131. Resolution: Fixed Fix Version/s: 1.1.0 0.11.0.2 1.0.0 >

[GitHub] kafka pull request #4140: KAFKA-6131: Use atomic putIfAbsent to create txn m...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4140 ---

[jira] [Created] (KAFKA-6135) TransactionsTest#testFencingOnCommit may fail due to unexpected KafkaException

Ted Yu created KAFKA-6135: - Summary: TransactionsTest#testFencingOnCommit may fail due to unexpected KafkaException Key: KAFKA-6135 URL: https://issues.apache.org/jira/browse/KAFKA-6135 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #2170

See Changes: [wangguoz] MINOR: Improve a Windows quickstart instruction -- [...truncated 3.31 MB...] kafka.security.auth.ResourceTypeTest > testJavaConversions STARTED k

Build failed in Jenkins: kafka-trunk-jdk7 #2925

See Changes: [wangguoz] MINOR: Improve a Windows quickstart instruction -- [...truncated 1.83 MB...] java.lang.NullPointerException at hudson.plugins.toolenv.Tool

Jenkins build is back to normal : kafka-trunk-jdk8 #2169

See

[jira] [Created] (KAFKA-6134) High memory usage on controller during partition reassignment

Jason Gustafson created KAFKA-6134: -- Summary: High memory usage on controller during partition reassignment Key: KAFKA-6134 URL: https://issues.apache.org/jira/browse/KAFKA-6134 Project: Kafka

Jenkins build is back to normal : kafka-1.0-jdk7 #58

See

Build failed in Jenkins: kafka-trunk-jdk7 #2924

See Changes: [wangguoz] KAFKA-6100: Down-grade RocksDB to 5.7.3 -- [...truncated 1.83 MB...] org.apache.kafka.streams.kstream.internals.KTableAggregateTest > testAggRepa

Build failed in Jenkins: kafka-trunk-jdk9 #153

See Changes: [wangguoz] KAFKA-6100: Down-grade RocksDB to 5.7.3 [wangguoz] MINOR: Improve a Windows quickstart instruction -- [...truncated 1.41 MB...] kafka.log.Producer

Build failed in Jenkins: kafka-1.0-jdk7 #57

See Changes: [ismael] MINOR: Add missing semicolon to example jaas configuration -- [...truncated 1.82 MB...] org.apache.kafka.streams.integration.JoinIntegrationTest > test

[GitHub] kafka pull request #4083: MINOR: Improve a Windows quickstart instruction

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4083 ---

[GitHub] kafka-site pull request #104: Replace link

Github user manjuapu commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147262245 --- Diff: powered-by.html --- @@ -2,453 +2,452 @@

[GitHub] kafka-site pull request #104: Replace link

Github user manjuapu commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147262007 --- Diff: powered-by.html --- @@ -2,453 +2,452 @@

[GitHub] kafka-site pull request #104: Replace link

Github user guozhangwang commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147261460 --- Diff: powered-by.html --- @@ -2,453 +2,452 @@

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

Hi, Thanks for your suggestions. I have some comments, to make sure that there is no misunderstanding. 1. Maybe we can deprecate the `commit()` in ProcessorContext, to enforce > user to consolidate this call as > "processorContext.recordContext().commit()". And internal implementation > of > `P

Re: [VOTE] KIP-205: Add all() and range() API to ReadOnlyWindowStore

BTW, Xavier has an argument to rename "range" as it does not take a key or key range at all. I'd propose we rename this function to "fetchAll". Guozhang On Wed, Oct 25, 2017 at 7:27 AM, Damian Guy wrote: > +1 > > On Tue, 24 Oct 2017 at 16:46 Guozhang Wang wrote: > > > +1. Thanks. > > > > On Mo

Re: [DISCUSS] KIP-205: Add getAllKeys() API to ReadOnlyWindowStore

Hello Richard, Xavier: I think I am convinced my your arguments. How about keeping all() as is and rename "range" to "fetchAll" then? Guozhang On Thu, Oct 26, 2017 at 9:21 AM, Xavier Léauté wrote: > I don't feel this worth holding up the vote for, if no one else shares my > concerns. > On W

[GitHub] kafka pull request #4136: KAFKA-6100: Down-grade RocksDB to 5.7.3

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4136 ---

[jira] [Resolved] (KAFKA-6100) Streams quick start crashes Java on Windows

[ https://issues.apache.org/jira/browse/KAFKA-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6100. -- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 4136 [https://githu

[GitHub] kafka-site pull request #104: Replace link

Github user joel-hamill commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147256782 --- Diff: 0110/streams/index.html --- @@ -17,20 +17,20 @@

[GitHub] kafka-site pull request #104: Replace link

Github user joel-hamill commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147256754 --- Diff: 0110/streams/developer-guide.html --- @@ -19,7 +19,17 @@

[GitHub] kafka-site pull request #104: Replace link

Github user joel-hamill commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147256824 --- Diff: 0110/streams/quickstart.html --- @@ -18,11 +18,21 @@

[GitHub] kafka-site pull request #104: Replace link

Github user joel-hamill commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147256597 --- Diff: 0110/streams/core-concepts.html --- @@ -19,7 +19,17 @@

[GitHub] kafka-site pull request #104: Replace link

Github user joel-hamill commented on a diff in the pull request: https://github.com/apache/kafka-site/pull/104#discussion_r147256868 --- Diff: 0110/streams/tutorial.html --- @@ -18,7 +18,17 @@

[GitHub] kafka-site pull request #104: Replace link

GitHub user manjuapu opened a pull request: https://github.com/apache/kafka-site/pull/104 Replace link @guozhangwang Please review. You can merge this pull request into a Git repository by running: $ git pull https://github.com/manjuapu/kafka-site replace-link Alternatively yo

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

Hello all, I've updated the KIP based on this conversation, and made it so that its interface, config setting, and parameters line up more closely with the interface in KIP-161 (deserialization handler). I believe there are a few specific questions I need to reply to. > The question I had ab

[jira] [Created] (KAFKA-6133) NullPointerException in S3 Connector when using rotate.interval.ms

Elizabeth Bennett created KAFKA-6133: Summary: NullPointerException in S3 Connector when using rotate.interval.ms Key: KAFKA-6133 URL: https://issues.apache.org/jira/browse/KAFKA-6133 Project: Kaf

Build failed in Jenkins: kafka-trunk-jdk7 #2923

See Changes: [ismael] MINOR: Revert EmbeddedZooKeeper rename [ismael] MINOR: Add missing semicolon to example jaas configuration -- [...truncated 1.83 MB...] org.apache.k

[GitHub] kafka pull request #4140: KAFKA-6131: Use atomic putIfAbsent to create txn m...

GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/4140 KAFKA-6131: Use atomic putIfAbsent to create txn marker queues You can merge this pull request into a Git repository by running: $ git pull https://github.com/rajinisivaram/kafka KAFKA-

Build failed in Jenkins: kafka-trunk-jdk8 #2168

See Changes: [ismael] MINOR: Revert EmbeddedZooKeeper rename [ismael] MINOR: Add missing semicolon to example jaas configuration -- [...truncated 381.98 KB...] kafka.mes

[jira] [Created] (KAFKA-6132) KafkaProducer.initTransactions dead locks

Piotr Nowojski created KAFKA-6132: - Summary: KafkaProducer.initTransactions dead locks Key: KAFKA-6132 URL: https://issues.apache.org/jira/browse/KAFKA-6132 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-6131) Transaction markers are sometimes discarded if txns complete concurrently

Rajini Sivaram created KAFKA-6131: - Summary: Transaction markers are sometimes discarded if txns complete concurrently Key: KAFKA-6131 URL: https://issues.apache.org/jira/browse/KAFKA-6131 Project: Ka

Build failed in Jenkins: kafka-0.11.0-jdk7 #327

See Changes: [ismael] MINOR: Add missing semicolon to example jaas configuration -- [...truncated 976.88 KB...] kafka.utils.UtilsTest > testUrlSafeBase64EncodeUUID STARTE

Build failed in Jenkins: kafka-trunk-jdk9 #152

See Changes: [me] MINOR: reset state in cleanup, fixes jmx mixin flakiness [junrao] MINOR: Rename and change package of async ZooKeeper classes [ismael] MINOR: Revert EmbeddedZooKeeper rename [ismael] MINOR: Ad

Re: [DISCUSS] KIP-205: Add getAllKeys() API to ReadOnlyWindowStore

I don't feel this worth holding up the vote for, if no one else shares my concerns. On Wed, Oct 25, 2017 at 15:59 Richard Yu wrote: > Xavier: There has been two pluses on the voting thread. Are you fine with > the current formation? > > On Tue, Oct 24, 2017 at 4:26 PM, Richard Yu > wrote: > > >

[GitHub] kafka pull request #4139: MINOR: Indentation Fix

GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/4139 MINOR: Indentation Fix You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka minor/indentation_fix_1710 Alternatively yo

Permission to create a KIP

Hi Kafka Devs, I'd like permission to create a KIP. This is following up on a discussion from the #connect slack channel regarding overrides for producer/consumer configs on a per-connector level. My confluence id is: elizabeth.bennett Thanks, Liz

Re: [VOTE] KIP-207:The Offsets which ListOffsetsResponse returns should monotonically increase even during a partition leader change

Thanks for the KIP. +1 (non-binding) On Thu, Oct 26, 2017 at 5:58 AM, Jason Gustafson wrote: > +1. Thanks for the KIP. > > On Mon, Oct 23, 2017 at 11:30 AM, Colin McCabe wrote: > > > On Mon, Oct 23, 2017, at 10:29, Jason Gustafson wrote: > > > Thanks for the KIP. I'm assuming the new behavior

[GitHub] kafka pull request #4101: MINOR: Add missing semicolon to example jaas confi...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4101 ---

[GitHub] kafka pull request #4138: MINOR: Revert EmbeddedZooKeeper rename

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4138 ---

[jira] [Resolved] (KAFKA-6128) Shutdown script does not do a clean shutdown

[ https://issues.apache.org/jira/browse/KAFKA-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6128. Resolution: Not A Problem > Shutdown script does not do a clean shutdown > -

[jira] [Reopened] (KAFKA-6128) Shutdown script does not do a clean shutdown

[ https://issues.apache.org/jira/browse/KAFKA-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reopened KAFKA-6128: > Shutdown script does not do a clean shutdown > > >

Re: Use self contained tokens instead of ACL

Hi Peter, I am not entirely sure that I understand what you mean when you say "at application level" to be honest, but I do understand that you want to forego 3rd party tools. However, this would mean that you have to implement some form of trust between your portal which issues the tokens and Kaf

[jira] [Resolved] (KAFKA-6128) Shutdown script does not do a clean shutdown

[ https://issues.apache.org/jira/browse/KAFKA-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alastair Munro resolved KAFKA-6128. --- Resolution: Fixed Fix Version/s: 0.11.0.0 0.11.0.1 Broken zookeeper

[GitHub] kafka pull request #4138: MINOR: Revert EmbeddedZooKeeper rename

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4138 MINOR: Revert EmbeddedZooKeeper rename Even though this class is internal, it's widely used by other projects and it's better to avoid breaking them until we have a publicly supported test

[jira] [Created] (KAFKA-6130) VerifiableConsume with --max-messages

Tom Bentley created KAFKA-6130: -- Summary: VerifiableConsume with --max-messages Key: KAFKA-6130 URL: https://issues.apache.org/jira/browse/KAFKA-6130 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-6129) kafka issue when exposing through nodeport in kubernetes

Francesco vigotti created KAFKA-6129: Summary: kafka issue when exposing through nodeport in kubernetes Key: KAFKA-6129 URL: https://issues.apache.org/jira/browse/KAFKA-6129 Project: Kafka

Build failed in Jenkins: kafka-1.0-jdk7 #56

See Changes: [me] MINOR: reset state in cleanup, fixes jmx mixin flakiness -- [...truncated 1.82 MB...] org.apache.kafka.streams.TopologyTest > singleSourcePatternShouldHave

[jira] [Created] (KAFKA-6128) Shutdown script does not do a clean shutdown

Alastair Munro created KAFKA-6128: - Summary: Shutdown script does not do a clean shutdown Key: KAFKA-6128 URL: https://issues.apache.org/jira/browse/KAFKA-6128 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-214: Add zookeeper.max.in.flight.requests config to the broker

Can you fill out JIRA number ? Thanks Original message From: Onur Karaman Date: 10/25/17 10:37 PM (GMT-08:00) To: dev@kafka.apache.org Subject: [DISCUSS] KIP-214: Add zookeeper.max.in.flight.requests config to the broker Hey everyone. Giving this another shot since it looks