Re: Permission request to create a KIP

2017-05-04 Thread UMESH CHAUDHARY
Thank you Ewen! Now, I can create child page under "Apache Kafka". Regards, Umesh On Fri, 5 May 2017 at 10:52 Ewen Cheslack-Postava wrote: > Umesh, > > I've given you permissions on the wiki. Let me know if you run into any > issues. > > -Ewen > > On Thu, May 4, 2017 at 12:04 AM, UMESH CHAUDHAR

Re: Permission request to create a KIP

2017-05-04 Thread Ewen Cheslack-Postava
Umesh, I've given you permissions on the wiki. Let me know if you run into any issues. -Ewen On Thu, May 4, 2017 at 12:04 AM, UMESH CHAUDHARY wrote: > Hello Mates, > I need to start a KIP for KAFKA-5057 > under this wiki page >

[jira] [Commented] (KAFKA-5161) reassign-partitions to check if broker of ID exists in cluster

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997808#comment-15997808 ] ASF GitHub Bot commented on KAFKA-5161: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2962: KAFKA-5161: add code in reassign-partitions to che...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2962 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5161) reassign-partitions to check if broker of ID exists in cluster

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5161. -- Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2962 [https://gi

Build failed in Jenkins: kafka-trunk-jdk8 #1484

2017-05-04 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Temporarily disable a few flaky tests -- [...truncated 843.92 KB...] kafka.integration.SaslPlaintextTopicMetadataTest > testAliveBrokerListWi

Build failed in Jenkins: kafka-trunk-jdk7 #2150

2017-05-04 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Temporarily disable a few flaky tests -- [...truncated 844.95 KB...] kafka.integration.SaslPlaintextTopicMetadataTest > testAliveBrokerListWi

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997793#comment-15997793 ] Matthias J. Sax commented on KAFKA-5166: No problem. (1) Internal topics: we need

Re: [VOTE] KIP-143: Controller Health Metrics

2017-05-04 Thread Michael André Pearce
+1 , really good to see better operational visibility being added to the broker. Sent from my iPhone > On 5 May 2017, at 03:34, Ismael Juma wrote: > > Hi everyone, > > It seems like the discussion has converged, so I would like to initiate the > voting process for KIP-143: Controller Health Me

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-05-04 Thread Michael André Pearce
My vote would be with 2, then 3 then 1. Could I suggest maybe an option 4. that is option 2 but with a note that there is an intent in 1/2 years time to deprecate the old way (under another kip). This way books materials can be updated over a period, code won't be making compile warnings today.

[jira] [Commented] (KAFKA-5137) Controlled shutdown timeout message improvement

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997782#comment-15997782 ] ASF GitHub Bot commented on KAFKA-5137: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-5137) Controlled shutdown timeout message improvement

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5137. Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2932 [https://github

[GitHub] kafka pull request #2932: KAFKA-5137 : Controlled shutdown timeout message i...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2932 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

2017-05-04 Thread Michael Pearce
+1 From: Joel Koshy Sent: Friday, May 5, 2017 4:32:42 AM To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches. +1 On Thu, May 4, 2017 at 7:00 PM Becket Qin wrote: > Bump. > > On Tue, Apr 25,

[jira] [Commented] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997779#comment-15997779 ] ASF GitHub Bot commented on KAFKA-5162: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5162. Resolution: Fixed Issue resolved by pull request 2958 [https://github.com/apache/kafka/pull/2958] >

[GitHub] kafka pull request #2958: KAFKA-5162: Add a reference to AdminClient to docs...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2958 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4996) Fix findbugs multithreaded correctness warnings for streams

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997772#comment-15997772 ] ASF GitHub Bot commented on KAFKA-4996: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2966: KAFKA-4996: Fix findbugs multithreaded correctness...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2966 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #2978: MINOR: Temporarily disable a few flaky tests

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2978 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-118: Drop Support for Java 7 in Kafka 0.11

2017-05-04 Thread Ismael Juma
Hearing no objections, I have updated the release plan. Ismael On Tue, May 2, 2017 at 10:07 PM, Ismael Juma wrote: > Hi all, > > As I looked deeper into the details of the impact of this change, it > became apparent to me that it may better to postpone it to a future > release. Reasons follow:

Re: [DISCUSS] KIP-144: Exponential backoff for broker reconnect attempts

2017-05-04 Thread Ismael Juma
Thanks for the feedback Gwen and Colin. I agree that the original formula was not intuitive. I updated it to include a max jitter as was suggested. I also updated the config name to include `ms`: https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=69408222&selectedPageVersio

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

2017-05-04 Thread Joel Koshy
+1 On Thu, May 4, 2017 at 7:00 PM Becket Qin wrote: > Bump. > > On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck wrote: > > > +1 > > > > On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin wrote: > > > > > +1 (non-binding) > > > > > > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin > > wrote: > > > > > > > Hi

0.11.0.0 Release Update

2017-05-04 Thread Ismael Juma
Hi all, We're quickly approaching our next time-based release. If you missed any of the updates on the new time-based releases we'll be following, see https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan for an explanation. The release plan can be found in the usual location:

[jira] [Updated] (KAFKA-4763) Handle disk failure for JBOD (KIP-112)

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4763: --- Status: Patch Available (was: Open) > Handle disk failure for JBOD (KIP-112) > --

[VOTE] KIP-143: Controller Health Metrics

2017-05-04 Thread Ismael Juma
Hi everyone, It seems like the discussion has converged, so I would like to initiate the voting process for KIP-143: Controller Health Metrics: https://cwiki.apache.org/confluence/display/KAFKA/KIP-143 %3A+Controller+Health+Metrics The vote will run for a minimum of 72 hours. Thanks, Ismael

[DISCUSS] KIP-133: List and Alter Configs Admin APIs

2017-05-04 Thread Ismael Juma
Hi all, We've posted "KIP-133: List and Alter Configs Admin APIs" for discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-133%3A+List+and+Alter+Configs+Admin+APIs This completes the first batch of AdminClient APIs so that topic, config and ACL management is supported. Please take

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

2017-05-04 Thread Becket Qin
Bump. On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck wrote: > +1 > > On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin wrote: > > > +1 (non-binding) > > > > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin > wrote: > > > > > Hi, > > > > > > I would like to start the voting on KIP-126. The KIP is intended to

[jira] [Commented] (KAFKA-5177) Default quick start config prompts warnings into console

2017-05-04 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997692#comment-15997692 ] huxi commented on KAFKA-5177: - Did you create topic `test` before issuing kafka--console-produ

Re: [DISCUSS] KIP 145 - Expose Record Headers in Kafka Connect

2017-05-04 Thread Michael Pearce
Hi Ewen, Did you get a chance to look at the updated sample showing the idea? Did it help? Cheers Mike Sent using OWA for iPhone From: Michael Pearce Sent: Wednesday, May 3, 2017 10:11:55 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP 145 - Expo

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997675#comment-15997675 ] Bharat Viswanadham commented on KAFKA-5166: --- And also one more question, we are

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997674#comment-15997674 ] Bharat Viswanadham commented on KAFKA-5166: --- Hi Matthias, Thanks for clear info.

[jira] [Work started] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5166 started by Bharat Viswanadham. - > Add option "dry run" to Streams application reset tool >

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
GitHub user smferguson reopened a pull request: https://github.com/apache/kafka/pull/2969 doc typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/smferguson/kafka doc_typo Alternatively you can review and apply these changes as

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
Github user smferguson closed the pull request at: https://github.com/apache/kafka/pull/2969 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997655#comment-15997655 ] Matthias J. Sax commented on KAFKA-5154: With regard to the exception you mentione

[jira] [Commented] (KAFKA-5112) Trunk compatibility tests should test against 0.10.2

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997649#comment-15997649 ] ASF GitHub Bot commented on KAFKA-5112: --- Github user cmccabe closed the pull request

[GitHub] kafka pull request #2893: KAFKA-5112: Trunk compatibility tests should test ...

2017-05-04 Thread cmccabe
Github user cmccabe closed the pull request at: https://github.com/apache/kafka/pull/2893 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] kafka pull request #2978: MINOR: Temporarily disable a few flaky tests

2017-05-04 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2978 MINOR: Temporarily disable a few flaky tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka disable-some-flaky-tests Alternatively y

Re: [DISCUSS] KIP 151 - Expose Connector type in REST API

2017-05-04 Thread Gwen Shapira
YES PLEASE! On Tue, May 2, 2017 at 1:48 PM, dan wrote: > hello. > > in an attempt to make the connect rest endpoints more useful i'd like to > add the Connector type (Sink/Source) in our rest endpoints to make them > more self descriptive. > > KIP here: > https://cwiki.apache.org/confluence/disp

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
That's a good point. It's worth mentioning that there is a KIP in progress, KIP-133: List and Alter Configs Admin APIs, that should help with those. In the long term, it would be nice if we could deprecate 'allow.everyone.if.no.acl.found', along with topic auto-creation. It should be possible to

[jira] [Created] (KAFKA-5177) Default quick start config prompts warnings into console

2017-05-04 Thread Pranas Baliuka (JIRA)
Pranas Baliuka created KAFKA-5177: - Summary: Default quick start config prompts warnings into console Key: KAFKA-5177 URL: https://issues.apache.org/jira/browse/KAFKA-5177 Project: Kafka Issu

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997568#comment-15997568 ] Matthias J. Sax commented on KAFKA-5166: All tools and their parameters _are_ publ

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997561#comment-15997561 ] Ismael Juma commented on KAFKA-5173: Another somewhat recent change was https://githu

[jira] [Work started] (KAFKA-5170) KafkaAdminClientIntegration test should wait until metadata is propagated to all brokers

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5170 started by Colin P. McCabe. -- > KafkaAdminClientIntegration test should wait until metadata is propagated t

[jira] [Work started] (KAFKA-5159) Update Kafka documentation to mention AdminClient

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5159 started by Colin P. McCabe. -- > Update Kafka documentation to mention AdminClient > ---

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997529#comment-15997529 ] Ismael Juma commented on KAFKA-5173: Another one that is slightly different, but looks

[jira] [Assigned] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe reassigned KAFKA-5176: -- Assignee: Colin P. McCabe > AdminClient: add controller and clusterId methods to Descri

[jira] [Commented] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997528#comment-15997528 ] ASF GitHub Bot commented on KAFKA-5176: --- GitHub user cmccabe opened a pull request:

[GitHub] kafka pull request #2977: KAFKA-5176: AdminClient: add controller and cluste...

2017-05-04 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/2977 KAFKA-5176: AdminClient: add controller and clusterId methods to Desc… …ribeClusterResults You can merge this pull request into a Git repository by running: $ git pull https://github.com/cm

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I sure can. I have added the following description to my KIP. If this doesn't help let me know and I will take some more time to build a diagram and make more of a step by step description: Example with Current API: KTable table1 = builder.stream("topic1").groupByKey().aggregate(initializer1, agg

[jira] [Created] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-5176: -- Summary: AdminClient: add controller and clusterId methods to DescribeClusterResults Key: KAFKA-5176 URL: https://issues.apache.org/jira/browse/KAFKA-5176 Project

Build failed in Jenkins: kafka-trunk-jdk8 #1483

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5104: DumpLogSegments should not open index files with `rw` -- [...truncated 1.49 MB...] kafka.server.epoch.LeaderEpochFileCacheTest > shou

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-04 Thread Gwen Shapira
Hi, What about Transformations? Are they going to be isolated too? If they are, what do we do with the built-in ones? On Sat, Apr 29, 2017 at 9:16 AM, Konstantine Karantasis < konstant...@confluent.io> wrote: > * Because of KIP number collision, please disregard my previous KIP > announcement an

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-04 Thread Gwen Shapira
On Wed, May 3, 2017 at 11:17 AM, Konstantine Karantasis < konstant...@confluent.io> wrote: > Thanks Ewen. I'm replying inline as well. > > On Tue, May 2, 2017 at 11:24 AM, Ewen Cheslack-Postava > wrote: > > > Thanks for the KIP. > > > > A few responses inline, followed by additional comments. > >

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread dan
what about the configs for: `allow.everyone.if.no.acl.found` and ` super.users`? i understand they are an implementation detail of `SimpleAclAuthorizer` configs, but without these its difficult to make sense of what permissions a `ListAclsResponse` actually represents. maybe something for another

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997510#comment-15997510 ] Jun Rao commented on KAFKA-4764: [~rsivaram], thanks for the explanation. I looked at KIP-

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-04 Thread Matthias J. Sax
One follow up. There was this email on the user list: http://search-hadoop.com/m/Kafka/uyzND17KhCaBzPSZ1?subj=Shouldn+t+the+initializer+of+a+stream+aggregate+accept+the+key+ It might make sense so include Initializer, Adder, and Substractor inferface, too. And we should double check if there are

[jira] [Assigned] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman reassigned KAFKA-5175: --- Assignee: Onur Karaman > Transient failure: > ControllerIntegrationTest.testPreferredReplica

[jira] [Created] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5175: -- Summary: Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection Key: KAFKA-5175 URL: https://issues.apache.org/jira/browse/KAFKA-5175 Project: Ka

[jira] [Commented] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997497#comment-15997497 ] Ismael Juma commented on KAFKA-5175: [~onurkaraman], can you please take a look? > Tr

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
On Thu, May 4, 2017, at 13:46, Magnus Edenhill wrote: > Hey Colin, > > good KIP! > > Some comments: > > 1a. For operation, permission_type and resource_type: is there any reason > for having the any and unknown enums as negative values? > Since neither of these fields has an integer significance

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997464#comment-15997464 ] Bharat Viswanadham commented on KAFKA-5166: --- Hi Matthias, I have not written KIP

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Ismael Juma
Hi Rajini, I think we were talking about slightly different things. I was just referring to the fact that there are cases where we throw an AuthorizationException back to the user without retrying from various methods (poll, commitSync, etc). As you said, my initial preference was for not retryin

Build failed in Jenkins: kafka-trunk-jdk7 #2149

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5118: Improve message for Kafka failed startup with non-Kafka data [wangguoz] KAFKA-5104: DumpLogSegments should not open index files with `rw` ---

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997427#comment-15997427 ] Matthias J. Sax commented on KAFKA-5166: Thanks for picking this up [~bharatviswa]

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997426#comment-15997426 ] Bharat Viswanadham commented on KAFKA-5166: --- Hi Matthias, I will look into this,

[jira] [Assigned] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned KAFKA-5166: - Assignee: Bharat Viswanadham > Add option "dry run" to Streams application reset

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997421#comment-15997421 ] Rajini Sivaram commented on KAFKA-4764: --- [~junrao] Yes, Zookeeper does the same as K

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Magnus Edenhill
Hi Rajini, great KIP! This solution was proposed on the original KIP-43 thread but voted down, so let's hope it does better this time :) /Magnus 2017-05-04 13:37 GMT+02:00 Rajini Sivaram : > Hi all, > > I have created a KIP to improve diagnostics for SASL authentication > failures and reduce re

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Matthias J. Sax
I had a quick look into this. With regard to backward compatibility, I think it would be required do introduce a new type `TypesStateStoreSupplier` (that extends `StateStoreSupplier`) and to overload all methods that take a `StateStoreSupplier` that accept the new type instead of the current one.

Re: [VOTE] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
Hi Guozhang, Thanks for taking a look. On Thu, May 4, 2017, at 00:43, Guozhang Wang wrote: > Colin, > > Thanks for the KIP. A general question I have is whether we can support > "wildcard" resource names as well? For example, if we want to create / > delete ACLs for all topic names following a w

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Magnus Edenhill
Hey Colin, good KIP! Some comments: 1a. For operation, permission_type and resource_type: is there any reason for having the any and unknown enums as negative values? Since neither of these fields has an integer significance (unlike for example offsets which use negative offsets for logical offs

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Matthias J. Sax
Kyle, thanks a lot for the KIP. Maybe I am a little slow, but I could not follow completely. Could you maybe add a more concrete example, like 3 streams with 3 records each (plus expected result), and show the difference between current way to to implement it and the proposed API? This could also

Build failed in Jenkins: kafka-trunk-jdk8 #1482

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5118: Improve message for Kafka failed startup with non-Kafka data -- [...truncated 844.67 KB...] kafka.utils.CommandLineUtilsTest > testPar

Re: Contributing to Kafka

2017-05-04 Thread Matthias J. Sax
Hi Rajan, thanks for your plan to contribute back! First, I would recommend to check out the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes Also check out the JIRA boards: https://issues.apache.org/jira/browse/KAFKA-1 You can just filter for components you are

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-04 Thread Matthias J. Sax
Thanks for updating the KIP. Deep copying the key will work for sure, but I am actually a little bit worried about performance impact... We might want to do some test to quantify this impact. Btw: this remind me about the idea of `RichFunction` interface that would allow users to access record m

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-05-04 Thread Matthias J. Sax
We can go either way. I just pointed out, what I would prefer -- it's also quite subjective. The least invasive change would be to add new constructors and update the JavaDocs to point out the semantics of `partition` parameter. However, I still like the builder pattern: ProducerRecord has 6 para

Build failed in Jenkins: kafka-trunk-jdk7 #2148

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4925: delay initial rebalance of consumer group -- [...truncated 844.64 KB...] kafka.tools.ConsoleConsumerTest > shouldLimitReadsToMaxMessage

[GitHub] kafka pull request #2976: KAFKA-5170. KafkaAdminClientIntegration test shoul...

2017-05-04 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/2976 KAFKA-5170. KafkaAdminClientIntegration test should wait until metada… …ta is propagated to all brokers You can merge this pull request into a Git repository by running: $ git pull https://

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-05-04 Thread Matthias J. Sax
Hi, thanks for updating the KIP. Looks good to me overall. I think adding `Cancellable` (or should it be `Cancelable` to follow American English?) is a clean solution, in contrast to the proposed alternative. One minor comment: can you add `ValueTransformer#punctuate()` to the list of deprecated

[jira] [Commented] (KAFKA-5170) KafkaAdminClientIntegration test should wait until metadata is propagated to all brokers

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997329#comment-15997329 ] ASF GitHub Bot commented on KAFKA-5170: --- GitHub user cmccabe opened a pull request:

[GitHub] kafka pull request #2905: kafka-5104: DumpLogSegments should not open index ...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2905 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5104) DumpLogSegments should not open index files with `rw`

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5104. -- Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2905 [https://gi

Build failed in Jenkins: kafka-trunk-jdk8 #1481

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4925: delay initial rebalance of consumer group -- [...truncated 844.34 KB...] kafka.integration.SaslPlaintextTopicMetadataTest > testAlive

[jira] [Assigned] (KAFKA-5174) RocksDb might stall in environments with 1 core only

2017-05-04 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-5174: --- Assignee: Eno Thereska > RocksDb might stall in environments with 1 core only > -

[jira] [Created] (KAFKA-5174) RocksDb might stall in environments with 1 core only

2017-05-04 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5174: --- Summary: RocksDb might stall in environments with 1 core only Key: KAFKA-5174 URL: https://issues.apache.org/jira/browse/KAFKA-5174 Project: Kafka Issue Type:

[jira] [Resolved] (KAFKA-5118) Improve message for Kafka failed startup with non-Kafka data in data.dirs

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5118. -- Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2907 [https://gi

[GitHub] kafka pull request #2907: kafka-5118: Improve message for Kafka failed start...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2907 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I have made a pull request. It can be found here. https://github.com/apache/kafka/pull/2975 I plan to write some more unit tests for my classes and get around to writing documentation for the public api additions. One thing I was curious about is during the KCogroupedStreamImpl#aggregate method

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Matthias J. Sax
Did not have time to have a look. But backward compatibility is a must from my point of view. -Matthias On 5/4/17 12:56 AM, Michal Borowiecki wrote: > Hello, > > I've updated the KIP with missing information. > > I would especially appreciate some comments on the compatibility aspects > of thi

[jira] [Commented] (KAFKA-4925) Add a configurable delay to the initial consumer group rebalance

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997160#comment-15997160 ] ASF GitHub Bot commented on KAFKA-4925: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #2758: KAFKA-4925: delay initial rebalance of consumer gr...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4925) Add a configurable delay to the initial consumer group rebalance

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4925: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[jira] [Updated] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5154: Attachment: clio.txt.gz > Kafka Streams throws NPE during rebalance > --

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997141#comment-15997141 ] Lukas Gemela commented on KAFKA-5154: - I just found the exception from my previous com

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Balint Molnar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997134#comment-15997134 ] Balint Molnar commented on KAFKA-5173: -- I reran this test 50 times in my computer no

[GitHub] kafka pull request #2975: KIP-150 [WIP]: Kafka Streams Cogroup

2017-05-04 Thread KyleWinkelman
GitHub user KyleWinkelman opened a pull request: https://github.com/apache/kafka/pull/2975 KIP-150 [WIP]: Kafka Streams Cogroup Work in progress PR for KIP-150. You can merge this pull request into a Git repository by running: $ git pull https://github.com/KyleWinkelman/kafka c

[GitHub] kafka pull request #2633: MINOR: Add simplified aggregate methods to KGroupe...

2017-05-04 Thread KyleWinkelman
Github user KyleWinkelman closed the pull request at: https://github.com/apache/kafka/pull/2633 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Eno Thereska
I’ll look as well asap, sorry, been swamped. Eno > On May 4, 2017, at 6:17 PM, Damian Guy wrote: > > Hi Kyle, > > Thanks for the KIP. I apologize that i haven't had the chance to look at > the KIP yet, but will schedule some time to look into it tomorrow. For the > implementation, can you raise

  1   2   >