Permission request to create a KIP

2017-05-04 Thread UMESH CHAUDHARY
Hello Mates, I need to start a KIP for KAFKA-5057 under this wiki page but looks like I don't have sufficient permissions to create a child page under "Apache Kafka" sp

Re: Request to add to the contributor list

2017-05-04 Thread Amit Daga
Thank you Guozhang. On Thu, May 4, 2017 at 2:00 AM, Guozhang Wang wrote: > Hi Amit, > > I have added you to the contributor list and assigned 4996 to you. Cheers. > > Will also review your PR soon. > > > Guozhang > > > On Tue, May 2, 2017 at 5:43 AM, Amit Daga wrote: > > > Hello, > > > > Wonder

[GitHub] kafka pull request #2783: HOTFIX: fix potentially hanging test shouldAddStat...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2783 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Guozhang Wang
Colin, Thanks for the KIP. A general question I have is whether we can support "wildcard" resource names as well? For example, if we want to create / delete ACLs for all topic names following a wildcard regex? I read though the principle wildcards description but I am not sure if it is designed fo

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Michal Borowiecki
Hello, I've updated the KIP with missing information. I would especially appreciate some comments on the compatibility aspects of this as the proposed change is not fully backwards-compatible. In the absence of comments I shall call for a vote in the next few days. Thanks, Michal On 30/04

Build failed in Jenkins: kafka-trunk-jdk7 #2147

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: fix potentially hanging test -- [...truncated 1.64 MB...] kafka.integration.SaslSslTopicMetadataTest > testAutoCreateTopicWithCollision ST

[jira] [Commented] (KAFKA-4801) Transient test failure (part 2): ConsumerBounceTest.testConsumptionWithBrokerFailures

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996438#comment-15996438 ] Ismael Juma commented on KAFKA-4801: [~original-brownbear], feel free to try to reprod

[jira] [Assigned] (KAFKA-4801) Transient test failure (part 2): ConsumerBounceTest.testConsumptionWithBrokerFailures

2017-05-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Armin Braun reassigned KAFKA-4801: -- Assignee: Armin Braun (was: Jason Gustafson) > Transient test failure (part 2): > ConsumerBou

[jira] [Commented] (KAFKA-4801) Transient test failure (part 2): ConsumerBounceTest.testConsumptionWithBrokerFailures

2017-05-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996442#comment-15996442 ] Armin Braun commented on KAFKA-4801: [~ijuma] will take a look very soon then (~2h :))

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I am replying to this in hopes it will draw some attention to my KIP as I haven't heard from anyone in a couple days. This is my first KIP and my first large contribution to the project so I'm sure I did something wrong. ;) On May 1, 2017 4:18 PM, "Kyle Winkelman" wrote: > Hello all, > > I have

Error: Executing consumer group command failed due to Request GROUP_COORDINATOR failed on brokers List(localhost:9092 (id: -1 rack: null))

2017-05-04 Thread Abhimanyu Nagrath
Hi, I am using single node Kafka cluster(version 0.10.2) and single node zookeeper (3.4.9). I am having approx 310 topics with Avg 100 partitions per topic. On Kafka broker when I am running the command to check consumer status in a group > ./kafka-consumer-groups.sh --bootstrap-server localhost:9

[DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram
Hi all, I have created a KIP to improve diagnostics for SASL authentication failures and reduce retries and blocking when authentication fails: https://cwiki.apache.org/confluence/display/KAFKA/KIP-152+-+Improve+diagnostics+for+SASL+authentication+failures Comments and suggestions are welcome.

[jira] [Commented] (KAFKA-5153) KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting

2017-05-04 Thread Arpan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996597#comment-15996597 ] Arpan commented on KAFKA-5153: -- Hi @huxi - I did not set anything specifically in server.prop

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Ismael Juma
Thanks Rajini. This is a good improvement. One question, the proposal states: Producer waitForMetadata and consumer ensureCoordinatorReady will be > updated to throw AuthenticationFailedException if connections to all > available brokers fail authentication. Can you elaborate on the reason why w

Re: [DISCUSS] KIP-143: Controller Health Metrics

2017-05-04 Thread Ismael Juma
Hi Onur, Comments inline. On Wed, May 3, 2017 at 6:54 PM, Onur Karaman wrote: > Regarding the ControllerState and the potential for overlap, I think it > depends on our definition of controller state. While KAFKA-5028 allows only > a single ControllerEvent to be processed at a time, it still al

Re: [DISCUSS] KIP-143: Controller Health Metrics

2017-05-04 Thread Ismael Juma
Hi Joel, Thanks for the feedback. Comments inline. On Wed, May 3, 2017 at 7:52 PM, Joel Koshy wrote: > Yes - that is roughly what I was thinking (although deletes are no longer > long running). Also, what is the "steady-state" controller state? Idle? > Yes. > What about a broker that is not

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
Github user smferguson closed the pull request at: https://github.com/apache/kafka/pull/2969 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
GitHub user smferguson reopened a pull request: https://github.com/apache/kafka/pull/2969 doc typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/smferguson/kafka doc_typo Alternatively you can review and apply these changes as

[jira] [Commented] (KAFKA-5004) poll() timeout not enforced when connecting to 0.10.0 broker

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996706#comment-15996706 ] Ismael Juma commented on KAFKA-5004: To be clear, this is only an issue if a client di

Build failed in Jenkins: kafka-trunk-jdk8 #1480

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: fix potentially hanging test -- [...truncated 704.58 KB...] kafka.server.epoch.LeaderEpochFileCacheTest > shouldNotOverwriteLogEndOffsetFo

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram
Hi Ismael, Thank you for reviewing the KIP. An authenticated client that is not authorized to access a topic is never told that the operation was not authorized. This is to prevent the client from finding out if the topic exists by sending an unauthorized request. So in this case, the client will

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Ismael Juma
H Rajini, Comments inline. On Thu, May 4, 2017 at 2:29 PM, Rajini Sivaram wrote: > Hi Ismael, > > Thank you for reviewing the KIP. > > An authenticated client that is not authorized to access a topic is never > told that the operation was not authorized. This is to prevent the client > from fin

[jira] [Updated] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5173: --- Fix Version/s: 0.11.0.0 > SASL tests failing with Could not find a 'KafkaServer' or > 'sasl_plaintext

[jira] [Created] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5173: -- Summary: SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration Key: KAFKA-5173 URL: https://issues.apache.org/jira/bro

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram
Hi Ismael, I thought the blocking waits in the producer and consumer are always related to retrying for metadata. So an authorization exception that impacts this wait can only be due to Describe authorization failure - that always retries? I agree that connecting to different brokers when authent

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996879#comment-15996879 ] Ismael Juma commented on KAFKA-5173: It seems like this started recently, could it be

Contributing to Kafka

2017-05-04 Thread Rajan Gupta
Hello I have being leading teams using Kafka for processing high volume audit and user behavior data and would like to give back to the Kafka community in anyway that Dev likes. I can start by testing, write performance tests, execute performance tests, monitor tests, fix bugs, write unit test c

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
Github user smferguson closed the pull request at: https://github.com/apache/kafka/pull/2969 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
GitHub user smferguson reopened a pull request: https://github.com/apache/kafka/pull/2969 doc typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/smferguson/kafka doc_typo Alternatively you can review and apply these changes as

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996995#comment-15996995 ] Lukas Gemela commented on KAFKA-5154: - I wasnt able to reproduce the issue yet, but I

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996995#comment-15996995 ] Lukas Gemela edited comment on KAFKA-5154 at 5/4/17 4:26 PM: -

[jira] [Commented] (KAFKA-4987) Topic creation allows invalid config values on running brokers

2017-05-04 Thread Artiom Darie (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997105#comment-15997105 ] Artiom Darie commented on KAFKA-4987: - Hi [~norwood], I fixed this issue by removing

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Damian Guy
Hi Kyle, Thanks for the KIP. I apologize that i haven't had the chance to look at the KIP yet, but will schedule some time to look into it tomorrow. For the implementation, can you raise a PR against kafka trunk and mark it as WIP? It will be easier to review what you have done. Thanks, Damian O

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997107#comment-15997107 ] Jun Rao commented on KAFKA-4764: [~rsivaram], thanks for creating the jira. It seems that

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Eno Thereska
I’ll look as well asap, sorry, been swamped. Eno > On May 4, 2017, at 6:17 PM, Damian Guy wrote: > > Hi Kyle, > > Thanks for the KIP. I apologize that i haven't had the chance to look at > the KIP yet, but will schedule some time to look into it tomorrow. For the > implementation, can you raise

[GitHub] kafka pull request #2633: MINOR: Add simplified aggregate methods to KGroupe...

2017-05-04 Thread KyleWinkelman
Github user KyleWinkelman closed the pull request at: https://github.com/apache/kafka/pull/2633 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] kafka pull request #2975: KIP-150 [WIP]: Kafka Streams Cogroup

2017-05-04 Thread KyleWinkelman
GitHub user KyleWinkelman opened a pull request: https://github.com/apache/kafka/pull/2975 KIP-150 [WIP]: Kafka Streams Cogroup Work in progress PR for KIP-150. You can merge this pull request into a Git repository by running: $ git pull https://github.com/KyleWinkelman/kafka c

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Balint Molnar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997134#comment-15997134 ] Balint Molnar commented on KAFKA-5173: -- I reran this test 50 times in my computer no

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997141#comment-15997141 ] Lukas Gemela commented on KAFKA-5154: - I just found the exception from my previous com

[jira] [Updated] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5154: Attachment: clio.txt.gz > Kafka Streams throws NPE during rebalance > --

[jira] [Updated] (KAFKA-4925) Add a configurable delay to the initial consumer group rebalance

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4925: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[GitHub] kafka pull request #2758: KAFKA-4925: delay initial rebalance of consumer gr...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4925) Add a configurable delay to the initial consumer group rebalance

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997160#comment-15997160 ] ASF GitHub Bot commented on KAFKA-4925: --- Github user asfgit closed the pull request

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Matthias J. Sax
Did not have time to have a look. But backward compatibility is a must from my point of view. -Matthias On 5/4/17 12:56 AM, Michal Borowiecki wrote: > Hello, > > I've updated the KIP with missing information. > > I would especially appreciate some comments on the compatibility aspects > of thi

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I have made a pull request. It can be found here. https://github.com/apache/kafka/pull/2975 I plan to write some more unit tests for my classes and get around to writing documentation for the public api additions. One thing I was curious about is during the KCogroupedStreamImpl#aggregate method

[GitHub] kafka pull request #2907: kafka-5118: Improve message for Kafka failed start...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2907 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-5118) Improve message for Kafka failed startup with non-Kafka data in data.dirs

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5118. -- Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2907 [https://gi

[jira] [Created] (KAFKA-5174) RocksDb might stall in environments with 1 core only

2017-05-04 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5174: --- Summary: RocksDb might stall in environments with 1 core only Key: KAFKA-5174 URL: https://issues.apache.org/jira/browse/KAFKA-5174 Project: Kafka Issue Type:

[jira] [Assigned] (KAFKA-5174) RocksDb might stall in environments with 1 core only

2017-05-04 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-5174: --- Assignee: Eno Thereska > RocksDb might stall in environments with 1 core only > -

Build failed in Jenkins: kafka-trunk-jdk8 #1481

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4925: delay initial rebalance of consumer group -- [...truncated 844.34 KB...] kafka.integration.SaslPlaintextTopicMetadataTest > testAlive

[jira] [Resolved] (KAFKA-5104) DumpLogSegments should not open index files with `rw`

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5104. -- Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2905 [https://gi

[GitHub] kafka pull request #2905: kafka-5104: DumpLogSegments should not open index ...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2905 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-5170) KafkaAdminClientIntegration test should wait until metadata is propagated to all brokers

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997329#comment-15997329 ] ASF GitHub Bot commented on KAFKA-5170: --- GitHub user cmccabe opened a pull request:

[GitHub] kafka pull request #2976: KAFKA-5170. KafkaAdminClientIntegration test shoul...

2017-05-04 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/2976 KAFKA-5170. KafkaAdminClientIntegration test should wait until metada… …ta is propagated to all brokers You can merge this pull request into a Git repository by running: $ git pull https://

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-05-04 Thread Matthias J. Sax
Hi, thanks for updating the KIP. Looks good to me overall. I think adding `Cancellable` (or should it be `Cancelable` to follow American English?) is a clean solution, in contrast to the proposed alternative. One minor comment: can you add `ValueTransformer#punctuate()` to the list of deprecated

Build failed in Jenkins: kafka-trunk-jdk7 #2148

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4925: delay initial rebalance of consumer group -- [...truncated 844.64 KB...] kafka.tools.ConsoleConsumerTest > shouldLimitReadsToMaxMessage

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-05-04 Thread Matthias J. Sax
We can go either way. I just pointed out, what I would prefer -- it's also quite subjective. The least invasive change would be to add new constructors and update the JavaDocs to point out the semantics of `partition` parameter. However, I still like the builder pattern: ProducerRecord has 6 para

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-04 Thread Matthias J. Sax
Thanks for updating the KIP. Deep copying the key will work for sure, but I am actually a little bit worried about performance impact... We might want to do some test to quantify this impact. Btw: this remind me about the idea of `RichFunction` interface that would allow users to access record m

Re: Contributing to Kafka

2017-05-04 Thread Matthias J. Sax
Hi Rajan, thanks for your plan to contribute back! First, I would recommend to check out the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes Also check out the JIRA boards: https://issues.apache.org/jira/browse/KAFKA-1 You can just filter for components you are

Build failed in Jenkins: kafka-trunk-jdk8 #1482

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5118: Improve message for Kafka failed startup with non-Kafka data -- [...truncated 844.67 KB...] kafka.utils.CommandLineUtilsTest > testPar

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Matthias J. Sax
Kyle, thanks a lot for the KIP. Maybe I am a little slow, but I could not follow completely. Could you maybe add a more concrete example, like 3 streams with 3 records each (plus expected result), and show the difference between current way to to implement it and the proposed API? This could also

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Magnus Edenhill
Hey Colin, good KIP! Some comments: 1a. For operation, permission_type and resource_type: is there any reason for having the any and unknown enums as negative values? Since neither of these fields has an integer significance (unlike for example offsets which use negative offsets for logical offs

Re: [VOTE] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
Hi Guozhang, Thanks for taking a look. On Thu, May 4, 2017, at 00:43, Guozhang Wang wrote: > Colin, > > Thanks for the KIP. A general question I have is whether we can support > "wildcard" resource names as well? For example, if we want to create / > delete ACLs for all topic names following a w

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Matthias J. Sax
I had a quick look into this. With regard to backward compatibility, I think it would be required do introduce a new type `TypesStateStoreSupplier` (that extends `StateStoreSupplier`) and to overload all methods that take a `StateStoreSupplier` that accept the new type instead of the current one.

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Magnus Edenhill
Hi Rajini, great KIP! This solution was proposed on the original KIP-43 thread but voted down, so let's hope it does better this time :) /Magnus 2017-05-04 13:37 GMT+02:00 Rajini Sivaram : > Hi all, > > I have created a KIP to improve diagnostics for SASL authentication > failures and reduce re

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997421#comment-15997421 ] Rajini Sivaram commented on KAFKA-4764: --- [~junrao] Yes, Zookeeper does the same as K

[jira] [Assigned] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned KAFKA-5166: - Assignee: Bharat Viswanadham > Add option "dry run" to Streams application reset

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997426#comment-15997426 ] Bharat Viswanadham commented on KAFKA-5166: --- Hi Matthias, I will look into this,

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997427#comment-15997427 ] Matthias J. Sax commented on KAFKA-5166: Thanks for picking this up [~bharatviswa]

Build failed in Jenkins: kafka-trunk-jdk7 #2149

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5118: Improve message for Kafka failed startup with non-Kafka data [wangguoz] KAFKA-5104: DumpLogSegments should not open index files with `rw` ---

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Ismael Juma
Hi Rajini, I think we were talking about slightly different things. I was just referring to the fact that there are cases where we throw an AuthorizationException back to the user without retrying from various methods (poll, commitSync, etc). As you said, my initial preference was for not retryin

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997464#comment-15997464 ] Bharat Viswanadham commented on KAFKA-5166: --- Hi Matthias, I have not written KIP

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
On Thu, May 4, 2017, at 13:46, Magnus Edenhill wrote: > Hey Colin, > > good KIP! > > Some comments: > > 1a. For operation, permission_type and resource_type: is there any reason > for having the any and unknown enums as negative values? > Since neither of these fields has an integer significance

[jira] [Commented] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997497#comment-15997497 ] Ismael Juma commented on KAFKA-5175: [~onurkaraman], can you please take a look? > Tr

[jira] [Created] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5175: -- Summary: Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection Key: KAFKA-5175 URL: https://issues.apache.org/jira/browse/KAFKA-5175 Project: Ka

[jira] [Assigned] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman reassigned KAFKA-5175: --- Assignee: Onur Karaman > Transient failure: > ControllerIntegrationTest.testPreferredReplica

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-04 Thread Matthias J. Sax
One follow up. There was this email on the user list: http://search-hadoop.com/m/Kafka/uyzND17KhCaBzPSZ1?subj=Shouldn+t+the+initializer+of+a+stream+aggregate+accept+the+key+ It might make sense so include Initializer, Adder, and Substractor inferface, too. And we should double check if there are

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997510#comment-15997510 ] Jun Rao commented on KAFKA-4764: [~rsivaram], thanks for the explanation. I looked at KIP-

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread dan
what about the configs for: `allow.everyone.if.no.acl.found` and ` super.users`? i understand they are an implementation detail of `SimpleAclAuthorizer` configs, but without these its difficult to make sense of what permissions a `ListAclsResponse` actually represents. maybe something for another

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-04 Thread Gwen Shapira
On Wed, May 3, 2017 at 11:17 AM, Konstantine Karantasis < konstant...@confluent.io> wrote: > Thanks Ewen. I'm replying inline as well. > > On Tue, May 2, 2017 at 11:24 AM, Ewen Cheslack-Postava > wrote: > > > Thanks for the KIP. > > > > A few responses inline, followed by additional comments. > >

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-04 Thread Gwen Shapira
Hi, What about Transformations? Are they going to be isolated too? If they are, what do we do with the built-in ones? On Sat, Apr 29, 2017 at 9:16 AM, Konstantine Karantasis < konstant...@confluent.io> wrote: > * Because of KIP number collision, please disregard my previous KIP > announcement an

Build failed in Jenkins: kafka-trunk-jdk8 #1483

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5104: DumpLogSegments should not open index files with `rw` -- [...truncated 1.49 MB...] kafka.server.epoch.LeaderEpochFileCacheTest > shou

[jira] [Created] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-5176: -- Summary: AdminClient: add controller and clusterId methods to DescribeClusterResults Key: KAFKA-5176 URL: https://issues.apache.org/jira/browse/KAFKA-5176 Project

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I sure can. I have added the following description to my KIP. If this doesn't help let me know and I will take some more time to build a diagram and make more of a step by step description: Example with Current API: KTable table1 = builder.stream("topic1").groupByKey().aggregate(initializer1, agg

[GitHub] kafka pull request #2977: KAFKA-5176: AdminClient: add controller and cluste...

2017-05-04 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/2977 KAFKA-5176: AdminClient: add controller and clusterId methods to Desc… …ribeClusterResults You can merge this pull request into a Git repository by running: $ git pull https://github.com/cm

[jira] [Commented] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997528#comment-15997528 ] ASF GitHub Bot commented on KAFKA-5176: --- GitHub user cmccabe opened a pull request:

[jira] [Assigned] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe reassigned KAFKA-5176: -- Assignee: Colin P. McCabe > AdminClient: add controller and clusterId methods to Descri

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997529#comment-15997529 ] Ismael Juma commented on KAFKA-5173: Another one that is slightly different, but looks

[jira] [Work started] (KAFKA-5159) Update Kafka documentation to mention AdminClient

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5159 started by Colin P. McCabe. -- > Update Kafka documentation to mention AdminClient > ---

[jira] [Work started] (KAFKA-5170) KafkaAdminClientIntegration test should wait until metadata is propagated to all brokers

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5170 started by Colin P. McCabe. -- > KafkaAdminClientIntegration test should wait until metadata is propagated t

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997561#comment-15997561 ] Ismael Juma commented on KAFKA-5173: Another somewhat recent change was https://githu

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997568#comment-15997568 ] Matthias J. Sax commented on KAFKA-5166: All tools and their parameters _are_ publ

[jira] [Created] (KAFKA-5177) Default quick start config prompts warnings into console

2017-05-04 Thread Pranas Baliuka (JIRA)
Pranas Baliuka created KAFKA-5177: - Summary: Default quick start config prompts warnings into console Key: KAFKA-5177 URL: https://issues.apache.org/jira/browse/KAFKA-5177 Project: Kafka Issu

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
That's a good point. It's worth mentioning that there is a KIP in progress, KIP-133: List and Alter Configs Admin APIs, that should help with those. In the long term, it would be nice if we could deprecate 'allow.everyone.if.no.acl.found', along with topic auto-creation. It should be possible to

Re: [DISCUSS] KIP 151 - Expose Connector type in REST API

2017-05-04 Thread Gwen Shapira
YES PLEASE! On Tue, May 2, 2017 at 1:48 PM, dan wrote: > hello. > > in an attempt to make the connect rest endpoints more useful i'd like to > add the Connector type (Sink/Source) in our rest endpoints to make them > more self descriptive. > > KIP here: > https://cwiki.apache.org/confluence/disp

[GitHub] kafka pull request #2978: MINOR: Temporarily disable a few flaky tests

2017-05-04 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/2978 MINOR: Temporarily disable a few flaky tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka disable-some-flaky-tests Alternatively y

[GitHub] kafka pull request #2893: KAFKA-5112: Trunk compatibility tests should test ...

2017-05-04 Thread cmccabe
Github user cmccabe closed the pull request at: https://github.com/apache/kafka/pull/2893 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Commented] (KAFKA-5112) Trunk compatibility tests should test against 0.10.2

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997649#comment-15997649 ] ASF GitHub Bot commented on KAFKA-5112: --- Github user cmccabe closed the pull request

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997655#comment-15997655 ] Matthias J. Sax commented on KAFKA-5154: With regard to the exception you mentione

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
Github user smferguson closed the pull request at: https://github.com/apache/kafka/pull/2969 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

  1   2   >