Re: [VOTE] 0.11.0.2 RC0

2017-11-15 Thread Satish Duggana
+1 (non-binding) - Ran testAll on source - Verified signatures on binaries built with Scala-2.11 - Ran through quickstart of core/streams On Wed, Nov 15, 2017 at 12:46 AM, Gwen Shapira wrote: > +1 (binding) > > Validated signatures, compiled sources, ran through quickstart on my > machine. >

[GitHub] kafka pull request #4187: MINOR: Handle error metrics removal during shutdow...

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4187 ---

[jira] [Created] (KAFKA-6210) IllegalArgumentException if 1.0.0 is used for inter.broker.protocol.version or log.message.format.version

2017-11-15 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-6210: -- Summary: IllegalArgumentException if 1.0.0 is used for inter.broker.protocol.version or log.message.format.version Key: KAFKA-6210 URL: https://issues.apache.org/jira/browse/KAFKA-621

[jira] [Created] (KAFKA-6211) PartitionAssignmentState is protected whereas KafkaConsumerGroupService.describeGroup() returns PartitionAssignmentState Object

2017-11-15 Thread Subhransu Acharya (JIRA)
Subhransu Acharya created KAFKA-6211: Summary: PartitionAssignmentState is protected whereas KafkaConsumerGroupService.describeGroup() returns PartitionAssignmentState Object Key: KAFKA-6211 URL: https://issu

[jira] [Created] (KAFKA-6212) Kafka Streams - Incorrect partition rebalancing

2017-11-15 Thread Ivan Atanasov (JIRA)
Ivan Atanasov created KAFKA-6212: Summary: Kafka Streams - Incorrect partition rebalancing Key: KAFKA-6212 URL: https://issues.apache.org/jira/browse/KAFKA-6212 Project: Kafka Issue Type: Bug

Build failed in Jenkins: kafka-trunk-jdk7 #2969

2017-11-15 Thread Apache Jenkins Server
See Changes: [rajinisivaram] MINOR: Handle error metrics removal during shutdown -- [...truncated 422.00 KB...] kafka.tools.ReplicaVerificationToolTest > testReplicaBuffe

[jira] [Created] (KAFKA-6213) Stream processor receives messages after close() is invoked

2017-11-15 Thread Bart De Vylder (JIRA)
Bart De Vylder created KAFKA-6213: - Summary: Stream processor receives messages after close() is invoked Key: KAFKA-6213 URL: https://issues.apache.org/jira/browse/KAFKA-6213 Project: Kafka

Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

2017-11-15 Thread Paolo Patierno
Ismael +1 ... I'm going to update the name Paolo Patierno Senior Software Engineer (IoT) @ Red Hat Microsoft MVP on Azure & IoT Microsoft Azure Advisor Twitter : @ppatierno Linkedin : paolopatierno Blog : DevExperience

Re: 答复: 答复: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

2017-11-15 Thread charly molter
Hi Jun, Jiangle, I'd just like to clarify that KIP-225 seems to be using per partition metric the same way as KIP-223 seems to be doing. I believe avg and max are still necessary because the MetricsReporter doesn't work in a "push" manner and the "Value" measurableStat will only keep the last rec

[GitHub] kafka pull request #4203: MINOR: Remove note in docs that is no longer requi...

2017-11-15 Thread rajinisivaram
Github user rajinisivaram closed the pull request at: https://github.com/apache/kafka/pull/4203 ---

[GitHub] kafka pull request #4199: KAFKA-6164; Shutdown quota managers if other compo...

2017-11-15 Thread rajinisivaram
Github user rajinisivaram closed the pull request at: https://github.com/apache/kafka/pull/4199 ---

Jenkins build is back to normal : kafka-trunk-jdk8 #2209

2017-11-15 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #4196: MINOR: KafkaZkClient refactor. Use match instead o...

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4196 ---

[GitHub] kafka pull request #4217: MINOR: Updated KafkaZkClient.pathExists() to use E...

2017-11-15 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/4217 MINOR: Updated KafkaZkClient.pathExists() to use ExistsRequest rather than using GetDataRequest You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] kafka pull request #4218: Update a protocol.html error

2017-11-15 Thread Joannis
GitHub user Joannis opened a pull request: https://github.com/apache/kafka/pull/4218 Update a protocol.html error Removed two words that indicated that the primitive types of the protocol would be listed here, which is not yet the case. ### Committer Checklist (excluded fro

[GitHub] kafka pull request #4219: MINOR: Fix NPE in unregisterPartitionReassignmentI...

2017-11-15 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4219 MINOR: Fix NPE in unregisterPartitionReassignmentIsrChangeHandlers I was looking at a transient failures of `shouldPerformMultipleReassignmentOperationsOverVariousTopics` and came across a NPE and

Re: [VOTE] KIP-215: Add topic regex support for Connect sinks

2017-11-15 Thread Jeff Klukas
I've made all the changes on the KIP-215 and general KIP page to mark this as approved. Just waiting on approval and merging of the PR at this point. On Thu, Nov 9, 2017 at 9:36 AM, Randall Hauch wrote: > Jeff, > > This KIP does pass with 3 binding +1s and no other binding votes, and with > more

Build failed in Jenkins: kafka-trunk-jdk8 #2210

2017-11-15 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Use match instead of if/else in KafkaZkClient -- [...truncated 1.79 MB...] org.apache.kafka.streams.integration.RegexSourceIntegrationTest >

Jenkins build is back to normal : kafka-trunk-jdk7 #2970

2017-11-15 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-6214) Using standby replicas with an in memory state store causes Streams to crash

2017-11-15 Thread Matt Farmer (JIRA)
Matt Farmer created KAFKA-6214: -- Summary: Using standby replicas with an in memory state store causes Streams to crash Key: KAFKA-6214 URL: https://issues.apache.org/jira/browse/KAFKA-6214 Project: Kafka

[GitHub] kafka pull request #4220: KAFKA-6210: IllegalArgumentException if 1.0.0 is u...

2017-11-15 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/4220 KAFKA-6210: IllegalArgumentException if 1.0.0 is used for inter.broker.protocol.version or log.message.format.version Added unit test for ApiVersion and testApiVersions from Scala to Java.

[GitHub] kafka pull request #4221: MINOR: fix instable KafkaStreamsTest

2017-11-15 Thread mjsax
GitHub user mjsax opened a pull request: https://github.com/apache/kafka/pull/4221 MINOR: fix instable KafkaStreamsTest - set streams state.dir to test-dir (default /tmp is not reliable) ### Committer Checklist (excluded from commit message) - [ ] Verify design and impl

Build failed in Jenkins: kafka-trunk-jdk9 #193

2017-11-15 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Use match instead of if/else in KafkaZkClient -- [...truncated 1.81 MB...] org.apache.kafka.streams.kstream.WindowTest > shouldThrowIfStartIsNe

[jira] [Created] (KAFKA-6215) KafkaStreamsTest fails in trunk

2017-11-15 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-6215: - Summary: KafkaStreamsTest fails in trunk Key: KAFKA-6215 URL: https://issues.apache.org/jira/browse/KAFKA-6215 Project: Kafka Issue Type: Test Reporter: Ted Yu

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

2017-11-15 Thread Vahid S Hashemian
I'm forwarding this feedback from John to the mailing list, and responding at the same time: John, thanks for the feedback. I agree that the scenario you described could lead to unnecessary long offset retention for other consumer groups. If we want to address that in this KIP we could either ke

[GitHub] kafka pull request #4221: KAFKA-6215: KafkaStreamsTest fails in trunk

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4221 ---

Re: [DISCUSS] KIP-220: Add AdminClient into Kafka Streams' ClientSupplier

2017-11-15 Thread Guozhang Wang
Yes, I will update the KIP accordingly. Thanks. On Tue, Nov 14, 2017 at 2:56 PM, Matthias J. Sax wrote: > One more thing. Can you update the KIP accordingly. It still says: > > - Compatibility check: we will use a network client for this purpose, > as it is a one-time thing. > > Additionally, I

Jenkins build is back to normal : kafka-trunk-jdk9 #194

2017-11-15 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

2017-11-15 Thread Jeff Widman
I thought about this scenario as well. However, my conclusion was that because __consumer_offsets is a compacted topic, this extra clutter from short-lived consumer groups is negligible. The disk size is the product of the number of consumer groups and the number of partitions in the group's subs

[GitHub] kafka pull request #4214: MINOR: Make PushHttpMetricsReporter API compatible...

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4214 ---

[GitHub] kafka pull request #4222: Adding secondary nav to Streams page

2017-11-15 Thread manjuapu
GitHub user manjuapu opened a pull request: https://github.com/apache/kafka/pull/4222 Adding secondary nav to Streams page *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to

Jenkins build is back to normal : kafka-trunk-jdk8 #2211

2017-11-15 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #4212: MINOR: Introduction fixup

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4212 ---

[GitHub] kafka pull request #4208: MINOR: Not enough replica exception should never h...

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4208 ---

Re: [VOTE] KIP-205: Add all() and range() API to ReadOnlyWindowStore

2017-11-15 Thread Guozhang Wang
Since we already have three binding +1s for this KIP, I'm closing this thread as accepted and updating the KIP wiki accordingly. Guozhang On Mon, Oct 30, 2017 at 2:10 PM, Gwen Shapira wrote: > +1 for the KIP and Rename > > On Sat, Oct 28, 2017 at 5:51 AM Bill Bejeck wrote: > > > +1 for the KI

[GitHub] kafka pull request #4222: Adding secondary nav to Streams page

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4222 ---

Build failed in Jenkins: kafka-1.0-jdk7 #84

2017-11-15 Thread Apache Jenkins Server
See Changes: [me] MINOR: Make PushHttpMetricsReporter API compatible with releases back to -- [...truncated 1.41 MB...] org.apache.kafka.clients.consumer.internals.AbstractCoo

Build failed in Jenkins: kafka-trunk-jdk9 #195

2017-11-15 Thread Apache Jenkins Server
See Changes: [me] MINOR: Make PushHttpMetricsReporter API compatible with releases back to -- [...truncated 1.42 MB...] kafka.api.PlaintextConsumerTest > testMultiConsumer

[GitHub] kafka pull request #4223: when closing a socket in response to an IOExceptio...

2017-11-15 Thread radai-rosenblatt
GitHub user radai-rosenblatt opened a pull request: https://github.com/apache/kafka/pull/4223 when closing a socket in response to an IOException, also print the root issue if closing fails `Selector.pollSelectionKeys()` attempts to close the channel in response to an Exception (le

[jira] [Created] (KAFKA-6216) kafka logs for misconfigured ssl clients are unhelpful

2017-11-15 Thread radai rosenblatt (JIRA)
radai rosenblatt created KAFKA-6216: --- Summary: kafka logs for misconfigured ssl clients are unhelpful Key: KAFKA-6216 URL: https://issues.apache.org/jira/browse/KAFKA-6216 Project: Kafka Is

Build failed in Jenkins: kafka-trunk-jdk9 #196

2017-11-15 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: kafka-site introduction section improvements [wangguoz] MINOR: Not enough replica exception should never happen for delete [wangguoz] MINOR: Adding secondary nav to Streams webpage

Jenkins build is back to normal : kafka-0.11.0-jdk7 #335

2017-11-15 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #4224: [WIP] KAFKA-6170; KIP-220 Part 2: Break dependency...

2017-11-15 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/4224 [WIP] KAFKA-6170; KIP-220 Part 2: Break dependency of Assignor on StreamThread This refactoring is discussed in https://github.com/apache/kafka/pull/3624#discussion_r132614639. More specifica

Build failed in Jenkins: kafka-1.0-jdk7 #85

2017-11-15 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: kafka-site introduction section improvements [wangguoz] MINOR: Adding secondary nav to Streams webpage -- [...truncated 373.39 KB...] kafka.se

Build failed in Jenkins: kafka-trunk-jdk7 #2973

2017-11-15 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: kafka-site introduction section improvements [wangguoz] MINOR: Not enough replica exception should never happen for delete [wangguoz] MINOR: Adding secondary nav to Streams webpag

Re: [DISCUSS] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

2017-11-15 Thread Vahid S Hashemian
Thanks Jeff. I believe the in-memory cache size is currently unbounded. As you mentioned the size of this cache on each broker is a factor of the number of consumer groups (whose coordinator is on that broker) and the number of partitions in each group. With compaction in mind, the cache size co

[jira] [Resolved] (KAFKA-6210) IllegalArgumentException if 1.0.0 is used for inter.broker.protocol.version or log.message.format.version

2017-11-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6210. Resolution: Fixed > IllegalArgumentException if 1.0.0 is used for inter.broker.protocol.version > o

[GitHub] kafka pull request #4220: KAFKA-6210: IllegalArgumentException if 1.0.0 is u...

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4220 ---

Re: [VOTE] 0.11.0.2 RC0

2017-11-15 Thread Tim Carey-Smith
Hi Rajini, +1 (non-binding). We ran a preliminary performance and regression suites and found no noticeable negative impacts. Tim @ Heroku On Fri, Nov 10, 2017, at 16:40, Rajini Sivaram wrote: > Resending to include kafka-clients. > > On Sat, Nov 11, 2017 at 12:37 AM, Rajini Sivaram > > wrote

[GitHub] kafka pull request #4217: MINOR: Updated KafkaZkClient.pathExists() to use E...

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4217 ---

[GitHub] kafka pull request #4210: KAFKA-6167: Timestamp on streams directory contain...

2017-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4210 ---

Re: [VOTE] 0.11.0.2 RC0

2017-11-15 Thread Guozhang Wang
+1 - Ran through quick start, streams tutorials. - Ran testAll (scala 2.11, java 8) On Wed, Nov 15, 2017 at 12:27 AM, Satish Duggana wrote: > +1 (non-binding) > > - Ran testAll on source > - Verified signatures on binaries built with Scala-2.11 > - Ran through quickstart of core/streams > > > >

Jenkins build is back to normal : kafka-1.0-jdk7 #86

2017-11-15 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk7 #2974

2017-11-15 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-6210; IllegalArgumentException if 1.0.0 is used for -- [...truncated 390.21 KB...] kafka.zk.KafkaZkClientTest > testSetGetAndDeletePartitionRea

Jenkins build is back to normal : kafka-trunk-jdk9 #197

2017-11-15 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-6217) Allow consumers to read messages from LEO

2017-11-15 Thread Ashok Bala (JIRA)
Ashok Bala created KAFKA-6217: - Summary: Allow consumers to read messages from LEO Key: KAFKA-6217 URL: https://issues.apache.org/jira/browse/KAFKA-6217 Project: Kafka Issue Type: Improvement

Re: [VOTE] 0.11.0.2 RC0

2017-11-15 Thread Ismael Juma
+1 (binding). Tested the quickstart with the source and binary (Scala 2.12) artifacts, ran the tests on the source artifact and verified some signatures and hashes on source and binary (Scala 2.12) artifacts. Thanks for managing this release Rajini! On Sat, Nov 11, 2017 at 12:37 AM, Rajini Sivara

Re: [DISCUSS] KIP-209 Connection String Support

2017-11-15 Thread Clebert Suconic
So, just asking for guidance here... should I go for a vote.. or... if you guys think this should be retired.. that's fine.. I am using my spare time on this.. and I'm about to fill it up that slot soon :) I'm trying to figure out if there is interest on this. On Mon, Nov 13, 2017 at 9:51 AM, Cl

[jira] [Created] (KAFKA-6218) Optimize condition in if statement to reduce the number of comparisons

2017-11-15 Thread sachin bhalekar (JIRA)
sachin bhalekar created KAFKA-6218: -- Summary: Optimize condition in if statement to reduce the number of comparisons Key: KAFKA-6218 URL: https://issues.apache.org/jira/browse/KAFKA-6218 Project: Kaf

[GitHub] kafka pull request #4225: KAFKA-6218 : Optimize condition in if statement to...

2017-11-15 Thread sachinbhalekar
GitHub user sachinbhalekar opened a pull request: https://github.com/apache/kafka/pull/4225 KAFKA-6218 : Optimize condition in if statement to reduce the number of comparisons Changed the condition in **if** statement **(schema.name() == null || !(schema.name().equals(LOGI

Jenkins build is back to normal : kafka-trunk-jdk7 #2975

2017-11-15 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #2214

2017-11-15 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-6210; IllegalArgumentException if 1.0.0 is used for [ismael] MINOR: Updated KafkaZkClient.pathExists() to use ExistsRequest [wangguoz] KAFKA-6167: Timestamp on streams directory cont

[jira] [Created] (KAFKA-6219) Inconsistent behavior for kafka-consumer-groups with ACL enabled

2017-11-15 Thread huxihx (JIRA)
huxihx created KAFKA-6219: - Summary: Inconsistent behavior for kafka-consumer-groups with ACL enabled Key: KAFKA-6219 URL: https://issues.apache.org/jira/browse/KAFKA-6219 Project: Kafka Issue Type:

Reply: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

2017-11-15 Thread Hu Xi
Currently, partition-level records-lag metrics would not be displayed under tags 'topic=,partition='. Instead they were shown under client-level due to the incorrect tags used in the code, see below: /* Partition level */ this.partitionRecordsLag = new MetricNameTemplate("{topic}-{part

Re: [DISCUSS] KIP-212: Enforce set of legal characters for connector names

2017-11-15 Thread Sönke Liebau
Hi Randall, zero length definitely works, that's what sent me down this hole in the first place. I had a customer accidentally create a connector without a name in his environment and then be unable to delete it. No connector name doesn't work, as this throws a null pointer exception due to KAFKA-