Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-08-04 Thread Boyang Chen
Hey Guozhang, I think this makes sense. I'm wondering whether we could reuse the consumer client id as unique identifier instead of introducing new terms. From my experience, they should be unique in either Stream or Consumer use case. Thanks a lot for the clarification!

[jira] [Created] (KAFKA-7247) A link to Apache BookKeeper project is broken

2018-08-04 Thread okumin (JIRA)
okumin created KAFKA-7247: - Summary: A link to Apache BookKeeper project is broken Key: KAFKA-7247 URL: https://issues.apache.org/jira/browse/KAFKA-7247 Project: Kafka Issue Type: Bug Compo

[jira] [Created] (KAFKA-7246) Please add OWASP Dependency Check to the build

2018-08-04 Thread Albert Baker (JIRA)
Albert Baker created KAFKA-7246: --- Summary: Please add OWASP Dependency Check to the build Key: KAFKA-7246 URL: https://issues.apache.org/jira/browse/KAFKA-7246 Project: Kafka Issue Type: New Fe

Build failed in Jenkins: kafka-trunk-jdk8 #2866

2018-08-04 Thread Apache Jenkins Server
See Changes: [mjsax] MINOR: clean up window store interface to avoid confusion (#5359) -- [...truncated 875.78 KB...] kafka.security.auth.SimpleAclAuthorizerTest > testAcl

Re: [EXTERNAL] [DISCUSS] KIP-310: Add a Kafka Source Connector to Kafka Connect

2018-08-04 Thread McCaig, Rhys
Hi All, If there are no further comments on this KIP I’ll start a vote early this week. Rhys On Aug 1, 2018, at 12:32 AM, McCaig, Rhys mailto:rhys_mcc...@cable.comcast.com>> wrote: Hi All, I’ve updated the proposal to include the improvements suggested by Stephane. I have also submitted a PR

Build failed in Jenkins: kafka-trunk-jdk8 #2865

2018-08-04 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: close producer instance in AbstractJoinIntegrationTest (#5459) -- [...truncated 2.47 MB...] org.apache.kafka.streams.TopologyTest > shouldT

Build failed in Jenkins: kafka-trunk-jdk10 #369

2018-08-04 Thread Apache Jenkins Server
See Changes: [mjsax] MINOR: clean up window store interface to avoid confusion (#5359) -- [...truncated 1.53 MB...] kafka.coordinator.transaction.TransactionCoordinatorTe

Build failed in Jenkins: kafka-trunk-jdk10 #368

2018-08-04 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: close producer instance in AbstractJoinIntegrationTest (#5459) -- [...truncated 1.91 MB...] at org.gradle.internal.event.BroadcastD

Build failed in Jenkins: kafka-trunk-jdk8 #2864

2018-08-04 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu xenial) in workspace

Re: [DISCUSS] KIP-346 - Limit blast radius of log compaction failure

2018-08-04 Thread Stanislav Kozlovski
Hey Ray, Thanks for the explanation. In regards to the configuration property - I'm not sure. As long as it has sufficient documentation, I find "max.uncleanable.partitions" to be okay. If we were to add the distinction explicitly, maybe it should be `max.uncleanable.partitions.per.logdir` ? On T

Re: [VOTE] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2018-08-04 Thread Stanislav Kozlovski
Hey Colin, It may be a bit vague but keep in mind we also raise the exception in the case where the record is corrupted. We discussed with Jason offline that message corruption most often prevents deserialization itself and that may be enough of an argument to raise `RecordDeserializationException

Build failed in Jenkins: kafka-trunk-jdk8 #2863

2018-08-04 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #2862

2018-08-04 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: clean up node and store sensors (#5450) -- [...truncated 2.48 MB...] org.apache.kafka.streams.TopologyTest > multipleSourcesWithProcessors

Re: [DISCUSS] KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it

2018-08-04 Thread Attila Sasvári
Thanks for the KIP. Regarding the motivation: - KIP-113 added a new command, kafka-log-dirs.sh, to get the partitions associated with a specific broker (however, it does not work on secured clusters, see KIP-340). It would be probably better/more flexible if you could specify multiple broker ids.

Re: [DISCUSS] KIP-348 Eliminate null from SourceTask#poll()

2018-08-04 Thread Chia-Ping Tsai
hi Colin Thanks for the reviews! You are totally right. The description of KIP-348 is not accurate. The purpose of KIP-348 is to encourage connector user to substitute empty list to null value, but at the same time returning null still work. I will update the KIP-348 ASAP. cheers, Chia-Ping

Build failed in Jenkins: kafka-trunk-jdk10 #367

2018-08-04 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: clean up node and store sensors (#5450) -- [...truncated 1.95 MB...] at org.gradle.internal.event.ListenerBroadcast.dispatch(Listen