Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-11-28 Thread Matt Farmer
Hi there, sorry for the delay in responding. Last week had a holiday and several busy work days in it so I'm just now getting around to responding. > We would only exclude > exception Streams can handle itself (like ProducerFencedException) -- > thus, if the handler has code to react to this, it w

Support for Gradle 2.X

2017-11-28 Thread Jakub Scholz
Hi, According to the GitHub page, "Kafka requires Gradle 2.0 or higher.". However, when I try to build Kafka using Gradle 2.7, it doesn't work because of the com.github.johnrengelman.shadow plugin which in the version used by Kafka requires Gradle 3.0+. There seems to be already a JIRA for it: htt

[jira] [Resolved] (KAFKA-6249) Interactive query downtime when node goes down even with standby replicas

2017-11-28 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6249. Resolution: Duplicate > Interactive query downtime when node goes down even with standby rep

Re: [DISCUSS] KIP-227: Introduce Incremental FetchRequests to Increase Partition Scalability

2017-11-28 Thread Colin McCabe
On Mon, Nov 27, 2017, at 22:30, Jan Filipiak wrote: > Hi Colin, thank you for this KIP, it can become a really useful thing. > > I just scanned through the discussion so far and wanted to start a > thread to make as decision about keeping the > cache with the Connection / Session or having some

[GitHub] kafka pull request #4224: KAFKA-6170; KIP-220 Part 2: Break dependency of As...

2017-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4224 ---

[jira] [Created] (KAFKA-6279) Connect metrics do not get cleaned up for a source connector that doesn't stop properly

2017-11-28 Thread Randall Hauch (JIRA)
Randall Hauch created KAFKA-6279: Summary: Connect metrics do not get cleaned up for a source connector that doesn't stop properly Key: KAFKA-6279 URL: https://issues.apache.org/jira/browse/KAFKA-6279

[GitHub] kafka pull request #4270: [WIP] KAFKA-6150: Purge repartition topics

2017-11-28 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/4270 [WIP] KAFKA-6150: Purge repartition topics *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate

Build failed in Jenkins: kafka-trunk-jdk8 #2243

2017-11-28 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6170; KIP-220 Part 2: Break dependency of Assignor on StreamThread -- [...truncated 1.90 MB...] org.apache.kafka.connect.runtime.rest.entit

[jira] [Resolved] (KAFKA-6274) Improve KTable Source state store auto-generated names

2017-11-28 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6274. -- Resolution: Fixed Fix Version/s: 1.0.1 1.1.0 Issue resolved by pull re

[GitHub] kafka pull request #4268: KAFKA-6274: Use topic plus dash as prefix of auto-...

2017-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4268 ---

Re: [ANNOUNCE] New committer: Onur Karaman

2017-11-28 Thread Jason Gustafson
Sorry for being late to the party, but congratulations Onur! On Wed, Nov 8, 2017 at 1:47 AM, Sandeep Nemuri wrote: > Congratulations Onur!! > > On Wed, Nov 8, 2017 at 9:19 AM, UMESH CHAUDHARY > wrote: > > > Congratulations Onur! > > > > On Tue, 7 Nov 2017 at 21:44 Jun Rao wrote: > > > > > Af

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-11-28 Thread Colin McCabe
Hi Rajini, This seems like a nice improvement! One thing that is a bit concerning is that, if bin/kafka-configs.sh is used, there is no way for the broker to give feedback or error messages. The broker can't say "sorry, I can't reconfigure that in that way." Or even "that configuration propert

[GitHub] kafka pull request #3448: KAFKA-5526: Report group consumers while offsets a...

2017-11-28 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/3448 ---

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-11-28 Thread Guozhang Wang
Jan, Thanks for your input, I can understand now that the oldValue is also exposed in user customized `filter` function and hence want record context we should expose is a problem. And I think it does brings a good point to consider for KIP-159. The discussions maybe a bit confusing to reader thou

Build failed in Jenkins: kafka-trunk-jdk8 #2244

2017-11-28 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6274: Use topic plus dash as prefix of auto-generated state store -- [...truncated 1.91 MB...] org.apache.kafka.connect.runtime.rest.entiti

[GitHub] kafka pull request #4271: KAFKA-5526: Additional `--describe` views for Cons...

2017-11-28 Thread vahidhashemian
GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/4271 KAFKA-5526: Additional `--describe` views for ConsumerGroupCommand (KIP-175) The `--describe` option of ConsumerGroupCommand is expanded to support: * `--describe` or `--describe --offsets

[jira] [Created] (KAFKA-6280) Allow for additional archive types to be loaded from plugin.path in Connect

2017-11-28 Thread Konstantine Karantasis (JIRA)
Konstantine Karantasis created KAFKA-6280: - Summary: Allow for additional archive types to be loaded from plugin.path in Connect Key: KAFKA-6280 URL: https://issues.apache.org/jira/browse/KAFKA-6280

Build failed in Jenkins: kafka-trunk-jdk8 #2245

2017-11-28 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-6255; Add ProduceBench to Trogdor -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubu

Build failed in Jenkins: kafka-trunk-jdk7 #3006

2017-11-28 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-6255; Add ProduceBench to Trogdor -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30

[jira] [Resolved] (KAFKA-6255) Add ProduceBench to Trogdor

2017-11-28 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-6255. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 4245 [https://git

[GitHub] kafka pull request #4245: KAFKA-6255: Add ProduceBench to Trogdor

2017-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4245 ---

[GitHub] kafka pull request #4272: KAFKA-4827: Porting fix for KAFKA-4827 to v0.10 an...

2017-11-28 Thread wicknicks
GitHub user wicknicks opened a pull request: https://github.com/apache/kafka/pull/4272 KAFKA-4827: Porting fix for KAFKA-4827 to v0.10 and v0.11 Back porting the fix in this PR (https://github.com/apache/kafka/pull/4205) to v0.10 and v0.11. You can merge this pull request into a Gi

Build failed in Jenkins: kafka-trunk-jdk9 #226

2017-11-28 Thread Apache Jenkins Server
See Changes: [rajinisivaram] KAFKA-6255; Add ProduceBench to Trogdor -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H30

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-11-28 Thread Rajini Sivaram
Hi Colin, Thank you for reviewing the KIP. *kaka-configs.sh* will be converted to use *AdminClient* under KAFKA-5722. This is targeted for the next release (1.1.0). Under this KIP, we will implement *AdminClient#alterConfigs* for the dynamic configs listed in the KIP. This will include validation

[DISCUSS] KIP-229: DeleteGroups API

2017-11-28 Thread Vahid S Hashemian
Hi everyone, I started KIP-229 and proposed a consumer group deletion API for Kafka-based group management to address KAFKA-6275: https://cwiki.apache.org/confluence/display/KAFKA/KIP-229%3A+DeleteGroups+API Your feedback and suggestions are welcome! Thanks. --Vahid

[jira] [Resolved] (KAFKA-6279) Connect metrics do not get cleaned up for a source connector that doesn't stop properly

2017-11-28 Thread Randall Hauch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-6279. -- Resolution: Duplicate > Connect metrics do not get cleaned up for a source connector that doesn'

Re: [DISCUSS] KIP 226 - Dynamic Broker Configuration

2017-11-28 Thread Jason Gustafson
Hi Rajini, One quick question I was wondering about is whether this could be used to update the inter-broker protocol version or the message format version? Potentially then we'd only need one rolling restart to upgrade the cluster. I glanced quickly through the uses of this config in the code and

答复: REPLY: [DISCUSS]KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer

2017-11-28 Thread Hu Xi
Hi Rao Jun, Already updated the patch per your suggestion and it seems there are no further feedbacks on this KIP. Could we vote now? 发件人: Jun Rao 发送时间: 2017年11月23日 6:21 收件人: dev@kafka.apache.org 主题: Re: REPLY: [DISCUSS]KIP-223 - Add per-topic min lead and pe

[GitHub] kafka pull request #4273: KAFKA-4827: Porting fix for KAFKA-4827 to v0.10 an...

2017-11-28 Thread wicknicks
GitHub user wicknicks opened a pull request: https://github.com/apache/kafka/pull/4273 KAFKA-4827: Porting fix for KAFKA-4827 to v0.10 and v0.11 You can merge this pull request into a Git repository by running: $ git pull https://github.com/wicknicks/kafka KAFKA-4827-0.10.2 A

Re: [DISCUSS] KIP-229: DeleteGroups API

2017-11-28 Thread Dong Lin
Hey Vahid, Thanks for the KIP! This is certainly a useful one and users have been asking about the ability to delete group from the Kafka offset topic in my past experience. It seems that the protocol of the new request/response should probably include more fields fields. For example, it may be u

[jira] [Resolved] (KAFKA-6257) KafkaConsumer was hung when bootstrap servers was not existed

2017-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-6257. - Resolution: Duplicate Closing this as duplicate since no contradicting information was added. > K