[jira] [Created] (KAFKA-7610) Detect consumer failures in initial JoinGroup

2018-11-09 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-7610: -- Summary: Detect consumer failures in initial JoinGroup Key: KAFKA-7610 URL: https://issues.apache.org/jira/browse/KAFKA-7610 Project: Kafka Issue Type: I

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-09 Thread Boyang Chen
Hey Mayuresh, thanks for the thoughtful questions! Let me try to answer your questions one by one. For having a consumer config at runtime, I think it's not necessary to address in this KIP because most companies run sidecar jobs through daemon software like puppet. It should be easy to chan

Re: Query Kafka Connect

2018-11-09 Thread Ryanne Dolan
Stupid question: do you have transforms=DateConvert as well? On Fri, Nov 9, 2018, 9:00 PM sanjeev0915 wrote: > Hi > > Please help for the below issue > > i am using Kafka connect JDBC Connector and trying to pull the data from > Oracle Database table. I am using Apache Kafka (not the confluent).

Re: [VOTE] KIP-354 Time-based log compaction policy

2018-11-09 Thread xiongqi wu
Thanks Dong. I have updated the KIP. Xiongqi (Wesley) Wu On Fri, Nov 9, 2018 at 5:31 PM Dong Lin wrote: > Thanks for the KIP Xiongqi. LGTM. +1 (binding) > > One minor comment: it may be a bit better to clarify in the public > interface section that the value of the newly added metric is determ

Re: Permissions

2018-11-09 Thread Matthias J. Sax
Done. On 11/9/18 7:06 PM, kamal kaur wrote: > Thanks Matthias! > > Both are kamalkang > > Kamal Kang > > On Fri, Nov 9, 2018 at 3:07 PM Matthias J. Sax > wrote: > >> Thanks for contribution! >> >> Check out >> https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes >> >> F

Re: Permissions

2018-11-09 Thread kamal kaur
Thanks Matthias! Both are kamalkang Kamal Kang On Fri, Nov 9, 2018 at 3:07 PM Matthias J. Sax wrote: > Thanks for contribution! > > Check out > https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes > > For writing a KIP, follow the instruction: > > https://cwiki.apache.or

Query Kafka Connect

2018-11-09 Thread sanjeev0915
Hi Please help for the below issue i am using Kafka connect JDBC Connector and trying to pull the data from Oracle Database table. I am using Apache Kafka (not the confluent). But using JDBC connector from Confluent 5.0.0. i have a field of number(19) with auto-increment as a primary key. the da

Re: [DISCUSS] KIP-345: Reduce multiple consumer rebalances by specifying member id

2018-11-09 Thread Mayuresh Gharat
Hi Boyang, Thanks for the KIP and sorry for being late to the party. This KIP is really useful for us at Linkedin. I had a few questions : The idea of having static member name seems nice, but instead of a config, would it be possible for it to be passed in to the consumer at runtime? This is be

Re: [VOTE] KIP-354 Time-based log compaction policy

2018-11-09 Thread Dong Lin
Thanks for the KIP Xiongqi. LGTM. +1 (binding) One minor comment: it may be a bit better to clarify in the public interface section that the value of the newly added metric is determined based by applying that formula across all compactable segments. For example: The maximum value of Math.max(now

Re: [VOTE] KIP-354 Time-based log compaction policy

2018-11-09 Thread xiongqi wu
Thanks Joel. Tracking the delay at second granularity makes sense I have updated KIP. Xiongqi (Wesley) Wu On Fri, Nov 9, 2018 at 5:05 PM Joel Koshy wrote: > +1 with one suggestion on the proposed metric. You should probably include > the unit. So for e.g., max-compaction-delay-secs. > > Joel >

Re: [VOTE] KIP-354 Time-based log compaction policy

2018-11-09 Thread Joel Koshy
+1 with one suggestion on the proposed metric. You should probably include the unit. So for e.g., max-compaction-delay-secs. Joel On Tue, Nov 6, 2018 at 5:30 PM xiongqi wu wrote: > bump > Xiongqi (Wesley) Wu > > > On Thu, Sep 27, 2018 at 4:20 PM xiongqi wu wrote: > > > > > Thanks Eno, Brett, D

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
Hey Mani, Thanks again for catching this. The issue has been fixed and the configs are properly displayed in http://kafka.apache.org/20/documentation.html#producerconfigs now. Thanks, Dong On Fri, Nov 9, 2018 at 3:53 PM Dong Lin wrote: > Hey Mani, > > Thanks for catching these! Since kafka-sit

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
Hey Mani, Thanks for catching these! Since kafka-site ( https://github.com/apache/kafka-site) can be updated separately of the kafka release, I will file ticket and fix these later. Thanks, Dong On Fri, Oct 26, 2018 at 6:58 AM Manikumar wrote: > minor observation: config sections are empty in

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
Hey Eno, Thanks for the test! Yes https://builds.apache.org/job/kafka-2.1-jdk8 also shows flaky test. It does not block the release. I will create ticket for them and we will fix these one by one later. Thanks, Dong On Tue, Oct 30, 2018 at 6:22 AM Eno Thereska wrote: > 2 tests failed for me an

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
Hey everyone, Thanks for your help with testing the release! It has taken us some time to validate the system tests for 2.1.0, fix flaky test and discuss/fix upgrade note. All these issues are resolved now. I have started another email thread to vote for 2.1.0 RC1. Please help test and vote for R

[VOTE] 2.1.0 RC1

2018-11-09 Thread Dong Lin
Hello Kafka users, developers and client-developers, This is the second candidate for feature release of Apache Kafka 2.1.0. This is a major version release of Apache Kafka. It includes 28 new KIPs and critical bug fixes. Please see the Kafka 2.1.0 release plan for more details: *https://cwiki.

Re: [ANNOUNCE] Apache Kafka 2.0.1

2018-11-09 Thread Jun Rao
Thanks for running the release, Mani! Jun On Fri, Nov 9, 2018 at 11:42 AM, Manikumar wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 2.0.1 > > This is a bug fix release and it includes fixes and improvements from 51 > JIRAs. > > All of the changes in th

Build failed in Jenkins: kafka-trunk-jdk8 #3190

2018-11-09 Thread Apache Jenkins Server
See Changes: [colin] KAFKA-7564: Expose single task details in Trogdor (#5852) -- [...truncated 2.73 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldFailI

Jenkins build is back to normal : kafka-trunk-jdk11 #87

2018-11-09 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-4277) creating ephemeral node already exist

2018-11-09 Thread Jonathan Santilli (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Santilli resolved KAFKA-4277. -- Resolution: Duplicate This is getting closed since KAFKA-7165 have been solved > creat

[jira] [Resolved] (KAFKA-5971) Broker keeps running even though not registered in ZK

2018-11-09 Thread Jonathan Santilli (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Santilli resolved KAFKA-5971. -- Resolution: Duplicate This is getting closed since KAFKA-7165 have been solved > Broke

Re: Permissions

2018-11-09 Thread Matthias J. Sax
Thanks for contribution! Check out https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes For writing a KIP, follow the instruction: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals Please share you Jira an Wiki account IDs (it's two separate ac

[ANNOUNCE] Apache Kafka 2.0.1

2018-11-09 Thread Manikumar
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.0.1 This is a bug fix release and it includes fixes and improvements from 51 JIRAs. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/2.0.1/RELEASE_NOTES.html Y

Re: [DISCUSS] KIP-388 Add observer interface to record request and response

2018-11-09 Thread Mayuresh Gharat
Hi Lincong, Thanks for the KIP. As Colin pointed out, would it better to expose certain specific pieces of information from the request/response like api key, request headers, record counts, client ID instead of the entire request/response objects ? This enables us to change the request response

RE: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

2018-11-09 Thread ChienHsing Wu
Just to check: Will anyone review this? It's been silent for a week... Thanks, ChienHsing From: ChienHsing Wu Sent: Monday, November 05, 2018 4:18 PM To: 'dev@kafka.apache.org' Subject: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer Hi I just put together the KI

[jira] [Resolved] (KAFKA-5255) Auto generate request/response classes

2018-11-09 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5255. Resolution: Duplicate There is a more recent ticket with a PR (KAFKA-7609) so closing as duplicate.

Permissions

2018-11-09 Thread kamal kaur
Hi, I would like to work on https://issues.apache.org/jira/browse/KAFKA-6812?jql=project%20%3D%20KAFKA%20AND%20text%20~%20%22console%20producer%20error%22 Please grant me permissions so I can write the KIP and then implement it. Since this will be my first contribution to Kafka, please let me kn