Re: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol

2019-05-21 Thread Boyang Chen
Thank you Guozhang for all the hard work. +1 (non-binding) From: Guozhang Wang Sent: Wednesday, May 22, 2019 1:32 AM To: dev Subject: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol Hello folks, I'd like to start the voting for KIP-429 now, detail

Build failed in Jenkins: kafka-2.3-jdk8 #4

2019-05-21 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-8315: fix the JoinWindows retention deprecation doc (#6664) [rajinisivaram] KAFKA-8052; Ensure fetch session epoch is updated before new request [jason] MINOR: A few logging improvemen

Build failed in Jenkins: kafka-trunk-jdk11 #558

2019-05-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: A few logging improvements in the broker (#6773) [jason] MINOR: Set `replicaId` for OffsetsForLeaderEpoch from followers (#6775) -- [...trunc

Build failed in Jenkins: kafka-trunk-jdk8 #3664

2019-05-21 Thread Apache Jenkins Server
See Changes: [github] KAFKA-8052; Ensure fetch session epoch is updated before new request [github] MINOR: A few logging improvements in the broker (#6773) [jason] MINOR: Set `replicaId` for OffsetsForLeaderEpo

[jira] [Created] (KAFKA-8405) Remove deprecated preferred leader RPC and Command

2019-05-21 Thread Jose Armando Garcia Sancio (JIRA)
Jose Armando Garcia Sancio created KAFKA-8405: - Summary: Remove deprecated preferred leader RPC and Command Key: KAFKA-8405 URL: https://issues.apache.org/jira/browse/KAFKA-8405 Project: Ka

Re: [VOTE] KIP-455: Create an Administrative API for Replica Reassignment

2019-05-21 Thread George Li
Hi Colin,    Great! Looking forward to these features.    +1 (non-binding) What is the estimated timeline to have this implemented?  If any help is needed in the implementation of cancelling reassignments,  I can help if there is spare cycle.  Thanks, George On Thursday, May 16, 2019,

Build failed in Jenkins: kafka-trunk-jdk11 #557

2019-05-21 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-8315: fix the JoinWindows retention deprecation doc (#6664) [github] KAFKA-8052; Ensure fetch session epoch is updated before new request --

Build failed in Jenkins: kafka-trunk-jdk8 #3663

2019-05-21 Thread Apache Jenkins Server
See Changes: [rhauch] KAFKA-8265: Fix override config name to match KIP-458. (#6776) [wangguoz] KAFKA-8315: fix the JoinWindows retention deprecation doc (#6664) -- [...t

Build failed in Jenkins: kafka-2.3-jdk8 #3

2019-05-21 Thread Apache Jenkins Server
See Changes: [manikumar] KAFKA-3143: Controller should transition offline replicas on startup -- [...truncated 2.91 MB...] kafka.security.auth.SimpleAclAuthorizerTest > testD

[jira] [Resolved] (KAFKA-7565) NPE in KafkaConsumer

2019-05-21 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7565. --- Resolution: Duplicate Fix Version/s: 2.3.0 > NPE in KafkaConsumer > --

[jira] [Resolved] (KAFKA-8052) Intermittent INVALID_FETCH_SESSION_EPOCH error on FETCH request

2019-05-21 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-8052. --- Resolution: Fixed Reviewer: Jason Gustafson Fix Version/s: 2.3.0 > Intermitte

Build failed in Jenkins: kafka-trunk-jdk11 #556

2019-05-21 Thread Apache Jenkins Server
See Changes: [rhauch] KAFKA-8265: Fix override config name to match KIP-458. (#6776) -- [...truncated 2.50 MB...] org.apache.kafka.trogdor.workload.PayloadGeneratorTest >

[jira] [Created] (KAFKA-8404) Authorization header is not passed in Connect when forwarding REST requests

2019-05-21 Thread Robert Yokota (JIRA)
Robert Yokota created KAFKA-8404: Summary: Authorization header is not passed in Connect when forwarding REST requests Key: KAFKA-8404 URL: https://issues.apache.org/jira/browse/KAFKA-8404 Project: Ka

Build failed in Jenkins: kafka-trunk-jdk8 #3662

2019-05-21 Thread Apache Jenkins Server
See Changes: [manikumar] KAFKA-3143: Controller should transition offline replicas on startup -- [...truncated 2.46 MB...] org.apache.kafka.streams.scala.kstream.Consumed

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-05-21 Thread Sophie Blee-Goldman
I definitely agree with Guozhang's "meta" comment: if it's possible to allow users to pick and choose individual RocksDB metrics that would be ideal. One further question is whether these will be debug or info level metrics, or a separate level altogether? If there is a nontrivial overhead associat

[VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol

2019-05-21 Thread Guozhang Wang
Hello folks, I'd like to start the voting for KIP-429 now, details can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-429%3A+Kafka+Consumer+Incremental+Rebalance+Protocol#KIP-429:KafkaConsumerIncrementalRebalanceProtocol-RebalanceCallbackErrorHandling And the on-going PRs a

To add in contributors list

2019-05-21 Thread omkar mestry
Hello, My name is Omkar Mahadev Mestry and I am a java developer, currently working on java and kafka streams. I have been working with kafka and would like to contribute to kafka community. Please add me in the contributors list so that I can start working with JIRA. I have attached my resume as

Build failed in Jenkins: kafka-trunk-jdk11 #555

2019-05-21 Thread Apache Jenkins Server
See Changes: [manikumar] KAFKA-3143: Controller should transition offline replicas on startup -- [...truncated 2.46 MB...] kafka.controller.ControllerEventManagerTest > te

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-05-21 Thread Guozhang Wang
Hello Bruno, Thanks for the KIP, I have a few minor comments and a meta one which are relatively aligned with other folks: Minor: 1) Regarding the "rocksdb-state-id = [store ID]", to be consistent with other state store metrics (see https://cwiki.apache.org/confluence/display/KAFKA/KIP-444%3A+Au

[jira] [Created] (KAFKA-8403) Suppress needs a Materialized variant

2019-05-21 Thread John Roesler (JIRA)
John Roesler created KAFKA-8403: --- Summary: Suppress needs a Materialized variant Key: KAFKA-8403 URL: https://issues.apache.org/jira/browse/KAFKA-8403 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-8152) Offline partition state not propagated by controller

2019-05-21 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-8152. -- Resolution: Duplicate > Offline partition state not propagated by controller >

[jira] [Resolved] (KAFKA-3143) inconsistent state in ZK when all replicas are dead

2019-05-21 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3143. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 5041 [https://github.com/a

Re: [DISCUSS] KIP-471: Expose RocksDB Metrics in Kafka Streams

2019-05-21 Thread Dongjin Lee
Hi Bruno, I just read the KIP. I think this feature is great. As far as I know, most Kafka users monitor the host resources, JVM resources, and Kafka metrics only, not RocksDB for configuring the statistics feature is a little bit tiresome. Since RocksDB impacts the performance of Kafka Streams, I

[jira] [Created] (KAFKA-8402) bin/kafka-preferred-replica-election.sh fails if generated json is bigger than 1MB

2019-05-21 Thread Vyacheslav Stepanov (JIRA)
Vyacheslav Stepanov created KAFKA-8402: -- Summary: bin/kafka-preferred-replica-election.sh fails if generated json is bigger than 1MB Key: KAFKA-8402 URL: https://issues.apache.org/jira/browse/KAFKA-8402

[jira] [Resolved] (KAFKA-8320) Connect Error handling is using the RetriableException from common package

2019-05-21 Thread Randall Hauch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-8320. -- Resolution: Fixed Fix Version/s: 2.2.1 2.1.2 2.3.0

Re: [DISCUSS] KIP-317: Transparent Data Encryption

2019-05-21 Thread Sönke Liebau
Hi everybody, I'd like to rekindle the discussion around KIP-317. I have reworked the KIP a little bit in order to design everything as a pluggable implementation. During the course of that work I've also decided to rename the KIP, as encryption will only be transparent in some cases. It is now ca

[jira] [Created] (KAFKA-8401) consumer.poll(Duration.ofMillis(100)) blocking

2019-05-21 Thread leishuiyu (JIRA)
leishuiyu created KAFKA-8401: Summary: consumer.poll(Duration.ofMillis(100)) blocking Key: KAFKA-8401 URL: https://issues.apache.org/jira/browse/KAFKA-8401 Project: Kafka Issue Type: Bug

Re: [VOTE] 2.2.1 RC1

2019-05-21 Thread Jakub Scholz
+1 (non-binding) ... I used the binaries and run tests with different clients. All seems to work fine. On Tue, May 14, 2019 at 5:15 AM Vahid Hashemian wrote: > Hello Kafka users, developers and client-developers, > > This is the second candidate for release of Apache Kafka 2.2.1. > > Compared to

Re: v2 ProduceResponse documentation wrong?

2019-05-21 Thread Graeme Jenkinson
Looking at the protocol doc again I think it may just be a misunderstanding on my part. Graeme > On 20 May 2019, at 19:58, Graeme Jenkinson wrote: > > Hi, > > on parsing the a v2 ProduceResponse from Kafka I am seeing a discrepancy from > the documentation. Specifically the base_offset and l