Re: Request for permissions to add KIP for user shnguyen

2018-11-19 Thread Matthias J. Sax
Done. On 11/19/18 8:46 PM, Shawn Nguyen wrote: > Hey folks, > Any chance I could get permissions to add a KIP > ? > > > Thanks a bunch, > Shawn > > On Fri, Nov 16, 2018 a

Build failed in Jenkins: kafka-trunk-jdk8 #3208

2018-11-19 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-6567: Remove KStreamWindowReducer (#5922) -- [...truncated 2.58 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldPassIfValueA

[jira] [Created] (KAFKA-7658) Add KStream#toTable to the Streams DSL

2018-11-19 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-7658: Summary: Add KStream#toTable to the Streams DSL Key: KAFKA-7658 URL: https://issues.apache.org/jira/browse/KAFKA-7658 Project: Kafka Issue Type: Improvement

Jenkins build is back to normal : kafka-trunk-jdk8 #3207

2018-11-19 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-7657) Invalid reporting of StreamState in KafkaStreams application

2018-11-19 Thread Thomas Crowley (JIRA)
Thomas Crowley created KAFKA-7657: - Summary: Invalid reporting of StreamState in KafkaStreams application Key: KAFKA-7657 URL: https://issues.apache.org/jira/browse/KAFKA-7657 Project: Kafka

Re: Request for permissions to add KIP for user shnguyen

2018-11-19 Thread Shawn Nguyen
Hey folks, Any chance I could get permissions to add a KIP ? Thanks a bunch, Shawn On Fri, Nov 16, 2018 at 2:54 PM Shawn Nguyen wrote: > Hi there, > Can you grant me per

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-11-19 Thread Ryanne Dolan
Dan, you've got it right. ACL sync will be done by MM2 automatically (unless disabled) according to simple rules: - If a principal has READ access on a topic in a source cluster, the same principal should have READ access on downstream replicated topics ("remote topics"). - Only MM2 has WRITE acce

Re: [DISCUSS] KIP-258: Allow to Store Record Timestamps in RocksDB

2018-11-19 Thread Adam Bellemare
Hi Matthias Thanks - I figured that it was probably a case of just too much to do and not enough time. I know how that can go. I am asking about this one in relation to https://issues.apache.org/jira/browse/KAFKA-4212, adding a TTL to RocksDB. I have outlined a bit about my use-case within 4212, b

Re: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

2018-11-19 Thread Matt Farmer
Hi there, Thanks for the KIP. We’ve run into issues with this at Mailchimp so something to address consuming behavior would save us from having to always ensure we’re running enough consumers that each consumer has only one partition (which is our usual MO). I wonder though if it would be simple

Re: [Discuss] KIP-389: Enforce group.max.size to cap member metadata growth

2018-11-19 Thread Matt Farmer
Thanks for the KIP. Will this cap be a global cap across the entire cluster or per broker? Either way the default value seems a bit high to me, but that could just be from my own usage patterns. I’d have probably started with 500 or 1k but could be easily convinced that’s wrong. Thanks, Matt On

[Discuss] KIP-389: Enforce group.max.size to cap member metadata growth

2018-11-19 Thread Boyang Chen
Hey folks, I would like to start a discussion on KIP-389: https://cwiki.apache.org/confluence/display/KAFKA/KIP-389%3A+Enforce+group.max.size+to+cap+member+metadata+growth This is a pretty simple change to cap the consumer group size for broker stability. Give me your valuable feedback when y

Re: [DISCUSS] KIP-382: MirrorMaker 2.0

2018-11-19 Thread daniel . locious
Hi guys, This is an exciting topic. could I have a word here? I understand there are many scenarios that we can apply mirrormaker. I am at the moment working on active/active DC solution using MirrorMaker; our goal is to allow the clients to failover to connect the other kafka cluster (on the

[jira] [Created] (KAFKA-7656) ReplicaManager fetch fails on leader due to long/integer overflow

2018-11-19 Thread Patrick Haas (JIRA)
Patrick Haas created KAFKA-7656: --- Summary: ReplicaManager fetch fails on leader due to long/integer overflow Key: KAFKA-7656 URL: https://issues.apache.org/jira/browse/KAFKA-7656 Project: Kafka

[jira] [Resolved] (KAFKA-764) Race Condition in Broker Registration after ZooKeeper disconnect

2018-11-19 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-764. - Resolution: Duplicate This old issue is similar to KAFKA-7165. Closing this as duplicate KAFKA-7165 > Rac

Re: [VOTE] 2.1.0 RC1

2018-11-19 Thread Dong Lin
Hey Ismael, I checked out a clean copy of Kafka and reuploaded artifacts for 2.1.0-rc1 without code change. There are still those new files in https://repository.apache.org/content/groups/staging/org/apache/kafka/kafka_2.12/2.1.0. I compared 2.0 and 2.1 branch but did not find any suspicious chang

[jira] [Resolved] (KAFKA-7323) add replication factor doesn't work

2018-11-19 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7323. -- Resolution: Not A Problem Closing as per above comment. probably heap memory is not sufficient. Please

[jira] [Resolved] (KAFKA-7554) zookeeper.session.timeout.ms Value

2018-11-19 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7554. -- Resolution: Not A Problem Default Zookeeper session timeout value 6 seconds. If the server fails to he

[jira] [Created] (KAFKA-7655) Metadata spamming requests from Kafka Streams under some circumstances, potential DOS

2018-11-19 Thread Pasquale Vazzana (JIRA)
Pasquale Vazzana created KAFKA-7655: --- Summary: Metadata spamming requests from Kafka Streams under some circumstances, potential DOS Key: KAFKA-7655 URL: https://issues.apache.org/jira/browse/KAFKA-7655

RE: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer

2018-11-19 Thread ChienHsing Wu
Hi, could anyone please review this KIP? Thanks, ChienHsing From: ChienHsing Wu Sent: Friday, November 09, 2018 1:10 PM To: dev@kafka.apache.org Subject: RE: [DISCUSS] KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer Just to check: Will anyone review this? It's been silent f

[jira] [Created] (KAFKA-7654) Relax requirements on serializing-only methods.

2018-11-19 Thread Bruno Bieth (JIRA)
Bruno Bieth created KAFKA-7654: -- Summary: Relax requirements on serializing-only methods. Key: KAFKA-7654 URL: https://issues.apache.org/jira/browse/KAFKA-7654 Project: Kafka Issue Type: Improve

Re: [VOTE] 2.1.0 RC1

2018-11-19 Thread Dong Lin
Hey Ismael, Thanks much for catching this! Sorry I didn't catch this issue before. These files were uploaded by release.py scrip in the repo. kafka_2.12-2.1.0.mapping contains the following string and the other files are the signature and hash of the file kafka_2.12-2.1.0.mapping: /home/dolin/re

Re: [VOTE] 2.1.0 RC1

2018-11-19 Thread Ismael Juma
Hi Dong, I was looking through the Maven repository for 2.1.0 and there are some weird files there that didn't exist in 2.0.1: kafka_2.12-2.1.0.mapping Fri Nov 09 23:08:52 UTC 2018 198 kafka_2.12-2.1.0.mapping.asc Fri Nov 09 23:09:03 UTC 2018 821 kafka_2.12-2.1.0.mapping.asc.md5 Fri Nov 09 23:09: