Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

2018-02-21 Thread Gwen Shapira
Re: Why would anyone want to delete partitions: Imagine a system that is built to handle 200K events per sec most of the time, but they have 2-4 days per year where traffic spikes to 11M events per sec. We'll almost certainly need more partitions (and more consumers) during the spike to process al

Re: [DISCUSS] KIP-255: OAuth Authentication via SASL/OAUTHBEARER

2018-02-21 Thread Ron Dagostino
Hi everyone. I implemented the ability to perform substitution in JAAS config module options, which was the only part of KIP 255 that was not implemented when I originally published the KIP last week. I have made adjustments to that section of the KIP based on this implementation experience, incl

Build failed in Jenkins: kafka-trunk-jdk7 #3204

2018-02-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix Streams-Broker-Compatibility system test (#4594) -- [...truncated 415.36 KB...] kafka.zk.KafkaZkClientTest > testTopicAssignmentMethods PA

Build failed in Jenkins: kafka-trunk-jdk8 #2429

2018-02-21 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix Streams-Broker-Compatibility system test (#4594) -- [...truncated 1.86 MB...] org.apache.kafka.streams.processor.internals.ProcessorStateM

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

2018-02-21 Thread vito jeng
Matthias, Sorry for not response these days. I just finished it. Please have a look. :) --- Vito On Wed, Feb 14, 2018 at 5:45 AM, Matthias J. Sax wrote: > Is there any update on this KIP? > > -Matthias > > On 1/3/18 12:59 AM, vito jeng wrote: > > Matthias, > > > > Thank you for your response

[jira] [Created] (KAFKA-6580) Connect bin scripts have incorrect usage

2018-02-21 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-6580: Summary: Connect bin scripts have incorrect usage Key: KAFKA-6580 URL: https://issues.apache.org/jira/browse/KAFKA-6580 Project: Kafka Issue

[VOTE] 1.0.1 RC2

2018-02-21 Thread Ewen Cheslack-Postava
Hello Kafka users, developers and client-developers, This is the third candidate for release of Apache Kafka 1.0.1. This is a bugfix release for the 1.0 branch that was first released with 1.0.0 about 3 months ago. We've fixed 49 issues since that release. Most of these are non-critical, but in a

[jira] [Created] (KAFKA-6576) Configurable Quota Management (KIP-257)

2018-02-21 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-6576: - Summary: Configurable Quota Management (KIP-257) Key: KAFKA-6576 URL: https://issues.apache.org/jira/browse/KAFKA-6576 Project: Kafka Issue Type: New Featu

Jenkins build is back to normal : kafka-trunk-jdk8 #2428

2018-02-21 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-6579) Consolidate window store and session store unit tests into a single class

2018-02-21 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-6579: Summary: Consolidate window store and session store unit tests into a single class Key: KAFKA-6579 URL: https://issues.apache.org/jira/browse/KAFKA-6579 Project: Kafk

Jenkins build is back to normal : kafka-1.1-jdk7 #57

2018-02-21 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-0.11.0-jdk7 #359

2018-02-21 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-trunk-jdk9 #423

2018-02-21 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-6577) Connect standalone SASL file source and sink test fails without explanation

2018-02-21 Thread Randall Hauch (JIRA)
Randall Hauch created KAFKA-6577: Summary: Connect standalone SASL file source and sink test fails without explanation Key: KAFKA-6577 URL: https://issues.apache.org/jira/browse/KAFKA-6577 Project: Ka

[jira] [Created] (KAFKA-6578) Connect distributed and standalone worker 'main()' methods should catch and log all exceptions

2018-02-21 Thread Randall Hauch (JIRA)
Randall Hauch created KAFKA-6578: Summary: Connect distributed and standalone worker 'main()' methods should catch and log all exceptions Key: KAFKA-6578 URL: https://issues.apache.org/jira/browse/KAFKA-6578

Jenkins build is back to normal : kafka-1.0-jdk7 #158

2018-02-21 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-2796) add support for reassignment partition to specified logdir

2018-02-21 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2796. -- Resolution: Fixed Fixed in KIP-113 (KAFKA-5163/KAFKA-5694) > add support for reassignment partition to

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

2018-02-21 Thread Jun Rao
Hi, Dong, Thanks for the KIP. At the high level, this makes sense. A few comments below. 1. It would be useful to support removing partitions as well. The general idea could be bumping the leader epoch for the remaining partitions. For the partitions to be removed, we can make them read-only and

Build failed in Jenkins: kafka-trunk-jdk7 #3203

2018-02-21 Thread Apache Jenkins Server
See Changes: [me] MINOR: Cancel port forwarding for HttpMetricsCollector during cleanup -- [...truncated 409.51 KB...] kafka.coordinator.transaction.TransactionCoordinato

[jira] [Resolved] (KAFKA-2553) Kafka Consumer Hangs after Network Partition

2018-02-21 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-2553. -- Resolution: Fixed Similar issues are in KAFKA-2169. Pl reopen if the issue still exists > Kafka Consume

[DISCUSS] KIP-257 - Configurable Quota Management

2018-02-21 Thread Rajini Sivaram
Hi all, I have submitted KIP-257 to enable customisation of client quota computation: https://cwiki.apache.org/confluence/display/KAFKA/KIP-257+-+Configurable+Quota+Management The KIP proposes to make quota management pluggable to enable group-based and partition-based quotas for clients. Feed

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

2018-02-21 Thread Dong Lin
Hey Jun, Thanks much for your comments. On Wed, Feb 21, 2018 at 10:17 AM, Jun Rao wrote: > Hi, Dong, > > Thanks for the KIP. At the high level, this makes sense. A few comments > below. > > 1. It would be useful to support removing partitions as well. The general > idea could be bumping the lea

FINAL REMINDER: CFP for Apache EU Roadshow Closes 25th February

2018-02-21 Thread Sharan F
Hello Apache Supporters and Enthusiasts This is your FINAL reminder that the Call for Papers (CFP) for the Apache EU Roadshow is closing soon. Our Apache EU Roadshow will focus on Cloud, IoT, Apache Tomcat, Apache Http and will run from 13-14 June 2018 in Berlin. Note that the CFP deadline has

[jira] [Resolved] (KAFKA-902) Randomize backoff on the clients for metadata requests

2018-02-21 Thread Manikumar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-902. - Resolution: Fixed Resolving this Duplicate of KAFKA-3878. Pls reopen if you think otherwise. > Randomize b

[jira] [Resolved] (KAFKA-6573) KafkaController.brokerInfo not updated on dynamic update

2018-02-21 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6573. Resolution: Fixed > KafkaController.brokerInfo not updated on dynamic update > -

[jira] [Resolved] (KAFKA-6575) Unhandled exception "NoRouteToHostException: No route to host"

2018-02-21 Thread Sergey Romanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Romanov resolved KAFKA-6575. --- Resolution: Won't Fix > Unhandled exception "NoRouteToHostException: No route to host" >

[jira] [Created] (KAFKA-6575) Unhandled exception "NoRouteToHostException: No route to host"

2018-02-21 Thread Sergey Romanov (JIRA)
Sergey Romanov created KAFKA-6575: - Summary: Unhandled exception "NoRouteToHostException: No route to host" Key: KAFKA-6575 URL: https://issues.apache.org/jira/browse/KAFKA-6575 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #2426

2018-02-21 Thread Apache Jenkins Server
See Changes: [damian.guy] KAFKA-6238; Fix inter-broker protocol message format compatibility check -- [...truncated 416.43 KB...] kafka.zookeeper.ZooKeeperClientTest > te

Re: Do the Jackson security vulnerabilities affect Kafka at all?

2018-02-21 Thread Jeff Widman
My bad, I forgot I had checked out the 1.0.1 source which has Jackson 2.9.1... I thought the fix required 2.9.3 based on what I'd been told by the security team at a customer (the original motivation behind my email), but I dug a bit deeper and it looks like 2.9.1 has the patch