How to provide certificate chain/intermediate CA to kafka broker

2018-11-09 Thread Fang Xing
Hello, I'm looking for some instructions about setting SSL in Kafka with certificate chains. There is instruction about settings for broker certificate issued by a self-signed root CA, however I didn't find information related to certificate chain. If the chain is like this: root ca -> intermedia

Kafka streams consumer/producer throttling

2018-11-09 Thread Andrey Dyachkov
Hello, Could you tell me if there is a way to throttle kafka streams by client id? I’ve tried to set bandwidth limit for client id, which is specefied in kafka stream config, but it does not work. -- With great enthusiasm, Andrey

Custom Token Authentication Callback

2018-11-09 Thread ilter P
Hi, I am trying to build a custom sequence to authenticate the clients. According to documentation, I need to create 2 different Callback: sasl.login.callback.handler.class -> I am assuming this is for the first time connect request comes then I should create a JWT token inside this Callback sas

kafka.consumers Java Package

2018-11-09 Thread Chris Barlock
I was trying to move some of our Kafka client code from kafka_2.11_0.10.2.2 to kafka_2.11_2.0.0. However, we have some code that uses code in the kafka.consumer package. That appears to be either moved or removed from kafka_2.11_2.0.0. Is it gone or moved? Thanks! Chris

Re: kafka.consumers Java Package

2018-11-09 Thread Harsha Chintalapani
Chris,         You are upgrading from 0.10.2.2 to 2.0.0 . There will be quite few changes and it looks like you might be using classes other than KafkaConsumer which are not public API? What classes specifically are not available. -Harsha On Nov 9, 2018, 7:47 AM -0800, Chris Barlock , wrote: > I

Re: kafka.consumers Java Package

2018-11-09 Thread Eric Azama
The kafka.consumer package was the old scala consumer. The upgrade notes indicate that they were deprecated in 0.11 and removed in 2.0 On Fri, Nov 9, 2018 at 8:00 AM Harsha Chintalapani wrote: > Chris, > You are upgrading from 0.10.2.2 t

Re: kafka.consumers Java Package

2018-11-09 Thread Chris Barlock
Thank you! Chris From: Eric Azama To: users@kafka.apache.org Date: 11/09/2018 12:27 PM Subject:Re: kafka.consumers Java Package The kafka.consumer package was the old scala consumer. The upgrade notes < https://kafka.apache.org/documentation/#upgrade > indicate that they we

Re: How to provide certificate chain/intermediate CA to kafka broker

2018-11-09 Thread Rohan Rasane
Hi Fang, You will need to create a CSR using the Private Key, then get that CSR signed by your Certs team which should be able to add the root and intermediate certs in the signed certs. Then you will have to add them to your stores on the host. Let me know if you have any specific questions. -Ro

Re: How to provide certificate chain/intermediate CA to kafka broker

2018-11-09 Thread Fang Xing
Hi Rohan, Thanks for the quick response. I do have some troubles with providing certificate chain to brokers... This is how I set up keystore and truststore and provide them in server.properties 1. generate pkcs12 file for broker key/cert and cert chain kafka-key is broker's private key cert-sign

[ANNOUNCE] Apache Kafka 2.0.1

2018-11-09 Thread Manikumar
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.0.1 This is a bug fix release and it includes fixes and improvements from 51 JIRAs. All of the changes in this release can be found in the release notes: https://www.apache.org/dist/kafka/2.0.1/RELEASE_NOTES.html Y

Re: [ANNOUNCE] Apache Kafka 2.0.1

2018-11-09 Thread Jun Rao
Thanks for running the release, Mani! Jun On Fri, Nov 9, 2018 at 11:42 AM, Manikumar wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 2.0.1 > > This is a bug fix release and it includes fixes and improvements from 51 > JIRAs. > > All of the changes in th

[VOTE] 2.1.0 RC1

2018-11-09 Thread Dong Lin
Hello Kafka users, developers and client-developers, This is the second candidate for feature release of Apache Kafka 2.1.0. This is a major version release of Apache Kafka. It includes 28 new KIPs and critical bug fixes. Please see the Kafka 2.1.0 release plan for more details: *https://cwiki.

Re: [VOTE] 2.1.0 RC0

2018-11-09 Thread Dong Lin
Hey everyone, Thanks for your help with testing the release! It has taken us some time to validate the system tests for 2.1.0, fix flaky test and discuss/fix upgrade note. All these issues are resolved now. I have started another email thread to vote for 2.1.0 RC1. Please help test and vote for R

Re: How to provide certificate chain/intermediate CA to kafka broker

2018-11-09 Thread Martin Gainty
if you dont have a "certs team" you can purchase a Contract with Certificate Authority such as Verisign to handle signing X509 certs Once the certs are signed and stuffed into truststore(s) you will then be able to supply the x509 cert with public key from CA to your clients Martin __