kafka-consumer-groups.sh with ssl

2017-07-26 Thread Gabriel Machado
Hi, I use kafka_2.11-0.10.0.1 with ssl. I try to see lag between consummers and producers with the kafka-consumer-groups.sh script. #bin/kafka-consumer-groups.sh --new-consumer --bootstrap-server myserver:9092 --list Error while executing consumer group command Java heap space java.lang.OutOfMemo

Re: kafka-consumer-groups tool with SASL_PLAINTEXT

2017-07-28 Thread Gabriel Machado
Hi Vahid, Do you know how to use consumer-group tool with ssl only (without sasl) ? Gabriel. Le 24 juil. 2017 11:15 PM, "Vahid S Hashemian" a écrit : Hi Meghana, I did some experiments with SASL_PLAINTEXT and documented the results here: https://developer.ibm.com/opentech/2017/05/31/kafka-ac

Re: kafka-consumer-groups tool with SASL_PLAINTEXT

2017-07-31 Thread Gabriel Machado
with? > > Thanks. > --Vahid > > > > > From: Gabriel Machado > To: users@kafka.apache.org > Date: 07/28/2017 08:40 AM > Subject:Re: kafka-consumer-groups tool with SASL_PLAINTEXT > > > > Hi Vahid, > > Do you know how to use consumer-gro

Re: kafka-consumer-groups tool with SASL_PLAINTEXT

2017-08-07 Thread Gabriel Machado
urity.protocol=SSL > >>ssl.truststore.location=/var/private/ssl/client.truststore.jks > >>ssl.truststore.password=test1234 > > http://kafka.apache.org/documentation.html#security_configclients > > On Mon, Jul 31, 2017 at 1:22 PM, Gabriel Machado > wrote: > > > Thank you for

Avoid jvm swapping

2017-08-07 Thread Gabriel Machado
Hi, I have a 3 nodes cluster with 18 GB RAM and 2 GB swap. Each node have the following JVMs (Xms=Xmx) : - Zookeeper 2GB - Kafka 12 GB - Kafka mirror-maker DCa 1 GB - Kafka mirror-maker DCb 1 GB All th JVMs consume 16 GB. It leaves 2 GB for the OS (debian jessie 64 bits). Why i have no swap free

Re: Avoid jvm swapping

2017-08-07 Thread Gabriel Machado
and cache > in order to get better performance from consumers. You can see from that > output that it's trying to. > > It really looks like you're just overloading your system. In which case > swapping is to be expected. > > -Todd > > > > On Aug 7, 2017 8

Re: Querying consumer groups programmatically (from Golang)

2017-08-16 Thread Gabriel Machado
Hi Jens and Ian, Very usefuls projects :). What's the difference between the 2 softwares ? Do they support kafka ssl clusters ? Thanks, Gabriel. 2017-08-13 3:29 GMT+02:00 Ian Duffy : > Hi Jens, > > We did something similar to this at Zalando. > > https://github.com/zalando-incubator/remora > >

Re: Querying consumer groups programmatically (from Golang)

2017-08-18 Thread Gabriel Machado
Hello, Could you tell me if burrow or remora is compatible with ssl kafka clusters ? Gabriel. 2017-08-16 15:39 GMT+02:00 Gabriel Machado : > Hi Jens and Ian, > > Very usefuls projects :). > What's the difference between the 2 softwares ? > Do they support kafka ssl c