JMX Port Conflict when starting both Broker and kafka Connect

2018-11-30 Thread harish lohar
Hi , I am trying to use kafkaConnect for mongdb-source-connector I am using connect-distributed.sh. When i start kafka with KAFKA_JMX_OPTS, kafka broker starts fine but as soon as kafka connect is started it gives javaagent:./jmx_prometheus_javaagent-0.6.jar=7071:./kafka-0-8-2.yml" address alre

Re: Very long consumer rebalances

2018-07-09 Thread harish lohar
Try reducing below timer metadata.max.age.ms = 30 On Fri, Jul 6, 2018 at 5:55 AM Shantanu Deshmukh wrote: > Hello everyone, > > We are running a 3 broker Kafka 0.10.0.1 cluster. We have a java app which > spawns many consumer threads consuming from different topics. For every > topic we hav

Whats the Kafka Broker Behavior when ZooKeeperCluster is DOWN

2018-06-27 Thread harish lohar
Hi All, In a 3 Node Zookeeper cluster if 2 Nodes goes down but Zookeeper to which Kafka broker is up, what is expected ?? Is kafka borker expected to go down ?? or only the new operations will fail. Thanks Harish

Re: kafka Broker Znode TTL

2018-06-12 Thread harish lohar
will be removed . > > > > > -- 原始邮件 ------ > 发件人: "harish lohar"; > 发送时间: 2018年6月7日(星期四) 晚上11:41 > 收件人: "users"; > 主题: kafka Broker Znode TTL > > > > Do Kafka Broker has configuration to specify TTL for kafka broker znodes > such /broker

kafka Broker Znode TTL

2018-06-07 Thread harish lohar
Do Kafka Broker has configuration to specify TTL for kafka broker znodes such /broker/ids/ This is useful in case zookeeper cluster goes down and kafka broker re-registers , in that case it fails to start as Zookeeper already has the same broker id registered. Thanks Harish