Kafka 0.8.2.1 Topic List

2016-02-14 Thread Joe San
I'm using the following command to start the broker and create the topic: bin/kafka-server-start.sh config/server.properties & bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic read-singnals Prior to doing this, I start zoo keeper: bin/zookeepe

Apache Kafka 0.8.2 Zookeeper Reconnect

2016-02-14 Thread Joe San
: 20160214-16:58:10.983+0100 [tsdb-kafka-consumer-akka.actor.default-dispatcher-2-SendThread( 127.0.0.1:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 20160214-16:58:10.984+0100

SSL Mirror Maker

2016-02-14 Thread Lee Hyunjung
Hi, I've set up broker ssl successfully. Here is the detail. *[broker]* 1. run shell script (generate ssl key, certificate and CA and sign the certificate) 2. here is server.properties on brokers. listeners=PLAINTEXT://:9092,SSL://:9093 ssl.keystore.location=/opt/kafka/keys/server.keystore.jks

Re: SSL Mirror Maker

2016-02-14 Thread Ismael Juma
Hi Lee, Is the CA used to sign the client certificates in the server truststore and the CA used to sign the server certificates in the client truststore? See the following blog post for a working example (including a Vagrant setup): http://www.confluent.io/blog/apache-kafka-security-authorization

increase replication factor of a topic

2016-02-14 Thread Nikhil Bhaware
Hi, I have 6 node kafka cluster on which i created topic with 3 replication-factor and 1000 partitions.now i want to increase replication factor. is there any way i can increase replication factor to 5? using kafka 0.8.2.1 -- Regards , Nikhil Bhaware M.Tech (CSE) NIT Warangal,India

Kafka advice for small startup

2016-02-14 Thread Kyle Mathews
Hi I'm the technical co-founder of a startup in San Francisco and I've been investigating using Kafka for some time. I'm thinking about biting the bullet and integrating it soon into our system. My main concern is how much operational overhead it'll add. I'm the only engineer right now and am alre

Re: Kafka advice for small startup

2016-02-14 Thread philip.otoole
I've built both large and small systems with Kafka. It's not difficult to set up, and works like a charm. It should be the least of your worries, in my experience. Philip  - http://www.philipotoole.com On Sunday, February 14, 2016 4:07 PM, Kyle Mathew

Re: Kafka advice for small startup

2016-02-14 Thread philip.otoole
Just to be clear, Kafka is not something that needs babysitting. It just works (in the good way).  - http://www.philipotoole.com On Sunday, February 14, 2016 4:17 PM, "philip.oto...@yahoo.com.INVALID" wrote: I've built both large and small system

Re: Kafka advice for small startup

2016-02-14 Thread Todd Snyder
So long as you put some basic monitoring in place, it should run nicely with very little intervention and let you be confident everything is as it should be. Key things to watch: * disk space - a disk filling up really makes things difficult for you. Make sure your retention fits your footprint

答复: NoAuth for /controller

2016-02-14 Thread 赵景波
Can you help me? ___ JingBo Zhao �C 赵景波 jing...@staff.sina.com.cn 研发中心 - 平台架构部 - 数据库平台 - DBA (手机)18610917066 Add.: 北京市海淀区北四环西路58号理想国际大厦17层 ___

Consumption from some of the partitions stops after rebalancing of partitions with kafka 0.9

2016-02-14 Thread Anurag Laddha
Greetings I have created a consumer using kafka 0.9 When one or more *new* consumers are added to an existing consumer group it causes partitions to get rebalanced (as expected) *Issue*: - After rebalancing, all the partitions of the topic get assigned to one of the consumers in the group (again,