Apache Kafka Cluster Setup

Hi all, I want setup a Kafka cluster in a production environment. During latest years I've worked with Solr user and, comparing the Kafka with Solr, it would be wonderful if even Kafka had an administration console where see what's happening. Looking around I've found this: https://github.com/y

Getting Timed out reading socket error for kafka cluster setup

Hi, I want to setup a kafka cluster type setup for three similar application having same queues like AppA -> {TopicX, TopicY, TopicZ}, AppB -> {TopicX, TopicZ}, AppC -> {TopicX, TopicY}. Producer and Consumer will be App specific. I setup kafka cluster with three brokers having partition 1,2,3 in

Re: multi-node and multi-broker kafka cluster setup

r doesn’t have to be the server hosting the kafka, but >> some >> >> tutorial says I should install zookeeper on each kafka node. >> >> >> >> Here is my plan: >> >> - I have three nodes: kfServer1, kfserver2, kfserver3, >> >> - kfserv

Re: multi-node and multi-broker kafka cluster setup

ne. > >> zk.connect=kfserver1:2181,kfserver2:2181 > >> - broker1, broker2, broker3 are in kfserver1, > >> broker4, broker5, broker6 are on kfserver2, > >> broker7, broker8, broker9 are on kfserver3. > >> > >> When I am configuring, the zk DataDir is in local directory of each > node, > >> instead located at the zk ensemble directory, is that correct? So far, I > >> couldnot make above scheme working, anyone have ever made multi-node and > >> multi-broker kafka cluster setup? > >> > >> thanks > >> > >> Alec > > > > > > -- > > -- Guozhang > -- Alec Li

Re: multi-node and multi-broker kafka cluster setup

kfserver2:2181 >> - broker1, broker2, broker3 are in kfserver1, >> broker4, broker5, broker6 are on kfserver2, >> broker7, broker8, broker9 are on kfserver3. >> >> When I am configuring, the zk DataDir is in local directory of each node, >>

Re: multi-node and multi-broker kafka cluster setup

located at the zk ensemble directory, is that correct? So far, I > couldnot make above scheme working, anyone have ever made multi-node and > multi-broker kafka cluster setup? > > thanks > > Alec > > > -- -- Guozhang

multi-node and multi-broker kafka cluster setup

ever made multi-node and multi-broker kafka cluster setup? thanks Alec

Re: Kafka cluster setup

Hi Raj There is a Quickstart document for setting up, single and multi-broker Kafka clusters. It doesn't include multi node ZK cluster setup though. You can find that in the ZK docs

Kafka cluster setup

Sorry for the spam. I am new to apache kafka. Can someone point me to kafka cluster installation document. I am planning to set up a 3 node ZK quorum and 10 broker cluster. Thanks, Raj Tanneru