Reg Kafka Replication

2014-06-29 Thread Balasubramanian Jayaraman
Hi, I have created a topic with the number of partitions as 5 and replication factor as 3. I have 5 Kafka brokers up and running. What happens if a broker with broker id '0' is down ? My observation is as follows. 1. The brokers are running as before and responding to the producers as

RE: Reg Broker information.

2014-06-29 Thread Balasubramanian Jayaraman
: [0, 1, 2, 3, 4] where items are broker ids you can further use to issue "get" request to ZK: get /brokers/ids/ 2014-06-26 12:37 GMT+04:00 Balasubramanian Jayaraman < balasubramanian.jayara...@autodesk.com>: > Hi, > > I used the command (bin/zookeeper-shell.sh 0.0.0.0:

RE: Reg Broker information.

2014-06-26 Thread Balasubramanian Jayaraman
en nodes? On Wed, Jun 25, 2014 at 7:29 PM, Balasubramanian Jayaraman < balasubramanian.jayara...@autodesk.com> wrote: > Hi, > > Currently we have the command (/brokers/ids/0) to get the individual > broker registration information. > How do I get all the registered brokers from the zookeeper. > > Thanks > Bala > >

Reg Broker information.

2014-06-25 Thread Balasubramanian Jayaraman
Hi, Currently we have the command (/brokers/ids/0) to get the individual broker registration information. How do I get all the registered brokers from the zookeeper. Thanks Bala

RE: Reg Partition

2014-03-09 Thread Balasubramanian Jayaraman (Contingent)
configure your topic to have enough partitions that you can achieve the required parallelism? That's what partitions are for. Martin On 6 Mar 2014, at 01:19, Balasubramanian Jayaraman (Contingent) wrote: > Thanks Martin. > I got it. The design is considered for Performance improve

RE: Reg Partition

2014-03-05 Thread Balasubramanian Jayaraman (Contingent)
artin On 5 Mar 2014, at 10:13, Balasubramanian Jayaraman (Contingent) wrote: > Hi > > I have a doubt on the parallelism. Why the number of parallel consumer > consuming messages from a topic is restricted on the number of partitions > configured for a topic? > Why should

Reg Partition

2014-03-05 Thread Balasubramanian Jayaraman (Contingent)
Hi I have a doubt on the parallelism. Why the number of parallel consumer consuming messages from a topic is restricted on the number of partitions configured for a topic? Why should this be the case. Why should the partition affect the number of parallel consumers? Thanks Bala

Reg Partition and Replica?

2014-02-26 Thread Balasubramanian Jayaraman (Contingent)
Hi, I have a doubt regarding to Partition and replica. What is the difference between them? I created a topic "test1" with 5 partition and 3 replicas. I am sending a message to the topic "test1". I see that different partitions are present in the different Kafka brokers. Some questions on this

RE: Reg Exception in Kafka

2014-02-23 Thread Balasubramanian Jayaraman (Contingent)
: users@kafka.apache.org Subject: Re: Reg Exception in Kafka Maybe you need to add the port to the right security group? Thanks, Jun On Thu, Feb 20, 2014 at 9:58 PM, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > One point to note is that, I

RE: Reg Exception in Kafka

2014-02-20 Thread Balasubramanian Jayaraman (Contingent)
, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > All the brokers reside in the same server and are listening on the > port 10092,10093,10094. From the same machine I can connect to the > zookeeper and the brokers. But When I tried to

RE: Reg Exception in Kafka

2014-02-20 Thread Balasubramanian Jayaraman (Contingent)
anged the JMX port when starting? On Thu, Feb 20, 2014 at 10:37 PM, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > All the brokers reside in the same server and are listening on the > port 10092,10093,10094. From the same machine I c

RE: Reg Exception in Kafka

2014-02-20 Thread Balasubramanian Jayaraman (Contingent)
connection from the controller host to the other broker? Also, what's the # open file handlers on each broker? Do you see any "too many open file handler" error in the broker log? Thanks, Jun On Wed, Feb 19, 2014 at 12:14 AM, Balasubramanian Jayaraman (Contingent) < bala

RE: Reg Exception in Kafka

2014-02-19 Thread Balasubramanian Jayaraman (Contingent)
Any issue with the network? Thanks, Jun On Tue, Feb 18, 2014 at 7:48 PM, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > I just came from vacation. > When I tested it, I get a Connect Exception. The complete stack trace is > given below.

RE: Reg Exception in Kafka

2014-02-18 Thread Balasubramanian Jayaraman (Contingent)
oller 3]: Newly added brokers: 2,1, deleted brokers: , all live brokers: 3,2,1 (kafka.controller.ReplicaStateMachine$BrokerChangeListener) -Original Message- From: Balasubramanian Jayaraman (Contingent) [mailto:balasubramanian.jayara...@autodesk.com] Sent: Thursday, February 06, 2014 5:

RE: Reg Exception in Kafka

2014-02-06 Thread Balasubramanian Jayaraman (Contingent)
. It should be " advertised.host.name", instead of advertise.host.name Thanks, Jun On Wed, Feb 5, 2014 at 6:06 PM, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > Thanks Joel. > > It seems the Broker is registered to

RE: Reg Exception in Kafka

2014-02-05 Thread Balasubramanian Jayaraman (Contingent)
./bin/zookeeper-shell.sh : get /brokers/ids/ On Wed, Feb 05, 2014 at 07:04:50AM +, Balasubramanian Jayaraman (Contingent) wrote: > Where should I look for these information. From the logs, I could see > ZooKeeper is bound to port 2181 and IP 0.0.0.0. The Kafka Server is started

RE: Reg Exception in Kafka

2014-02-04 Thread Balasubramanian Jayaraman (Contingent)
nd see what's the host/port of the broker? Thanks, Jun On Tue, Feb 4, 2014 at 1:54 AM, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > I downloaded from the trunk and set up the properties > host.name= > advertise.host.name= > &

RE: Reg Exception in Kafka

2014-02-04 Thread Balasubramanian Jayaraman (Contingent)
p out? Also, we recently added https://issues.apache.org/jira/browse/KAFKA-1092, which allows one to use a different ip for binding and connecting. You can see if this works for you. The patch is only in trunk though. Thanks, Jun On Tue, Jan 28, 2014 at 10:10 PM, Balasubramanian Jayaraman (Conti

RE: Reg Exception in Kafka

2014-01-28 Thread Balasubramanian Jayaraman (Contingent)
ginal Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Wednesday, January 29, 2014 12:27 PM To: users@kafka.apache.org Subject: Re: Reg Exception in Kafka Could it be a port conflict? Thanks, Jun On Tue, Jan 28, 2014 at 5:20 PM, Balasubramanian Jayaraman (Contingent) < balasubramania

RE: Reg Exception in Kafka

2014-01-28 Thread Balasubramanian Jayaraman (Contingent)
On Tue, Jan 28, 2014 at 2:17 AM, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > I checked the faq. I did change the host.name in server properties. > After changing it I get ConnectException. > > The problem here is in EC2 have a diff

RE: Reg Exception in Kafka

2014-01-28 Thread Balasubramanian Jayaraman (Contingent)
17 AM, Balasubramanian Jayaraman (Contingent) < balasubramanian.jayara...@autodesk.com> wrote: > Hi, > > I have a remote server (EC2) setup with Kafka cluster setup. There are > 3 brokers each running in the port 9092,9093,9094. The zookeeper is > running in the port 2181. &g

Reg Exception in Kafka

2014-01-27 Thread Balasubramanian Jayaraman (Contingent)
Hi, I have a remote server (EC2) setup with Kafka cluster setup. There are 3 brokers each running in the port 9092,9093,9094. The zookeeper is running in the port 2181. When I send message to the brokers from my PC, I get an exception which is given below. I did a dump in the remote server, the