Kafka error:- The requested operation can not be performed on a file with user-mapped section open.

2020-07-12 Thread Gagan Sabharwal
Hi team, I started 3 kafka servers on same machine listening to ports 9092,9093 and 9094 having their dedicated LOG and Data directories. I have created a topic with 1 partition and a replication factor of 3. Here is the code. NewTopic topic = new NewTopic("Queue", 1, (short) 3); Then I wrote

How to start more than one zookeeper server

2019-07-17 Thread Gagan Sabharwal
Hi team, When I look at the config\zookeeper.properties in Kafka folder, while starting, I can't see an option to start more than one zookeper service, either on the same machine or on a different server. This is to ensure that kafka broker is managed irrespective of the fact that one of the zk se

Re: KeeperException

2019-05-14 Thread Gagan Sabharwal
Hi team, Any pointers on the same ? Regards Gagan On Mon, May 13, 2019 at 11:24 AM Gagan Sabharwal wrote: > Hi team, > > I have just started to learn kafka following > https://kafka.apache.org/quickstart > > When I have started my zookeeper server and kafka server, I got a f

KeeperException

2019-05-12 Thread Gagan Sabharwal
Hi team, I have just started to learn kafka following https://kafka.apache.org/quickstart When I have started my zookeeper server and kafka server, I got a few exceptions in the log which are all "KepperExcetion". Even when i created a topic with name test I got the same exception. Can anyone thr

Kafka question on Stream Processing

2019-04-24 Thread Gagan Sabharwal
Hi team, Say we have a client which has pushed a message to a topic. The message has a a simple structure Task - Time of task Send an email - 1530 Now say that this message is consumed by a consumer subscribed to this topic. Since Topic already has a storage, what I intend to do is just read the

Re: Kafka work stealing question

2019-04-23 Thread Gagan Sabharwal
s for each consumer to be assigned at least > one. For example, if you have 5 partitions and 8 consumers, then three of > your > consumers will be effectively idle with no work (the other 5 consumers > will be > assigned a single partition each). > > Kind regards, > -Al > &g

Re: Kafka work stealing question

2019-04-22 Thread Gagan Sabharwal
r, that consumer will continue to poll until messages show up > in those partitions. It won't start consuming messages from partitions that > have been assigned to another consumer. > > HTH, > > Alex > > On Mon, Apr 22, 2019 at 10:57 PM Gagan Sabharwal > wr

Kafka work stealing question

2019-04-22 Thread Gagan Sabharwal
Hi team, If a consumer group has 5 subscribers to a topic which has 5 partitions, do the subscribers steal work if they are done with their own? Regards Gagan