RE: Error after restarting kafka broker

Also including kafka user mailing list. Has anybody seen this error? Any idea to fix it? Thanks Subhash Agrawal. From: Subhash Agrawal Sent: Wednesday, July 06, 2016 5:12 PM To: 'd...@kafka.apache.org' Subject: Error after restarting kafka broker Hi All, I am running kafka brok

RE: Error while sending message to Kafka broker on SSL with Kafka 0.10.0.0

at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:134) Please let me know what I am missing. Thanks Subhash Agrawal. From: Subhash Agrawal Sent: Monday, June 20, 2016 4:20 PM To: d...@kafka.apache.org; 'users@kafka.apache.org' Subject: Error while sending messa

Error while sending message to Kafka broker on SSL with Kafka 0.10.0.0

(Y/N)? y Any idea what should I look into? Thanks Subhash Agrawal

Embedding zookeeper and kafka in java process.

is not able to add the newly created kafka instance. Have you seen this error earlier? I have only single node kafka. Let me know if you have any suggestions. I will really appreciate any help on this. Thanks Subhash Agrawal. [2016-06-15 13:39:39,616] INFO [Logserver_Starter] Registered broker

RE: Migrating from 07.1 .100

kafka externally, then I don't see this error. Thanks Subhash A. From: Subhash Agrawal Sent: Wednesday, June 08, 2016 12:40 PM To: 'users@kafka.apache.org' Subject: Migrating from 07.1 .100 Hi, I am currently using Kafka 0.7.1 without zookeeper. We have single node kafka ser

Migrating from 07.1 .100

Hi, I am currently using Kafka 0.7.1 without zookeeper. We have single node kafka server. To enhance security, we have decided to support SSL. As 0.7.1 version does not support SSL, we are upgrading to latest version 0.10.0.0. We noticed that with the latest version, it is mandatory to use zooke

Migrating from Kafka 0.7.1 to 0.10.0

Hi, I am currently using Kafka 0.7.1 without zookeeper. We have single node kafka server. To enhance security, we have decided to support SSL. As 0.7.1 version does not support SSL, we are upgrading to latest version 0.10.0.0. We noticed that with the latest version, it is mandatory to use zooke

Async Producer (0.7 version) quick question

to disk or do we lose those messages? How can new producer process recover those messages? Thanks in advance for the help. Subhash Agrawal

RE: Exception in Kafka Broker when consumer shuts down/crashes.

and stop receiving data ? You shouldn't have to restart the broker when you kill the consumer, so maybe something else is wrong here. Thanks, Neha On Fri, Jan 4, 2013 at 11:58 AM, Subhash Agrawal wrote: > Hi, > > I noticed that when I kill consumer, I see exception in kafka broke

Exception in Kafka Broker when consumer shuts down/crashes.

Hi, I noticed that when I kill consumer, I see exception in kafka broker and I need to restart kafka broker server to get messages again. Do I need to tune anything to avoid this error or to avoid restarting kafka broker? Thanks Subhash Agrawal Here is the exception: [2013-01-05 11:12:59,361

Broker configuration from consumer using API

Hi, I need to get broker configuration information like number of partitions from consumer application using API. I looked at the API and realized I need KafkaBroker instance but I could not find way to get this instance from consumer. Any idea how to get this information? Thanks Subhash A.

RE: Batch size in producer

Thanks Neha. How can I shutdown the producer? is it ctrl-c? -Original Message- From: Neha Narkhede [mailto:neha.narkh...@gmail.com] Sent: Thursday, December 20, 2012 2:54 PM To: users@kafka.apache.org Subject: Re: Batch size in producer > How big should be the batch size? > In product

Batch size in producer

Hi, I have some questions about the batch size for producer. How big should be the batch size? What happens if producer client crashes before batch is full and messages were still sitting in producer queue? Does it recover those messages when we restart the producer? Are these messages stored

Consumer does not use broker.list property?

Hi All, I just noticed that consumer need to have zookeeper URL. It does not use broker.list property. Can somebody please confirm if this is the case. Thanks Subhash A.

RE: Design questions and your opinion and suggestions are appreciated

Hi, I have one more question related to this setup. If we don't use zookeeper in single Kafka broker setup, what will be the loss in terms of functionality? I noticed in ProducerConfig.scala file, that if brokerlist is configured, then it ignore partitioner class configuration. Thanks Su

RE: Quick question regarding kafka broker security

Fri, Dec 7, 2012 at 1:53 PM, Subhash Agrawal wrote: > Hi All, > > I am new to Kafka broker and realized that Kafka broker does not enforce > client authentication at connection or message level. > To avoid DOS attack, we are planning to implement security certificate at > clien

Quick question regarding kafka broker security

Hi All, I am new to Kafka broker and realized that Kafka broker does not enforce client authentication at connection or message level. To avoid DOS attack, we are planning to implement security certificate at client connection level, not at message level, so that we can authenticate client conn

Java API documentation

Hi All, I am new to Kafka and we are planning to use Kafka as message broker. I am wondering if there are java API documentation for Kafka. I noticed that current API doc is written for Scala user. I believe it could be because it is written in Scala. Please let me know. Thanks Subhash A.