Failed to find leader for Set exception

Hi, I am using Apache NiFi to read data form Kafka which runs as part of Hortonworks HDP 2.4. I use GetKafka processor to read messages form a topic but see the exception bellow. What can be wrong? 2016-05-26 17:13:36,776 INFO [d217bceb-d58b-4031-9143-26d8ddd15e40_BPIW01a-1464297163195-b78e95a5-l

Re: Add new client to "clients" page please

Vadim, do you have code samples for producer/consumer? On Fri, May 27, 2016 at 8:36 PM Guozhang Wang wrote: > Hello Vadim, > > Which Kafka version is it currently supporting up to? > > Guozhang > > On Wed, May 25, 2016 at 11:56 AM, Vadim Chekan > wrote: > > > Hi all, > > > > I'd like kafka4net

Topics, partitions and keys

I need some clarification on subject. In Kafka documentations I found the following: Kafka only provides a total order over messages *within* a partition, not between different partitions in a topic. Per-partition ordering combined with the ability to partition data by key is sufficient for most a

Test

Please someone reply. Not sure if subscribed properly.

Re: Test

thanks :) On Sun, May 29, 2016 at 2:09 PM, Stephen Powis wrote: > Hello! > > On Sun, May 29, 2016 at 1:02 PM, Igor Kravzov > wrote: > > > Please someone reply. Not sure if subscribed properly. > > >

Topics, partitions and keys

Please help me with the subject. In Kafka documentations I found the following: *Kafka only provides a total order over messages within a partition, not between different partitions in a topic. Per-partition ordering combined with the ability to partition data by key is sufficient for most applica

Re: Topics, partitions and keys

Thank you Todd for great response. On Sun, May 29, 2016 at 8:52 PM, Todd Palino wrote: > Answers are in-line below. > > -Todd > > On Sun, May 29, 2016 at 3:00 PM, Igor Kravzov > wrote: > > > Please help me with the subject. > > In Kafka documentations I found t

10MB message

In our system some data can be as big as 10MB. Is it OK to send 10 MB message through Kafka? What configuration parameters should I check/set? It is going to be one topic with one consumer - Apache NiFi GetKafka processor. Is one partition enough?

Use Zookeeper for a Producer

When I look at code samples producers mostly write to brokers and consumers use Zookeeper to consume from topics. Using Microsoft .net client ( https://github.com/Microsoft/CSharpClient-for-Kafka) I wrote producer witch uses Zookeeper and was able to write data successfully. Am I missing somethi

Re: Topics, partitions and keys

Thanks Alex. On Tue, May 31, 2016 at 2:37 PM, Alex Loddengaard wrote: > Hi Igor, see inline: > > On Sat, May 28, 2016 at 8:14 AM, Igor Kravzov > wrote: > > > I need some clarification on subject. > > In Kafka documentations I found the following: > > > >

Re: Use Zookeeper for a Producer

doesn't use ZooKeeper. The producer doesn't use ZooKeeper, either. However, > brokers still use ZooKeeper. > > Alex > > On Tue, May 31, 2016 at 12:03 PM, Igor Kravzov > wrote: > > > When I look at code samples producers mostly write to brokers and > consumers >

Re: Use Zookeeper for a Producer

r. > > Alex > > On Tue, May 31, 2016 at 12:44 PM, Igor Kravzov > wrote: > > > What if number of brokers change? Does it mean I need to change > > configuration or potentially recompile my producer and consumer? > > > > On Tue, May 31, 2016 at 3:27 PM

Re: How to use HDP kafka?

Hi, I am unable to see the images. But I use Kafka with HDP right now without any problem. On Tue, May 31, 2016 at 9:33 PM, Shaolu Xu wrote: > Hi All, > > > Anyone used HDP to run kafka, I used it and face a problem.The following > is the error info: > > [image: Inline image 2] > > > The follow

Re: How to use HDP kafka?

on that > is http://www.cnblogs.com/i2u9/p/ambari-kafka-multiip.html, but it not > works for me. > > Attachment errorInfo and HDPConfig snapshot. > > Thanks in advance! > > Thanks， > Nicole > > > On Wed, Jun 1, 2016 at 8:44 PM, Igor Kravzov > wrote: > >&