KafkaSpout

Hi all, I am using a kafka spout for reading data from a producer into my storm topology. On the kafkaconfig : 1. When i set Kafka.forcefromstart = true .. it read from the beginning , however if i close my topology midway and run the topology again by setting Kafka.forcefromstart = false , it doe

Re: KafkaSpout

Hi harsha, Yes i did check with the above mentioned spoutconfig setup I think i need to bypass the in memory zookeeper which i am unable to do in local mode of storm. Any thoughts on that? Thanks, Siddharth ubale

Re: KafkaSpout

:21 PM, Harsha wrote: > Are you running this using storm LocalCluster and you want to use > external zookeeper for LocalCluster?. > The latest code has those changes you can pass params to > LocalCluster(localhost,2181). > -Harsha > > On Mon, Sep 15, 2014, at 10:30 PM,

Kafka-Storm Integration

Hi, I am runnning a Kafka-storm topology . The topology works exactly as expected in LocalCluster mode. However in Distributed mode the Workers are not starting , supervisor has not started. Only nimbus starts I am trying to run the topology via eclipse. //Providing the details for zkHosts Brok

File as message's content

Hi , Can you please let me know if we can send a file as in a pdf,jpg or Jpeg as a content of a message which we send via Kafka? Thanks, Siddharth Ubale

Data inputs for Kafka.

other systems? 2. As compared to network of brokers concept in ActiveMQ do we have something like that in kafka also?? Thanks, Siddharth Ubale

Re: Data inputs for Kafka.

rite them to > Kafka. Take a look at the Ecosystem page: > > > https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem > > > Philip > > > - > http://www.philipotoole.com > > > On Wednesday, August 20, 2014 5:05 AM,

Re: Data inputs for Kafka.

technology other than java?? Thanks, Siddharth Ubale On Thu, Aug 21, 2014 at 11:48 AM, Sharninder wrote: > there are kafka producers/consumers in a lot of languages. There is an > Ecosystem page somewhere in the wiki. Take a look at that. > > Finally, I think you should experiment with b

Re: Data inputs for Kafka.

and > it'll parse it and do the needful. > > > > On Thu, Aug 21, 2014 at 3:59 PM, siddharth ubale < > siddharth.ub...@gmail.com> > wrote: > > > Hi , > > > > In continuity to this thread, can you let me know if i will have to > write > >

Failed to find leader

also i see this very often whenever i have restarted my topic .* Thanks, Siddharth ubale

kafkaConfig.forceFromStart=true;

. . and storm 0.9.2_incubating which supports the kafka spout. Also in the above topology i am using kafka spout for ingesting data into storm. Thanks, Siddharth Ubale

Kafka topics behaviour

before shutting down my virtual machine. IS THIS THE WAY KAFKA FUNCTIONS IN DISTRIBUTED MODE ALSO?? Thanks, Siddharth Ubale

Kafka data can be stored on a Dbase instead of file system?

consumer pick data from where it last left or will it start reading from beginning if i have set the consumer from beginning while coding the consumer. Thanks, Siddharth Ubale

Re: Kafka data can be stored on a Dbase instead of file system?

: > For your first question, I don't know of a way to do that. > > For the second question, consumers commit the offset after every/a few > reads. When the consumer restarts, it starts from the last committed > offset. > > > On Tue, Sep 9, 2014 at 7:23 PM, siddharth ub