Re: Is Kafka documentation regarding null key misleading?

Steven, You can take a look at kafka.producer.async.DefaultEventHandler, in getPartition function. Guozhang On Thu, Dec 11, 2014 at 9:58 AM, Steven Wu wrote: > Guozhang, > > can you point me to the code that implements "periodic/sticky" random > partitioner? I actually like to try it out in ou

Re: Very slow producer

Hi Ewen, Thank you for your response. It’s much faster after changing to async. Cheers,Huy, Le Van On Thursday, Dec 11, 2014 at 7:08 p.m., Ewen Cheslack-Postava , wrote: Did you set producer.type to async when creating your producer? The console producer uses async by default, but the

Re: [DISCUSSION] adding the serializer api back to the new java producer

Thanks Jun. I think we all understand the motivation of adding serialization API back, but are just proposing different ways of doing such. I personally prefer to not bind the producer instance with a fixed serialization, but that said I am fine with the current proposal too as this can still be d

Given brokers, is it able to know all the zookeepers that brokers connect to

Hi Guys, If I know the brokers. Is there a way to know the zookeeper host from broker list? Thanks! Siyuan

How do I create a consumer group

We're using 0.82 beta and a homegrown c++ async library based on boost asio that has support for the offset api. (apikeys OffsetCommitRequest = 8, OffsetFetchRequest = 9, ConsumerMetadataRequest = 10) If we use a java client and commit an offset then the consumer group shows up in the response f

Re: Very slow producer

Did you set producer.type to async when creating your producer? The console producer uses async by default, but the default producer config is sync. -Ewen On Thu, Dec 11, 2014 at 6:08 AM, Huy Le Van wrote: > Hi, > > > I’m writing my own producer to read from text files, and send line by line >

Re: Is Kafka documentation regarding null key misleading?

Guozhang, can you point me to the code that implements "periodic/sticky" random partitioner? I actually like to try it out in our env, even though I assume it is NOT ported to 0.8.2 java producer. Thanks, Steven On Mon, Dec 8, 2014 at 1:43 PM, Guozhang Wang wrote: > Hi Yury, > > Originally th

Re: OutOfMemoryException when starting replacement node.

Agree that the docs can be better. Perhaps you want to open a JIRA (at issues.apache.org) with this suggestion? On Wed, Dec 10, 2014 at 4:03 PM, Solon Gordon wrote: > I see, thank you for the explanation. You might consider being more > explicit about this in your documentation. We didn't realize

there is no option --delete--version kafka_2.9.2-0.8.1.1

There is no option --delete--version kafka_2.9.2-0.8.1.1： 张宗军 乐居控股有限公司 运维技术部 地址：北京市东城区广渠家园5号楼首东国际大厦11层，100022 电话：15110221260 / 010-58951710 电邮：zongj...@leju.com 网址：www.leju.com 本邮件可能包含机密或专属资料和信息，供目标收件人用于特殊目的。严格禁止其他人改动、 使用、分发或披露。如果您不是目标收件人（或经过授权的收件人），请回复该邮件与发件人 联系，并删除该邮件的

Re: ProducerData jar file

Hi, kafka.javaapi.producer.ProducerData class belongs to kafka 0.7/0.6. This class is removed from 0.8 on-wards. Pl try with 0.8.x API. Regards, Manikumar On Thu, Dec 11, 2014 at 8:10 PM, kishore kumar wrote: > hi Manikumar, > > As I mentioned in previous mail, I added the jars available

Re: ProducerData jar file

hi Manikumar, As I mentioned in previous mail, I added the jars available in libs folder, but this class is not available in that jars, I am using cloudera's CLABS-KAFKA. On Thu, Dec 11, 2014 at 4:55 PM, Manikumar Reddy wrote: > Hi, > > You just need to include the libraries available in kafka/

Very slow producer

Hi, I’m writing my own producer to read from text files, and send line by line to Kafka cluster. I notice that the producer is extremely slow. It's currently sending at ~57KB/node/s. This is like 50-100 times slower than using bin/kafka-console-producer.sh Here’s my producer: final File dir

Re: How to Setup MirrorMaker in Generalized way

Hi Neha, Thanks for your reply. Now using MM tool to replicate data between Kafka clusters, But I am facing one problem, Messages gets duplicated if MM killed forcefully[ *kill -9* ]. Is there any solution to avoid this duplicated entry in target cluster? I am using Kafka *8.1.1.* On Mon, Dec

Re: ProducerData jar file

Hi, You just need to include the libraries available in kafka/libs folder. Pl follow below example https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+Producer+Example On Thu, Dec 11, 2014 at 4:43 PM, kishore kumar wrote: > do i need to download this separately ? my requirement is inges

Re: ProducerData jar file

do i need to download this separately ? my requirement is ingest the data in my csv files into kafka, please help me how to do it with java code. On Thu, Dec 11, 2014 at 1:30 PM, kishore kumar wrote: > > Hi Experts, > > kafka.javaapi.producer.ProducerData class is available in 0.8.1 ? I am > un

ProducerData jar file

Hi Experts, kafka.javaapi.producer.ProducerData class is available in 0.8.1 ? I am unable to use it, I copied all the jars in /build/dependant-libs-2.10.1 and libs folders, any help ? -- Thanks, Kishore.