Re: Delete message after consuming it

Thanks Mani, Eager to know, which one is better to use? Could you please let me know the pros/cons of one over another? Regards Anand On Fri, Aug 1, 2014 at 6:12 PM, Manikumar Reddy wrote: > Hi, > > Kafka supports two types of log/messages retention policies. > > Log retention(size/time): The

RE: Consume more than produce

Hi What do you mean producer ACK value? In my code I don't have a retry mechanism, the Kafka producer API has a retry mechanism? -Original Message- From: Guozhang Wang [mailto:wangg...@gmail.com] Sent: Friday, August 01, 2014 6:08 PM To: users@kafka.apache.org Subject: Re: Consume mo

RE: Socket is not connected error while consuming messages using kafka

I tried again, yes from Telnet I am able to connect to ZK server successfully. Thanks, Pradeep Simha -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Monday, August 04, 2014 9:57 AM To: users@kafka.apache.org Subject: Re: Socket is not connected error while consuming mess

Recall: Socket is not connected error while consuming messages using kafka

Pradeep Simha (WT01 - Business Outcome Services) would like to recall the message, "Socket is not connected error while consuming messages using kafka". The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s)

RE: Socket is not connected error while consuming messages using kafka

Even from telnet I couldn’t connect it's showing error "Connecting to 10.10.10.10 ... Couldn't open connection to host", but I am able to connect from PuTTY. Thanks, Pradeep Simha Technical Lead -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Monday, August 04, 2014 9:

Re: Graceful shutdown without using jmx

You can use the controlled shutdown http://kafka.apache.org/documentation.html#basic_ops_restarting Thanks, Jun On Sun, Aug 3, 2014 at 7:42 PM, Jongyoul Lee wrote: > Hi, > > I've installed kafka 0.8.1.1 on linux. But the linux kafka-server-start.sh > doesn't set default jmx port so I cannot c

Re: Socket is not connected error while consuming messages using kafka

This seems to be a Zookeeper connection problem. Can you telnet to the ZK server from the consumer client host? Thanks, Jun On Sat, Aug 2, 2014 at 3:20 AM, wrote: > Hi Team, > > I am trying to consume a message from Kafka hosted on Ubuntu server, using > this example: > https://cwiki.apache.o

Re: Updated Kafka Roadmap?

I just updated the wiki with some rough timelines. Thanks, Jun On Fri, Aug 1, 2014 at 11:52 AM, Jonathan Weeks wrote: > Howdy, > > I was wondering if it would be possible to update the release plan: > > https://cwiki.apache.org/confluence/display/KAFKA/Future+release+plan > > aligned with the

Performance

Hello, Is there an official benchmark that compares the various clients (Java, C#, C++, etc.)?

Graceful shutdown without using jmx

Hi, I've installed kafka 0.8.1.1 on linux. But the linux kafka-server-start.sh doesn't set default jmx port so I cannot change leader of some partitions. How can I shutdown without data loss or duplication? I've already tested, and I've known that kafka lose data without graceful shutdown. Regard

offset commit api

Hi, I'm reading the offset management on the API link. https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-OffsetCommit/FetchAPI I have a couple of questions regarding using the offset fetch and commit API in 0.8.1.1 ? 1. Is the new offset com

Re: How to use kafka as flume source.

The author may or may not have upgraded the project to be compatible with 0.8.1. You could message the author directly to ask. On Sun, Aug 3, 2014 at 6:53 AM, rafeeq s wrote: > Thanks. > But above link example uses flume-ng to > communicate with *kafka 0.7,2 <

Re: How to use kafka as flume source.

Thanks. But above link example uses flume-ng to communicate with *kafka 0.7,2 *. I am using *kafka 0.8.1*. Please advice an example of flume-ng with kafka 0.8.1. Thanks in advance Regards, Rafeeq S *(“What you do is

Re: How to use kafka as flume source.

https://github.com/baniuyao/flume-ng-kafka-source On Sun, Aug 3, 2014 at 6:15 PM, rafeeq s wrote: > Hi, > > We are planning to use kafka as *flume source*. Please advice me, how to > use kafka as source in flume. > > please share if there is any best example of *flume- kafka source- hdfs > sin

Re: kafka consumer fail over

Hi Weide The consumer rebalancing algorithm is deterministic. In your failure scenario, when A comes back up again, the consumer threads will rebalance. This will give you the initial consumer configuration at the start of the test. I'm unsure whether the partitions are balanced round robin, o

How to use kafka as flume source.

Hi, We are planning to use kafka as *flume source*. Please advice me, how to use kafka as source in flume. please share if there is any best example of *flume- kafka source- hdfs sink*. Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*

Re: Exception in thread "main" kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries

Hi pradeep, It seems your client is not able to connect with Kafka Server. Kafka client connects with server using HOSTNAME not IP. You have to map the hostname with IP address. In Ubuntu Server, /etc/hosts put an entry of your {clientIp hostname} In Windows Client, %SystemRoot%