Re: Kafka Cluster Issue

Any comments on this issue? On Sat, May 2, 2015 at 9:16 AM, Kamal C wrote: > Hi, > We are using Kafka_2.10-0.8.2.0, new Kafka producer and Kafka Simple > Consumer. In Standalone mode, 1 ZooKeeper and 1 Kafka we haven't faced any > problems. > > In cluster mode, 3 ZooKeeper and 3 Kafka Brokers. W

Kafka behind AWS ELB

Hi, I am new to Apache Kafka. I have played with it on my laptop. I want to use Kafka in AWS. Currently we have tomcat web servers based REST API. We want to replace REST API with Apache Kafka, web servers are behind ELB. I would like to know if we can keep Kafka brokers behind ELB? Will it work

Re: Kafka - is there a quorum a used for reading when min isrs greater than 1

Hi, The leader always serves all requests. Replicas are used just for high availability (i.e to become leader if needed). On Fri, May 1, 2015 at 3:27 PM, Gomathivinayagam Muthuvinayagam < sankarm...@gmail.com> wrote: > I am just wondering if I have no of replicas as 3, and > if min.insync.replic

Re: I want to prescribe

Here is the place. On Sun, 3 May 2015 at 11:30 am Samuel Measho wrote: > > > Hi > > I have some questions regarding kafka, where do we post it? > > > Thanks, > Samuel >

I want to prescribe

Hi I have some questions regarding kafka, where do we post it? Thanks, Samuel

Kafka brokers behind AWS ELB

Hi, I am new to Apache Kafka. I have played with it on my laptop. I want to use Kafka in AWS. Currently we have tomcat web servers based REST API. We want to replace REST API with Apache Kafka, web servers are behind ELB. I would like to know if we can keep Kafka brokers behind ELB? Will it work

Re: Pulling Snapshots from Kafka, Log compaction last compact offset

Hi Gwen, As you said I see Bottled Water and Sqoop managing slightly different use cases so I don't see this feature as a Sqoop killer. However I did have a question on your comment that the transaction log or CDC approach will have problems with very large, very active databases. I get that you

Re: Data replication and zero data loss

Hi, Joong, Please check the following two links: - https://cwiki.apache.org/confluence/display/KAFKA/KIP-3+-+Mirror+Maker+Enhancement - https://cwiki.apache.org/confluence/display/KAFKA/KIP-8+-+Add+a+flush+method+to+the+producer+API They might help you understand the problem. Cheers, Xiao Li

High CPU Usage 0.8.1.2 on a kafka client

System: jdk-7u76 (Oracle), on Ubuntu 14.04.1 LTS, Trusty Tahr, Kernel: 3.13.0-44-generic Kafka Version: 0.8.1.2 Broker Cfg: Three brokers, Zookeeper Cfg: Three brokers, Replication Factor: 2 Client Machine Configuration:: - Memory: 4G - CPU: 2 (Xeon @ 2.50GHz) - Java args:: -server -Xmx2G -Xms2G

Re: New Producer API - batched sync mode support

Gwen, I don't care what anyone says I think we are totally stlone cold slobar. :-) I think the only caution I would have is that in general people ask for many things and yet the systems we all admire tend to keep their surface area really really simple. My observation is that never in the history

Re: Topic missing Leader and Isr

This seems to be an issue thats fixed in 0.8.2 and after upgrading the kafka cluster to 0.8.2 this issue was resolved. https://issues.apache.org/jira/browse/KAFKA-1738 On Fri, May 1, 2015 at 2:58 PM, Dillian Murphey wrote: > Hey, not a help, b

Kafka Cluster Issue

Hi, We are using Kafka_2.10-0.8.2.0, new Kafka producer and Kafka Simple Consumer. In Standalone mode, 1 ZooKeeper and 1 Kafka we haven't faced any problems. In cluster mode, 3 ZooKeeper and 3 Kafka Brokers. We did some sanity testing by bringing a Kafka node down then a random Producer starts to

Re: Topic missing Leader and Isr

Hey, not a help, but I just posted the same question. I'm noticing the same thing. Where is your hardware? Just curious. I'm running my kafka/zookeeper on AWS. On Tue, Apr 28, 2015 at 10:23 AM, Buntu Dev wrote: > Also note that the metadata for the topic is missing. I tried creating few > more

Kafka - is there a quorum a used for reading when min isrs greater than 1

I am just wondering if I have no of replicas as 3, and if min.insync.replicas > 1, in that case does a read require from read quorum or just the leader always serves the read request? Thanks & Regards,

Re: Leaderless topics

Delete topic doesn't work in 0.8.1.1, unfortunately. This is why you are seeing strange issues. We highly recommend upgrading to 0.8.2.1 - which should be relatively pain free upgrade. On Fri, May 1, 2015 at 8:59 AM, Dillian Murphey wrote: > kafka_2.9.2-0.8.1.1 > > Thanks, Gwen. > > On Thu, Apr

Re: Topic missing Leader and Isr

Oh let me further add. I believe there is no leader/isr when I've re-created a deleted topic. If I pick a topic name never seen before I get a leader/isr. Were you deleting topics? Deleting topics is also a good test of your system. FYI: $KAFKA_HOME/bin/kafka-run-class.sh kafka.admin.DeleteTo