Understanding Kafka for Event Processing system

Hi Joe, Many thanks for such a detailed response. So you would have a topic called "TypeA" and then setup a consumer group > and those consumers (if you really only needed 1 consumer set the > partitions to 1) would get everything from the "TypeA" topic. If you had > more event types then just

Re: trouble building 0.8

I deleted all the sbt project and target stuff, for both ~/.sbt and kafka/project/build. I had previously had php stuff in my global sbt stuff. This resolved this issue, but now I am having another… I get the following: [warn] Multiple resolvers having different access mechanism configured wi

trouble building 0.8

Well, I changed something, as it was working yesterday. Here's my attempt at updating… Robs-MacBook-Pro:kafka reefedjib$ sbt "++2.10.2 update" [info] Loading global plugins from /Users/reefedjib/.sbt/plugins [info] Loading project definition from /Users/reefedjib/Desktop/rob/comp/workspace-fra

Re: How do you recover an 0.8 Kafka server

Actually, you should just need to restart the failed broker and data should be replicated to that broker. One thing to check is the state-change log. Do you see any LeaderAndIsr request when the bad broker is restarted? Thanks, Jun On Sun, Aug 4, 2013 at 8:06 PM, Eric Sites wrote: > All, > > H

Re: [0.8 + scala 2.10 patches] [error] Failed tests: kafka.log.LogTest

Is this transient? The testTimeBasedLogRoll has timing dependency. I have seen it fail occasionally. Thanks, Jun On Fri, Aug 2, 2013 at 8:51 PM, Rob Withers wrote: > I built 0.8, fresh, with the scala 2.10 patches from KAFKA-717's tgz, on > my Macbook. I ran sbt tests (after running sbt ecli

RE: Fatal issue (was RE: 0.8 throwing exception "Failed to find leader" and high-level consumer fails to make progress_

And today I've attached a better patch (KAFKA-989-failed-to-find-leader-patch2.patch) to KAFKA-989. When in doubt, add another lock. ;) https://issues.apache.org/jira/browse/KAFKA-989?focusedCommentId=13729537&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13729537

Re: WELCOME to users@kafka.apache.org

Yes, depending on your implementation of the event processing system you may simply be able to have each topic be the type of event. So you would have a topic called "TypeA" and then setup a consumer group and those consumers (if you really only needed 1 consumer set the partitions to 1) would get

Re: WELCOME to users@kafka.apache.org

Hi every one, i am new to kafka and desiging an Event Processing System. Is this possible that Kafka Broker can do some event dependency handling so that for example events of type A only goes to Consumer1. I hope I was able to explain my problem Thanks.