There is an issue with the pom not having the dependency exclusion correct
(at least I believe that is the problem now being tackled)
I tried a fix but it did not work
https://issues.apache.org/jira/browse/KAFKA-974
if someone gets a chance to look at it or knows the fix before I get a
chance to
Hey Jay
This question might have been posed a million times, but thought I might
pose it again.
Why has kafka not been published to a public Maven repo?
Chetan
Florin,
In a high-level consumer "ConsumerConnector" you can setup the property
auto.commit.enable = false. Then you can call commitOffsets after
processing the message.
Calling commitOffsets after every message will slow processing down
dramatically. So setup a timer or other coordination mechan
Thanks Jay, this is helpful information. Controlling when offsets are committed
is possible only with the SimpleConsumer, correct? I believe that the
ConsumerConnector (the high level consumer) commits the offsets automatically.
It would be nice to have a hook into it that I can override to let
Hello,
I'm going through a series of tests with Kafka 0.8 to see what the failure
cases are. One simple scenario is this:
1. Launch Zookeeper
2. Launch my consumer (written in scala) but don't launch a Kafka broker (I am
not using replication in my configuration).
What happens in this particul
0.7 and 0.8 have mostly the same package/class names, so you have to shade
one of the jars if you want them to both be loaded and executable in the
same jvm process. I've done this in my consumers (e.g. my consumers
consume from both 0.7 and 0.8 during the transition). I chose to run
separate kaf
Hi guys,
Is it possible to have both 0.7 and 0.8 clients running within same process
? We would like to migrate to 0.8 only some of the topics initially so we
would need some consumers to have connection to both clusters. I remember a
mention of migration tool that consumes from 0.7 and produces t
Our plan is keep the agg cluster in a few, but not all DCs.
Thanks,
Jun
On Fri, Jul 12, 2013 at 9:30 AM, Maxime Petazzoni wrote:
> * Jun Rao [2013-07-11 21:10:46]:
>
> > We we have at LinkedIn is an extra aggregate cluster per data center. We
> > use mirror maker to copy data from the local
* Jun Rao [2013-07-11 21:10:46]:
> We we have at LinkedIn is an extra aggregate cluster per data center. We
> use mirror maker to copy data from the local cluster in each of the data
> centers to the aggregate one.
Do you mean you have an aggregate cluster in each datacenter that gets
all the da
