Hi,
I have set up a clean kafka set up on three ec2 nodes. I have pushed in
two messages into the set up. But i invoke the high level consumer, i
get this error in the kafka broker. I ran the Consumer offset tool. It
says the lag to be -6. This set up is fresh set up and it has three
kafka br
Robert - "exactly once" will be really hard unless you can commit the
offset with the aggregate in an atomic way downstream. That would defend
you against redeliveries (ignore updates from lower offset) while allowing
you to be more failure tolerant on the consuming side.
On Sat, Feb 15, 2014 at
We have this version in prod. It has been fine as we commitOffsets after every
message. After 3 months of this, we rolled out Hadoop, which requires
aggregation. We started commiting every 2 minutes and we saw that the fetchr
would get tangled and stop fetching and the consumer would get stuc
Thanks Bae. I'll report back with our experiences.
On Sat, Feb 15, 2014 at 10:48 AM, Bae, Jae Hyeon wrote:
> Netflix is using kafka 0.7 and 0.8 with zk 3.4.5, very stable.
>
> On Saturday, February 15, 2014, Todd Palino wrote:
>
> > We're not at the moment, but I'd definitely be interested in
Netflix is using kafka 0.7 and 0.8 with zk 3.4.5, very stable.
On Saturday, February 15, 2014, Todd Palino wrote:
> We're not at the moment, but I'd definitely be interested in hearing your
> results if you do. We're going to be experimenting with the latest version
> soon to evaluate it.
>
> -T
We're not at the moment, but I'd definitely be interested in hearing your
results if you do. We're going to be experimenting with the latest version
soon to evaluate it.
-Todd
On 2/14/14 4:32 PM, "Clark Breyman" wrote:
>Is anyone running 0.8 (or pre-0.8.1) with the latest Zookeeper? Any known
>
Jay,
That makes sense. position/seek deal with changing the consumers in-memory
data, so there is no remote rpc there. For some reason, I got committed and
seek mixed up in my head at that time :)
So we still end up with
long position(TopicPartition tp)
void seek(TopicPartitionOffset p)
Hi,
Kafka 8 is giving issues.
I want to connect to kafka via python
Below is the error I get in kafka and in python. I just dont get why kafka
fails...how do I resolvehow do I just reset everything? Thanks
from kafka.client import KafkaClient
from kafka.producer import SimpleProducer,
