build for kafka-avro-serializer

2016-02-21 Thread Venkatesh Rudraraju
How do I include "kafka-avro-serializer" in my maven build. It's not available in the maven repo as mentioned here -> http://docs.confluent.io/1.0/app-development.html#java-applications-serializers Thanks, Venkatesh

Re: Leader was set to -1 for some topic partitions

2016-02-21 Thread Raju Bairishetti
On Mon, Feb 22, 2016 at 1:13 PM, Salman Ahmed wrote: > We saw a similar issue a while back. If leader is -1, I believe you won't > have ingestion work for that partition. Was there any data ingestion dip? > *No, I am not seeing any data dip for topic but no data for that partition whose leader

Re: Leader was set to -1 for some topic partitions

2016-02-21 Thread Salman Ahmed
We saw a similar issue a while back. If leader is -1, I believe you won't have ingestion work for that partition. Was there any data ingestion dip? On Sun, Feb 21, 2016 at 7:44 PM Raju Bairishetti wrote: > Hello, >We are using 0.8.2 kafka version. We are running 5 brokers in the prod > cluste

Leader was set to -1 for some topic partitions

2016-02-21 Thread Raju Bairishetti
Hello, We are using 0.8.2 kafka version. We are running 5 brokers in the prod cluster. Each topic is having two partitions. We are seeing some issues with some topic partitions. For some topic partitions leader was set to -1. I am not seeing any errors in the controller and server logs. After s

RE: Exactly-once publication behaviour

2016-02-21 Thread Andrew Schofield
Hi Jay, Thanks for the response. Happy to engage in the discussions once there's something concrete on the wiki. Andrew > Date: Sun, 21 Feb 2016 10:23:55 -0800 > Subject: Re: Exactly-once publication behaviour > From: j...@confluent.io > To: users@kafka.a

Re: Exactly-once publication behaviour

2016-02-21 Thread Jay Kreps
Hey Andrew, Yeah I think the current state is that we did several design and prototypes (both the transaction work and the idempotence design and the conditional write KIP), but none of these offshoots is really fully rationalized with the other ones. Slow progress in this area has been mainly due

RE: Exactly-once publication behaviour

2016-02-21 Thread Andrew Schofield
Hi, That's good, but somewhat mysterious :) I'd like to help accelerate exactly-one behaviour. Perhaps it might be a candidate for the release after 0.10, if there's sufficient interest in the community. Could someone share the latest thinking on this subject? I'm not sure what the appropriate