Re: New consumer - poll/seek javadoc confusing, need clarification

2015-07-23 Thread Stevo Slavić
Thanks Ewen for heads up. It's great that seek is not needed in between poll when business goes as usual. In edge case, when my logic detects it needs to go back and reread events from given position in history, I use seek. I found out that next poll after seek will not respect offset used in see

Re: New consumer - poll/seek javadoc confusing, need clarification

2015-07-23 Thread Stevo Slavić
Strange, if after seek I make several poll requests, eventually it will read/return messages from offset that seek set. On Thu, Jul 23, 2015 at 11:03 AM, Stevo Slavić wrote: > Thanks Ewen for heads up. > > It's great that seek is not needed in between poll when business goes as > usual. > > In e

Re: ZK chroot path would be automatically created since Kafka 0.8.2.0?

2015-07-23 Thread yewton
Hi Gwen, I've created the ticket: https://issues.apache.org/jira/browse/KAFKA-2357 Thanks for your reply. On 2015/07/22 16:37, Gwen Shapira wrote: You are right, this sounds like a doc bug. Do you mind filing a JIRA ticket (http://issues.apache.org/jira/browse/KAFKA) so we can keep track of th

Re: New consumer - poll/seek javadoc confusing, need clarification

2015-07-23 Thread Jason Gustafson
Hey Stevo, Thanks for the early testing on the new consumer! This might be a bug. I wonder if it could also be explained by partition rebalancing. In the current implementation, a rebalance will clear the old positions (including those that were seeked to). I think it's debatable whether this beha

wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread David Montgomery
Just wondering I am getting this very disapointing error with kafka install. git clone https://git-wip-us.apache.org/repos/asf/kafka.git cd kafka git checkout -b 0.8 remotes/origin/0.8 ./sbt "++2.9.2 update" Thanks [warn] http://repo1.maven.org/maven2/com/jsuereth/xsbt-gpg-plugin_2

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread Gwen Shapira
Sorry, we don't actually do SBT builds anymore. You can build successfully using Gradle: You need to have [gradle](http://www.gradle.org/installation) installed. ### First bootstrap and download the wrapper ### cd kafka_source_dir gradle Now everything else will work ### Building a jar

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread Ewen Cheslack-Postava
Also, the branch you're checking out is very old. If you want the most recent release, that's tagged as 0.8.2.1. Otherwise, you'll want to use the trunk branch. -Ewen On Thu, Jul 23, 2015 at 11:45 AM, Gwen Shapira wrote: > Sorry, we don't actually do SBT builds anymore. > > You can build succes

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread David Montgomery
Thanks Now I get the below error I am on ubuntu 14.04. sudo add-apt-repository ppa:cwchien/gradle sudo apt-get update sudo apt-get install --upgrade gradle git clone https://github.com/apache/kafka.git cd kafka git checkout -b 0.8.2.1 gradle --debug 04:32:54.478 [DEBUG] [org.apache.http.imp

consumer property - zookeeper.sync.time.ms

2015-07-23 Thread Kris K
Hi, Can someone please throw some light on the consumer property zookeeper.sync.time.ms? What are the implications of decreasing it to lower than 2 secs ? I read the description from documentation but could not understand it completely. Thanks, Kris

Disaster Recovery

2015-07-23 Thread Luke Kysow
Hello All, would very much appreciate your thoughts and experiences on backup, restore, and disaster recovery. In the confluent.io docs ( http://docs.confluent.io/1.0/kafka/post-deployment.html under Backup & Restoration) it says the best way to backup your cluster is to set up a mirror. 1. Given

Re: wow--kafka--why? unresolved dependency: com.eed3si9n#sbt-assembly;0.8.8: not found

2015-07-23 Thread Ewen Cheslack-Postava
I think you're just having connectivity issues with Maven Central. I just ran your exact set of commands in a VM and the final gradle command (without --debug) ran fine and you can see it downloaded the file you had trouble with ( https://repo1.maven.org/maven2/org/eclipse/jgit/org.eclipse.jgit/3.3