Re: New consumer - offset one gets in poll is not offset one is supposed to commit

2015-07-24 Thread Stevo Slavić
Sorry, wrong ML. On Fri, Jul 24, 2015 at 7:07 PM, Cody Koeninger wrote: > Are you intending to be mailing the spark list or the kafka list? > > On Fri, Jul 24, 2015 at 11:56 AM, Stevo Slavić wrote: > >> Hello Cody, >> >> I'm not sure we're talk

Re: New consumer - offset one gets in poll is not offset one is supposed to commit

2015-07-24 Thread Stevo Slavić
tion isn't asking you to "commit" anything. > It's asking you to provide a starting point for the stream on startup. > > Because offset ranges are inclusive start, exclusive end, it's pretty > natural to use the end of the previous offset range as the beginning of th

New consumer - offset one gets in poll is not offset one is supposed to commit

2015-07-24 Thread Stevo Slavić
Hello Apache Kafka community, Say there is only one topic with single partition and a single message on it. Result of calling a poll with new consumer will return ConsumerRecord for that message and it will have offset of 0. After processing message, current KafkaConsumer implementation expects o

Re: Spark-core and guava

2015-03-26 Thread Stevo Slavić
ed" is more of a > Maven workaround to achieve a desired effect. It's not "provided" in > the usual sense. > > On Thu, Mar 26, 2015 at 12:24 PM, Stevo Slavić wrote: > > Hello Apache Spark community, > > > > spark-core 1.3.0 has guava 14.0.1 as provided

Spark-core and guava

2015-03-26 Thread Stevo Slavić
Hello Apache Spark community, spark-core 1.3.0 has guava 14.0.1 as provided dependency (see http://repo1.maven.org/maven2/org/apache/spark/spark-core_2.10/1.3.0/spark-core_2.10-1.3.0.pom ) What is supposed to provide guava, and that specific version? Kind regards, Stevo Slavic.