Re: Usual remedy for "Under Replicated" and "Offline Partitions"

2018-02-02 Thread Richard Rodseth
of partitions that are really hot and will soon be marked as > not being in sync. > > I know this doesn't provide full details, but hopefully it's enough to get > you pointed in the right direction... > > Cheers, > Jeff > > > > On Fri, Feb 2, 2018 at 11:

Usual remedy for "Under Replicated" and "Offline Partitions"

2018-02-02 Thread Richard Rodseth
We have a DataDog integration showing some metrics, and for one of our clusters the above two values are > 0 and highlighted in red. What's the usual remedy (Confluient Platform, OSS version) ? Thanks

Re: poll() semantics

2016-04-24 Thread Richard Rodseth
://cwiki.apache.org/confluence/display/KAFKA/KIP-41%3A+KafkaConsumer+Max+Records > . > > Cheers, > Jens > > On Sat, Apr 23, 2016 at 2:20 AM Richard Rodseth > wrote: > > > To answer my own question (partially), I have learned that > > > > max.partition

Re: poll() semantics

2016-04-22 Thread Richard Rodseth
("auto.offset.reset","earliest") has the desired effect. On Fri, Apr 22, 2016 at 11:08 AM, Richard Rodseth wrote: > Do I understand correctly that poll() will return a subset of the messages > in a topic each time it is called? So if I want to replay all messages, I > would seek t

poll() semantics

2016-04-22 Thread Richard Rodseth
Do I understand correctly that poll() will return a subset of the messages in a topic each time it is called? So if I want to replay all messages, I would seek to the beginning and call poll in a loop? Not easily knowing when I was done, without a high watermark https://issues.apache.org/jira/brow

Re: Confluent or not?

2016-03-29 Thread Richard Rodseth
ny closed-source stuff yet. It is > coming up, but you'll never have to use it (and therefore never have to pay > us.) > > Hope this helps, > > Gwen > > On Mon, Mar 28, 2016 at 1:20 PM, Richard Rodseth > wrote: > > > For a low-budget proof of concept, would y

Confluent or not?

2016-03-28 Thread Richard Rodseth
For a low-budget proof of concept, would you recommend starting with the Apache download, or the Confluent platform? Does the Confluent product ultimately lock one into obtaining a license? Are components like Schema Registry available to non-paying users, just not there out-of-the-box ?

Reaction to Reactive Streams?

2014-04-17 Thread Richard Rodseth
Announcement from Typesafe et al: http://www.reactive-streams.org/ https://typesafe.com/blog/typesafe-announces-akka-streams

Re: Using Kafka 0.8 from Scala and Akka

2013-12-03 Thread Richard Rodseth
Any update on this, Chetan? Thanks. On Thu, Oct 31, 2013 at 4:11 PM, chetan conikee wrote: > I am in the process of releasing out Scala and RxJava consumer(s) on > github. Will be releasing it soon. Keep an eye out. > > > On Thu, Oct 31, 2013 at 3:49 PM, Richard Rodseth >

Kafka for *critical* data

2013-11-01 Thread Richard Rodseth
I'm excited about Kafka but want to be sure it is ready (or will be soon) for a critical data pipeline. What are the showstoppers, if any? eg. https://issues.apache.org/jira/browse/KAFKA-156 mentioned here: http://stackoverflow.com/questions/12130481/is-kafka-ready-for-production-use/12764663#1

Using Kafka 0.8 from Scala and Akka

2013-10-31 Thread Richard Rodseth
So I have the 0.8. Beta 1 consumer Java example running now. Is there a Scala API documented somewhere? What about Akka examples? RxJava? When I Google for that I get old links to using Kafka as a durable Akka mailbox. I don't think that's what I'm looking for. I just want something "reactive" tha

Re: Roadmap

2013-10-31 Thread Richard Rodseth
op> > ********/ > > > On Thu, Oct 31, 2013 at 12:48 PM, Richard Rodseth >wrote: > > > Thanks Neha. > > > > I get the following compilation error in Eclipse, and in a maven build. > > > > The type scala.collection.

Re: Roadmap

2013-10-31 Thread Richard Rodseth
e data is probably end of Jan 2014. I > updated the versions page to reflect that. > > Thanks, > Neha > > > On Wed, Oct 30, 2013 at 6:39 PM, Richard Rodseth > wrote: > > > Hi > > > > I just started looking at Kafka today. Installing 0.8 Beta 1 went well >

Roadmap

2013-10-30 Thread Richard Rodseth
Hi I just started looking at Kafka today. Installing 0.8 Beta 1 went well and I was able to run the command-line producer and consumer. When I tried to write some Java code, I ran into problems with Maven dependencies (it was looking for Scala.Product). I used the appropriate from Maven central.