Durability

2014-07-24 Thread Matan Safriel
Hi, I have come back to looking at Kafka after a while. Is it really the case that messages can be lost if the producer is disconnected from the broker, as described in KAFKA-789 , and touched on with some elaboration in KAFKA-156

Re: How to view Topic registration info and Partition state info from zookeeper in 0.8?

2013-03-01 Thread Matan Safriel
You can use the eclipse zookeeper plugin, if you only want to sporadically view state.. On Mar 1, 2013, at 11:49 AM, Jason Huang wrote: > Hello, > > I am reading the "Kafka data structures in Zookeeper" > (https://cwiki.apache.org/KAFKA/kafka-data-structures-in-zookeeper.html) > document and try

Re: Kafka replication presentation at ApacheCon

2013-02-28 Thread Matan Safriel
Thanks Jun, great slides! On Wed, Feb 27, 2013 at 11:52 PM, Jun Rao wrote: > Hi, > > I gave a talk on Kafka replication at ApacheCon yesterday. The slides can > be found at > http://www.slideshare.net/junrao/kafka-replication-apachecon2013(it's > also added to Kafka wiki). I will share the link

Re: Error when running sbt test

2013-02-27 Thread Matan Safriel
Just to note moving to Unix you will no longer get this one, but rather the test suite will run. On Feb 28, 2013, at 12:38 AM, zayeem wrote: I fetched the head version(0.8) of Kafka and ran sbt test and got the following error. This is on a windows machine. Should i be using a different version

Re: Advice about running 0.8 tests

2013-02-26 Thread Matan Safriel
/kafka > running on the same box ? > Al though its a pain, we currently don't use any tool for viewing the test > results, but maybe the new version of sbt that we upgraded to has some > options that I'm unaware of. > > Thanks, > Neha > > > On Fri, Feb 22, 2013

Advice about running 0.8 tests

2013-02-22 Thread Matan Safriel
Hi, I grabbed the 0.8 branch today and managed building it with SBT as well as in eclipse. I'm running the tests through *./sbt test - *which naturally yields one long output that is very hard to deal with. What's your favorite configuration or tool for viewing kafka 0.8's test results in a more i

Re: status of 0.8?

2013-02-22 Thread Matan Safriel
As per 0.8, just a quick question about grabbing HEAD. What's the difference between the 0.8 branch and the trunk? Also should I take it from Neha's reply that replication is a must in using 0.8 even if you don't wish to use it? is there any design limitation (or operations aspect) that should make

Re: Committers: how do you develop locally?

2013-01-12 Thread Matan Safriel
Hi, Can you have a go at suggesting a viable dev environment for non-LinkedIn staff? Perhaps the following would make sense to ask in this context. - How much hardware would you throw at it if you didn't have access to a very large lab? - Have you ever run (for dev/testing) many compone

Kafka when volume is low

2012-12-16 Thread Matan Safriel
Hi, I've read about Kafka being used for huge paces and volumes of messages. My scenario is a bit different, I'm looking for mostly only persistence of a message queue, where the queue is usually not huge. This scenario means that messages are not typically queued for long. Why Kafka? What I like