Re: Running Kafka on Windows?

2012-12-04 Thread Johan Lundahl
I've been testing 0.72 successfully on windows but converted the start scripts myself. The only trap I ran into was forgetting to convert the .properties files to use unix style line breaks after editing them in a win editor. Johan On Wed, Dec 5, 2012 at 6:21 AM, Jun Rao wrote: > The windows s

Re: Producer questions and more

2012-12-14 Thread Johan Lundahl
ne. I offered to act as "personal programming slave" to any of the > LinkedIn designers if they would make us a nice logo. If that approach > fails maybe we should just do 99 designs? > > Cheers, > > -Jay > > > On Fri, Dec 14, 2012 at 4:42 AM, Johan Lundahl &g

Re: new website

2012-12-14 Thread Johan Lundahl
Hi, I ran FF linkchecker plugin on the new site and found a few things: * api docs in the left menu link to 0.7.1 is that right or is there api docs for 0.7.2? * on http://kafka.apache.org/downloads.html the KEYS link: http://svn.apache.org/repos/asf/incubator/kafka/KEYS gives 404 * on ht

Re: Retrieve most-recent-n messages from kafka topic

2013-07-19 Thread Johan Lundahl
I've had a similar use case where we want to browse and display the latest few messages in different topics in a webapp. This kind of works by doing as you describe; submitting a FetchRequest with an offset of messages_desired * avg_bytes_per_message plus a bit more. You'll get the ByteBuffer and

Re: Retrieve most-recent-n messages from kafka topic

2013-07-19 Thread Johan Lundahl
> Johan, are you using just the simple FetchRequest? Did you get around the > InvalidMessageSizeError when you try to force a fetch offset different from > those returned by getOffsetsBefore? Or are you also starting from that > last known offset and iterating forwards by the desired amount? >

Broker side consume-request filtering

2014-03-13 Thread Johan Lundahl
Hi, I have a use case that might be relevant to the new consumer API but that would require most of the work on the broker. I would be surprised if it had not been discussed before but I was not able to find any directly related thread. Has there been any discussion about providing broker side con

Broker plugins

2014-03-13 Thread Johan Lundahl
Hi, I have a use case for which it would be useful with pluggable processing functions in the broker. We have some data containing sensitive information which is legally ok to transmit over the internal network to the Kafka brokers and keep in volatile memory but not to flush to disk unconcealed/

Re: Broker plugins

2014-03-13 Thread Johan Lundahl
processing to the client side. In > > this case, you can imagine a producer that encrypts sensitive data before > > sending it to a topic on the broker. > > > > Thanks, > > Neha > > > > > > On Thu, Mar 13, 2014 at 11:03 AM, Johan Lundah