Re: One more Kafka Meetup hosted by LinkedIn in 2015 (this time in San Francisco) - does anyone want to talk?

2015-11-03 Thread Lukas Steiblys
This is sad news. I was looking forward to finally going to a Kafka or Samza meetup. Going to Mountain View for a meetup is just unrealistic with 2h travel time each way. Lukas -Original Message- From: Ed Yakabosky Sent: Tuesday, November 3, 2015 10:36 AM To: users@kafka.apache.org ;

Re: Kafka 8.2.2 doesn't want to compress in snappy

2015-10-18 Thread Lukas Steiblys
Sounds similar to my experience right now. We have 110GB of JSON data that I convert to AVRO and upload to Kafka 0.8.2.2 using the 0.8.2.2 Java producer with snappy compression. The entire logs in Kafka end up 53GB in size, which is way bigger than I'd expect. I haven't had time to dig into this

Re: Kafka loses data after one broker reboot

2015-09-01 Thread Lukas Steiblys
Hi Gleb, Are you sure you were not trying to read data that had already exceeded its retention policy? Lukas -Original Message- From: Gleb Zhukov Sent: Tuesday, September 1, 2015 6:26 AM To: users@kafka.apache.org Subject: Kafka loses data after one broker reboot Hi, All! We use 3

Re: Kafka metadata

2015-08-07 Thread Lukas Steiblys
Hi Qi, Yes, the metadata request will return information about all the brokers in the cluster. Alternatively you can get the same metadata from Zookeeper. Lukas -Original Message- From: Qi Xu Sent: Friday, August 7, 2015 2:30 PM To: users@kafka.apache.org Subject: Kafka metadata Hi