RE: Kafka Producer 0.9 performance issue with small messages

Gary, I was asking last week on the dev list regarding performance in 0.9.x and how best to achieve optimal message throughput and find your results rather interesting. Is producing 7142 msg/sec a fairly typical rate for your test environment (I realize you're just using your laptop, though).

RE: Regarding The Kafka Offset Management Issue In Direct Stream Approach.

Charan, You may find this Gist useful for storing/retrieving offsets for Kafka topics: https://gist.github.com/ariens/e6a39bc3dbeb11467e53 From: Cody Koeninger [c...@koeninger.org] Sent: Friday, November 06, 2015 10:10 AM To: users@kafka.apache.org Subjec

Kafka Connect and Spark/Storm Comparisons

I just finished reading up on Kafka Connect and am trying to wrap my head around where it fits within the big data ecosystem. Other than the high level overview provided in the docs I haven't heard much about this feature. My limited understan