Re: how to work arounf Kafka message length?

2014-03-22 Thread Dan Hoffman
Why not use the snappy/gzip compression? On Saturday, March 22, 2014, Vishal Kapoor wrote: > Hello, > > We are in the process of building a general purpose messaging system, our > messages are in xml format to start with, and usually are longer than 1 mb, > what are the best practices around bre

how to work arounf Kafka message length?

2014-03-22 Thread Vishal Kapoor
Hello, We are in the process of building a general purpose messaging system, our messages are in xml format to start with, and usually are longer than 1 mb, what are the best practices around breaking messages into smaller units, we may also need to support binary messages sometime in future, it i

kafka.common.LeaderNotAvailableException

2014-03-22 Thread Robert Zitelli
All, Please help... I constantly get LeaderNotAvailableExceptions using the kafka-console-producer. I am using kafka_2.8.0-0.8.0 zookeeper and kafka-server seem to run without errors. Here are the results from the topic list and the kafka-console-producer. The server-change.log is below; there a