Hey Ian, this is where a tool like kafkacat comes in handy, it will use a random partitioner by default (without the need for defining a key):
tail -f /my/log | kafkacat -b mybroker -t mytopic See https://github.com/edenhill/kafkacat 2014-04-10 6:13 GMT+07:00 Ian Friedman <i...@flurry.com>: > Hey guys. We recently migrated our production cluster from 0.7.2 to 0.8.1. > One of the tools in the 0.7 distribution was something called Producer > Shell, which we used in some cron jobs to do some manual addition of > messages (for messages that got dropped for various reasons). So in 0.8 > that is gone, and I have tried replacing it with the console Producer. It > seems like the console producer only produces to a single partition whereas > the producer shell used to randomly distribute the messages. Is this > behavior configurable? AM I missing something obvious? > > Thanks in advance > --Ian