I wouldn't say no to some discussion of encryption. We're running on Azure EventHubs (with preparations for Kinesis for EC2, and Kafka for deployments in customer datacenters when needed) so can't just use disk level encryption (which would have its own overhead). We're putting all of our messages inside of encrypted envelopes before sending them to the stream which limits our opportunities for schema verification of the underlying messages to the declared type of the message.
Encryption at rest mostly works out to a sales point for customers who want assurances, and in a Kafka focused discussion might be dealt with by covering disk encryption and how the conversations between Kafka instances are protected. Christian On Wed, Feb 25, 2015 at 11:51 AM, Jay Kreps <j...@confluent.io> wrote: > Hey guys, > > One thing we tried to do along with the product release was start to put > together a practical guide for using Kafka. I wrote this up here: > http://blog.confluent.io/2015/02/25/stream-data-platform-1/ > > I'd like to keep expanding on this as good practices emerge and we learn > more stuff. So two questions: > 1. Anything you think other people should know about working with data > streams? What did you wish you knew when you got started? > 2. Anything you don't know about but would like to hear more about? > > -Jay >
