Yes, and if on top of that it would be possible to define an own “compression” algorithm, which actually does compress + encrypt, then this would be a non-issue.
> On 06 Jun 2016, at 17:11, Ismael Juma <ism...@juma.me.uk> wrote: > > On Mon, Jun 6, 2016 at 3:12 PM, Tom Brown <tombrow...@gmail.com> wrote: > >> How would it be possible to encrypt an entire batch? My understanding >> is that the Kafka server needs to know the boundaries of each message. >> (E.g. The server decompresses compressed message sets and re-compresses >> individual messages). >> > > Quick note: as of 0.10 and KIP-31, the broker can avoid recompressing > messages. > > Ismael
