Have you considered encrypting at the broker filesystem level, perhaps with
something like LUKS?
Alex
On Fri, Jan 15, 2016 at 8:38 AM, Jim Hoagland
wrote:
> We did not look at compression and did not use it. You'll probably get
> the best compression while having encryption by building a batch
We did not look at compression and did not use it. You'll probably get
the best compression while having encryption by building a batch of
messages, compressing that, then encrypting the compressed batch.
Compressing across the batch will probably almost certainly be better
space-wise than compre
Thanks for the input Jim.
We managed to reduce the encryption impact to about 25% by disabling the kafka
batch compression and compressing the messages ourselves before encrypting them
one-by-one. However we still believe we could improve by batch compressing +
batch encrypting.
Can you confi
We did a proof of concept on end-to-end encryption using an approach which
sounds similar to what you describe. We blogged about it here:
http://www.symantec.com/connect/blogs/end-end-encryption-though-kafka-our-p
roof-concept
You might want to review what is there to see how it differs from w
Hello,
In our project we have a very strong requirement to protect all data, all the
time. Even when the data is “in-rest” on disk, it needs to be protected.
We’ve been trying to figure out how to this with Kafka, and hit some obstacles.
One thing we’ve tried to do is to encrypt every message we
