Hi, I have a use case for which it would be useful with pluggable processing functions in the broker.
We have some data containing sensitive information which is legally ok to transmit over the internal network to the Kafka brokers and keep in volatile memory but not to flush to disk unconcealed/unencrypted. The application server resources are too scarce and critical to handle this processing so we must do it elsewhere. To cope with this, I'm looking for a way to plug a "concealer" somewhere near KafkaApis.handleProducerRequest before anything has been flushed to disk but I imagine that other people might come up with ideas where plugging in custom functions would be interesting as well. My case might be relatively specific but has the general idea of user plugins in different areas of the broker ever been discussed?
