Not out of the box, no - I don't think you can use an attribute of the
posted JSON to specify topics for kafka or folder for HDFS.
For dynamically creating topics in kafka, you would have to write some kind
of custom kafka producer - the kafka channel or sink in flume requires a
kafka topic to be
I'm new to Flume and thinking to use Flume in the below scenario.
Our system receives events as HTTP POST, and we need to store them in Kafka(for
processing) as well as HDFS(as permanent store).
Can we configure Flume as below ?
* Source: HTTP (expecting JSON event as HTTP body, with a
