I am new to Flume but this is how I would solve your problem. You can get the
Community feedback.
I assume for your use case you can set the value of idleTimeout as each
transfer results in one HDFS file:
agent.sinks.hdfs1.hdfs.idleTimeout = 1
The default value is zero, you see that Flume will
Forgot to highlight that the value for the temp file is controlled by:
agent.sinks.hdfs1.hdfs.inUsePrefix = .
agent.sinks.hdfs1.hdfs.inUseSuffix = .temp
If you want to change them to set values as your script would depend on them.
From: Soheil Eizadi [seiz
