Are there the plan to upgrade kafka?

2017-07-03 Thread Takafumi Saito
Hi all, Kafka 0.11.0.0 was already released. There are additions of exactly-once semantics and record headers as new features. I think these features are very important when considering integration with Flume. Are there the plan to upgrade kafka to 0.11.0.0? (Current version of kafka in Flume is

unable to save streaming data in hive as RCfile format

2017-07-03 Thread Kumar, Ashok 6. (Nokia - IN/Bangalore)
Hi , I am using kafka as source and hive as a sink , I am getting streaming data from kafka and trying to save this data into hive as RCfile format. But I am getting the following error : 2017-07-03 07:18:59,128 (SinkRunner-PollingRunner-DefaultSinkProcessor) [INFO - org.apache.flume.sink.hive

Management of transfer across agents

2017-07-03 Thread Takafumi Saito
Hi, I’d like to manage the whole transfer of flume agents by aggregating settings of each agents. The goal is to construct online forwarding route, which figure out where events will go, across flume agents. Please let me know if there already are libraries or plugins that realize it. If not, I