Thanks for the overview. I think I will use akka streams and pipe the
result to kafka, then move on with flink.
Tzu-Li (Gordon) Tai schrieb am Do. 27. Apr. 2017 um
18:37:
> Hi Georg,
>
> Simply from the aspect of a Flink source that listens to a REST endpoint
> for input data, there should be qui
Hi Georg,
Simply from the aspect of a Flink source that listens to a REST endpoint for
input data, there should be quite a variety of options to do that. The Akka
streaming source from Bahir should also serve this purpose well. It would also
be quite straightforward to implement one yourself.
Wouldn't adding flume -> Kafka -> flink also introduce additional latency?
Georg Heiler schrieb am So., 23. Apr. 2017 um
20:23 Uhr:
> So you would suggest flume over a custom akka-source from bahir?
>
> Jörn Franke schrieb am So., 23. Apr. 2017 um
> 18:59 Uhr:
>
>> I would use flume to import t
So you would suggest flume over a custom akka-source from bahir?
Jörn Franke schrieb am So., 23. Apr. 2017 um
18:59 Uhr:
> I would use flume to import these sources to HDFS and then use flink or
> Hadoop or whatever to process them. While it is possible to do it in flink,
> you do not want that
I would use flume to import these sources to HDFS and then use flink or Hadoop
or whatever to process them. While it is possible to do it in flink, you do not
want that your processing fails because the web service is not available etc.
Via flume which is suitable for this kind of tasks it is mor
