Hi @all, I started to work on an compatibility layer to run Storm Topologies on Flink. I just pushed a first beta: https://github.com/mjsax/flink/tree/flink-storm-compatibility
Please check it out, and let me know how you like it. In this first version, I tried to code without changing too many things in the existing code. However, a deeper integration would be nice. There are many things that do not work yet. Currently, only shuffle and fieldsGrouping is supported (and only Storm's default output stream). Furthermore, topologies must be "simple", ie, they cannot be configured with a Config object and Storm meta information (ie, TopologyContext) is also not there. The layer can be used to integrate existing Spouts and/or Bolts as Flink operators into a regular Flink program. Furthermore, a whole Storm topology can be executed by switching from TopologyBuilder to FlinkTopologyBuilder and from LocalCluster/NimbusClient/StormSubmitter to FlinkLocalCluster/FlinkClient/FlinkStormSubmitter. Examples of both cases are given as ITCases. Cheers, Matthias
signature.asc
Description: OpenPGP digital signature