It looks like there is a now a PR request available for the storm
compatibility: https://github.com/apache/flink/pull/764
It seems were are not the only new stream processing system with
compatibility to Storm: http://dl.acm.org/citation.cfm?id=2742788
On Tue, Jun 2, 2015 at 11:09 AM, Szabó Péter
@Robert
Thanks! I think the PR will be ready to merge soon :)
@Matthias
I fixed the finite-source issue on my branch, now every example and ITCase
runs and stopps without throwing an exception. Also, in case of finite
sources, the spout wrapper will not loop infinitely.
I will study your branch an
Great to see that you two are working together on the storm compatibility
layer.
Please let the other Flink committers know when Matthias PR is in a state
that we can review it again (= when you think its ready).
Given the feedback from Peter and the long list of missing features and the
current r
Thank you very much, this explains a lot of things :)
I'm aware of that currently the support of TopologyContext is limited, so I
do not expect it to work smoothly. However, there was another issue with
the grouping by the "id" field, which seemed very strange. Anyway, I will
live the SimpleJoin ex
Hi Peter,
I started to look into the issue. However, I could not find the
following classes in the git repository:
org.apache.flink.stormcompatibility.util.AbstractStormSpout
org.apache.flink.stormcompatibility.util.OutputFormatter
org.apache.flink.stormcompatibility.util.StormBoltFileSink
org.ap
Hi Matthias,
Of course, here is the package that contains the example's source classes.
https://github.com/mbalassi/flink/tree/storm-backup/flink-staging/flink-streaming/flink-storm-examples/src/main/java/org/apache/flink/stormcompatibility/singlejoin
It is mostly a copy-paste of SimpleJoin from s
Hi Peter,
Thanks a lot for your feedback. It's exiting to see, that somebody uses
the layer already. :)
The current prototype is going to be merged soon. However, I am more
than happy to extend the functionality of the layer. Can you please
share your example with me, so I can see what the proble
Hey everyone,
I experimented with the Storm compatibility layer Matthias wrote, and ran
some Storm examples on Flink. I found that Storm's SimpleJoin example does
not work. I suppose it is because of the multiple input streams. I'm
willing to add another example instead.
Right now, I'm getting it
