Re: Key factors for Flink's performance

2016-05-11 Thread Stephan Ewen
Hi Leon! I agree with Aljoscha that the term "microbatches" is confusing in that context. Flink's network layer is "buffer" oriented rather than "record oriented". Buffering it is a best effort to gather some elements in case where they come fast enough that this would not add much latency anyways

Re: Key factors for Flink's performance

2016-05-11 Thread Aljoscha Krettek
Hi, latency for Flink and Storm are pretty similar. The only reason I could see for Flink having the slight upper hand there is the fact that Storm tracks the progress of every tuple throughout the topology and requires ACKs that have to go back to the sinks. As for throughput you are right that F

Key factors for Flink's performance

2016-05-09 Thread leon_mclare
Hello Flink team, i am currently playing around with Storm and Flink in the context of a smart home. The primary functional requirement is to quickly react to certain properties in stream tuples. I was looking at some benchmarks from the two systems, and generally Flink has the upper hand, in bo