Re: Comparison of storm and flink

2016-01-24 Thread Niels Basjes
Hi, I don't have a perfect list available but these are some of the things to keep in mind: 1) end2end Latency. Some systems (like spark) use microbatching which introduces a latency of seconds 2) Do you get "exactly once guarantees"? Storm can give you that but then the throughput goes really dow

Re: Comparison of storm and flink

2016-01-23 Thread Vinaya M S
Hi Slim Baltagi, Thank you for the list you mentioned. It will be really helpful. I have gone through few of the materials you have mentioned, like: 1. Benchmarking Streaming Computation Engines at Yahoo! 2. CapitalOne slides in slideshare. 3. Data-artisan article. Based on these I have ident

Re: Comparison of storm and flink

2016-01-23 Thread Slim Baltagi
Hi Vinaya 1. Comparing streaming tools ( in this case Storm and Flink) should not be based on performance benchmarks only! For example, slides 16-36 list over 96 criteria, that we identified at Capital One, to compare two streaming tools http://www.slideshare.net/sbaltagi/flink-vs-spark/17 2.