Re: Flink Benchmark: comparing flink's performance in different environments

2015-05-13 Thread Tobias Wiens
Hi Robert, thank you for your reply. Yes I read on the mailing list about it, very nice that you maintain it as part of the flink project now. I might swap to use those dockerfiles. Thank you for that tip, I will look more into the TPC-* direction. You are right I expect some impact in reading a

Re: Flink Benchmark: comparing flink's performance in different environments

2015-05-07 Thread Robert Metzger
Hi Tobias, sorry for the late reply. Did you checkout the code for starting flink on docker already? https://github.com/apache/flink/tree/master/flink-contrib/docker-flink Maybe that will save you some time ;) Benchmarks using TPC-* data are quite popular. Maybe this is also helpful for you: http

Flink Benchmark: comparing flink's performance in different environments

2015-05-04 Thread Tobias Wiens
Hi, I am writing my master thesis about how to orchestrate scalable tasks and services with docker. The idea is to swap a task's environment very fast, I plan to use Flink as the environment. For that I package Apache Flink into container and start one master and X worker nodes plus one task on th