Monitoring single-run job statistics

2016-01-01 Thread Filip Łęczycki
Hi all, I am running filnk aps on YARN cluster and I am trying to get some benchmarks. When I start a long-running flink cluster on my YARN cluster I have an access to web UI and rest API that provide me statistics of the deployed jobs (as desribed here: https://ci.apache.org/projects/flink/flink-

[ANNOUNCE] Introducing Apache Flink Taiwan User Group - Flink.tw

2016-01-01 Thread tzulitai
Hi Flink community, We are very excited to announce a new local Flink user group / meetup based in Taiwan: Facebook group: http://www.facebook.com/groups/flink.tw Blog: http://blog.flink.tw We're a group of Chinese-speaking p

RideCleansing example

2016-01-01 Thread Serkan Taş
Hi, I am working on lectures and examples to get used to on flink. For the RideCleansing example, in intelliJ it is working as expected. But after packaging submitting to local flink, there is no output. is it normal ? Here is the console 01/01/2016 19:55:31 Job execution switched to sta

Re: Getting executionplan in the local mode inside IDE

2016-01-01 Thread Fabian Hueske
Hi, you can only get the execution plan for programs that have a data sink and haven't been executed. In your code print() defines the data sink, however it also eagerly executes a program. After execution the program is "removed" from the execution environment. Therefore, Flink complains that no

Getting executionplan in the local mode inside IDE

2016-01-01 Thread madhu phatak
Hi, I am trying to get execution plan for wordcount using below code in local mode inside IntelliJ IDEA. I am using flink 0.10.0. val env = ExecutionEnvironment.getExecutionEnvironment val data = List("hi","how are you","hi") val dataSet = env.fromCollection(data) val words = dataSet.flatMap(va