Re: Question on Task Chaining

2015-11-07 Thread Isha Arkatkar
Thanks Stephan! That helps :) Regards, Isha On Sat, Nov 7, 2015 at 7:08 AM, Stephan Ewen wrote: > Hi! > > Chained tasks run in the same thread, and there is no serialization > involved. The FilterFunction is directly called on the result of the > MapFunction. > > Records between non-chained tas

Re: Accessing TM metrics

2015-11-07 Thread Gyula Fóra
Thanks Stephan, this should work for now :) You are right, latency is quite tricky, I don't have any better ideas either, but I will definitely let you know if there are any. Gyula Stephan Ewen ezt írta (időpont: 2015. nov. 7., Szo, 21:58): > You probably need to calculate the throughput yours

Re: Accessing TM metrics

2015-11-07 Thread Stephan Ewen
You probably need to calculate the throughput yourself at this point, from accumulated number of records. You can periodically poll the following URLs via HTTP GET - /jobs/ : This gives you the aggregate number of records / bytes per JobVertex - /jobs//vertices/ : This gives you accumulated reco

Accessing TM metrics

2015-11-07 Thread Gyula Fóra
Hey guys, I am trying to look at the throughput of my Flink Streaming job over time. Is there any way to extract this information from the dashboard or is it only possible to view the cumulative statistics at given time points. Also I am wondering whether there is any info about the latency in th

Re: neo4j - Flink connector

2015-11-07 Thread Martin Junghanns
Hi Robert, Thank you for the hints. I tried to narrow down the error: Flink version: 0.10-SNAPSHOT Neo4j version: 2.3.0 I start with two dependencies: flink-java flink-gelly (1) Add neo4j-harness and run basic example from Neo4j [1] Leads to: java.lang.ClassNotFoundException: org.eclipse.jett

Re: Question on Task Chaining

2015-11-07 Thread Stephan Ewen
Hi! Chained tasks run in the same thread, and there is no serialization involved. The FilterFunction is directly called on the result of the MapFunction. Records between non-chained tasks always go through the serialization stack. Even in the case of non-chained tasks, the different operators sh