Re: Monitoring single-run job statistics

2016-01-06 Thread Stephan Ewen
on long running Flink cluster? >>> >>> I will be very grateful for an answer:) >>> >>> Best regards, >>> Filip >>> >>> Pozdrawiam, >>> Filip Łęczycki >>> >>> 2016-01-04 10:05 GMT+01:00 Till Rohrmann : >&g

Re: Monitoring single-run job statistics

2016-01-06 Thread Filip Łęczycki
) for a single job ran on long running Flink cluster? >> >> I will be very grateful for an answer:) >> >> Best regards, >> Filip >> >> Pozdrawiam, >> Filip Łęczycki >> >> 2016-01-04 10:05 GMT+01:00 Till Rohrmann : >> >>> Hi Fil

Re: Monitoring single-run job statistics

2016-01-05 Thread Stephan Ewen
r:) > > Best regards, > Filip > > Pozdrawiam, > Filip Łęczycki > > 2016-01-04 10:05 GMT+01:00 Till Rohrmann : > >> Hi Filip, >> >> at the moment it is not possible to retrieve the job statistics after the >> job has finished with flink run -m ya

Re: Monitoring single-run job statistics

2016-01-04 Thread Filip Łęczycki
zycki 2016-01-04 10:05 GMT+01:00 Till Rohrmann : > Hi Filip, > > at the moment it is not possible to retrieve the job statistics after the > job has finished with flink run -m yarn-cluster. The reason is that the > YARN cluster is only alive as long as the job is executed. Thus, I woul

Re: Monitoring single-run job statistics

2016-01-04 Thread Till Rohrmann
Hi Filip, at the moment it is not possible to retrieve the job statistics after the job has finished with flink run -m yarn-cluster. The reason is that the YARN cluster is only alive as long as the job is executed. Thus, I would recommend you to execute your jobs with a long running Flink cluster

Monitoring single-run job statistics

2016-01-01 Thread Filip Łęczycki
Hi all, I am running filnk aps on YARN cluster and I am trying to get some benchmarks. When I start a long-running flink cluster on my YARN cluster I have an access to web UI and rest API that provide me statistics of the deployed jobs (as desribed here: https://ci.apache.org/projects/flink/flink-

Re: Job Statistics

2015-06-18 Thread Stephan Ewen
>>>> >>>> 2015-06-18 10:45 GMT-03:00 Maximilian Michels : >>>> >>>>> Hi Jean, >>>>> >>>>> I think it would be a nice to have feature to display some metrics on >>>>> the command line after a job has c

Re: Job Statistics

2015-06-18 Thread Jean Bez
;> and the accumulator results available at the CLI and printing those would >>>> be easy. What metrics in particular are you looking for? >>>> >>>> Best, >>>> Max >>>> >>>> On Thu, Jun 18, 2015 at 3:41 PM, Jean Bez >>>

Re: Job Statistics

2015-06-18 Thread Jean Bez
>>> >>> Best, >>> Max >>> >>> On Thu, Jun 18, 2015 at 3:41 PM, Jean Bez wrote: >>> >>>> Hi Fabian, >>>> >>>> I am trying to compare some examples on Hadoop, Spark and Flink. If >>>> possible I wo

Re: Job Statistics

2015-06-18 Thread Maximilian Michels
already have the run time and >> the accumulator results available at the CLI and printing those would be >> easy. What metrics in particular are you looking for? >> >> Best, >> Max >> >> On Thu, Jun 18, 2015 at 3:41 PM, Jean Bez wrote: >> >>>

Re: Job Statistics

2015-06-18 Thread Jean Bez
, Jean Bez wrote: > >> Hi Fabian, >> >> I am trying to compare some examples on Hadoop, Spark and Flink. If >> possible I would like to see the job statistics like the report given by >> Hadoop. Since I am running these examples on a large cluster it would be &g

Re: Job Statistics

2015-06-18 Thread Maximilian Michels
Thu, Jun 18, 2015 at 3:41 PM, Jean Bez wrote: > Hi Fabian, > > I am trying to compare some examples on Hadoop, Spark and Flink. If > possible I would like to see the job statistics like the report given by > Hadoop. Since I am running these examples on a large cluster it would be &

Re: Job Statistics

2015-06-18 Thread Jean Bez
Hi Fabian, I am trying to compare some examples on Hadoop, Spark and Flink. If possible I would like to see the job statistics like the report given by Hadoop. Since I am running these examples on a large cluster it would be much better if I could obtain such data directly from the console

Re: Job Statistics

2015-06-18 Thread Fabian Hueske
Hi Jean, what kind of job execution stats are you interested in? Cheers, Fabian 2015-06-18 9:01 GMT+02:00 Matthias J. Sax : > Hi, > > the CLI cannot show any job statistics. However, you can use the > JobManager web interface that is accessible at port 8081 from a browser. &

Re: Job Statistics

2015-06-18 Thread Matthias J. Sax
Hi, the CLI cannot show any job statistics. However, you can use the JobManager web interface that is accessible at port 8081 from a browser. -Matthias On 06/17/2015 10:13 PM, Jean Bez wrote: > Hello, > > Is it possible to view job statistics after it finished to execute > dir

Job Statistics

2015-06-17 Thread Jean Bez
Hello, Is it possible to view job statistics after it finished to execute directly in the command line? If so, could you please explain how? I could not find any mentions about this in the docs. I also tried to set the logs to debug mode, but no other information was presented. Thank you