Re: extract workers' resources stats

2015-08-07 Thread Stefanos Antaris
Hi to all. Thank you for your quick response. I will try both of your solutions in order to find which one I the best. Thanks, Stefanos On 7 Aug 2015 20:40, "Robert Metzger" wrote: > Hi Stefanos, > > you can also write yourself a little script/tool which is periodically > requesting the followi

Re: extract workers' resources stats

2015-08-07 Thread Robert Metzger
Hi Stefanos, you can also write yourself a little script/tool which is periodically requesting the following JSON from the JobManager: http://localhost:8081/setupInfo?get=taskmanagers&_=1438972693441 It returns a JSON string like this: {"taskmanagers":[{"path":"akka:\/\/flink\/user\/taskmanager

Re: extract workers' resources stats

2015-08-07 Thread Andra Lungu
Hi, You can use something like iostat to extract the CPU usage. For instance, I call this script on the JM node: #!/usr/bin/env bash lines=`cat /home/andra.lungu/hostnames.txt | paste -d, -s` echo "${lines}" IFS="," read -ra hostnames <<<"${lines}" for line in "${hostnames[@]}"; do ssh ${line}

extract workers' resources stats

2015-08-07 Thread Stefanos Antaris
Hi to all. I am working an a research project using flink and i would like to extract the CPU + RAM resources consumed on each worker in order to include the stats in my paper. Can anyone advice me on how could i extract them? Thanks in advance. Stefanos