Re: How to analyze space usage of Flink algorithms

2016-12-19 Thread Fabian Hueske
l the getRuntimeContext() to print or store it? > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/How-to-analyze- > space-usage-of-Flink-algorithms-tp10555p10686.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

Re: How to analyze space usage of Flink algorithms

2016-12-19 Thread otherwise777
extends the richfunction afaik, so how would i call the getRuntimeContext() to print or store it? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-analyze-space-usage-of-Flink-algorithms-tp10555p10686.html Sent from the Apache Flink

Re: How to analyze space usage of Flink algorithms

2016-12-16 Thread Fabian Hueske
k/flink-docs- > release-1.1/apis/metrics.html#list-of-all-variables > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/How-to-analyze- > space-usage-of-Flink-algorithms-tp10555p10661.html > Sent from the Apache

Re: How to analyze space usage of Flink algorithms

2016-12-16 Thread otherwise777
/apis/metrics.html#list-of-all-variables -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-analyze-space-usage-of-Flink-algorithms-tp10555p10661.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: How to analyze space usage of Flink algorithms

2016-12-09 Thread Greg Hogan
This does sound like a nice feature, both per-job and per-taskmanager bytes written to and read from disk. On Fri, Dec 9, 2016 at 8:51 AM, Chesnay Schepler wrote: > We do not measure how much data we are spilling to disk. > > > On 09.12.2016 14:43, Fabian Hueske wrote: > > Hi, > > the heap mem u

Re: How to analyze space usage of Flink algorithms

2016-12-09 Thread Chesnay Schepler
t things here, like Heap space, disk space, overal memory or allocated memory. I would like to analyze some of these. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-analyze-space-usage-of-Flink-algorithms-tp10555.

Re: How to analyze space usage of Flink algorithms

2016-12-09 Thread Fabian Hueske
his message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/How-to-analyze- > space-usage-of-Flink-algorithms-tp10555.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >

How to analyze space usage of Flink algorithms

2016-12-09 Thread otherwise777
e can mean different things here, like Heap space, disk space, overal memory or allocated memory. I would like to analyze some of these. -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-analyze-space-usage-of-Flink-algorithms-tp10555.html Sen