Re: [Proposal] Enabling time series analysis on spark metrics

2016-03-03 Thread Karan Kumar
le. > > > On Tue, Mar 1, 2016 at 8:17 AM, Karan Kumar > wrote: > >> +dev mailing list >> >> Time series analysis on metrics becomes quite useful when running spark >> jobs using a workflow manager like oozie. >> >> Would love to take this up if the

[Proposal] Enabling time series analysis on spark metrics

2016-02-23 Thread Karan Kumar
HI Spark at the moment uses application ID to report metrics. I was thinking that if we can create an option to export metrics on a user-controlled key. This will allow us to do time series analysis on counters by dumping these counters in a DB such as graphite. One of the approaches I had in min

Re: [Proposal] Enabling time series analysis on spark metrics

2016-03-01 Thread Karan Kumar
+dev mailing list Time series analysis on metrics becomes quite useful when running spark jobs using a workflow manager like oozie. Would love to take this up if the community thinks its worthwhile. On Tue, Feb 23, 2016 at 2:59 PM, Karan Kumar wrote: > HI > > Spark at the mo