subject:"Re\: Spark Streaming Metrics"

Re: Spark Streaming Metrics

2014-11-21 Thread andy petrella

Yo, I've discussed with some guyz from cloudera that are working (only oO) on spark-core and streaming. The streaming was telling me the same thing about the scheduling part. Do you have some nice screenshots and info about stages running, task time, akka health and things like these -- I said th

Re: Spark Streaming Metrics

2014-11-21 Thread Gerard Maas

Looks like metrics are not a hot topic to discuss - yet so important to sleep well when jobs are running in production. I've created Spark-4537 to track this issue. -kr, Gerard. On Thu, Nov 20, 2014 at 9:25 PM, Gerard Maas wrote: > As the Spar