Hi,
There's also SPM for Spark --
http://sematext.com/spm/integrations/spark-monitoring.html
SPM graphs all Spark metrics and gives you alerting, anomaly detection,
etc. and if you ship your Spark and/or other logs to Logsene -
http://sematext.com/logsene - you can correlate metrics, logs, errors
parse:
>
>- jobs from the same batch are not grouped together
>- You only get total delay, not scheduling delay
>
>
> From: Hari Shreedharan
> Date: Tuesday, September 29, 2015 at 5:27 AM
> To: Shixiong Zhu
> Cc: Siva, "user@spark.apache.org"
> Sub
;user@spark.apache.org<mailto:user@spark.apache.org>"
Subject: Re: Monitoring tools for spark streaming
+1. The Streaming UI should give you more than enough information.
Thanks,
Hari
On Mon, Sep 28, 2015 at 9:55 PM, Shixiong Zhu
mailto:zsxw...@gmail.com>> wrote:
Which version ar
+1. The Streaming UI should give you more than enough information.
Thanks, Hari
On Mon, Sep 28, 2015 at 9:55 PM, Shixiong Zhu wrote:
> Which version are you using? Could you take a look at the new Streaming UI
> in 1.4.0?
> Best Regards,
> Shixiong Zhu
> 2015-09-29 7:52 GMT+08:00 Siva :
>> H
Which version are you using? Could you take a look at the new Streaming UI
in 1.4.0?
Best Regards,
Shixiong Zhu
2015-09-29 7:52 GMT+08:00 Siva :
> Hi,
>
> Could someone recommend the monitoring tools for spark streaming?
>
> By extending StreamingListener we can dump the delay in processing of
>
