Thanks Andrew, I will take a look at it. On Tue, Apr 8, 2014 at 3:35 PM, Andrew Ash [via Apache Spark User List] < [email protected]> wrote:
> If you set up Spark's metrics reporting to write to the Ganglia backend > that will give you a good idea of how much network/disk/CPU is being used > and on what machines. > > https://spark.apache.org/docs/0.9.0/monitoring.html > > > On Tue, Apr 8, 2014 at 12:57 PM, yxzhao <[hidden > email]<http://user/SendEmail.jtp?type=node&node=3920&i=0> > > wrote: > >> Hi All, >> >> I want to measure the total network traffic for a Spark Job. But I >> did >> not see related information from the log. Does anybody know how to measure >> it? Thanks very much in advance. >> >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Measuring-Network-Traffic-for-Spark-Job-tp3912.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> > > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Measuring-Network-Traffic-for-Spark-Job-tp3912p3920.html > To unsubscribe from Measuring Network Traffic for Spark Job, click > here<http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3912&code=eXh6aGFvQHVhbHIuZWR1fDM5MTJ8LTY0Mjc0NDkzMQ==> > . > NAML<http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Measuring-Network-Traffic-for-Spark-Job-tp3912p3963.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
