Re: JMXSink for YARN deployment

2016-01-12 Thread Kyle Lin
SS_NAME' --master >> yarn-cluster --files /PATH/TO/metrics.properties /PATH/TO/JAR.FILE >> >> >> This will run JMX on the driver node on or "JMX_PORT". Note that the >> driver >> node and the YARN master node are not the same, you'll have to lo

Re: JMXSink for YARN deployment

2016-01-12 Thread Kyle Lin
are not the same, you'll have to look where > spark put the driver node and then connect there. > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/JMXSink-for-YARN-deployment-tp13958p25572.html > Sent from the Apache Spark User List ma

Re: JMXSink for YARN deployment

2015-12-04 Thread spearson23
ame, you'll have to look where spark put the driver node and then connect there. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/JMXSink-for-YARN-deployment-tp13958p25572.html Sent from the Apache Spark

Re: JMXSink for YARN deployment

2015-12-04 Thread spearson23
: http://apache-spark-user-list.1001560.n3.nabble.com/JMXSink-for-YARN-deployment-tp13958p25570.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr

Re: JMXSink for YARN deployment

2014-09-13 Thread Otis Gospodnetic
September 11, 2014 7:30 PM > *To:* user@spark.apache.org > *Subject:* JMXSink for YARN deployment > > > > Hello, we are in Sematext (https://apps.sematext.com/) are writing > Monitoring tool for Spark and we came across one question: > > > > How to enable JMX m

Re: JMXSink for YARN deployment

2014-09-11 Thread Vladimir Tretyakov
perties, but the prerequisite is that each container >>> should find this file in their local FS because this file is loaded locally. >>> >>> >>> >>> Besides I think this might be a kind of workaround, a better solution is >>> to fix this by some oth

Re: JMXSink for YARN deployment

2014-09-11 Thread Kousuke Saruta
s by some other solutions. Thanks Jerry *From:*Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com <mailto:vladimir.tretya...@sematext.com>] *Sent:* Thursday, September 11, 2014 10:08 PM *Cc:* user@spark.apache.org <mailto:user@sp

Re: JMXSink for YARN deployment

2014-09-11 Thread Vladimir Tretyakov
>> >> Jerry >> >> >> >> *From:* Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com] >> *Sent:* Thursday, September 11, 2014 10:08 PM >> *Cc:* user@spark.apache.org >> *Subject:* Re: JMXSink for YARN deployment >> >> >

Re: JMXSink for YARN deployment

2014-09-11 Thread Kousuke Saruta
mailto:user@spark.apache.org> *Subject:* Re: JMXSink for YARN deployment Hi Shao, thx for explanation, any ideas how to fix it? Where should I put metrics.properties file? On Thu, Sep 11, 2014 at 4:18 PM, Shao, Saisai mailto:saisai.s...@intel.com>> wrote: Hi, I’

Re: JMXSink for YARN deployment

2014-09-11 Thread Vladimir Tretyakov
akov [mailto:vladimir.tretya...@sematext.com] > *Sent:* Thursday, September 11, 2014 10:08 PM > *Cc:* user@spark.apache.org > *Subject:* Re: JMXSink for YARN deployment > > > > Hi Shao, thx for explanation, any ideas how to fix it? Where should I put > metrics.properties f

RE: JMXSink for YARN deployment

2014-09-11 Thread Shao, Saisai
to fix this by some other solutions. Thanks Jerry From: Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com] Sent: Thursday, September 11, 2014 10:08 PM Cc: user@spark.apache.org Subject: Re: JMXSink for YARN deployment Hi Shao, thx for explanation, any ideas how to fix it? Where should I

Re: JMXSink for YARN deployment

2014-09-11 Thread Vladimir Tretyakov
the yarn container, so metrics > system cannot load the right sinks. > > > > Thanks > > Jerry > > > > *From:* Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com] > *Sent:* Thursday, September 11, 2014 7:30 PM > *To:* user@spark.apache.org > *Su

RE: JMXSink for YARN deployment

2014-09-11 Thread Shao, Saisai
7:30 PM To: user@spark.apache.org Subject: JMXSink for YARN deployment Hello, we are in Sematext (https://apps.sematext.com/) are writing Monitoring tool for Spark and we came across one question: How to enable JMX metrics for YARN deployment? We put "*.sink.jmx.

JMXSink for YARN deployment

2014-09-11 Thread Vladimir Tretyakov
Hello, we are in Sematext (https://apps.sematext.com/) are writing Monitoring tool for Spark and we came across one question: How to enable JMX metrics for YARN deployment? We put "*.sink.jmx.class=org.apache.spark.metrics.sink.JmxSink" to file $SPARK_HOME/conf/metrics.properties but it doesn't w