SS_NAME' --master
>> yarn-cluster --files /PATH/TO/metrics.properties /PATH/TO/JAR.FILE
>>
>>
>> This will run JMX on the driver node on or "JMX_PORT". Note that the
>> driver
>> node and the YARN master node are not the same, you'll have to lo
are not the same, you'll have to look where
> spark put the driver node and then connect there.
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/JMXSink-for-YARN-deployment-tp13958p25572.html
> Sent from the Apache Spark User List ma
ame, you'll have to look where
spark put the driver node and then connect there.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/JMXSink-for-YARN-deployment-tp13958p25572.html
Sent from the Apache Spark
:
http://apache-spark-user-list.1001560.n3.nabble.com/JMXSink-for-YARN-deployment-tp13958p25570.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
September 11, 2014 7:30 PM
> *To:* user@spark.apache.org
> *Subject:* JMXSink for YARN deployment
>
>
>
> Hello, we are in Sematext (https://apps.sematext.com/) are writing
> Monitoring tool for Spark and we came across one question:
>
>
>
> How to enable JMX m
perties, but the prerequisite is that each container
>>> should find this file in their local FS because this file is loaded locally.
>>>
>>>
>>>
>>> Besides I think this might be a kind of workaround, a better solution is
>>> to fix this by some oth
s by some other solutions.
Thanks
Jerry
*From:*Vladimir Tretyakov
[mailto:vladimir.tretya...@sematext.com
<mailto:vladimir.tretya...@sematext.com>]
*Sent:* Thursday, September 11, 2014 10:08 PM
*Cc:* user@spark.apache.org <mailto:user@sp
>>
>> Jerry
>>
>>
>>
>> *From:* Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com]
>> *Sent:* Thursday, September 11, 2014 10:08 PM
>> *Cc:* user@spark.apache.org
>> *Subject:* Re: JMXSink for YARN deployment
>>
>>
>
mailto:user@spark.apache.org>
*Subject:* Re: JMXSink for YARN deployment
Hi Shao, thx for explanation, any ideas how to fix it? Where
should I put metrics.properties file?
On Thu, Sep 11, 2014 at 4:18 PM, Shao, Saisai
mailto:saisai.s...@intel.com>> wrote:
Hi,
I’
akov [mailto:vladimir.tretya...@sematext.com]
> *Sent:* Thursday, September 11, 2014 10:08 PM
> *Cc:* user@spark.apache.org
> *Subject:* Re: JMXSink for YARN deployment
>
>
>
> Hi Shao, thx for explanation, any ideas how to fix it? Where should I put
> metrics.properties f
to fix
this by some other solutions.
Thanks
Jerry
From: Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com]
Sent: Thursday, September 11, 2014 10:08 PM
Cc: user@spark.apache.org
Subject: Re: JMXSink for YARN deployment
Hi Shao, thx for explanation, any ideas how to fix it? Where should I
the yarn container, so metrics
> system cannot load the right sinks.
>
>
>
> Thanks
>
> Jerry
>
>
>
> *From:* Vladimir Tretyakov [mailto:vladimir.tretya...@sematext.com]
> *Sent:* Thursday, September 11, 2014 7:30 PM
> *To:* user@spark.apache.org
> *Su
7:30 PM
To: user@spark.apache.org
Subject: JMXSink for YARN deployment
Hello, we are in Sematext (https://apps.sematext.com/) are writing Monitoring
tool for Spark and we came across one question:
How to enable JMX metrics for YARN deployment?
We put "*.sink.jmx.
Hello, we are in Sematext (https://apps.sematext.com/) are writing
Monitoring tool for Spark and we came across one question:
How to enable JMX metrics for YARN deployment?
We put "*.sink.jmx.class=org.apache.spark.metrics.sink.JmxSink"
to file $SPARK_HOME/conf/metrics.properties but it doesn't w
14 matches
Mail list logo