Hi,
This article may help you. Expose your counter through akka actor
https://tersesystems.com/2014/08/19/exposing-akka-actor-state-with-jmx/
Sent from Mail for Windows 10
From: Yogesh Vyas
Sent: 2015年11月5日 21:21
To: Romi Kuntsman
Cc: user@spark.apache.org
Subject: Re: JMX with Spark
Hi
Hi,
Please let me elaborate my question so that you will get to know what
exactly I want.
I am running a Spark Streaming job. This job is to count number of
occurrence of the event. Right now I am using a key/value pair RDD
which tells me the count of an event, where key is the event and value
is
Have you read this?
https://spark.apache.org/docs/latest/monitoring.html
*Romi Kuntsman*, *Big Data Engineer*
http://www.totango.com
On Thu, Nov 5, 2015 at 2:08 PM, Yogesh Vyas wrote:
> Hi,
> How we can use JMX and JConsole to monitor our Spark applications?
>
>
Hello Folks,
Sorry for the delay, these emails got missed due to the volume.
Here is my metrics.conf
root@jobs-ab-hdn4:~# cat /opt/klout/spark/conf/metrics.conf
# syntax: [instance].sink|source.[name].[options]=[value]
# This file configures Spark's internal metrics system. The metrics syste
Can you share your working metrics.properties.?
I want remote jmx to be enabled so i need to use the JMXSink and monitor my
spark master and workers.
But what are the parameters that are to be defined like host and port ?
So your config can help.
--
View this message in context:
http://ap
Hi Paul, would you please paste your metrics.conf out so that we can find the
problems if you still have problems.
Thanks
Jerry
From: Parviz Deyhim [mailto:pdey...@gmail.com]
Sent: Wednesday, April 16, 2014 9:10 AM
To: user@spark.apache.org
Subject: Re: JMX with Spark
home directory or $home
home directory or $home/conf directory? works for me with
metrics.properties hosted under conf dir.
On Tue, Apr 15, 2014 at 6:08 PM, Paul Schooss wrote:
> Has anyone got this working? I have enabled the properties for it in the
> metrics.conf file and ensure that it is placed under spark's home
