So the answer to my previous question is NO.
It looks like I could use SparkEnv.get.conf but
* * NOTE: This is not intended for external use. This is exposed for Shark
and may be made private * in a future release. */
On Wed, 16 Mar 2016 at 08:22 Pete Robbins wrote:
> OK thanks. Does that wo
OK thanks. Does that work in an executor?
On Wed, 16 Mar 2016 at 07:58 Reynold Xin wrote:
> SparkConf is not a singleton.
>
> However, SparkContext in almost all cases are. So you can use
> SparkContext.getOrCreate().getConf
>
> On Wed, Mar 16, 2016 at 12:38 AM, Pete Robbins
> wrote:
>
>> I'm w
SparkConf is not a singleton.
However, SparkContext in almost all cases are. So you can use
SparkContext.getOrCreate().getConf
On Wed, Mar 16, 2016 at 12:38 AM, Pete Robbins wrote:
> I'm writing a metrics sink and reporter to push metrics to Elasticsearch.
> An example format of a metric in JSO
I'm writing a metrics sink and reporter to push metrics to Elasticsearch.
An example format of a metric in JSON:
{
"timestamp": "2016-03-15T16:11:19.314+",
"hostName": "10.192.0.87"
"applicationName": "My application",
"applicationId": "app-20160315093931-0003",
"executorId": "17",
"exec
