GitHub user sarutak opened a pull request:
https://github.com/apache/spark/pull/2432
[SPARK-3377] [Metrics] Metrics can be accidentally aggregated(Another
solution)
This PR is another solution for #2250
Closes #2250
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sarutak/spark metrics-structure-improvement2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2432.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2432
----
commit 4180993fdfd5643e5c1a37820266fb6abd626c84
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T08:23:31Z
Modified SparkContext to retain spark.unique.app.name property in SparkConf
commit 55debab06be171c094ece4ebc5fd9e1bb76b6b00
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T08:25:56Z
Modified SparkContext and Executor to set spark.executor.id to identifiers
commit 71609f57ff14f71ef62be74e737416789605e618
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T08:30:12Z
Modified sourceName of ExecutorSource, DAGSchedulerSource and
BlockManagerSource
commit 868e326f82a86001399842ba4dbfdb51203c0fd3
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T08:33:26Z
Modified MetricsSystem to set registry name with unique application-id and
driver/executor-id
commit 85ffc0244398b26365bcda751496a35bff3d3080
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T15:12:22Z
Revert "Modified sourceName of ExecutorSource, DAGSchedulerSource and
BlockManagerSource"
This reverts commit 71609f57ff14f71ef62be74e737416789605e618.
commit 4e057c9e20aad0d28c6c19920f2a6e868cf18a79
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T15:12:44Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 6fc5560846bbd99ebcbc916bbc840cadb8db7849
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T15:17:23Z
Modified sourceName of ExecutorSource, DAGSchedulerSource and
BlockManagerSource
commit 6f7dcd44bb07da4ee0686cf0b1994c97305ecee3
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T16:01:45Z
Modified constructor of DAGSchedulerSource and BlockManagerSource because
the instance of SparkContext is no longer used
commit 15f88a390fc78181e88e030f47903c0576b664bd
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-03T18:21:11Z
Modified MetricsSystem#buildRegistryName because conf.get does not return
null when correspondin entry is absent
commit fa7175bb6946d454016a30dc132fd8438a84c3a8
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-04T01:05:29Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 4603a398bbf14f2db5160583bc90191a529b81fe
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-04T01:56:28Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 3e098d8e5f578d466864a1ac157ef81514048569
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-04T05:17:38Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit e4a4593fd52da8a15770b8c3322f39b0f1363dbf
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-04T06:04:33Z
tmp
commit 912a637b1dbee0900d9c01f9487bb0c254d6f054
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-07T18:05:17Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 848819c5d67cad4081797b6c574f2f40de18b156
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-12T01:14:15Z
Merge branch 'metrics-structure-improvement' of github.com:sarutak/spark
into metrics-structure-improvement
commit 93e263ac53db9d81441f93777a7851d052a7e846
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-12T01:16:14Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 45bd33d3e8008515f8ee4fc10eeff92d046b6857
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-12T03:24:12Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 7b67f5a381099171a9ac0c11039f99d4a8300ffe
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-13T07:41:23Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 08e627e12a04de57a9c7eaae9deaa4bbb97688a1
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-15T05:04:45Z
Revert "tmp"
This reverts commit e4a4593fd52da8a15770b8c3322f39b0f1363dbf.
commit ead8966e4bed34243cda135cb5dd1b5ec5c8c332
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-15T05:05:11Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 3ea789626d188708878505157a13b9286ca3b3a7
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-16T18:22:51Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit 2ec848ad057c92c737fac63a7388f1cb9bd4d6e8
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-17T04:45:27Z
Merge branch 'master' of git://git.apache.org/spark into
metrics-structure-improvement
commit efcb6e149a274eca9f1780bd042451143fa6af57
Author: Kousuke Saruta <[email protected]>
Date: 2014-09-17T16:57:21Z
Modified to add application id to metrics name
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
