GitHub user DeathByTape opened a pull request:
https://github.com/apache/spark/pull/2769
Stats collection
Implementation of basic stats collection for updated scheduler.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/DeathByTape/spark Stats_Collection
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2769.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2769
----
commit 4db1b55ba0800185975cf55dd960c13d02963b7d
Author: Dennis J. McWherter Jr <[email protected]>
Date: 2014-10-09T04:49:22Z
Added NodeStats calculation helper class for stats reporting.
commit ff544fd272bd158c191e3559f6288d7c261df75b
Author: Dennis J. McWherter Jr <[email protected]>
Date: 2014-10-09T13:55:14Z
Updated code to be scalastyle compliant (i.e. Apache open source header).
commit 380331899491d0a02c94c67826e289213a92bcc9
Author: Dennis J. McWherter Jr <[email protected]>
Date: 2014-10-10T02:21:44Z
Added static/initial stats sending upon connection.
commit 565b8a4e0754ccf30ea2ea19a010e27f8a0c45ef
Author: Dennis J. McWherter Jr <[email protected]>
Date: 2014-10-10T03:37:04Z
Added node stats to web UI for worker.
commit 2fb4741779f221d412c35318f038635844830f8d
Author: Dennis J. McWherter Jr <[email protected]>
Date: 2014-10-10T13:18:28Z
Added support for Latency and LeanStatistics.
commit b3d1e23e7efa713a53785eec31264420853c3640
Author: Dennis J. McWherter Jr <[email protected]>
Date: 2014-10-10T21:28:01Z
Threading stats through to clients-- may need to look into the further to
make sure they're getting updated in correct places.
commit 4db0892fbdc4c93e07ac9d3872e4aa3495962f0b
Author: Dennis J. McWherter Jr <[email protected]>
Date: 2014-10-11T14:19:30Z
Node stat transmission fix.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
