Matt Massie wrote:
Anthony-
The ganglia web site is at http://ganglia.info/ with documentation in a
wiki at http://ganglia.wiki.sourceforge.net/. There is also a good wiki
page at IBM as well
http://www.ibm.com/developerworks/wikis/display/WikiPtype/ganglia .
Ganglia packages are available for most distributions to help with
installation so make sure to grep for ganglia with your favorite package
manager (e.g. aptitude, yum, etc). Ganglia will give you more
information about your cluster than just Hadoop metrics. You'll get
CPU, load, memory, disk and network monitoring as well for free.
You can see live demos of ganglia at http://ganglia.info/?page_id=69.
Good luck.
-Matt
Out of Modesty, Matt neglects to mention that Ganglia one of his
projects, so not only does it work well with Hadoop today, I would
expect the integration to only get better over time.
Anthony -don't forget to feed those stats back into your DFS for later
analysis...