On Mar 19, 2009, at 6:56 AM, Tamir Kamara wrote:
Hi Brian,
I see GangliaContext31.class in the jar and GangliaContext31.java in
the src
folder.
By the way, I only used the last version of each patch. Should I
apply the
different files per patch from the earliest to the latest ?
Nope.
Can you perform "lsof" on the running process and see if it's perhaps
using the wrong JAR?
Brian
Thanks,
Tamir
On Thu, Mar 19, 2009 at 1:38 PM, Brian Bockelman
<bbock...@cse.unl.edu>wrote:
Hey Tamir,
Can you see the file GangliaContext31.java in your jar? In the
source
directory?
Brian
On Mar 19, 2009, at 2:33 AM, Tamir Kamara wrote:
Hi,
All my testing were fine with Ganglia 3.0, I used HADOOP-3422
patch to fix
the metric names provided by hadoop and it worked. Because I had to
recompile hadoop (base 0.18.3) I also used Hadoop-4675 in order to
use the
latest Ganglia (3.1). After changing the metrics file to report
with the
GangliaContext31 class I started getting a ClassNotFoundException.
The
command I used to recompile hadoop was "ant clean jar" and then I
moved
and
renamed it instead of the original core jar.
Do you what is wrong ?
Thanks,
Tamir
On Tue, Mar 17, 2009 at 5:25 PM, jason hadoop
<jason.had...@gmail.com
wrote:
Make all of your hadoop-metrics properties use the standard IP
address of
your master node.
Then add a straight udp receive block to the gmond.conf of your
master
node.
Then point your gmetad.conf at your master node.
There are complete details in forthcoming book, and with this in
it,
should
be available in alpha soon.
On Tue, Mar 17, 2009 at 8:23 AM, Tamir Kamara <tamirkam...@gmail.com
>
wrote:
I sent my gmond.conf in my previous email... and the address is
like
carlos
wrote.
I'll change the hadoop-metrics file and check again.
However, I would prefer to use a method I'm more familiar with -
like
unicast tcp communication. Do you know what I need to change in
ganglia
and
/ or hadoop to use it ?
Thanks.
On Tue, Mar 17, 2009 at 5:16 PM, Brian Bockelman <bbock...@cse.unl.edu
wrote:
On Mar 17, 2009, at 10:08 AM, Carlos Valiente wrote:
On Tue, Mar 17, 2009 at 14:56, Tamir Kamara <tamirkam...@gmail.com
>
wrote:
I don't know too much about multicast... and I'm using the
default
gmond
conf file.
The default multicast address seems to be 239.2.11.71, so
that's the
one for your hadoop-metrics.properties.
Yup, try that - although I could tell better if I had Tamir's
gmond.conf,
of course.
Wouldn't using the multicast address mean I'll need to specify a
different
address for each node so that the data won't get to all nodes
running
gmond
The design of Ganglia is such that all the data goes at all
the nodes
running gmond. If you don't like it, Ganglia 3.1 supports
non-multicast
TCP
channels.
For reference, our 200 node cluster has about 250KB/s of
background
chatter
on idle nodes, which is probably Ganglia-related. It's an
incredibly
small
perturbation on network traffic.
Brian
I'm not an expert, either --- I'm using the same multicast
address on
all nodes in my cluster. On each node, tcpdump shows incoming
Ganglia
traffic from every other node to the multicast address. It's
usually a
burst of about 200 UDP packets every 4 seconds or so (for a 6-
node
cluster), so the traffic overhead should be negligible.
C
--
Alpha Chapters of my book on Hadoop are available
http://www.apress.com/book/view/9781430219422
