ganglia configuration

0

I'm having a little trouble getting mapr or hadoop stats reporting to ganglia. I have ganglia up and running and reporting the usual stats. But when I try to configure mapr/hadoop metrics through /opt/mapr/hadoop/hadoop-0.20.2/conf/hadoop-metrics.properties nothing I seem to do triggers any metrics to get reported. I've had this running OK in the past on an apache-hadoop 0.20.2 cluster sending metrics to ganglia 3.0.x.

In this case, I'm using ganglia 3.1 running the web frontend and gmetad on a separate node. I've tried configuring the *.servers properties to point at several different spots ranging from the multicast address of the local gmond to the tcp port of the gmetad server and I'm not seeing any collection via the xml interfaces or in the web front-end.

I've run maprcli config save -values '{"cldb.ganglia.fileserver.metrics":"1"}' to trigger the reporting and I've restarted the fileserver and the tasktracker on the node I'm testing, but I can't even seem to find any logging info as to what might be misconfigured.

The contexts I'm trying to set up are (239.2.11.72 is the multicast endpoint that my gmonds are communicating over.):

mapred.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
mapred.period=10
mapred.servers=239.2.11.72:8649

jvm.class=org.apache.hadoop.metrics.ganglia.GangliaContext31
jvm.period=10
jvm.servers=239.2.11.72:8649

fileserver.class=com.mapr.fs.cldb.counters.MapRGangliaContext31
fileserver.period=10
fileserver.servers=239.2.11.72:8649
fileserver.spoof=1

asked 12 Dec '11, 07:48

Matt's gravatar image

Matt
156●11●12●17
accept rate: 50%

One Answer:
oldestnewestmost voted
1

You will have to update /opt/mapr/conf/hadoop-metrics.properties files. (Since GangliaContext is hardcoded to load hadoop-metrics.properties as file name, the same name had to be used for now). Then you will have enable metrics in CLDB and FileServer section 



Configuration of the "cldb" context for ganglia


cldb.class=com.mapr.fs.cldb.counters.MapRGangliaContext31
cldb.period=10
cldb.servers=localhost:8649
cldb.spoof=1


Configuration of the "fileserver" context for ganglia


fileserver.class=com.mapr.fs.cldb.counters.MapRGangliaContext31
fileserver.period=37
fileserver.servers=localhost:8649
fileserver.spoof=1

Once that is done, restart CLDB and you should start seeing metrics in ganglia. Let us know how it goes.

link

answered 12 Dec '11, 15:43

Lohit's gravatar image

Lohit ♦♦
2.1k●3●11
accept rate: 44%

I hadn't picked up on the fact that there was a separate hadoop-metrics.properties under /opt/mapr/conf in addition to the one in /opt/mapr/hadoop/hadoop-*/conf

Thanks.

(13 Dec '11, 15:18) Matt
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or __italic__
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

learn more about Markdown

Tags:

×7

Asked: 12 Dec '11, 07:48

Seen: 664 times

Last updated: 13 Dec '11, 15:18

Related questions

Ganglia cannot communicate between meta and monitored nodes

"fileserver metrics" not working with Ganglia

Amazon EMR with MapR M3 Fails to start with ganglia selected as the Bootstrap operation

Need of Ganglia

gnaglia cldb metrics

Could not see MapR metrics in Ganglia

about | faq | privacy | contact

powered by OSQA