After going through single node install steps from the documentation there are a few problems left.

Specifically the admin UI gives alerts that TaskTracker and NFS services fail to start and HBase connection fails too.

Here is the error readout from the relevant logs -

=============================================
/opt/mapr/hadoop/hadoop-0.20.2/logs/hadoop-root-tasktracker-XXXXXX.log =============================================

sun.cpu.endian: little hadoop.policy.file: hadoop-policy.xml sun.cpu.isalist: ------------------------------------------------------------*/ 2012-03-04 21:51:33,763 INFO org.apache.hadoop.mapred.TaskTracker: /tmp is tmpfs. Java Hotspot Instrumentation will be enabled by default
2012-03-04 21:51:33,764 INFO org.apache.hadoop.mapred.TaskTracker: Cleaning up config files from the job history folder
2012-03-04 21:51:33,766 INFO org.apache.hadoop.mapred.TaskTracker: TT local config is /opt/mapr/hadoop/hadoop-0.20.2/conf/mapred-site.xml
2012-03-04 21:51:33,766 INFO org.apache.hadoop.mapred.TaskTracker: Loading resource properties file : /opt/mapr//logs/cpu_mem_disk
2012-03-04 21:51:33,766 INFO org.apache.hadoop.mapred.TaskTracker: Physical memory reserved for mapreduce tasks = 915406848 bytes
2012-03-04 21:51:33,766 INFO org.apache.hadoop.mapred.TaskTracker: CPUS: 8
2012-03-04 21:51:33,767 INFO org.apache.hadoop.mapred.TaskTracker: Total MEM: 3.8588066GB
2012-03-04 21:51:33,767 INFO org.apache.hadoop.mapred.TaskTracker: Reserved MEM: 673MB
2012-03-04 21:51:33,767 INFO org.apache.hadoop.mapred.TaskTracker: Reserved MEM for Ephemeral slots 200
2012-03-04 21:51:33,767 INFO org.apache.hadoop.mapred.TaskTracker: DISKS: 1
2012-03-04 21:51:33,784 INFO org.apache.hadoop.mapred.TaskTracker: Map slots 6, Default heapsize for map task 60 mb
2012-03-04 21:51:33,784 INFO org.apache.hadoop.mapred.TaskTracker: Reduce slots 4, Default heapsize for reduce task 78 mb
2012-03-04 21:51:33,784 INFO org.apache.hadoop.mapred.TaskTracker: Ephemeral slots 1, memory given for each ephemeral slot 200 mb
2012-03-04 21:51:33,784 INFO org.apache.hadoop.mapred.TaskTracker: Prefetch map slots 3
2012-03-04 21:51:33,855 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2012-03-04 21:51:33,926 INFO org.apache.hadoop.http.HttpServer: Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-03-04 21:51:33,937 WARN org.apache.hadoop.mapred.LinuxTaskController: Exit code from checking binary permissions is : 22
2012-03-04 21:51:33,937 INFO org.apache.hadoop.mapred.TaskController: Reading task controller config from /opt/mapr/hadoop/hadoop-0.20.2/conf/taskcontroller.cfg 2012-03-04 21:51:33,937 INFO org.apache.hadoop.mapred.TaskController: The task-controller binary should not have write or execute for others.
2012-03-04 21:51:33,938 INFO org.apache.hadoop.mapred.TaskController: Invalid permissions on task-controller binary.
2012-03-04 21:51:33,938 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start TaskTracker because java.io.IOException: Task controller setup failed because of invalidpermissions/ownership with exit code 22
at org.apache.hadoop.mapred.LinuxTaskController.setup(LinuxTaskController.java:148)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:2149)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:5216)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:322)
at org.apache.hadoop.util.Shell.run(Shell.java:249)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:442)
at org.apache.hadoop.mapred.LinuxTaskController.setup(LinuxTaskController.java:142)
... 2 more

2012-03-04 21:51:33,940 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG:
/*********
SHUTDOWN_MSG: Shutting down TaskTracker at XXXXXX/127.0.0.1
*********/

=============================================
/opt/mapr/logs/nfsserver.log =============================================

2012-03-05 01:44:26,1514 INFO nfsserver[13470] fs/nfsd/mount.cc:1968 Export info: /mapr (rw)
2012-03-05 01:44:26,1517 INFO nfsserver[13470] fs/nfsd/mount.cc:1693 CLDB info: 127.0.0.1:7222
2012-03-05 01:44:26,1523 INFO nfsserver[13470] fs/nfsd/nfsha.cc:399 hostname: XXXXXX, hostid: 0x34dff6b8b8ed6ea1
2012-03-05 01:44:26,1525 INFO nfsserver[13470] fs/nfsd/nfsha.cc:153 No carrier-sense on eth1, skipped
2012-03-05 01:44:26,1525 INFO nfsserver[13470] fs/nfsd/nfsha.cc:153 No carrier-sense on sit0, skipped
2012-03-05 01:44:26,1527 INFO nfsserver[13470] fs/nfsd/requesthandle.cc:410 found NFS_HEAPSIZE env var: 119
2012-03-05 01:44:26,2357 INFO nfsserver[13470] fs/nfsd/main.cc:487 NFS server started ... pid=13470, uid=0
2012-03-05 01:44:26,2371 INFO nfsserver[13470] fs/nfsd/nfsha.cc:887 exiting: No license to run NFS server

=============================================
Additionally HBase shell example from the documentation fails as well -

HBase Shell; enter 'help<return>' for list of supported commands. Type "exit<return>" to leave the HBase Shell Version 0.90.4, rUnknown, Wed Nov 9 17:35:00 PST 2011

hbase(main):001:0> create 'weblog', 'stats'

ERROR: org.apache.hadoop.hbase.MasterNotRunningException: null

Here is some help for this command: Create table; pass table name, a dictionary of specifications per column family, and optionally a dictionary of table configuration. Dictionaries are described below in the GENERAL NOTES section. Examples:

hbase> create 't1', {NAME => 'f1', VERSIONS => 5} hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'} hbase> # The above in shorthand would be the following: hbase> create 't1', 'f1', 'f2', 'f3' hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000, BLOCKCACHE => true}

=============================================

What could be causing these problems?

asked 05 Mar '12, 02:07

tc_dev's gravatar image

tc_dev
967812
accept rate: 33%


For taskcontroller permissions, check this file

/opt/mapr/hadoop/hadoop-0.20.2/bin/Linux-amd64-64/bin

I think you might have done a top level permission reset for the mapr folder.The default permission on this file is 4754

[root@nmk-centos-60-1 bin]# ls -la /opt/mapr/hadoop/hadoop-0.20.2/bin/Linux-amd64-64/bin/task-controller -rwsr-xr--. 1 root root 94235 Feb 28 12:08 /opt/mapr/hadoop/hadoop-0.20.2/bin/Linux-amd64-64/bin/task-controller*

The hbase error is because its not able to find the hbase master. Check the status of hbase-master on the node where you have assigned the role.

link

answered 05 Mar '12, 02:27

Nabeel's gravatar image

Nabeel ♦♦
2.3k148
accept rate: 23%

edited 15 Mar, 05:02

The whole /opt/mapr directory has 755 permission, including taskcontroller binary. What else could be causing the problem?

How do I check the status of hbase-master? I tried "service hbase-master status" and it says service unrecognized. I believe I did install everything with yum "yum install mapr*". Am I missing something?

(05 Mar '12, 02:43) tc_dev

The particular file should NOT have 755. The error says

The task-controller binary should not have write or execute for others.

So it should be RO for others.

For hbase status,this command should help maprcli node list -columns service

For further troubleshooting, look at the logs in /opt/mapr/hbase/hbase-<version>/logs

(05 Mar '12, 03:03) Nabeel ♦♦
1

Thanks. It took doing chmod 4754 to fix it though

(05 Mar '12, 10:54) tc_dev

I spoke too soon, TaskTracker still fails with this message (createTTVolume.log) -

ERROR (22) - Unable to map host: HOSTNAME to non-local ipaddress while creating volume mapr.HOSTNAME.local.mapred

What is causing this IP address problem and how to fix it?

(06 Mar '12, 04:00) tc_dev

Most likely you have your hostname mapped to a 127.0.0.1 ip. Add the other non-127 ip in /etc/hosts and try again.

(06 Mar '12, 04:02) Nabeel ♦♦

After fixing the hostname here is the new error -

ERROR (22) - FileServer HOSTNAME:5660 has not registered with CLDB

What could be causing this?

(06 Mar '12, 11:48) tc_dev

Check the mfs.log and mfs.err on the node. Also look for FSRegister in the cldb.log and see if there are attempts from the fileserver to register in the CLDB.

(06 Mar '12, 23:51) Nabeel ♦♦

Thanks. The problem was an error in our hosts file...

(07 Mar '12, 01:51) tc_dev

Good to know.

Pls accept" the appropriate answer to your original question to make it easy for those who reach this page in similar circumstances.

(07 Mar '12, 01:56) Nabeel ♦♦

How do I "accept" it? Never used this system before...

(07 Mar '12, 11:36) tc_dev
showing 5 of 10 show all

To get NFS, get a license from here: http://mapr.com/doc/display/MapR/Getting+a+License

link

answered 05 Mar '12, 13:57

MC%20Srivas's gravatar image

MC Srivas ♦♦
2.6k1517
accept rate: 35%

Thanks, I got it!

(06 Mar '12, 03:55) tc_dev

To run NFS, please get a license by registering (NFS is free, only registration needed).

link

answered 05 Mar '12, 06:28

MC%20Srivas's gravatar image

MC Srivas ♦♦
2.6k1517
accept rate: 35%

Where do I register / how do I apply this license? I did not see this info in the single-node install doc

(05 Mar '12, 10:55) tc_dev
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or __italic__
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×77
×70
×47
×36

Asked: 05 Mar '12, 02:07

Seen: 1,562 times

Last updated: 15 Mar, 05:02

powered by OSQA