Hi, There: I am looking to change several values for more stable hbase operation in mapr, for example, I want to set values like these:

<property> <name>dfs.socket.timeout</name> <value>400000</value> </property>

<property> <name>dfs.datanode.max.xcievers</name> <value>2047</value> <final>true</final> </property> <property> <name>dfs.datanode.handler.count</name> <value>20</value> <final>true</final> </property>

However, I noticed that hdfs-site.xml is not in the /opt/mapr/hadoop/hadoop-0.20.2/conf by default. Does anybody know where I should put those values ? Should I just create a hdfs-site.xml to do all the customization ?

Another question if the parameter list. I can't find it in the mapr web site, I wonder if I can take those standard apache parameter list. I do notice "dfs" is not supported, but "fs" is supported in the hadoop command, so there seems to be some difference between mapr and apache distribution.

asked 18 Jul '11, 10:29

jimmy888's gravatar image

jimmy888
1079911
accept rate: 0%

edited 18 Jul '11, 15:32

TedDunning's gravatar image

TedDunning ♦♦
3.6k322


In the /opt/mapr folder there is a zookeepers and hadoop folders you can find their conf folders in those directories

link

answered 18 Jul '11, 19:23

Andrew%20Wells's gravatar image

Andrew Wells
3416814
accept rate: 100%

If you are running HBase on MapR, then you need not set HDFS specific parameters. The parameters you mentioned above are specific to HDFS.

dfs.socket.timeout
dfs.datanode.max.xcievers
dfs.datanode.handler.count

Everything supported by HDFS is supported by MapR FileSystem. MapR does not need to be tuned with the above equivalent parameters. So, you can safely ignore them and continue your operation of HBase on MapR.

Regarding your question about parameter list, all parameters of HBase, MapReduce or other components should work as is. Parameter list for MapReduce can be found here

link

answered 18 Jul '11, 11:09

Lohit's gravatar image

Lohit ♦♦
2.1k313
accept rate: 44%

edited 18 Jul '11, 11:53

Peter%20Conrad's gravatar image

Peter Conrad ♦♦
926237

Remember, we aren't running HDFS. Most of the parameters you mention make no sense for maprfs. They are specific to hdfs.

link

answered 18 Jul '11, 15:34

TedDunning's gravatar image

TedDunning ♦♦
3.6k322
accept rate: 23%

Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or __italic__
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×74
×44
×3

Asked: 18 Jul '11, 10:29

Seen: 3,184 times

Last updated: 18 Jul '11, 19:23

powered by OSQA