Client trying to run PigMix on small cluster and get the follwoing. What could be the reason?

ERROR 2999: Unexpected internal error. Failed to create DataStorage

java.lang.RuntimeException: Failed to create DataStorage at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init( at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>( at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init( at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init( at org.apache.pig.impl.PigContext.connect( at org.apache.pig.PigServer.<init>( at org.apache.pig.PigServer.<init>( at<init>( at at org.apache.pig.Main.main( Caused by: No FileSystem for scheme: maprfs at org.apache.hadoop.fs.FileSystem.createFileSystem( at org.apache.hadoop.fs.FileSystem.access$200( at org.apache.hadoop.fs.FileSystem$Cache.get( at org.apache.hadoop.fs.FileSystem.get( at org.apache.hadoop.fs.FileSystem.get( at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(

asked 16 Aug '11, 08:22

lfedotov's gravatar image

lfedotov ♦♦
accept rate: 27%

In order to have this working correctly, MapR have modifyed pigmix, pointing to correct configurations and correct class paths. Ask MapR support if you need one.


answered 17 Aug '11, 08:33

lfedotov's gravatar image

lfedotov ♦♦
accept rate: 27%

This error also occurs if a pig script is executed inside java. The pig executable in the mapr package is set up with the correct classpaths, but while running pig scripts in java, the classpath needs to be set up manually. Here's how the appropriate java properties and classpath need to be setup for mapr:

/usr/lib/jvm/java-6-sun/bin/java -Djava.library.path=/opt/mapr/lib -cp /opt/mapr/pig/pig-0.9.0/pigperf.jar:/opt/mapr/pig/pig-0.9.0/conf/* org.apache.pig.Main yourpigscript.pig

answered 23 Aug '11, 14:34

richa's gravatar image

accept rate: 21%

This sounds like you are using the ordinary hadoop distribution on the client side. You may need to install the MapR client distribution on the machine running the program from.

Can you include more details about which nodes are running what software?


answered 16 Aug '11, 11:02

TedDunning's gravatar image

TedDunning ♦♦
accept rate: 23%

Working Pigmix script can be downloaded from It have all class paths defined correctly.


answered 23 Aug '11, 14:38

lfedotov's gravatar image

lfedotov ♦♦
accept rate: 27%

Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here



Answers and Comments

Markdown Basics

  • *italic* or __italic__
  • **bold** or __bold__
  • link:[text]( "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported



Asked: 16 Aug '11, 08:22

Seen: 3,229 times

Last updated: 23 Aug '11, 14:38

powered by OSQA