|
I have run into an issue using HBase completebulkload. The first issue is that it does not seem to properly find zookeeper. I believe this is somewhat related to HBASE-3714 which does not look like it is incorporated in the included version of HBase ( hbase-0.90.2 ). I can somewhat work around the issue ( as we worked around it in CDH3U0 ) by setting the zookeeper paramters on the command line. The bulk load works and loads a few of the files, but fails with the following (santized) exception: java.io.IOException: java.io.IOException: Failed rename of maprfs://x.x.x.x:7222/src to maprfs://y.y.y.y:7222/hbase/dest at org.apache.hadoop.hbase.regionserver.StoreFile.rename(StoreFile.java:512) at org.apache.hadoop.hbase.regionserver.Store.bulkLoadHFile(Store.java:366) at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFile(HRegion.java:2201) at org.apache.hadoop.hbase.regionserver.HRegionServer.bulkLoadHFile(HRegionServer.java:2031) at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) I guess my question is has anyone had success with completebulkload? |
|
It looks like /src is different volume than /hbase. As of now rename across volumes are not supported. You will have to load data /src into /hbase (same volume) and then try bulk load. For example, you might use /hbase/src as the directory for the bulk load files since all of the contents of source will be entirely within the volume mounted as /hbase. |
|
Thank you for your answer. I believe you are correct. I was able to place the temporary files on the same volume and successfully execute the completebulkload. I appreciate your response. |
