I have an LZO-compressed table which I disabled for testing purposes. When trying to enable it back (from HBase shell) the operation fails with the following message in the log:

2012-04-30 01:15:45,362 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: weblog,,1332138688550.c9a0df28af30d46fc6cf7ebbca48c7b6.
2012-04-30 01:15:45,368 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of region=weblog,,1332138688550.c9a0df28af30d46fc6cf7ebbca48c7b6.
java.io.IOException: java.lang.RuntimeException: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
    at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:89)
    at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:2573)
    at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2562)
    at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2550)
    at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:272)
    at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:99)
    at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:156)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
    at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$1.getCodec(Compression.java:92)
    at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm.getCompressor(Compression.java:197)
    at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:84)
    ... 9 more
Caused by: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    at org.apache.hadoop.hbase.io.hfile.Compression$Algorithm$1.getCodec(Compression.java:87)
    ... 11 more
2012-04-30 03:03:29,567 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: Received request to open region: mytable,,1335780209485.0378717c656eadd185fc57974eb94ca8.
2012-04-30 03:03:29,573 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of region=mytable,,1335780209485.0378717c656eadd185fc57974eb94ca8.
java.io.IOException: Compression algorithm 'lzo' previously failed test.
    at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:78)
    at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:2573)
    at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2562)
    at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:2550)
    at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:272)
    at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:99)
    at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:156)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:662)

After getting this error I verified again that LZO is present by creating a dummy table with LZO column family, which went fine despite LZO dependency.

create 'mytable', {NAME=>'colfam', COMPRESSION=>'lzo'}

What would you suggest for troubleshooting LZO class loading issues from HBase shell and beyond?

asked 30 Apr '12, 03:16

tc_dev's gravatar image

tc_dev
967812
accept rate: 33%

edited 30 Apr '12, 03:17

Be the first one to answer this question!
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or __italic__
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Tags:

×76
×36
×4

Asked: 30 Apr '12, 03:16

Seen: 645 times

Last updated: 30 Apr '12, 03:17

powered by OSQA