問題描述

在HBase上運行MapReduce作業時，報如下異常：IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString

使用HBase環境如下：CDH5.0.1, HBase版本：0.96.1

問題原因

This isssue occurs because of an optimization introduced in??HBASE-9867??that inadvertently introduced a classloader dependency. This affects both jobs using the??-libjars??option and "fat jar," jobs which package their runtime dependencies in a nested lib folder.

這個問題的發生是由于優化了?HBASE-9867??引起的，無意間引進了一個依賴類加載器。它影響使用-libjars參數和使用 fat jar兩種模式的job.?

fat jar模式Hadoop的一個特殊功能：可以讀取操作目錄中/lib目錄下包含的所有庫的JAR文件，把運行job依賴的jar放在jar中的lib目錄下。

解決方案

1、永久解決方案

cd?/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hadoop

ln -s /opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar hbase-protocol-0.96.1.1-cdh5.0.0.jar

2: 臨時解決方案

HADOOP_CLASSPATH=/opt/cloudera/parcels/CDH-5.0.0-1.cdh5.0.0.p0.47/lib/hbase/lib/hbase-protocol-0.96.1.1-cdh5.0.0.jar:/etc/hbase/conf hadoop ?jar myjar.jar MyJobMainClass

詳細報錯信息

14/07/16 14:40:50 WARN client.HConnectionManager$HConnectionImplementation: Encountered problems when prefetch hbase:meta table:

org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=10, exceptions:

Wed Jul 16 14:32:49 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405,

java.lang.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString

Wed Jul 16 14:32:52 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:32:57 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:33:07 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:33:28 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:34:08 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:35:49 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:37:29 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:39:10 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405, java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

Wed Jul 16 14:40:50 CST 2014, org.apache.hadoop.hbase.client.RpcRetryingCaller@52380405,

java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

? ? ? ? at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:134)

? ? ? ? at org.apache.hadoop.hbase.client.HTable.getRowOrBefore(HTable.java:705)

? ? ? ? at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:144)

? ? ? ? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:1102)

? ? ? ? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1162)

? ? ? ? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1054)

? ? ? ? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1011)

? ? ? ? at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:326)

? ? ? ? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:192)

? ? ? ? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:150)

? ? ? ? at org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:206)

? ? ? ? at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:73)

? ? ? ? at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)

? ? ? ? at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:455)

? ? ? ? at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:343)

? ? ? ? at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)

? ? ? ? at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)

? ? ? ? at java.security.AccessController.doPrivileged(Native Method)

? ? ? ? at javax.security.auth.Subject.doAs(Subject.java:415)

? ? ? ? at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)

? ? ? ? at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)

? ? ? ? at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1313)

? ? ? ? at mapreduce.ImportFromFile.run(ImportFromFile.java:228)

? ? ? ? at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

? ? ? ? at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

? ? ? ? at mapreduce.ImportFromFile.main(ImportFromFile.java:185)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

? ? ? ? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

? ? ? ? at java.lang.reflect.Method.invoke(Method.java:606)

? ? ? ? at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)

? ? ? ? at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)

? ? ? ? at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)

? ? ? ? at mapreduce.Driver.main(Driver.java:29)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

? ? ? ? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

? ? ? ? at java.lang.reflect.Method.invoke(Method.java:606)

? ? ? ? at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

Caused by: java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

? ? ? ? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildRegionSpecifier(RequestConverter.java:897)

? ? ? ? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildGetRowOrBeforeRequest(RequestConverter.java:131)

? ? ? ? at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRowOrBefore(ProtobufUtil.java:1402)

? ? ? ? at org.apache.hadoop.hbase.client.HTable$2.call(HTable.java:701)

? ? ? ? at org.apache.hadoop.hbase.client.HTable$2.call(HTable.java:699)

? ? ? ? at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:120)

? ? ? ? ... 38 more

Exception in thread "main" java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString

? ? ? ? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildRegionSpecifier(RequestConverter.java:897)

? ? ? ? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildGetRowOrBeforeRequest(RequestConverter.java:131)

? ? ? ? at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRowOrBefore(ProtobufUtil.java:1402)

? ? ? ? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1176)

? ? ? ? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1054)

? ? ? ? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1011)

? ? ? ? at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:326)

? ? ? ? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:192)

? ? ? ? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:150)

? ? ? ? at org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:206)

? ? ? ? at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:73)

? ? ? ? at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)

? ? ? ? at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:455)

? ? ? ? at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:343)

? ? ? ? at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)

? ? ? ? at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)

? ? ? ? at java.security.AccessController.doPrivileged(Native Method)

? ? ? ? at javax.security.auth.Subject.doAs(Subject.java:415)

? ? ? ? at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)

? ? ? ? at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)

? ? ? ? at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1313)

? ? ? ? at mapreduce.ImportFromFile.run(ImportFromFile.java:228)

? ? ? ? at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

? ? ? ? at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

? ? ? ? at mapreduce.ImportFromFile.main(ImportFromFile.java:185)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

? ? ? ? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

? ? ? ? at java.lang.reflect.Method.invoke(Method.java:606)

? ? ? ? at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)

? ? ? ? at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)

? ? ? ? at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)

? ? ? ? at mapreduce.Driver.main(Driver.java:29)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

? ? ? ? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

? ? ? ? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

? ? ? ? at java.lang.reflect.Method.invoke(Method.java:606)

? ? ? ? at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

參考

https://issues.apache.org/jira/browse/HBASE-11118

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.9.0/bk_releasenotes_hdp_2.0/content/ch_relnotes-hdpch_relnotes-hdp-2.0.9.0-knownissues-hbase.html

----------------------------------------------------------------------------------------------------------------------------

在集群上執行mr(操作hbase)任務報錯

通過eclipse 插件遠程提交mr(有操作hbase)任務到集群執行沒有問題，

打成jar包在集群上執行報錯，錯誤如下：

15/04/19 00:20:40 WARN client.HConnectionManager$HConnectionImplementation: Encountered problems when prefetch hbase:meta table:?
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString
??????? at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateException(RpcRetryingCaller.java:215)
??????? at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:127)
??????? at org.apache.hadoop.hbase.client.HTable.getRowOrBefore(HTable.java:705)
??????? at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:144)
??????? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:1107)
??????? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1167)
??????? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1059)
??????? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1016)
??????? at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:326)
??????? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:192)
??????? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:150)
??????? at com.lyq.mr.File2HFile2HBase.getJob(File2HFile2HBase.java:105)
??????? at com.lyq.mr.File2HFile2HBase.access$1(File2HFile2HBase.java:93)
??????? at com.lyq.mr.File2HFile2HBase$1.run(File2HFile2HBase.java:71)
??????? at com.lyq.mr.File2HFile2HBase$1.run(File2HFile2HBase.java:1)
??????? at java.security.AccessController.doPrivileged(Native Method)
??????? at javax.security.auth.Subject.doAs(Subject.java:337)
??????? at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1471)
??????? at com.lyq.mr.File2HFile2HBase.run(File2HFile2HBase.java:62)
??????? at com.lyq.mr.File2HFile2HBase.main(File2HFile2HBase.java:124)
??????? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
??????? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
??????? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
??????? at java.lang.reflect.Method.invoke(Method.java:597)
??????? at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.lang.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString
??????? at java.lang.ClassLoader.defineClass1(Native Method)
??????? at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
??????? at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
??????? at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
??????? at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
??????? at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
??????? at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
??????? at java.security.AccessController.doPrivileged(Native Method)
??????? at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
??????? at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
??????? at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
??????? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildRegionSpecifier(RequestConverter.java:910)
??????? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildGetRowOrBeforeRequest(RequestConverter.java:131)
??????? at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRowOrBefore(ProtobufUtil.java:1403)
??????? at org.apache.hadoop.hbase.client.HTable$2.call(HTable.java:701)
??????? at org.apache.hadoop.hbase.client.HTable$2.call(HTable.java:699)
??????? at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:120)
??????? ... 23 more
Exception in thread "main" java.lang.IllegalAccessError: com/google/protobuf/HBaseZeroCopyByteString
??????? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildRegionSpecifier(RequestConverter.java:910)
??????? at org.apache.hadoop.hbase.protobuf.RequestConverter.buildGetRowOrBeforeRequest(RequestConverter.java:131)
??????? at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRowOrBefore(ProtobufUtil.java:1403)
??????? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1181)
??????? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1059)
??????? at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1016)
??????? at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:326)
??????? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:192)
??????? at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:150)
??????? at com.lyq.mr.File2HFile2HBase.getJob(File2HFile2HBase.java:105)
??????? at com.lyq.mr.File2HFile2HBase.access$1(File2HFile2HBase.java:93)
??????? at com.lyq.mr.File2HFile2HBase$1.run(File2HFile2HBase.java:71)
??????? at com.lyq.mr.File2HFile2HBase$1.run(File2HFile2HBase.java:1)
??????? at java.security.AccessController.doPrivileged(Native Method)
??????? at javax.security.auth.Subject.doAs(Subject.java:337)
??????? at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1471)
??????? at com.lyq.mr.File2HFile2HBase.run(File2HFile2HBase.java:62)
??????? at com.lyq.mr.File2HFile2HBase.main(File2HFile2HBase.java:124)
??????? at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
??????? at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
??????? at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
??????? at java.lang.reflect.Method.invoke(Method.java:597)
??????? at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

原因：

這是hbase的一個bug,詳細信息訪問：

https://issues.apache.org/jira/browse/HBASE-10304

解決方法：

1、在集群環境變量 etc/profiles 里添加如下配置：

export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:/home/hadoop/hbase-0.96.2-hadoop2/lib/hbase-protocol-0.96.2-hadoop2.jar

注意：hbase-protocol-*.jar 的路徑根據自己配置目錄而定。

2、執行source /etc/profile，是配置生效

總結

以上是生活随笔為你收集整理的ZeroCopyLiteralByteString cannot access superclass的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。