日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 编程资源 > 编程问答 >内容正文

编程问答

HBase出现java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration问题

發布時間:2023/12/3 编程问答 32 豆豆
生活随笔 收集整理的這篇文章主要介紹了 HBase出现java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration问题 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

問題:Hbase在集群上運行報錯:NoClassDefFoundError:org/apache/hadoop/hbase/HBaseConfiguration
需求:HBase使用Java創建表,打包成jar,提交到集群上行運行!
在IDEA中使用Maven添加Hbase
代碼:

<dependency><groupId>org.apache.hbase</groupId><artifactId>hbase-it</artifactId><version>1.1.3</version></dependency>

Java代碼:

package com.bynear.HBase; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.HColumnDescriptor; import org.apache.hadoop.hbase.HTableDescriptor; import org.apache.hadoop.hbase.TableName; import org.apache.hadoop.hbase.client.HBaseAdmin; import java.io.IOException; /*** 2018/6/20* 15:35*/ public class HBaseTest {public static void main(String[] args) throws Exception {Configuration conf = HBaseConfiguration.create();conf.set("hbase.zookeeper.quorum", "Spark1:2181,Spark2:2181");HBaseAdmin admin = new HBaseAdmin(conf);TableName name = TableName.valueOf("nvshen");HTableDescriptor desc = new HTableDescriptor(name);HColumnDescriptor base_info = new HColumnDescriptor("base_info");HColumnDescriptor extra_info = new HColumnDescriptor("extra_info");base_info.setMaxVersions(5);extra_info.setMaxVersions(5);desc.addFamily(base_info);desc.addFamily(extra_info);admin.createTable(desc);} }

打包提價到集群上:

hadoop jar /root/SparkStudy.jar com/bynear/HBase/HBaseTest

結果出現如下報錯!

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfigurationat com.bynear.HBase.HBaseTest.main(HBaseTest.java:19)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:606)at org.apache.hadoop.util.RunJar.main(RunJar.java:212) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfigurationat java.net.URLClassLoader$1.run(URLClassLoader.java:366)at java.net.URLClassLoader$1.run(URLClassLoader.java:355)at java.security.AccessController.doPrivileged(Native Method)at java.net.URLClassLoader.findClass(URLClassLoader.java:354)at java.lang.ClassLoader.loadClass(ClassLoader.java:425)at java.lang.ClassLoader.loadClass(ClassLoader.java:358)... 6 more

解決辦法:
把hbase的jar包加入到hadoop classpath中
在hadoop安裝目錄下找到hadoop-env.sh文件,
添加 : export HADOOP_CLASSPATH=/home/hadoop/apps/hbase/lib/*
不需要重啟,重新執行命令hadoop jar mapreducehbase.jar hbase.TxHBase 運行成功。

HBase的安裝!
tar -zxvf hbase.tar -C 到指定的目錄
vim hbase-env.sh
添加 JAVA_HOME 將自導的Zookeeper 修改為flase
vim hbase-site.xml

<configuration> <property> //添加HDFS的路徑(自動創建)<name>hbase.rootdir</name><value>hdfs://Spark1:9000/hbase</value> </property> <property> //是否啟用分布式<name>hbase.cluster.distributed</name><value>true</value> </property> <property> //配置zookeeper<name>hbase.zookeeper.quorum</name><value>Spark1:2181,Spark2:2181</value> </property> </configuration>

注意:
需要將 Hadoop 的 hdfs-site.xml 和 core-site.xml 拷貝到Hbase的conf目錄中,因為HBase集群是依賴于Hadoop集群的,HBase的region產生的HFile,存儲在hbase-site.xml中創建的HDFS指定的目錄中!
執行結果:

18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/root/app/hadoop-2.5.0-cdh5.3.6/lib/native 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-431.el6.x86_64 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:user.name=root 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:user.home=/root 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Client environment:user.dir=/root 18/06/21 01:01:36 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=Spark1:2181,Spark2:2181 sessionTimeout=90000 watcher=hconnection-0xcb18130x0, quorum=Spark1:2181,Spark2:2181, baseZNode=/hbase 18/06/21 01:01:36 INFO zookeeper.ClientCnxn: Opening socket connection to server Spark1/192.168.2.15:2181. Will not attempt to authenticate using SASL (unknown error) 18/06/21 01:01:36 INFO zookeeper.ClientCnxn: Socket connection established, initiating session, client: /192.168.2.15:47408, server: Spark1/192.168.2.15:2181 18/06/21 01:01:36 INFO zookeeper.ClientCnxn: Session establishment complete on server Spark1/192.168.2.15:2181, sessionid = 0x641d2794760039, negotiated timeout = 40000 18/06/21 01:01:40 INFO client.HBaseAdmin: Created nvshen

運行結果:

hbase(main):001:0> list TABLE nvshen 1 row(s) in 0.4150 seconds=> ["nvshen"] hbase(main):002:0>

總結

以上是生活随笔為你收集整理的HBase出现java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration问题的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。