################################################第1種辦法##############################################################

[1]的解決方案是:

更換hadoop版本，讓hadoop與hbase更加兼容

################################################第2種辦法##############################################################

[2]的解決方案是：

hbase-site.xml增加配置 <property><name>hbase.unsafe.stream.capability.enforce</name><value>false</value> </property>

注意這種設置有丟數據的風險

##########################################第3種辦法#############################################################################

[3]的方案是

(Python3.6) appleyuchi@Desktop:~/bigdata/hbase-2.2.6/lib$ ls |grep hadoop
hadoop-annotations-2.8.5.jar
hadoop-auth-2.8.5.jar
hadoop-client-2.8.5.jar
hadoop-common-2.8.5.jar
hadoop-distcp-2.8.5.jar
hadoop-hdfs-2.8.5.jar
hadoop-hdfs-2.8.5-tests.jar
hadoop-hdfs-client-2.8.5.jar
hadoop-mapreduce-client-app-2.8.5.jar
hadoop-mapreduce-client-common-2.8.5.jar
hadoop-mapreduce-client-core-2.8.5.jar
hadoop-mapreduce-client-hs-2.8.5.jar
hadoop-mapreduce-client-jobclient-2.8.5.jar
hadoop-mapreduce-client-shuffle-2.8.5.jar
hadoop-minicluster-2.8.5.jar
hadoop-yarn-api-2.8.5.jar
hadoop-yarn-client-2.8.5.jar
hadoop-yarn-common-2.8.5.jar
hadoop-yarn-server-applicationhistoryservice-2.8.5.jar
hadoop-yarn-server-common-2.8.5.jar
hadoop-yarn-server-nodemanager-2.8.5.jar
hadoop-yarn-server-resourcemanager-2.8.5.jar
hadoop-yarn-server-tests-2.8.5-tests.jar
hadoop-yarn-server-web-proxy-2.8.5.jar
hbase-hadoop2-compat-2.2.6.jar
hbase-hadoop2-compat-2.2.6-tests.jar
hbase-hadoop-compat-2.2.6.jar
hbase-hadoop-compat-2.2.6-tests.jar

液就是說$HBASE_HOME/lib下面的2.8.5的相關的jar全部要替換掉

替換腳本auto.sh：

#!/bin/sh cp $HADOOP_HOME/share/hadoop/hdfs/lib/hadoop-annotations-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/hdfs/lib/hadoop-auth-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/common/hadoop-common-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/tools/lib/hadoop-distcp-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-api-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-client-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-common-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-common-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.1.2.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/test/hadoop-yarn-server-tests-3.1.2-tests.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.1.2.jar $HBASE_HOME/lib#啟動所需的依賴 cp $HADOOP_HOME/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/common/lib/stax2-api-3.1.4.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/common/lib/commons-beanutils-1.9.3.jar $HBASE_HOME/lib cp $HADOOP_HOME/share/hadoop/common/lib/commons-configuration2-2.1.1.jar $HBASE_HOME/lib #下面是額外的依賴 cp $HADOOP_HOME/share/hadoop/common/lib/protobuf-java-2.5.0.jar $HBASE_HOME/lib/rm $HBASE_HOME/lib/hadoop-annotations-2.8.5.jar rm $HBASE_HOME/lib/hadoop-auth-2.8.5.jar rm $HBASE_HOME/lib/hadoop-common-2.8.5.jar rm $HBASE_HOME/lib/hadoop-distcp-2.8.5.jar #下面的三個經過測試不要刪除 #rm $HBASE_HOME/lib/hadoop-hdfs-2.8.5.jar #rm $HBASE_HOME/lib/hadoop-hdfs-2.8.5-tests.jar #rm $HBASE_HOME/lib/hadoop-hdfs-client-2.8.5.jar rm $HBASE_HOME/lib/hadoop-mapreduce-client-app-2.8.5.jar rm $HBASE_HOME/lib/hadoop-mapreduce-client-common-2.8.5.jar rm $HBASE_HOME/lib/hadoop-mapreduce-client-core-2.8.5.jar rm $HBASE_HOME/lib/hadoop-mapreduce-client-hs-2.8.5.jar rm $HBASE_HOME/lib/hadoop-mapreduce-client-jobclient-2.8.5.jar rm $HBASE_HOME/lib/hadoop-mapreduce-client-shuffle-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-api-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-client-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-common-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-server-applicationhistoryservice-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-server-common-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-server-nodemanager-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-server-resourcemanager-2.8.5.jar rm $HBASE_HOME/lib/hadoop-yarn-server-tests-2.8.5-tests.jar rm $HBASE_HOME/lib/hadoop-yarn-server-web-proxy-2.8.5.jar wget -P $HBASE_HOME https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-minicluster/3.1.2/hadoop-minicluster-3.1.2.jar wget -P $HBASE_HOME https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-client/3.1.2/hadoop-client-3.1.2.jar

chmod u+x auto.sh

./auto.sh

然后上述jar同步到集群其他各個節點

并且hbase-site.xml中需要添加

<property>
? <name>hbase.wal.provider</name>
? <value>filesystem</value>
</property>

?

Reference:

[1]HBASE中Hmaster啟動后自動掛掉的問題

[2]The procedure WAL relies on the ability to hsync for proper operation during component failures,...

[3]

總結

以上是生活随笔為你收集整理的The procedure WAL relies on the ability to hsync for proper operation during component failures的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。