環境:

ubuntu19.10

hadoop3.1.2

hbase2.2.4

完整報錯如下:

java.lang.IllegalStateException: The procedure WAL relies on the ability to hsync for proper operation during component failures, but the underlying filesystem does not support doing so. Please check the config value of 'hbase.procedure.store.wal.use.hsync' to set the desired level of robustness and ensure the config value of 'hbase.wal.dir' points to a FileSystem mount that can provide it.at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.rollWriter(WALProcedureStore.java:1092)at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.recoverLease(WALProcedureStore.java:424)at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.init(ProcedureExecutor.java:586)at org.apache.hadoop.hbase.master.HMaster.createProcedureExecutor(HMaster.java:1523)at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:938)at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2124)at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:580)at java.lang.Thread.run(Thread.java:748) 2020-05-16 14:51:47,983 ERROR [master/Desktop:16000:becomeActiveMaster] master.HMaster: ***** ABORTING master desktop,16000,1589611905045: Unhandled exception. Starting shutdown. ***** java.lang.IllegalStateException: The procedure WAL relies on the ability to hsync for proper operation during component failures, but the underlying filesystem does not support doing so. Please check the config value of 'hbase.procedure.store.wal.use.hsync' to set the desired level of robustness and ensure the config value of 'hbase.wal.dir' points to a FileSystem mount that can provide it.at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.rollWriter(WALProcedureStore.java:1092)at org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore.recoverLease(WALProcedureStore.java:424)at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.init(ProcedureExecutor.java:586)at org.apache.hadoop.hbase.master.HMaster.createProcedureExecutor(HMaster.java:1523)at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:938)at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2124)at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:580)at java.lang.Thread.run(Thread.java:748)

網上的一個辦法之一是直接設定hbase.unsafe.stream.capability.enforce=false

根據官網的說法，hbase.unsafe.stream.capability.enforce=false存在丟失數據的風險，根本無法用于生產環境。

又想用最新版本又想兼容，只能自己編譯了。

＃－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－－

準備工作:

https://mirror.bit.edu.cn/apache/hbase/2.2.4/hbase-2.2.4-src.tar.gz

注意配置好maven的阿里云鏡像

編譯命令

mvn clean package -DskipTests assembly:single -Dhadoop.profile=3.0 -Dhadoop-three.version=3.1.2

?

編譯時間Total time: 30:23 min

?

編譯結束后得到:

/home/appleyuchi/bigdata/hbase-2.2.4-源碼/hbase-assembly/target/hbase-2.2.4-bin.tar.gz

?

然后可以看到得到hbase2.2.4都是依賴于hadoop3.2.1了。

?

Reference:

http://www.meilongkui.com/archives/1544

?

?

總結

以上是生活随笔為你收集整理的编译hbase2.2.4+hadoop3.1.2的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。