日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 编程资源 > 编程问答 >内容正文

编程问答

hadoop的web ui的8088端口打不开一例

發布時間:2023/12/31 编程问答 30 豆豆
生活随笔 收集整理的這篇文章主要介紹了 hadoop的web ui的8088端口打不开一例 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

首先jps看下,得到:

25013 Master
8599 SecondaryNameNode
8200 NameNode
8377 DataNode
9902 Jps
?

可以發現沒有resourcemanager,也就是說yarn沒有啟動.

log路徑:

/home/appleyuchi/bigdata/hadoop-2.7.7/logs/yarn-appleyuchi-resourcemanager-Desktop.log

log中報錯如下:

2020-04-27 15:13:36,416 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT]
2020-04-27 15:13:36,606 INFO org.apache.hadoop.conf.Configuration: found resource core-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/core-site.xml
2020-04-27 15:13:36,704 INFO org.apache.hadoop.security.Groups: clearing userToGroupsMap cache
2020-04-27 15:13:36,746 INFO org.apache.hadoop.conf.Configuration: found resource yarn-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/yarn-site.xml
2020-04-27 15:13:36,767 INFO org.apache.hadoop.service.AbstractService: Service ResourceManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
?? ?at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
?? ?at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state
2020-04-27 15:13:36,769 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
?? ?at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
?? ?at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
?? ?at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
?? ?at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,771 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG:?
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at Desktop/192.168.0.103
************************************************************/

調試的過程中還碰到下面的錯誤:

Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.

****************************

2020-04-27 16:11:57,674 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.resourcemanager.EmbeddedElectorService failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not set
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not se

最終會牽涉到Zookeeper,zookeeper要求運行的最低集群配置是3臺,由于手頭只有兩臺,所以沒法搞.

?

所以最終解決方案是不要在yarn-site.xml中開啟yarn.resourcemanager.ha.enabled:

<configuration> <!-- <property><name>yarn.resourcemanager.ha.enabled</name><value>true</value> </property> -->

?

總結

以上是生活随笔為你收集整理的hadoop的web ui的8088端口打不开一例的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。