配置中進行如下調整：

其實就是在在yarn-site.xm中添加yarn.resourcemanager.scheduler.class，修改成容量調度器：

<property><name>yarn.resourcemanager.scheduler.class</name><value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler</value> </property>

配置中搜索yarn.scheduler.capacity.root.queues，以XML格式查看，導入以下配置后重啟yarn：

修改后的配置：

<configuration> <property><name>yarn.scheduler.capacity.maximum-applications</name><value>10000</value></property><property><name>yarn.scheduler.capacity.maximum-am-resource-percent</name><value>0.1</value></property><property><name>yarn.scheduler.capacity.resource-calculator</name><value>org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator</value></property><property><name>yarn.scheduler.capacity.root.queues</name><value>default,dmgeo</value></property><property><name>yarn.scheduler.capacity.root.default.capacity</name><value>40</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.capacity</name><value>60</value></property><property><name>yarn.scheduler.capacity.root.default.user-limit-factor</name><value>1</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.user-limit-factor</name><value>1</value></property><property><name>yarn.scheduler.capacity.root.default.maximum-capacity</name><value>100</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.maximum-capacity</name><value>100</value></property><property><name>yarn.scheduler.capacity.root.default.state</name><value>RUNNING</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.state</name><value>RUNNING</value></property><property><name>yarn.scheduler.capacity.root.default.acl_submit_applications</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.acl_submit_applications</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.default.acl_administer_queue</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.acl_administer_queue</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.default.acl_application_max_priority</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.acl_application_max_priority</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.default.maximum-application-lifetime </name><value>-1</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.maximum-application-lifetime </name><value>-1</value></property><property><name>yarn.scheduler.capacity.root.default.default-application-lifetime </name><value>-1</value></property><property><name>yarn.scheduler.capacity.root.dmgeo.default-application-lifetime </name><value>-1</value></property><property><name>yarn.scheduler.capacity.node-locality-delay</name><value>40</value></property><property><name>yarn.scheduler.capacity.rack-locality-additional-delay</name><value>-1</value></property><property><name>yarn.scheduler.capacity.queue-mappings</name><value></value></property><property><name>yarn.scheduler.capacity.queue-mappings-override.enable</name><value>false</value></property><property><name>yarn.scheduler.capacity.per-node-heartbeat.maximum-offswitch-assignments</name><value>1</value></property> </configuration>

默認的配置：

<configuration><property><name>yarn.scheduler.capacity.root.queues</name><value>default</value></property><property><name>yarn.scheduler.capacity.root.capacity</name><value>100</value></property><property><name>yarn.scheduler.capacity.root.default.capacity</name><value>100</value></property></configuration>

參考鏈接：https://www.cnblogs.com/hongfeng2019/p/11477583.html

總結

以上是生活随笔為你收集整理的CDH 版本Hadoop Yarn配置容量调度器（默认是公平调度器）的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。