配置多隊列hive隊列和default隊列

<configuration>......<property><name>yarn.scheduler.capacity.root.queues</name><value>default,hive</value> --add<description>The queues at the this level (root is the root queue).</description></property><property><name>yarn.scheduler.capacity.root.default.capacity</name><value>40</value><description>Default queue target capacity.</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.capacity</name><value>60</value><description>Default queue target capacity.</description></property><property><name>yarn.scheduler.capacity.root.default.user-limit-factor</name><value>1</value><description>Default queue user limit a percentage from 0.0 to 1.0.</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.user-limit-factor</name><value>1</value></property><property><name>yarn.scheduler.capacity.root.default.maximum-capacity</name><value>60</value><description>The maximum capacity of the default queue. </description></property>--add<property><name>yarn.scheduler.capacity.root.default.maximum-capacity</name><value>80</value></property><property><name>yarn.scheduler.capacity.root.default.state</name><value>RUNNING</value><description>The state of the default queue. State can be one of RUNNING or STOPPED.</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.state</name><value>RUNNING</value></property><property><name>yarn.scheduler.capacity.root.default.acl_submit_applications</name><value>*</value><description>The ACL of who can submit jobs to the default queue.</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.acl_submit_applications</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.default.acl_administer_queue</name><value>*</value><description>The ACL of who can administer jobs on the default queue.</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.acl_administer_queue</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.default.acl_application_max_priority</name><value>*</value><description>The ACL of who can submit applications with configured priority.For e.g, [user={name} group={name} max_priority={priority} default_priority={priority}]</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.acl_application_max_priority</name><value>*</value></property><property><name>yarn.scheduler.capacity.root.default.maximum-application-lifetime</name><value>-1</value><description>Maximum lifetime of an application which is submitted to a queuein seconds. Any value less than or equal to zero will be considered asdisabled.This will be a hard time limit for all applications in thisqueue. If positive value is configured then any application submittedto this queue will be killed after exceeds the configured lifetime.User can also specify lifetime per application basis inapplication submission context. But user lifetime will beoverridden if it exceeds queue maximum lifetime. It is point-in-timeconfiguration.Note : Configuring too low value will result in killing applicationsooner. This feature is applicable only for leaf queue.</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.maximum-application-lifetime</name><value>-1</value></property><property><name>yarn.scheduler.capacity.root.default.default-application-lifetime</name><value>-1</value><description>Default lifetime of an application which is submitted to a queuein seconds. Any value less than or equal to zero will be considered asdisabled.If the user has not submitted application with lifetime value then thisvalue will be taken. It is point-in-time configuration.Note : Default lifetime can't exceed maximum lifetime. This feature isapplicable only for leaf queue.</description></property>--add<property><name>yarn.scheduler.capacity.root.hive.default-application-lifetime</name><value>-1</value></property>......</configuration>

總結

以上是生活随笔為你收集整理的Hadoop yarn容量调度器capacity-scheduler.xml配置示例的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。