報錯如下:?

yarn-session.sh ?-tm 2048 -s 3

2020-06-08 22:24:20,317 WARN org.apache.flink.yarn.cli.FlinkYarnSessionCli - The configuration directory ('/home/appleyuchi/bigdata/flink-1.10.1/conf') already contains a LOG4J config file.If you want to use logback, then please delete or rename the log configuration file. 2020-06-08 22:24:20,554 INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at Desktop/192.168.0.103:8032 2020-06-08 22:24:20,787 INFO org.apache.hadoop.yarn.client.AHSProxy - Connecting to Application History server at Desktop/192.168.0.103:10201 2020-06-08 22:24:21,145 ERROR org.apache.flink.yarn.cli.FlinkYarnSessionCli - Error while running the Flink session. org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session clusterat org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:381)at org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:548)at org.apache.flink.yarn.cli.FlinkYarnSessionCli.lambda$main$5(FlinkYarnSessionCli.java:785)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)at org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:785) Caused by: org.apache.flink.configuration.IllegalConfigurationException: The number of requested virtual cores per node 3 exceeds the maximum number of virtual cores 2 available in the Yarn Cluster. Please note that the number of virtual cores is set to the number of task slots by default unless configured in the Flink config with 'yarn.containers.vcores.'at org.apache.flink.yarn.YarnClusterDescriptor.isReadyForDeployment(YarnClusterDescriptor.java:293)at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:444)at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:374)... 7 more------------------------------------------------------------The program finished with the following exception:org.apache.flink.client.deployment.ClusterDeploymentException: Couldn't deploy Yarn session clusterat org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:381)at org.apache.flink.yarn.cli.FlinkYarnSessionCli.run(FlinkYarnSessionCli.java:548)at org.apache.flink.yarn.cli.FlinkYarnSessionCli.lambda$main$5(FlinkYarnSessionCli.java:785)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)at org.apache.flink.yarn.cli.FlinkYarnSessionCli.main(FlinkYarnSessionCli.java:785) Caused by: org.apache.flink.configuration.IllegalConfigurationException: The number of requested virtual cores per node 3 exceeds the maximum number of virtual cores 2 available in the Yarn Cluster. Please note that the number of virtual cores is set to the number of task slots by default unless configured in the Flink config with 'yarn.containers.vcores.'at org.apache.flink.yarn.YarnClusterDescriptor.isReadyForDeployment(YarnClusterDescriptor.java:293)at org.apache.flink.yarn.YarnClusterDescriptor.deployInternal(YarnClusterDescriptor.java:444)at org.apache.flink.yarn.YarnClusterDescriptor.deploySessionCluster(YarnClusterDescriptor.java:374)... 7 more

關鍵是這句:

The number of requested virtual cores per node 3 exceeds the maximum number of virtual cores 2

這是因為，命令中申請了三個cpu core

yarn-session.sh ?-tm 2048 -s 3

yarn界面如下:

可以看到yarn界面中的最多讓申請2個core

所以解決方案：

要么命令中修改為2，

要么根據[1]$HADOOP_HOME/etc/hadoop/yarn-site.xml中調整參數.

[1]yarn界面中的Minimum Allocation和Maximum Allocation與yarn-site.xml中參數的對應關系

總結

以上是生活随笔為你收集整理的The number of requested virtual cores per node 3 exceeds the maximum number of virtual cores 2的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。