oozie提交workflow后執行task報錯：

2019-07-04 17:19:00,559 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: ERROR IN CONTACTING RM. java.lang.ArithmeticException: / by zeroat org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils.computeAvailableContainers(ResourceCalculatorUtils.java:38)at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.assign(RMContainerAllocator.java:981)at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator$ScheduledRequests.access$200(RMContainerAllocator.java:873)at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.heartbeat(RMContainerAllocator.java:252)at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator$1.run(RMCommunicator.java:282)at java.lang.Thread.run(Thread.java:748)

查看代碼

org.apache.hadoop.mapreduce.v2.app.rm.ResourceCalculatorUtils

public static int computeAvailableContainers(Resource available, Resource required, EnumSet<SchedulerResourceTypes> resourceTypes) {return resourceTypes.contains(SchedulerResourceTypes.CPU)?Math.min(available.getMemory() / required.getMemory(), available.getVirtualCores() / required.getVirtualCores()):available.getMemory() / required.getMemory();}

應該是以下兩者之一為0

required.getMemory()
required.getVirtualCores()

注意之前的日志還有一行

2019-07-04 17:18:58,557 INFO [Thread-51] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:0, vCores:1>

問題在于required.getMemory()=0

?

從job history server查看失敗task對應的application的conf發現問題

<tr><td>mapreduce.map.memory.mb</td><td>0</td><td>job.xml &#11013; programatically</td></tr>

查看oozie代碼發現

org.apache.oozie.action.hadoop.JavaActionExecutor

private static void injectLauncherProperties(Configuration srcConf, Configuration launcherConf) {for (Map.Entry<String, String> entry : srcConf) {if (entry.getKey().startsWith("oozie.launcher.")) {String name = entry.getKey().substring("oozie.launcher.".length());String value = entry.getValue();// setting original KEY launcherConf.set(entry.getKey(), value);// setting un-prefixed key (to allow Hadoop job config// for the launcher job launcherConf.set(name, value);}}}

所有的hadoop配置，都需要增加 oozie.launcher. 前綴（大量的組件都是這么搞得），即需要傳遞參數

oozie.launcher.mapreduce.map.memory.mb=1024

問題解決

?

轉載于:https://www.cnblogs.com/barneywill/p/11140996.html

總結

以上是生活随笔為你收集整理的【原创】大叔问题定位分享（33）oozie提交任务报错ArithmeticException: / by zero的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。