RM job was stuck when running with oozie

♀尐吖头ヾ 提交于 2019-12-08 12:24:56

问题


I'm running a mapreduce wordcount job task on oozie. 2 jobs were submitted to the yarn, and then the monitoring tasks running upto 99% were stuck. Wordcount job has been 0%.

When I kill off the monitor job, wordcount job runs smoothly.

I use a cluster of 3 virtual machines, configuration is as follows:

 Profile per VM: cores=2 memory=2048MB reserved=0GB usableMem=0GB disks=1
 Num Container=3
 Container Ram=640MB
 Used Ram=1GB
 Unused Ram=0GB
 yarn.scheduler.minimum-allocation-mb=640
 yarn.scheduler.maximum-allocation-mb=1920
 yarn.nodemanager.resource.memory-mb=1920
 mapreduce.map.memory.mb=640
 mapreduce.map.java.opts=-Xmx512m
 mapreduce.reduce.memory.mb=1280
 mapreduce.reduce.java.opts=-Xmx1024m
 yarn.app.mapreduce.am.resource.mb=640
 yarn.app.mapreduce.am.command-opts=-Xmx512m
 mapreduce.task.io.sort.mb=256

Is there any way to solve this, to make two jobs run smoothly and finish at the same time ?

来源:https://stackoverflow.com/questions/42456666/rm-job-was-stuck-when-running-with-oozie

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!