Oozie jobs are failing with class not found error - Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found

不羁岁月 提交于 2020-01-16 08:35:06

问题


Our oozie jobs are failing with java.lang.ClassNotFoundException. Please find complete log attached.

2019-11-26 12:41:31,690 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED; cause: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2401) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:545) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:522) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1696) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:522) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:307) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$5.run(MRAppMaster.java:1654) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1651) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1584) Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2369) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2393) ... 12 more Caused by: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2273) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2367) ... 13 more

As seen in other links, I have already updated my sharelib list and please find below the list which displays when I run the shareliblist command-

[Available ShareLib]
hive
distcp
mapreduce-streaming
oozie
hcatalog
hive2
sqoop
pig

We are using AWS EMR 5.14.1 and Oozie 4.3.0. We are using the S3 Filesystem as HDFS. Our input files and workflow are in S3 bucket.

Appreciate any guidance here.

来源:https://stackoverflow.com/questions/59052772/oozie-jobs-are-failing-with-class-not-found-error-class-org-apache-oozie-actio

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!