分享

oozie运行官方map-reduce example出错

elbert.malone 发表于 2016-9-16 01:05:33 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 2 8246
命令:
$bin/oozie job -oozie http://hadoop01.malone.com:11000/oozie -config examples/apps/map-reduce/job.properties -run

错误信息:
org.apache.oozie.action.ActionExecutorException: JA017: Unknown hadoop job [job_local1670017727_0001] associated with action [0000000-160916001854045-oozie-hado-W@mr-node].  Failing this action!
        at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1210)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1147)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
        at org.apache.oozie.command.XCommand.call(XCommand.java:281)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
        at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
2016-09-16 00:22:29,967  WARN ActionStartXCommand:544 - SERVER[hadoop01.malone.com] USER[hadoop] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-160916001854045-oozie-hado-W] ACTION[0000000-160916001854045-oozie-hado-W@mr-node] Error starting action [mr-node]. ErrorType [FAILED], ErrorCode [JA017], Message [JA017: Unknown hadoop job [job_local1670017727_0001] associated with action [0000000-160916001854045-oozie-hado-W@mr-node].  Failing this action!]
org.apache.oozie.action.ActionExecutorException: JA017: Unknown hadoop job [job_local1670017727_0001] associated with action [0000000-160916001854045-oozie-hado-W@mr-node].  Failing this action!
        at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1210)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1147)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
        at org.apache.oozie.command.XCommand.call(XCommand.java:281)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
        at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
2016-09-16 00:22:29,979  WARN ActionStartXCommand:544 - SERVER[hadoop01.malone.com] USER[hadoop] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-160916001854045-oozie-hado-W] ACTION[0000000-160916001854045-oozie-hado-W@mr-node] Failing Job due to failed action [mr-node]
2016-09-16 00:22:30,014  WARN LiteWorkflowInstance:544 - SERVER[hadoop01.malone.com] USER[hadoop] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-160916001854045-oozie-hado-W] ACTION[0000000-160916001854045-oozie-hado-W@mr-node] Workflow Failed. Failing node [mr-node]
2016-09-16 00:22:30,362  INFO KillXCommand:541 - SERVER[hadoop01.malone.com] USER[hadoop] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-160916001854045-oozie-hado-W] ACTION[-] STARTED WorkflowKillXCommand for jobId=0000000-160916001854045-oozie-hado-W
2016-09-16 00:22:30,477  INFO KillXCommand:541 - SERVER[hadoop01.malone.com] USER[hadoop] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-160916001854045-oozie-hado-W] ACTION[-] ENDED WorkflowKillXCommand for jobId=0000000-160916001854045-oozie-hado-W
2016-09-16 00:22:31,653  INFO CallbackServlet:541 - SERVER[hadoop01.malone.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000000-160916001854045-oozie-hado-W] ACTION[0000000-160916001854045-oozie-hado-W@mr-node] callback for action [0000000-160916001854045-oozie-hado-W@mr-node]
2016-09-16 00:22:31,719 ERROR CompletedActionXCommand:538 - SERVER[hadoop01.malone.com] USER[-] GROUP[-] TOKEN[] APP[-] JOB[0000000-160916001854045-oozie-hado-W] ACTION[0000000-160916001854045-oozie-hado-W@mr-node] XException,
org.apache.oozie.command.CommandException: E0800: Action it is not running its in [FAILED] state, action [0000000-160916001854045-oozie-hado-W@mr-node]
        at org.apache.oozie.command.wf.CompletedActionXCommand.eagerVerifyPrecondition(CompletedActionXCommand.java:77)
        at org.apache.oozie.command.XCommand.call(XCommand.java:251)
        at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
2016-09-16 00:22:31,721  WARN CallableQueueService$CallableWrapper:544 - SERVER[hadoop01.malone.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] exception callable [callback], E0800: Action it is not running its in [FAILED] state, action [0000000-160916001854045-oozie-hado-W@mr-node]
org.apache.oozie.command.CommandException: E0800: Action it is not running its in [FAILED] state, action [0000000-160916001854045-oozie-hado-W@mr-node]
        at org.apache.oozie.command.wf.CompletedActionXCommand.eagerVerifyPrecondition(CompletedActionXCommand.java:77)
        at org.apache.oozie.command.XCommand.call(XCommand.java:251)
        at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

已有(2)人评论

跳转到指定楼层
einhep 发表于 2016-9-16 16:08:13
首先看看jobhistory是否启动了
看下jobhistrory文件夹和tmp文件夹,运行job的用户,是否可以访问
回复

使用道具 举报

elbert.malone 发表于 2016-9-16 16:58:19
einhep 发表于 2016-9-16 16:08
首先看看jobhistory是否启动了
看下jobhistrory文件夹和tmp文件夹,运行job的用户,是否可以访问

谢谢回复,我的Jobhistory已经启动,权限没有问题。最后的原因是mapred-site.xml没有添加如下property:
<property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
        <description>The runtime framework for executing MapReduce jobs. Can be one of local, classic or yarn.</description>
</property>

回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条