分享

oozie is not allowed to impersonate oozie

jttsai 发表于 2014-8-15 09:02:33 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 26028
本帖最后由 jttsai 于 2014-8-15 09:03 编辑

在安装oozie上跑mapreduce时,报这样的错误:

2014-08-15 08:52:53,530  INFO ActionStartXCommand:539 - SERVER[master1.hadoop] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-140815085216532-oozie-oozi-W] ACTION[0000000-140815085216532-oozie-oozi-W@:start:] Start action [0000000-140815085216532-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-08-15 08:52:53,532  WARN ActionStartXCommand:542 - SERVER[master1.hadoop] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-140815085216532-oozie-oozi-W] ACTION[0000000-140815085216532-oozie-oozi-W@:start:] [***0000000-140815085216532-oozie-oozi-W@:start:***]Action status=DONE
2014-08-15 08:52:53,533  WARN ActionStartXCommand:542 - SERVER[master1.hadoop] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-140815085216532-oozie-oozi-W] ACTION[0000000-140815085216532-oozie-oozi-W@:start:] [***0000000-140815085216532-oozie-oozi-W@:start:***]Action updated in DB!
2014-08-15 08:52:53,741  INFO ActionStartXCommand:539 - SERVER[master1.hadoop] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-140815085216532-oozie-oozi-W] ACTION[0000000-140815085216532-oozie-oozi-W@mr-node] Start action [0000000-140815085216532-oozie-oozi-W@mr-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-08-15 08:52:54,902  WARN ActionStartXCommand:542 - SERVER[master1.hadoop] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-140815085216532-oozie-oozi-W] ACTION[0000000-140815085216532-oozie-oozi-W@mr-node] Error starting action [mr-node]. ErrorType [NON_TRANSIENT], ErrorCode [JA002], Message [JA002: User: oozie is not allowed to impersonate oozie]
org.apache.oozie.action.ActionExecutorException: JA002: User: oozie is not allowed to impersonate oozie
        at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:418)
        at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:392)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:915)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1071)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:217)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:62)
        at org.apache.oozie.command.XCommand.call(XCommand.java:280)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
        at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.hadoop.security.authorize.AuthorizationException: User: oozie is not allowed to impersonate oozie
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53)
        at org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:104)
        at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getDelegationToken(ApplicationClientProtocolPBClientImpl.java:264)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
        at com.sun.proxy.$Proxy33.getDelegationToken(Unknown Source)
        at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getRMDelegationToken(YarnClientImpl.java:320)
        at org.apache.hadoop.mapred.ResourceMgrDelegate.getDelegationToken(ResourceMgrDelegate.java:162)
        at org.apache.hadoop.mapred.YARNRunner.getDelegationToken(YARNRunner.java:220)
        at org.apache.hadoop.mapreduce.Cluster.getDelegationToken(Cluster.java:400)
        at org.apache.hadoop.mapred.JobClient$16.run(JobClient.java:1203)
        at org.apache.hadoop.mapred.JobClient$16.run(JobClient.java:1200)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
        at org.apache.hadoop.mapred.JobClient.getDelegationToken(JobClient.java:1199)
        at org.apache.oozie.service.HadoopAccessorService.createJobClient(HadoopAccessorService.java:374)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.createJobClient(JavaActionExecutor.java:1114)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:863)
        ... 10 more
Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: oozie is not allowed to impersonate oozie
        at org.apache.hadoop.ipc.Client.call(Client.java:1409)
        at org.apache.hadoop.ipc.Client.call(Client.java:1362)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
        at com.sun.proxy.$Proxy32.getDelegationToken(Unknown Source)
        at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getDelegationToken(ApplicationClientProtocolPBClientImpl.java:261)
        ... 30 more
2014-08-15 08:52:54,906  WARN ActionStartXCommand:542 - SERVER[master1.hadoop] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000000-140815085216532-oozie-oozi-W] ACTION[0000000-140815085216532-oozie-oozi-W@mr-node] Suspending Workflow Job id=0000000-140815085216532-oozie-oozi-W

我的hadoop下的core-site.xml也已经添加了
<property>
   <name>hadoop.proxyuser.oozie.groups</name>
   <value>hadoop</value>
</property>
<property>
    <name>hadoop.proxyuser.oozie.hosts</name>
    <value>master1.hadoop,master2.hadoop</value>
</property>
并且我也在yarn-site.xml上添加了如上的属性,真心不知道哪里有问题,希望能得到大家的帮助!!ps:我hadoop版本用的是cdh5

已有(4)人评论

跳转到指定楼层
sstutu 发表于 2014-8-15 10:10:51
本帖最后由 sstutu 于 2014-8-15 10:14 编辑
你的配置感觉不怎么正确,你尝试下面配置

user:代表你的用户
<property>  
            <name>hadoop.proxyuser.user.hosts</name>  
            <value>localhost</value>  
</property>
<property>
          <name>hadoop.proxyuser.user.groups</name>
          <value>user</value>
</property>
回复

使用道具 举报

jttsai 发表于 2014-8-15 11:16:18
sstutu 发表于 2014-8-15 10:10
本帖最后由 sstutu 于 2014-8-15 10:14 编辑
你的配置感觉不怎么正确,你尝试下面配置

好的,我试试
回复

使用道具 举报

jttsai 发表于 2014-8-15 11:56:20
sstutu 发表于 2014-8-15 10:10
本帖最后由 sstutu 于 2014-8-15 10:14 编辑
你的配置感觉不怎么正确,你尝试下面配置

<property>
          <name>hadoop.proxyuser.user.groups</name>
          <value>user</value>
</property>
其中, <value>user</value> 不应该是user的用户组么?怎么还是user啊?
回复

使用道具 举报

sstutu 发表于 2014-8-15 14:58:37
jttsai 发表于 2014-8-15 11:56
hadoop.proxyuser.user.groups
          user
这跟你创建的用户有关系。如果你没有修改的话,是系统默认的。
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条