日志

hadoop job ExitCodeException exitCode=1: chmod: ....... No such file or direct

热度 3已有 4322 次阅读2015-1-29 13:33

使用 hadoop.cdh5 作为部署

在执行Map red 数据分析时

抛出

15/01/29 13:06:15 INFO mapred.JobClient: Cleaning up the staging area file:/tmp/hadoop-jndong/mapred/staging/jndong234945070/.staging/job_local234945070_0001

Exception in thread "main" ExitCodeException exitCode=1: chmod: /tmp/hadoop-jndong/mapred/staging/jndong234945070/.staging/job_local234945070_0001: No such file or directory

at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)

at org.apache.hadoop.util.Shell.run(Shell.java:455)

at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)

at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)

at org.apache.hadoop.util.Shell.execCommand(Shell.java:774)

at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:646)

at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:479)

at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:599)

at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:814)

at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:774)

at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:178)

at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:991)

at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:976)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:394)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)

at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:976)

at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:950)

at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1412)

at com.heioo.school.hadoop.kpi.KPIPV.main(KPIPV.java:77)

通过错误提示可以知道是应该权限问题可是我已经把／tmp 目录赋值为 777 权限了请问这样的问题我应该如何处理

Ps 初学Hadoop

路过

雷人

握手

鲜花

鸡蛋

收藏分享邀请举报

发表评论评论 (4 个评论)

回复 s060403072 2015-1-30 19:15: chmod: /tmp/hadoop-jndong/mapred/staging/jndong234945070/.staging/job_local234945070_0001: No such file or directory？
博主可能是搞错权限问题了，建议在方面补补Linux

回复 Jndong 2015-2-3 13:56: s060403072: chmod: /tmp/hadoop-jndong/mapred/staging/jndong234945070/.staging/job_local234945070_0001: No such file or directory？
博主可能是搞错权限问题了，建议 ...
嗯嗯问题已经解决了是本机环境导致的刚开始一直在调整集群环境的权限