分享

hadoop2.4.1 提交job后卡在UNASSIGNED状态,麻烦高手看一下,谢谢

提交job的输出:
[hadoop@plm127 ~]$ hadoop jar hadoop-2.4.1/share/hadoop/mapreduce/sources/hadoop-mapreduce-examples-2.4.1-sources.jar org.apache.hadoop.examples.WordCount /input/gc.log /output
14/09/11 09:24:25 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/09/11 09:24:26 INFO client.RMProxy: Connecting to ResourceManager at plmtest10.gree.com/10.1.18.246:8032
14/09/11 09:24:28 INFO input.FileInputFormat: Total input paths to process : 1
14/09/11 09:24:28 INFO mapreduce.JobSubmitter: number of splits:5
14/09/11 09:24:28 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1410311760697_0005
14/09/11 09:24:28 INFO impl.YarnClientImpl: Submitted application application_1410311760697_0005
14/09/11 09:24:28 INFO mapreduce.Job: The url to track the job: http://plmtest10.gree.com:8088/p ... 1410311760697_0005/
14/09/11 09:24:28 INFO mapreduce.Job: Running job: job_1410311760697_0005

yarn-hadoop-resourcemanager.log:2014-09-11 09:32:03,320 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 52014-09-11 09:32:04,396 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 5 submitted by user hadoop
2014-09-11 09:32:04,396 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hadoop        IP=10.2.8.127        OPERATION=Submit Application Request        TARGET=ClientRMService        RESULT=SUCCESS        APPID=application_1410311760697_0005
2014-09-11 09:32:04,397 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1410311760697_0005
2014-09-11 09:32:04,397 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1410311760697_0005 State change from NEW to NEW_SAVING
2014-09-11 09:32:04,397 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1410311760697_0005
2014-09-11 09:32:04,397 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1410311760697_0005 State change from NEW_SAVING to SUBMITTED
2014-09-11 09:32:04,398 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Accepted application application_1410311760697_0005 from user: hadoop, in queue: default, currently num of applications: 5
2014-09-11 09:32:04,399 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1410311760697_0005 State change from SUBMITTED to ACCEPTED
2014-09-11 09:32:04,399 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1410311760697_0005_000001
2014-09-11 09:32:04,400 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1410311760697_0005_000001 State change from NEW to SUBMITTED
2014-09-11 09:32:04,400 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Added Application Attempt appattempt_1410311760697_0005_000001 to scheduler from user: hadoop
2014-09-11 09:32:04,400 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1410311760697_0005_000001 State change from SUBMITTED to SCHEDULED



1.png

已有(3)人评论

跳转到指定楼层
rsgg03 发表于 2014-10-5 19:32:52
从提供的日志看不出什么来。UNASSIGNED是在创建task阶段卡住了,看看是不是资源不足造成的
回复

使用道具 举报

pengsuyun 发表于 2014-11-7 07:09:52
之前有执行出错的mapreduce吗?
回复

使用道具 举报

Mr.k 发表于 2016-11-7 14:07:46
执行export HADOOP_ROOT_LOGGER=DEBUG,console之后,打印所有的DEBUG消息后发现,消息中没有exception更改运行时额日志级别

修改$HADOOP_CONF_DIR/log4j.properties文件 hadoop.root.logger=ALL,console

or:

开启:export HADOOP_ROOT_LOGGER=DEBUG,console

关闭:export HADOOP_ROOT_LOGGER=INFO,console
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条