luwl 发表于 2017-7-3 10:05:22

刚开始学，第一次跑wordcount demo，出错

2017-06-27 16:44:36,763 INFOnodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(632)) - Initializing user root2017-06-27 16:44:36,774 INFOnodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(126)) - Copying from /hadoop/yarn/local/nmPrivate/container_e09_1498464711048_0002_01_000001.tokens to /hadoop/yarn/local/usercache/root/appcache/application_1498464711048_0002/container_e09_1498464711048_0002_01_000001.tokens2017-06-27 16:44:36,775 INFOnodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(133)) - Localizer CWD set to /hadoop/yarn/local/usercache/root/appcache/application_1498464711048_0002 = file:/hadoop/yarn/local/usercache/root/appcache/application_1498464711048_00022017-06-27 16:44:36,881 INFOlocalizer.ResourceLocalizationService (ResourceLocalizationService.java:run(867)) - Failed to download resource { { hdfs://dsj-02:8020/hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz, 1497422437142, ARCHIVE, null },pending,[(container_e09_1498464711048_0002_01_000001)],1215325000859924,DOWNLOADING}ExitCodeException exitCode=2: gzip: /hadoop/yarn/local/filecache/10_tmp/tmp_mapreduce.tar.gz: unexpected end of filetar: 它似ä1Žä¸åƒæ˜ˉä¸

langke93 发表于 2017-7-3 12:48:01

怎么跑的，下面资源下载失败了。
hdfs://dsj-02:8020/hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz

luwl 发表于 2017-7-3 13:10:41

是的啊，资源是有的
# hdfs dfs -ls /hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
SLF4J: Found binding in
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type
-r--r--r--   2 hdfs hadoop          0 2017-06-14 14:40 /hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz

luwl 发表于 2017-7-3 13:14:54

# hdfs dfs -ls /hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
SLF4J: Found binding in
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type
-r--r--r--   2 hdfs hadoop          0 2017-06-14 14:40 /hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz
但是资源是有的

easthome001 发表于 2017-7-3 16:33:11

luwl 发表于 2017-7-3 13:14
# hdfs dfs -ls /hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz
SLF4J: Class path con ...

-r--r--r--   2 hdfs hadoop          0 2017-06-14 14:40 /hdp/apps/2.5.3.0-37/mapreduce/mapreduce.tar.gz
可能权限不足，建议授权777,并且用户是当前运行的用户。否则不能具有下载权限

页: [1]
查看完整版本: 刚开始学，第一次跑wordcount demo，出错