hadoop2.7 运行wordcount

查看数: 191504 | 评论数: 9 | 收藏 3
关灯 | 提示:支持键盘翻页<-左 右->
    组图打开中,请稍候......
发布时间: 2015-4-28 14:22

正文摘要:

问题导读 1.Call From: ubuntu to localhost:9000 failed on connection exception: java.net.ConnectException: Connection本文是如何解决的? 2.运行wordcount,本文做了那些准备工作? 3.如何查看运行结果? ...

回复

zouzhi 发表于 2017-4-6 22:36:49


input  output是hdfs里面的路径
chinaboy 发表于 2016-4-28 14:25:50
ableq 发表于 2015-11-2 10:31
安装完hadoop 2.7.1是否自动有input、output目录,好像没见到要手动创建这两个目录?

input  output是hdfs里面的路径
ableq 发表于 2015-11-2 10:31:22
安装完hadoop 2.7.1是否自动有input、output目录,好像没见到要手动创建这两个目录?
snn123456 发表于 2015-10-21 17:14:36
谢谢分享!
ashic 发表于 2015-7-23 22:54:19
  • WARN hdfs.DFSClient: DFSInputStream has been closed already
  • 这个问题解决了吗?

jkdcdlly 发表于 2015-6-19 10:23:56
OK  找到了
jkdcdlly 发表于 2015-6-19 10:18:06
楼主:进入路径/tmp/hadoop-aboutyun/dfs/data,修改VERSION文件
并没有这个目录

QQ截图20150619101221.png
jkdcdlly 发表于 2015-6-19 10:15:54
楼主:进入路径/tmp/hadoop-aboutyun/dfs/data,修改VERSION文件
并没有这个目录
D:/QQ截图20150619101221.png
jseven 发表于 2015-5-15 15:59:27
非常感谢,照着这两篇文章,成功安装了hadoop2.8.对于最后的那个警告问题,apache官网有问题记录
https://issues.apache.org/jira/browse/HDFS-8099
建议是直接修改源代码,将WARN级别改为DEBUG级别。代码如下:
diff --git hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
index cf8015f..9f7b15c 100644
--- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
+++ hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
@@ -666,7 +666,7 @@ private synchronized DatanodeInfo blockSeekTo(long target) throws IOException {
   @Override
   public synchronized void close() throws IOException {
     if (!closed.compareAndSet(false, true)) {
-      DFSClient.LOG.warn("DFSInputStream has been closed already");
+      DFSClient.LOG.debug("DFSInputStream has been closed already");
       return;
     }
     dfsClient.checkOpen();
关闭

推荐上一条 /2 下一条