input output是hdfs里面的路径 |
ableq 发表于 2015-11-2 10:31 input output是hdfs里面的路径 |
安装完hadoop 2.7.1是否自动有input、output目录,好像没见到要手动创建这两个目录? |
谢谢分享! |
|
OK 找到了 |
楼主:进入路径/tmp/hadoop-aboutyun/dfs/data,修改VERSION文件 并没有这个目录 |
楼主:进入路径/tmp/hadoop-aboutyun/dfs/data,修改VERSION文件 并没有这个目录 D:/QQ截图20150619101221.png |
非常感谢,照着这两篇文章,成功安装了hadoop2.8.对于最后的那个警告问题,apache官网有问题记录 https://issues.apache.org/jira/browse/HDFS-8099 建议是直接修改源代码,将WARN级别改为DEBUG级别。代码如下: diff --git hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java index cf8015f..9f7b15c 100644 --- hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java +++ hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java @@ -666,7 +666,7 @@ private synchronized DatanodeInfo blockSeekTo(long target) throws IOException { @Override public synchronized void close() throws IOException { if (!closed.compareAndSet(false, true)) { - DFSClient.LOG.warn("DFSInputStream has been closed already"); + DFSClient.LOG.debug("DFSInputStream has been closed already"); return; } dfsClient.checkOpen(); |