编译hadoop2.5.2经验总结、问题分析及下载32位、64位安装包下载
本帖最后由 nettman 于 2014-11-24 01:33 编辑编译的时候遇到了不少问题，在后面会贴出错误，参考
从零教你在Linux环境下（ubuntu 12.04）如何编译hadoop2.4环境重新安装了一遍，但是却没有预想的那么顺利，遇到了不少问题，最终归结于编译环境不纯，什么是不纯那，举个例子
当时想通过在线安装maven，可是网络实在是太慢了，所以终止在线安装，直接从网上了下载了个离线包，然后配置了一下，结果编译不成功。
最后产生了如下的问题：
问题1：
------------------------------------------------------------------------
Reactor Summary:
Apache Hadoop Main ................................. SUCCESS
Apache Hadoop Project POM .......................... FAILURE
Apache Hadoop Annotations .......................... SKIPPED
Apache Hadoop Assemblies ........................... SKIPPED
Apache Hadoop Project Dist POM ..................... SKIPPED
Apache Hadoop Maven Plugins ........................ SKIPPED
Apache Hadoop MiniKDC .............................. SKIPPED
Apache Hadoop Auth ................................. SKIPPED
Apache Hadoop Auth Examples ........................ SKIPPED
Apache Hadoop Common ............................... SKIPPED
Apache Hadoop NFS .................................. SKIPPED
Apache Hadoop Common Project ....................... SKIPPED
Apache Hadoop HDFS ................................. SKIPPED
Apache Hadoop HttpFS ............................... SKIPPED
Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
Apache Hadoop HDFS-NFS ............................. SKIPPED
Apache Hadoop HDFS Project ......................... SKIPPED
hadoop-yarn ........................................ SKIPPED
hadoop-yarn-api .................................... SKIPPED
hadoop-yarn-common ................................. SKIPPED
hadoop-yarn-server ................................. SKIPPED
hadoop-yarn-server-common .......................... SKIPPED
hadoop-yarn-server-nodemanager ..................... SKIPPED
hadoop-yarn-server-web-proxy ....................... SKIPPED
hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
hadoop-yarn-server-resourcemanager ................. SKIPPED
hadoop-yarn-server-tests ........................... SKIPPED
hadoop-yarn-client ................................. SKIPPED
hadoop-yarn-applications ........................... SKIPPED
hadoop-yarn-applications-distributedshell .......... SKIPPED
hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
hadoop-yarn-site ................................... SKIPPED
hadoop-yarn-project ................................ SKIPPED
hadoop-mapreduce-client ............................ SKIPPED
hadoop-mapreduce-client-core ....................... SKIPPED
hadoop-mapreduce-client-common ..................... SKIPPED
hadoop-mapreduce-client-shuffle .................... SKIPPED
hadoop-mapreduce-client-app ........................ SKIPPED
hadoop-mapreduce-client-hs ......................... SKIPPED
hadoop-mapreduce-client-jobclient .................. SKIPPED
hadoop-mapreduce-client-hs-plugins ................. SKIPPED
Apache Hadoop MapReduce Examples ................... SKIPPED
hadoop-mapreduce ................................... SKIPPED
Apache Hadoop MapReduce Streaming .................. SKIPPED
Apache Hadoop Distributed Copy ..................... SKIPPED
Apache Hadoop Archives ............................. SKIPPED
Apache Hadoop Rumen ................................ SKIPPED
Apache Hadoop Gridmix .............................. SKIPPED
Apache Hadoop Data Join ............................ SKIPPED
Apache Hadoop Extras ............................... SKIPPED
Apache Hadoop Pipes ................................ SKIPPED
Apache Hadoop OpenStack support .................... SKIPPED
Apache Hadoop Client ............................... SKIPPED
Apache Hadoop Mini-Cluster ......................... SKIPPED
Apache Hadoop Scheduler Load Simulator ............. SKIPPED
Apache Hadoop Tools Dist ........................... SKIPPED
Apache Hadoop Tools ................................ SKIPPED
Apache Hadoop Distribution ......................... SKIPPED
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 40:20 min
Finished at: 2014-11-23T00:36:03-08:00
Final Memory: 32M/84M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-javadoc-plugin:2.8.1:jar (module-javadocs) on project hadoop-project: Execution module-javadocs of goal org.apache.maven.plugins:maven-javadoc-plugin:2.8.1:jar failed: Plugin org.apache.maven.plugins:maven-javadoc-plugin:2.8.1 or one of its dependencies could not be resolved: Failed to collect dependencies at org.apache.maven.plugins:maven-javadoc-plugin:jar:2.8.1 -> org.apache.maven.shared:maven-common-artifact-filters:jar:1.3: Failed to read artifact descriptor for org.apache.maven.shared:maven-common-artifact-filters:jar:1.3: Could not transfer artifact org.apache.maven:maven-parent:pom:13 from/to central (http://repo.maven.apache.org/maven2): GET request of: org/apache/maven/maven-parent/13/maven-parent-13.pom from central failed: Read timed out ->
问题2
Apache Hadoop Main ................................. SUCCESS
Apache Hadoop Project POM .......................... SUCCESS
Apache Hadoop Annotations .......................... SUCCESS
Apache Hadoop Assemblies ........................... SUCCESS
Apache Hadoop Project Dist POM ..................... SUCCESS
Apache Hadoop Maven Plugins ........................ SUCCESS
Apache Hadoop MiniKDC .............................. FAILURE
Apache Hadoop Auth ................................. SKIPPED
Apache Hadoop Auth Examples ........................ SKIPPED
Apache Hadoop Common ............................... SKIPPED
Apache Hadoop NFS .................................. SKIPPED
Apache Hadoop Common Project ....................... SKIPPED
Apache Hadoop HDFS ................................. SKIPPED
Apache Hadoop HttpFS ............................... SKIPPED
Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
Apache Hadoop HDFS-NFS ............................. SKIPPED
Apache Hadoop HDFS Project ......................... SKIPPED
hadoop-yarn ........................................ SKIPPED
hadoop-yarn-api .................................... SKIPPED
hadoop-yarn-common ................................. SKIPPED
hadoop-yarn-server ................................. SKIPPED
hadoop-yarn-server-common .......................... SKIPPED
hadoop-yarn-server-nodemanager ..................... SKIPPED
hadoop-yarn-server-web-proxy ....................... SKIPPED
hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
hadoop-yarn-server-resourcemanager ................. SKIPPED
hadoop-yarn-server-tests ........................... SKIPPED
hadoop-yarn-client ................................. SKIPPED
hadoop-yarn-applications ........................... SKIPPED
hadoop-yarn-applications-distributedshell .......... SKIPPED
hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
hadoop-yarn-site ................................... SKIPPED
hadoop-yarn-project ................................ SKIPPED
hadoop-mapreduce-client ............................ SKIPPED
hadoop-mapreduce-client-core ....................... SKIPPED
hadoop-mapreduce-client-common ..................... SKIPPED
hadoop-mapreduce-client-shuffle .................... SKIPPED
hadoop-mapreduce-client-app ........................ SKIPPED
hadoop-mapreduce-client-hs ......................... SKIPPED
hadoop-mapreduce-client-jobclient .................. SKIPPED
hadoop-mapreduce-client-hs-plugins ................. SKIPPED
Apache Hadoop MapReduce Examples ................... SKIPPED
hadoop-mapreduce ................................... SKIPPED
Apache Hadoop MapReduce Streaming .................. SKIPPED
Apache Hadoop Distributed Copy ..................... SKIPPED
Apache Hadoop Archives ............................. SKIPPED
Apache Hadoop Rumen ................................ SKIPPED
Apache Hadoop Gridmix .............................. SKIPPED
Apache Hadoop Data Join ............................ SKIPPED
Apache Hadoop Extras ............................... SKIPPED
Apache Hadoop Pipes ................................ SKIPPED
Apache Hadoop OpenStack support .................... SKIPPED
Apache Hadoop Client ............................... SKIPPED
Apache Hadoop Mini-Cluster ......................... SKIPPED
Apache Hadoop Scheduler Load Simulator ............. SKIPPED
Apache Hadoop Tools Dist ........................... SKIPPED
Apache Hadoop Tools ................................ SKIPPED
Apache Hadoop Distribution ......................... SKIPPED
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 22.376 s
Finished at: 2014-11-23T04:20:31-08:00
Final Memory: 38M/91M
------------------------------------------------------------------------
Failed to execute goal on project hadoop-minikdc: Could not resolve dependencies for project org.apache.hadoop:hadoop-minikdc:jar:2.5.2: Failure to find org.apache.directory.server:apacheds-core:jar:2.0.0-M15 in https://repository.apache.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots.https has elapsed or updates are forced ->
To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.
For more information about the errors and possible solutions, please read the following articles:
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
After correcting the problems, you can resume the build with the command
mvn <goals> -rf :hadoop-minikdc
问题3
------------------------------------------------------------------------
Reactor Summary:
Apache Hadoop Main ................................. SUCCESS
Apache Hadoop Project POM .......................... SUCCESS
Apache Hadoop Annotations .......................... SUCCESS
Apache Hadoop Assemblies ........................... SUCCESS
Apache Hadoop Project Dist POM ..................... SUCCESS
Apache Hadoop Maven Plugins ........................ SUCCESS
Apache Hadoop Auth ................................. FAILURE
Apache Hadoop Auth Examples ........................ SKIPPED
Apache Hadoop Common ............................... SKIPPED
Apache Hadoop NFS .................................. SKIPPED
Apache Hadoop MiniKDC .............................. SKIPPED
Apache Hadoop Common Project ....................... SKIPPED
Apache Hadoop HDFS ................................. SKIPPED
Apache Hadoop HttpFS ............................... SKIPPED
Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
Apache Hadoop HDFS-NFS ............................. SKIPPED
Apache Hadoop HDFS Project ......................... SKIPPED
hadoop-yarn ........................................ SKIPPED
hadoop-yarn-api .................................... SKIPPED
hadoop-yarn-common ................................. SKIPPED
hadoop-yarn-server ................................. SKIPPED
hadoop-yarn-server-common .......................... SKIPPED
hadoop-yarn-server-nodemanager ..................... SKIPPED
hadoop-yarn-server-web-proxy ....................... SKIPPED
hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
hadoop-yarn-server-resourcemanager ................. SKIPPED
hadoop-yarn-server-tests ........................... SKIPPED
hadoop-yarn-client ................................. SKIPPED
hadoop-yarn-applications ........................... SKIPPED
hadoop-yarn-applications-distributedshell .......... SKIPPED
hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
hadoop-yarn-site ................................... SKIPPED
hadoop-yarn-project ................................ SKIPPED
hadoop-mapreduce-client ............................ SKIPPED
hadoop-mapreduce-client-core ....................... SKIPPED
hadoop-mapreduce-client-common ..................... SKIPPED
hadoop-mapreduce-client-shuffle .................... SKIPPED
hadoop-mapreduce-client-app ........................ SKIPPED
hadoop-mapreduce-client-hs ......................... SKIPPED
hadoop-mapreduce-client-jobclient .................. SKIPPED
hadoop-mapreduce-client-hs-plugins ................. SKIPPED
Apache Hadoop MapReduce Examples ................... SKIPPED
hadoop-mapreduce ................................... SKIPPED
Apache Hadoop MapReduce Streaming .................. SKIPPED
Apache Hadoop Distributed Copy ..................... SKIPPED
Apache Hadoop Archives ............................. SKIPPED
Apache Hadoop Rumen ................................ SKIPPED
Apache Hadoop Gridmix .............................. SKIPPED
Apache Hadoop Data Join ............................ SKIPPED
Apache Hadoop Extras ............................... SKIPPED
Apache Hadoop Pipes ................................ SKIPPED
Apache Hadoop OpenStack support .................... SKIPPED
Apache Hadoop Client ............................... SKIPPED
Apache Hadoop Mini-Cluster ......................... SKIPPED
Apache Hadoop Scheduler Load Simulator ............. SKIPPED
Apache Hadoop Tools Dist ........................... SKIPPED
Apache Hadoop Tools ................................ SKIPPED
Apache Hadoop Distribution ......................... SKIPPED
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 01:32 min
Finished at: 2014-11-23T04:50:17-08:00
Final Memory: 42M/102M
------------------------------------------------------------------------
Failed to execute goal on project hadoop-auth: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.5.2: Failure to find org.apache.directory.server:apacheds-core:jar:2.0.0-M15 in https://repository.apache.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots.https has elapsed or updates are forced ->
To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.
For more information about the errors and possible solutions, please read the following articles:
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
After correcting the problems, you can resume the build with the command
mvn <goals> -rf :hadoop-auth
上面上的含义都是找不到包，可能的原因是找不到包，
但是我的网络又是通的，所以所以肯定是maven出了问题。
最后重新部署了干净的环境。
终于编译成功
hadoop-aboutyun-Linux64-2.5.2-.tar.gz
链接：http://pan.baidu.com/s/1bnH94xp 密码：**** Hidden Message *****
hadoop-2.5.2-官网.tar.gz（名字自行修改）
链接：http://pan.baidu.com/s/1ntHpj1R 密码：m0nw
文章推荐：
编译hadoop2.5.2经验总结、问题分析及下载32位、64位安装包下载
谢谢。。。。。 很好的文章，分享学习了 学习 了。这几天我也在看这方面知识
安装这个确实折腾，现在都要用maven 编译源码吗，能否直接用官网编译好的 凌飞羽 发表于 2014-11-24 22:21
安装这个确实折腾，现在都要用maven 编译源码吗，能否直接用官网编译好的
官网是32位的 desehawk 发表于 2014-11-24 23:30
官网是32位的
谢谢{:soso_e181:}
学习中 多 多多 thanks for share