上帝也风流 发表于 2015-1-12 15:14:07

hadoop 重新编译,提示如下错误,怎么个意思了?

编译环境 redhat 6.5 32位
# cd hadoop-2.5.0-src
# mvn package -Pdist,native,docs -DskipTests -Dtar

------------------------------------------------------------------------
Reactor Summary:

Apache Hadoop Main ................................. SUCCESS
Apache Hadoop Project POM .......................... FAILURE
Apache Hadoop Annotations .......................... SKIPPED
Apache Hadoop Assemblies ........................... SKIPPED
Apache Hadoop Project Dist POM ..................... SKIPPED
Apache Hadoop Maven Plugins ........................ SKIPPED
Apache Hadoop MiniKDC .............................. SKIPPED
Apache Hadoop Auth ................................. SKIPPED
Apache Hadoop Auth Examples ........................ SKIPPED
Apache Hadoop Common ............................... SKIPPED
Apache Hadoop NFS .................................. SKIPPED
Apache Hadoop Common Project ....................... SKIPPED
Apache Hadoop HDFS ................................. SKIPPED
Apache Hadoop HttpFS ............................... SKIPPED
Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
Apache Hadoop HDFS-NFS ............................. SKIPPED
Apache Hadoop HDFS Project ......................... SKIPPED
hadoop-yarn ........................................ SKIPPED
hadoop-yarn-api .................................... SKIPPED
hadoop-yarn-common ................................. SKIPPED
hadoop-yarn-server ................................. SKIPPED
hadoop-yarn-server-common .......................... SKIPPED
hadoop-yarn-server-nodemanager ..................... SKIPPED
hadoop-yarn-server-web-proxy ....................... SKIPPED
hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
hadoop-yarn-server-resourcemanager ................. SKIPPED
hadoop-yarn-server-tests ........................... SKIPPED
hadoop-yarn-client ................................. SKIPPED
hadoop-yarn-applications ........................... SKIPPED
hadoop-yarn-applications-distributedshell .......... SKIPPED
hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
hadoop-yarn-site ................................... SKIPPED
hadoop-yarn-project ................................ SKIPPED
hadoop-mapreduce-client ............................ SKIPPED
hadoop-mapreduce-client-core ....................... SKIPPED
hadoop-mapreduce-client-common ..................... SKIPPED
hadoop-mapreduce-client-shuffle .................... SKIPPED
hadoop-mapreduce-client-app ........................ SKIPPED
hadoop-mapreduce-client-hs ......................... SKIPPED
hadoop-mapreduce-client-jobclient .................. SKIPPED
hadoop-mapreduce-client-hs-plugins ................. SKIPPED
Apache Hadoop MapReduce Examples ................... SKIPPED
hadoop-mapreduce ................................... SKIPPED
Apache Hadoop MapReduce Streaming .................. SKIPPED
Apache Hadoop Distributed Copy ..................... SKIPPED
Apache Hadoop Archives ............................. SKIPPED
Apache Hadoop Rumen ................................ SKIPPED
Apache Hadoop Gridmix .............................. SKIPPED
Apache Hadoop Data Join ............................ SKIPPED
Apache Hadoop Extras ............................... SKIPPED
Apache Hadoop Pipes ................................ SKIPPED
Apache Hadoop OpenStack support .................... SKIPPED
Apache Hadoop Client ............................... SKIPPED
Apache Hadoop Mini-Cluster ......................... SKIPPED
Apache Hadoop Scheduler Load Simulator ............. SKIPPED
Apache Hadoop Tools Dist ........................... SKIPPED
Apache Hadoop Tools ................................ SKIPPED
Apache Hadoop Distribution ......................... SKIPPED
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 05:56 min
Finished at: 2015-01-11T23:05:51-08:00
Final Memory: 35M/85M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (create-testdirs) on project hadoop-project: Error executing ant tasks: /home/hadoop/software/hadoop-2.5.0-src/hadoop-project/target/antrun/build-main.xml (No such file or directory) ->

To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.

For more information about the errors and possible solutions, please read the following articles:
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

After correcting the problems, you can resume the build with the command
   mvn <goals> -rf :hadoop-project
$


请问该如何解决啊?

nextuser 发表于 2015-1-12 16:16:42

检查下ant是否安装

nextuser 发表于 2015-1-12 16:33:01



这有篇编译2.6的,跟2.5一样的,你可以参考
Hadoop-2.6.0在Centos6.5 64位系统编译前准备工作

上帝也风流 发表于 2015-1-12 16:56:40


第一次编辑错误提示
主要是增加了在maven目录下,conf/settings.xml
<mirror>
<id>nexus-osc</id>
<mirrorOf>*</mirrorOf>
<name>Nexusosc</name>
<url>http://maven.oschina.net/content/groups/public/</url>
</mirror>


<profile>
<id>jdk-1.7</id>
<activation>
<jdk>1.7</jdk>
</activation>
<repositories>
<repository>
   <id>nexus</id>
   <name>local private nexus</name>
   <url>http://maven.oschina.net/content/groups/public/</url>
   <releases>
    <enabled>true</enabled>
   </releases>
   <snapshots>
    <enabled>false</enabled>
   </snapshots>
</repository>
</repositories>
<pluginRepositories>
   <pluginRepository>
    <id>nexus</id>
    <name>local private nexus</name>
    <url>http://maven.oschina.net/content/groups/public/</url>
    <releases>
      <enabled>true</enabled>
    </releases>
    <snapshots>
      <enabled>false</enabled>
    </snapshots>
   </pluginRepository>
</pluginRepositories>
</profile>




------------------------------------------------------------------------
Reactor Summary:

Apache Hadoop Main ................................. FAILURE
Apache Hadoop Project POM .......................... SKIPPED
Apache Hadoop Annotations .......................... SKIPPED
Apache Hadoop Assemblies ........................... SKIPPED
Apache Hadoop Project Dist POM ..................... SKIPPED
Apache Hadoop Maven Plugins ........................ SKIPPED
Apache Hadoop MiniKDC .............................. SKIPPED
Apache Hadoop Auth ................................. SKIPPED
Apache Hadoop Auth Examples ........................ SKIPPED
Apache Hadoop Common ............................... SKIPPED
Apache Hadoop NFS .................................. SKIPPED
Apache Hadoop Common Project ....................... SKIPPED
Apache Hadoop HDFS ................................. SKIPPED
Apache Hadoop HttpFS ............................... SKIPPED
Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
Apache Hadoop HDFS-NFS ............................. SKIPPED
Apache Hadoop HDFS Project ......................... SKIPPED
hadoop-yarn ........................................ SKIPPED
hadoop-yarn-api .................................... SKIPPED
hadoop-yarn-common ................................. SKIPPED
hadoop-yarn-server ................................. SKIPPED
hadoop-yarn-server-common .......................... SKIPPED
hadoop-yarn-server-nodemanager ..................... SKIPPED
hadoop-yarn-server-web-proxy ....................... SKIPPED
hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
hadoop-yarn-server-resourcemanager ................. SKIPPED
hadoop-yarn-server-tests ........................... SKIPPED
hadoop-yarn-client ................................. SKIPPED
hadoop-yarn-applications ........................... SKIPPED
hadoop-yarn-applications-distributedshell .......... SKIPPED
hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
hadoop-yarn-site ................................... SKIPPED
hadoop-yarn-project ................................ SKIPPED
hadoop-mapreduce-client ............................ SKIPPED
hadoop-mapreduce-client-core ....................... SKIPPED
hadoop-mapreduce-client-common ..................... SKIPPED
hadoop-mapreduce-client-shuffle .................... SKIPPED
hadoop-mapreduce-client-app ........................ SKIPPED
hadoop-mapreduce-client-hs ......................... SKIPPED
hadoop-mapreduce-client-jobclient .................. SKIPPED
hadoop-mapreduce-client-hs-plugins ................. SKIPPED
Apache Hadoop MapReduce Examples ................... SKIPPED
hadoop-mapreduce ................................... SKIPPED
Apache Hadoop MapReduce Streaming .................. SKIPPED
Apache Hadoop Distributed Copy ..................... SKIPPED
Apache Hadoop Archives ............................. SKIPPED
Apache Hadoop Rumen ................................ SKIPPED
Apache Hadoop Gridmix .............................. SKIPPED
Apache Hadoop Data Join ............................ SKIPPED
Apache Hadoop Extras ............................... SKIPPED
Apache Hadoop Pipes ................................ SKIPPED
Apache Hadoop OpenStack support .................... SKIPPED
Apache Hadoop Client ............................... SKIPPED
Apache Hadoop Mini-Cluster ......................... SKIPPED
Apache Hadoop Scheduler Load Simulator ............. SKIPPED
Apache Hadoop Tools Dist ........................... SKIPPED
Apache Hadoop Tools ................................ SKIPPED
Apache Hadoop Distribution ......................... SKIPPED
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 10:10 min
Finished at: 2015-01-12T00:52:27-08:00
Final Memory: 29M/70M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.3:attach-descriptor (attach-descriptor) on project hadoop-main: Execution attach-descriptor of goal org.apache.maven.plugins:maven-site-plugin:3.3:attach-descriptor failed: Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of its dependencies could not be resolved: Failed to collect dependencies at org.apache.maven.plugins:maven-site-plugin:jar:3.3 -> org.apache.maven.reporting:maven-reporting-exec:jar:1.1 -> org.apache.maven.shared:maven-shared-utils:jar:0.3: Failed to read artifact descriptor for org.apache.maven.shared:maven-shared-utils:jar:0.3: Could not transfer artifact org.apache.maven.shared:maven-shared-utils:pom:0.3 from/to nexus-osc (http://maven.oschina.net/content/groups/public/): Failed to transfer file: http://maven.oschina.net/content/groups/public/org/apache/maven/shared/maven-shared-utils/0.3/maven-shared-utils-0.3.pom. Return code is: 502, ReasonPhrase: Bad Gateway. ->

To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.

For more information about the errors and possible solutions, please read the following articles:
http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
$

上帝也风流 发表于 2015-1-12 17:34:15

又提示了这么个错误

------------------------------------------------------------------------
Reactor Summary:

Apache Hadoop Main ................................. FAILURE
Apache Hadoop Project POM .......................... SKIPPED
Apache Hadoop Annotations .......................... SKIPPED
Apache Hadoop Assemblies ........................... SKIPPED
Apache Hadoop Project Dist POM ..................... SKIPPED
Apache Hadoop Maven Plugins ........................ SKIPPED
Apache Hadoop MiniKDC .............................. SKIPPED
Apache Hadoop Auth ................................. SKIPPED
Apache Hadoop Auth Examples ........................ SKIPPED
Apache Hadoop Common ............................... SKIPPED
Apache Hadoop NFS .................................. SKIPPED
Apache Hadoop Common Project ....................... SKIPPED
Apache Hadoop HDFS ................................. SKIPPED
Apache Hadoop HttpFS ............................... SKIPPED
Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
Apache Hadoop HDFS-NFS ............................. SKIPPED
Apache Hadoop HDFS Project ......................... SKIPPED
hadoop-yarn ........................................ SKIPPED
hadoop-yarn-api .................................... SKIPPED
hadoop-yarn-common ................................. SKIPPED
hadoop-yarn-server ................................. SKIPPED
hadoop-yarn-server-common .......................... SKIPPED
hadoop-yarn-server-nodemanager ..................... SKIPPED
hadoop-yarn-server-web-proxy ....................... SKIPPED
hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
hadoop-yarn-server-resourcemanager ................. SKIPPED
hadoop-yarn-server-tests ........................... SKIPPED
hadoop-yarn-client ................................. SKIPPED
hadoop-yarn-applications ........................... SKIPPED
hadoop-yarn-applications-distributedshell .......... SKIPPED
hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
hadoop-yarn-site ................................... SKIPPED
hadoop-yarn-project ................................ SKIPPED
hadoop-mapreduce-client ............................ SKIPPED
hadoop-mapreduce-client-core ....................... SKIPPED
hadoop-mapreduce-client-common ..................... SKIPPED
hadoop-mapreduce-client-shuffle .................... SKIPPED
hadoop-mapreduce-client-app ........................ SKIPPED
hadoop-mapreduce-client-hs ......................... SKIPPED
hadoop-mapreduce-client-jobclient .................. SKIPPED
hadoop-mapreduce-client-hs-plugins ................. SKIPPED
Apache Hadoop MapReduce Examples ................... SKIPPED
hadoop-mapreduce ................................... SKIPPED
Apache Hadoop MapReduce Streaming .................. SKIPPED
Apache Hadoop Distributed Copy ..................... SKIPPED
Apache Hadoop Archives ............................. SKIPPED
Apache Hadoop Rumen ................................ SKIPPED
Apache Hadoop Gridmix .............................. SKIPPED
Apache Hadoop Data Join ............................ SKIPPED
Apache Hadoop Extras ............................... SKIPPED
Apache Hadoop Pipes ................................ SKIPPED
Apache Hadoop OpenStack support .................... SKIPPED
Apache Hadoop Client ............................... SKIPPED
Apache Hadoop Mini-Cluster ......................... SKIPPED
Apache Hadoop Scheduler Load Simulator ............. SKIPPED
Apache Hadoop Tools Dist ........................... SKIPPED
Apache Hadoop Tools ................................ SKIPPED
Apache Hadoop Distribution ......................... SKIPPED
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 3.873 s
Finished at: 2015-01-12T01:32:11-08:00
Final Memory: 40M/247M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.3:attach-descriptor (attach-descriptor) on project hadoop-main: Execution attach-descriptor of goal org.apache.maven.plugins:maven-site-plugin:3.3:attach-descriptor failed: Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of its dependencies could not be resolved: The following artifacts could not be resolved: org.apache.struts:struts-taglib:jar:1.3.8, commons-collections:commons-collections:jar:3.2.1, org.apache.maven.doxia:doxia-integration-tools:jar:1.5, org.codehaus.plexus:plexus-io:jar:1.0, org.apache.velocity:velocity:jar:1.5, oro:oro:jar:2.0.8, org.codehaus.plexus:plexus-velocity:jar:1.1.8, org.mortbay.jetty:jetty:jar:6.1.25, org.mortbay.jetty:servlet-api:jar:2.5-20081211, commons-io:commons-io:jar:1.4: Could not transfer artifact org.apache.struts:struts-taglib:jar:1.3.8 from/to nexus-osc (http://maven.oschina.net/content/groups/public/): Failed to transfer file: http://maven.oschina.net/content/groups/public/org/apache/struts/struts-taglib/1.3.8/struts-taglib-1.3.8.jar. Return code is: 503, ReasonPhrase: Service Temporarily Unavailable. ->

To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.

For more information about the errors and possible solutions, please read the following articles:
http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
$

上帝也风流 发表于 2015-1-12 17:35:38

------------------------------------------------------------------------
Reactor Summary:

Apache Hadoop Main ................................. FAILURE
.....
------------------------------------------------------------------------
BUILD FAILURE
------------------------------------------------------------------------
Total time: 3.873 s
Finished at: 2015-01-12T01:32:11-08:00
Final Memory: 40M/247M
------------------------------------------------------------------------
Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.3:attach-descriptor (attach-descriptor) on project hadoop-main: Execution attach-descriptor of goal org.apache.maven.plugins:maven-site-plugin:3.3:attach-descriptor failed: Plugin org.apache.maven.plugins:maven-site-plugin:3.3 or one of its dependencies could not be resolved: The following artifacts could not be resolved: org.apache.struts:struts-taglib:jar:1.3.8, commons-collections:commons-collections:jar:3.2.1, org.apache.maven.doxia:doxia-integration-tools:jar:1.5, org.codehaus.plexus:plexus-io:jar:1.0, org.apache.velocity:velocity:jar:1.5, oro:oro:jar:2.0.8, org.codehaus.plexus:plexus-velocity:jar:1.1.8, org.mortbay.jetty:jetty:jar:6.1.25, org.mortbay.jetty:servlet-api:jar:2.5-20081211, commons-io:commons-io:jar:1.4: Could not transfer artifact org.apache.struts:struts-taglib:jar:1.3.8 from/to nexus-osc (http://maven.oschina.net/content/groups/public/): Failed to transfer file: http://maven.oschina.net/content/groups/public/org/apache/struts/struts-taglib/1.3.8/struts-taglib-1.3.8.jar. Return code is: 503, ReasonPhrase: Service Temporarily Unavailable. ->

To see the full stack trace of the errors, re-run Maven with the -e switch.
Re-run Maven using the -X switch to enable full debug logging.

For more information about the errors and possible solutions, please read the following articles:
http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
$

sstutu 发表于 2015-1-12 20:29:03

上帝也风流 发表于 2015-1-12 17:35
------------------------------------------------------------------------
Reactor Summary:



不要改maven的内容,除非自己对maven、hadoop原理清楚。该了,肯定会出错的。

上帝也风流 发表于 2015-1-12 23:35:43

Downloading: https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1/commons-logging-1.1.pom
Could not validate integrity of download from https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1/commons-logging-1.1.pom: Checksum validation failed, no checksums available
Checksum validation failed, no checksums available for https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1/commons-logging-1.1.pom
Downloaded: https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1/commons-logging-1.1.pom (7 KB at 0.0 KB/sec)

gwgyk 发表于 2015-3-26 16:05:46

给楼主一个思路,如果你改变hadoop源代码的话,但没用相应的改变test包里的内容,那在编译的时候就会出错。
你可以尝试在编译的时候不去编译test包。需要修改下build.xml文件
页: [1]
查看完整版本: hadoop 重新编译,提示如下错误,怎么个意思了?