hadoop2.4.1编译及hadoop2.4.1各种包下载
本帖最后由 howtodown 于 2014-8-19 11:49 编辑问题导读：
1.如何修改本地时区？
2.需要安装那些软件？
3.带dos参数与不带dos编译有什么区别？
static/image/hrline/4.gif
-- 参考：http://hadoop.apache.org/docs/r2 ... ativeLibraries.html
-- hadoop compile for CentOS
-- 编译hadoop之前，先修改源码中如下文件以支持本地时区
cd hadoop-2.4.1-src
vi ./hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/webapps/static/yarn.dt.plugins.js
-- 将如下行
return new Date(parseInt(data)).toUTCString();
-- 修改为：
return new Date(parseInt(data)).toLocaleString();
----------------------------------------------------------------------------------
Requirements:
* Unix System
* JDK 1.6+
* Maven 3.0 or later
* Findbugs 1.3.9 (if running findbugs)
* ProtocolBuffer 2.5.0
* CMake 2.6 or newer (if compiling native code)
* Internet connection for first build (to fetch all Maven and Hadoop dependencies)
-- 安装如下包：
# rpm -qa|grep gzip
gzip-1.3.12-19.el6_4.x86_64
# rpm -qa|grep zlib
zlib-1.2.3-29.el6.x86_64
zlib-devel-1.2.3-29.el6.x86_64
zlib-static-1.2.3-29.el6.x86_64
-- 安装protobuf 2.5.0
-- 参考：http://www.cnblogs.com/Anker/p/3209764.html
mkdir -p /usr/local/protobuf
tar -xvf protobuf-2.5.0.tar.gz
cd protobuf-2.5.0
./configure --prefix=/usr/local/protobuf
make
make check
make install
vi + /etc/profile
export PATH=$PATH:/usr/local/protobuf/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/protobuf/lib
source /etc/profile
-- 开始编译：
# mvn package -Pdist,native -DskipTests -Dtar
...
main:
$ tar cf hadoop-2.4.1.tar hadoop-2.4.1
$ gzip -f hadoop-2.4.1.tar
Hadoop dist tar available at: /opt/software/hadoop-2.4.1-src/hadoop-dist/target/hadoop-2.4.1.tar.gz
Executed tasks
--- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-dist ---
Building jar: /opt/software/hadoop-2.4.1-src/hadoop-dist/target/hadoop-dist-2.4.1-javadoc.jar
------------------------------------------------------------------------
Reactor Summary:
Apache Hadoop Main ................................ SUCCESS
Apache Hadoop Project POM ......................... SUCCESS
Apache Hadoop Annotations ......................... SUCCESS
Apache Hadoop Assemblies .......................... SUCCESS
Apache Hadoop Project Dist POM .................... SUCCESS [ 57.967 s]
Apache Hadoop Maven Plugins ....................... SUCCESS
Apache Hadoop MiniKDC ............................. SUCCESS
Apache Hadoop Auth ................................ SUCCESS
Apache Hadoop Auth Examples ....................... SUCCESS
Apache Hadoop Common .............................. SUCCESS
Apache Hadoop NFS ................................. SUCCESS [ 11.409 s]
Apache Hadoop Common Project ...................... SUCCESS
Apache Hadoop HDFS ................................ SUCCESS
Apache Hadoop HttpFS .............................. SUCCESS [ 34.246 s]
Apache Hadoop HDFS BookKeeper Journal ............. SUCCESS [ 14.162 s]
Apache Hadoop HDFS-NFS ............................ SUCCESS
Apache Hadoop HDFS Project ........................ SUCCESS
hadoop-yarn ....................................... SUCCESS
hadoop-yarn-api ................................... SUCCESS
hadoop-yarn-common ................................ SUCCESS [ 50.802 s]
hadoop-yarn-server ................................ SUCCESS
hadoop-yarn-server-common ......................... SUCCESS [ 16.060 s]
hadoop-yarn-server-nodemanager .................... SUCCESS [ 26.625 s]
hadoop-yarn-server-web-proxy ...................... SUCCESS
hadoop-yarn-server-applicationhistoryservice ...... SUCCESS
hadoop-yarn-server-resourcemanager ................ SUCCESS [ 24.955 s]
hadoop-yarn-server-tests .......................... SUCCESS
hadoop-yarn-client ................................ SUCCESS [ 10.712 s]
hadoop-yarn-applications .......................... SUCCESS
hadoop-yarn-applications-distributedshell ......... SUCCESS
hadoop-yarn-applications-unmanaged-am-launcher .... SUCCESS
hadoop-yarn-site .................................. SUCCESS
hadoop-yarn-project ............................... SUCCESS
hadoop-mapreduce-client ........................... SUCCESS
hadoop-mapreduce-client-core ...................... SUCCESS [ 36.397 s]
hadoop-mapreduce-client-common .................... SUCCESS [ 29.828 s]
hadoop-mapreduce-client-shuffle ................... SUCCESS
hadoop-mapreduce-client-app ....................... SUCCESS [ 16.686 s]
hadoop-mapreduce-client-hs ........................ SUCCESS [ 14.421 s]
hadoop-mapreduce-client-jobclient ................. SUCCESS [ 11.174 s]
hadoop-mapreduce-client-hs-plugins ................ SUCCESS
Apache Hadoop MapReduce Examples .................. SUCCESS [ 12.380 s]
hadoop-mapreduce .................................. SUCCESS
Apache Hadoop MapReduce Streaming ................. SUCCESS
Apache Hadoop Distributed Copy .................... SUCCESS [ 12.677 s]
Apache Hadoop Archives ............................ SUCCESS
Apache Hadoop Rumen ............................... SUCCESS [ 10.651 s]
Apache Hadoop Gridmix ............................. SUCCESS
Apache Hadoop Data Join ........................... SUCCESS
Apache Hadoop Extras .............................. SUCCESS
Apache Hadoop Pipes ............................... SUCCESS [ 13.207 s]
Apache Hadoop OpenStack support ................... SUCCESS [ 10.080 s]
Apache Hadoop Client .............................. SUCCESS
Apache Hadoop Mini-Cluster ........................ SUCCESS
Apache Hadoop Scheduler Load Simulator ............ SUCCESS [ 10.502 s]
Apache Hadoop Tools Dist .......................... SUCCESS
Apache Hadoop Tools ............................... SUCCESS
Apache Hadoop Distribution ........................ SUCCESS
------------------------------------------------------------------------
BUILD SUCCESS
------------------------------------------------------------------------
Total time: 37:45 min
Finished at: 2014-08-05T14:23:22+08:00
Final Memory: 180M/917M
------------------------------------------------------------------------
-- 注意：带doc参数编译出来有近200M，不带doc编译出来的只有120M左右
mvn package -Pdist,native,docs -DskipTests -Dtar
mvn package -Pdist,native -DskipTests -Dtar
-- ############################################################################################ --
--------------------------------------------------------------------------------------------------
-- lzo 支持：
-- 参考：http://www.iteblog.com/archives/992
wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.06.tar.gz
tar -zxvf lzo-2.06.tar.gz
cd lzo-2.06
export CFLAGS=-m64
./configure -enable-shared -prefix=/usr/local/hadoop/lzo/
make && make install
git clone https://github.com/twitter/hadoop-lzo.git
cd hadoop-lzo
export CFLAGS=-m64
export CXXFLAGS=-m64
export C_INCLUDE_PATH=/usr/local/hadoop/lzo/include
export LIBRARY_PATH=/usr/local/hadoop/lzo/lib
mvn clean package -Dmaven.test.skip=true
cd target/native/Linux-amd64-64
tar -cBf - -C lib . | tar -xBvf - -C ~
cp ~/libgplcompression* /usr/local/hadoop/lib/native/
cp /opt/software/hadoop-lzo/target/hadoop-lzo-0.4.20-SNAPSHOT.jar /usr/local/hadoop/share/hadoop/common/
static/image/hrline/2.gif
hadoop2.4.1的64位centos的native包
链接：http://pan.baidu.com/s/1eQioTd4 密码：4pgb
hadoop2.4.1的64位编译包
链接：http://pan.baidu.com/s/1mgxBN3U 密码：**** Hidden Message *****
hadoop2.4.1的32位编译包
链接：http://pan.baidu.com/s/1mg2v4es 密码：krdx
官网源码包：未下载代码
http://pan.baidu.com/s/1dDgphJz
更多资源：
hadoop家族、strom、spark、Linux、flume等jar包、安装包汇总下载(持续更新)
谢谢楼主大大分享
支持，非常不错！ 看看学习一下！
不错很有帮助 谢谢了！！！！！！！！
谢谢楼主大大分享 不错很有帮助 谢谢了！！！！！！！！ 不错很有帮助 谢谢了！！！！！！！！{:soso_e100:} 看看学习一下！ 谢谢楼主大大分享