分享

求助:hadoop-2.5.0格式化错误

ran_newstar 发表于 2014-8-24 16:56:11 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 6 25255
本帖最后由 ran_newstar 于 2014-8-24 16:58 编辑

大侠,XP下装vmware装CENTOS,32位机器。格式化namenode出现如下错误。hdfs namenode  -format
版本:hadoop-2.5.0
WARN:mapred-site这个问题一直没解决,从2.4.0到2.5.0,哪位大侠能分享下你的配置吗?就core-site.xml,yarn-site.xml,mapred-site.xml,hdfs-site.xml。
STARTUP_MSG:   java = 1.7.0_67
************************************************************/
14/08/24 01:40:30 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
14/08/24 01:40:30 INFO namenode.NameNode: createNameNode [-format, master]
14/08/24 01:40:31 DEBUG namenode.NameNode: Setting fs.defaultFS to hdfs://master:9001
14/08/24 01:40:31 DEBUG lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=, value=[Rate of successful kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)
14/08/24 01:40:31 DEBUG lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=, value=[Rate of failed kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)
14/08/24 01:40:31 DEBUG lib.MutableMetricsFactory: field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=, value=[GetGroups], always=false, type=DEFAULT, sampleName=Ops)
14/08/24 01:40:31 DEBUG impl.MetricsSystemImpl: UgiMetrics, User and group related metrics
14/08/24 01:40:32 DEBUG security.Groups:  Creating new Groups object
14/08/24 01:40:32 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/hadoop-2.5.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
14/08/24 01:40:32 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: /home/hadoop/hadoop-2.5.0/lib/native/libhadoop.so.1.0.0: /home/hadoop/hadoop-2.5.0/lib/native/libhadoop.so.1.0.0: wrong ELF class: ELFCLASS64 (Possible cause: architecture word width mismatch)
14/08/24 01:40:32 DEBUG util.NativeCodeLoader: java.library.path=/home/hadoop/hadoop-2.5.0/lib/native:/usr/java/packages/lib/i386:/lib:/usr/lib
14/08/24 01:40:32 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/08/24 01:40:32 DEBUG security.JniBasedUnixGroupsMappingWithFallback: Falling back to shell based
14/08/24 01:40:32 DEBUG security.JniBasedUnixGroupsMappingWithFallback: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
14/08/24 01:40:32 WARN conf.Configuration: mapred-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
14/08/24 01:40:32 WARN conf.Configuration: mapred-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.

14/08/24 01:40:32 DEBUG security.Groups: Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000
14/08/24 01:40:32 WARN conf.Configuration: mapred-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
14/08/24 01:40:32 WARN conf.Configuration: mapred-site.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.

Formatting using clusterid: CID-b112b0cd-66cc-4776-a5fc-b7c0145861f7
14/08/24 01:40:32 INFO namenode.FSNamesystem: fsLock is fair:true


已有(6)人评论

跳转到指定楼层
nettman 发表于 2014-8-24 17:20:34
你用的什么安装包
回复

使用道具 举报

ran_newstar 发表于 2014-8-24 17:46:34
nettman 发表于 2014-8-24 17:20
你用的什么安装包

aboutyun
和hadoop官网都试了,都出现这个问题
CPU是INTEL的
回复

使用道具 举报

ran_newstar 发表于 2014-8-24 19:19:56
据本人研究发现,这个问题2.4.0版本也存在。详细请参见论坛出的2.4.0完全分布式安装文档内的常见错误。
回复

使用道具 举报

babyLiyuan 发表于 2014-12-15 10:58:18
解决了么?我也碰到相同问题了。
回复

使用道具 举报

heraleign 发表于 2015-3-26 20:23:47
hadoop2.5以后的native包都是64位的
回复

使用道具 举报

yudedipan 发表于 2015-4-22 10:24:14
heraleign 发表于 2015-3-26 20:23
hadoop2.5以后的native包都是64位的

那32位上面安装hadoop2.5.2是不是也报错:
  1. Java HotSpot(TM) Client VM warning: You have loaded library /cloud/hadoop-2.5.2/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
  2. It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
复制代码
这样的错误是那个原因吗???
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条