分享

【求助】,hadoop-2.2.0 64位安装配置完后namenode启动后自动关闭,访问不了5007...

Purplelione 2016-4-3 16:30:52 发表于 疑问解答 只看大图 回帖奖励 阅读模式 关闭右栏 16 24238
【求助】,hadoop-2.2.0 64位安装配置完后namenode启动后自动关闭,登录web控制台访问不了50070,怎么解决。

已有(11)人评论

跳转到指定楼层
s060403072 发表于 2016-4-3 17:34:55
一般权限问题,然后就是配置问题,需要详细描述,贴出日志。
hadoop下面有日志

推荐文档:

hadoop(2.x)以hadoop2.2为例完全分布式最新高可靠安装文档
http://www.aboutyun.com/forum.php?mod=viewthread&tid=7684


回复

使用道具 举报

Purplelione 发表于 2016-4-3 18:06:07
s060403072 发表于 2016-4-3 17:34
一般权限问题,然后就是配置问题,需要详细描述,贴出日志。
hadoop下面有日志

我就是按照你推荐的文章来安装部署的。日志错误如下:
2016-04-03 02:52:38,559 INFO org.apache.hadoop.util.GSet: Computing capacity for map Namenode Retry Cache2016-04-03 02:52:38,559 INFO org.apache.hadoop.util.GSet: VM type       = 64-bit2016-04-03 02:52:38,559 INFO org.apache.hadoop.util.GSet: 0.029999999329447746% max memory = 966.7 MB2016-04-03 02:52:38,559 INFO org.apache.hadoop.util.GSet: capacity      = 2^15 = 32768 entries2016-04-03 02:52:38,644 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /usr/hadoop/dfs/name/in_use.lock acquired by nodename 4163@master2016-04-03 02:52:38,667 INFO org.mortbay.log: Stopped SelectChannelConnector@0.0.0.0:500702016-04-03 02:52:38,669 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NameNode metrics system...2016-04-03 02:52:38,670 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system stopped.2016-04-03 02:52:38,670 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system shutdown complete.2016-04-03 02:52:38,672 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: Exception in namenode joinjava.io.IOException: NameNode is not formatted.        at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:210)        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:787)        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:568)        at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:443)        at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:491)        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:684)        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:669)        at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1254)        at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1320)2016-04-03 02:52:38,680 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 12016-04-03 02:52:38,683 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: /************************************************************SHUTDOWN_MSG: Shutting down NameNode at master/192.168.112.137************************************************************/
回复

使用道具 举报

pig2 发表于 2016-4-3 18:39:00
Purplelione 发表于 2016-4-3 18:06
我就是按照你推荐的文章来安装部署的。日志错误如下:
2016-04-03 02:52:38,559 INFO org.apache.hadoop ...

NameNode is not formatted.   
namenode没有格式化,先格式化在启动
回复

使用道具 举报

Purplelione 发表于 2016-4-3 18:41:59
本帖最后由 pig2 于 2016-4-4 12:21 编辑
pig2 发表于 2016-4-3 18:39
NameNode is not formatted.   
namenode没有格式化,先格式化在启动

我已经格式化了,格式化后,在启动还是报错。启动后还是看不到namenode进程

1.png

2.jpg
回复

使用道具 举报

pig2 发表于 2016-4-3 18:46:35
Purplelione 发表于 2016-4-3 18:41
我已经格式化了,格式化后,在启动还是报错。启动后还是看不到namenode进程

在看日志,安装过程一定细心,否则会遇到各种问题
回复

使用道具 举报

Purplelione 发表于 2016-4-3 18:51:57
pig2 发表于 2016-4-3 18:46
在看日志,安装过程一定细心,否则会遇到各种问题

格式化后又查看了一下日志,日志错误如下:
RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:43,166 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/192.168.112.137:8020. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:44,168 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/192.168.112.137:8020. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:45,170 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/192.168.112.137:8020. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:46,172 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/192.168.112.137:8020. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:47,174 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/192.168.112.137:8020. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:47,178 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpointjava.net.ConnectException: Call From master/192.168.112.137 to master:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)        at org.apache.hadoop.ipc.Client.call(Client.java:1351)        at org.apache.hadoop.ipc.Client.call(Client.java:1300)        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)        at com.sun.proxy.$Proxy8.getTransactionId(Unknown Source)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)        at com.sun.proxy.$Proxy8.getTransactionId(Unknown Source)        at org.apache.hadoop.hdfs.protocolPB.NamenodeProtocolTranslatorPB.getTransactionID(NamenodeProtocolTranslatorPB.java:119)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.countUncheckpointedTxns(SecondaryNameNode.java:622)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.shouldCheckpointBasedOnCount(SecondaryNameNode.java:630)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:378)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$2.run(SecondaryNameNode.java:346)        at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:456)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:342)        at java.lang.Thread.run(Thread.java:744)Caused by: java.net.ConnectException: Connection refused        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:547)        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:642)        at org.apache.hadoop.ipc.Client$Connection.access$2600(Client.java:314)        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1399)        at org.apache.hadoop.ipc.Client.call(Client.java:1318)        ... 18 more

Purplelione 发表于 2016-4-3 18:54:32
pig2 发表于 2016-4-3 18:46
在看日志,安装过程一定细心,否则会遇到各种问题

格式化后又查看了一下日志,日志错误如下:2016-04-03 03:38:46,172 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/192.168.112.137:8020. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:47,174 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/192.168.112.137:8020. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 SECONDS)2016-04-03 03:38:47,178 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpointjava.net.ConnectException: Call From master/192.168.112.137 to master:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)        at org.apache.hadoop.ipc.Client.call(Client.java:1351)        at org.apache.hadoop.ipc.Client.call(Client.java:1300)        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)        at com.sun.proxy.$Proxy8.getTransactionId(Unknown Source)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)        at com.sun.proxy.$Proxy8.getTransactionId(Unknown Source)        at org.apache.hadoop.hdfs.protocolPB.NamenodeProtocolTranslatorPB.getTransactionID(NamenodeProtocolTranslatorPB.java:119)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.countUncheckpointedTxns(SecondaryNameNode.java:622)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.shouldCheckpointBasedOnCount(SecondaryNameNode.java:630)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doWork(SecondaryNameNode.java:378)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$2.run(SecondaryNameNode.java:346)        at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:456)        at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.run(SecondaryNameNode.java:342)        at java.lang.Thread.run(Thread.java:744)Caused by: java.net.ConnectException: Connection refused        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:547)        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:642)        at org.apache.hadoop.ipc.Client$Connection.access$2600(Client.java:314)        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1399)        at org.apache.hadoop.ipc.Client.call(Client.java:1318)        ... 18 more

Purplelione 发表于 2016-4-3 19:12:43
pig2 发表于 2016-4-3 18:46
在看日志,安装过程一定细心,否则会遇到各种问题

我是用vmware创建三台虚拟机来搭建的,日志报错上网查了一下说是端口问题,不知道有没有影响?
回复

使用道具 举报

Purplelione 发表于 2016-4-3 19:14:36
pig2 发表于 2016-4-3 18:46
在看日志,安装过程一定细心,否则会遇到各种问题

查看了一下日志,报错信息如下:
2016-04-03 03:38:47,178 ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpointjava.net.ConnectException: Call From master/192.168.112.137 to master:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:730)       ...Caused by: java.net.ConnectException: Connection refused        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:547)        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:642)        at org.apache.hadoop.ipc.Client$Connection.access$2600(Client.java:314)        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1399)        at org.apache.hadoop.ipc.Client.call(Client.java:1318)        ... 18 more

12下一页
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条