分享

Hadoop DataNode连接NameNode超时

一曲离殇 发表于 2017-3-31 10:48:56 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 13322
hdfs-site配置
[mw_shl_code=xml,true]<property>
        <name>dfs.namenode.rpc-address.ocetl.nn2</name>
        <value>einvoice244:8030</value>
</property>[/mw_shl_code]
异常信息
[mw_shl_code=java,true]17/03/31 09:38:26 WARN datanode.DataNode: IOException in offerService
java.net.SocketTimeoutException: Call From einvoice247/10.159.102.247 to einvoice244:8030 failed on socket timeout exception: java.net.SocketTimeoutException: 60000 mi
llis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/10.159.102.247:39497 remote=einvoice244/10.159.102.2
44:8030]; For more details see:  http://wiki.apache.org/hadoop/SocketTimeout
        at sun.reflect.GeneratedConstructorAccessor6.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:783)
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:749)
        at org.apache.hadoop.ipc.Client.call(Client.java:1415)
        at org.apache.hadoop.ipc.Client.call(Client.java:1364)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
        at com.sun.proxy.$Proxy12.sendHeartbeat(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolClientSideTranslatorPB.sendHeartbeat(DatanodeProtocolClientSideTranslatorPB.java:139)
        at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.sendHeartBeat(BPServiceActor.java:579)
        at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:677)
        at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:847)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/
10.159.102.247:39497 remote=einvoice244/10.159.102.244:8030]
        at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)
        at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
        at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
        at java.io.FilterInputStream.read(FilterInputStream.java:133)
        at java.io.FilterInputStream.read(FilterInputStream.java:133)
        at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:512)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        at java.io.DataInputStream.readInt(DataInputStream.java:387)
        at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1055)
        at org.apache.hadoop.ipc.Client$Connection.run(Client.java:950)[/mw_shl_code]

已有(4)人评论

跳转到指定楼层
langke93 发表于 2017-3-31 14:49:49
本帖最后由 langke93 于 2017-3-31 15:02 编辑

Call From einvoice247/10.159.102.247 to einvoice244:8030

java.nio.channels.SocketChannel[connected local=/10.159.102.247:39497 remote=einvoice244/10.159.102.2
44:8030]; For more details see:


楼主使用
[mw_shl_code=bash,true]telnet einvoice244 8030 [/mw_shl_code]
看是否通
排除错误,更多参考
大数据集群【hadoop、hbase、spark、hive,zookeeper、storm等】故障排除之端口详解
http://www.aboutyun.com/forum.php?mod=viewthread&tid=20880

猜测原因,可能是防火墙之类的问题


回复

使用道具 举报

一曲离殇 发表于 2017-3-31 15:00:12
langke93 发表于 2017-3-31 14:49
Call From einvoice247/10.159.102.247 to einvoice244:8030

java.nio.channels.SocketChannel[conn ...

防火墙已经关闭,这个已经确认过。
回复

使用道具 举报

einhep 发表于 2017-3-31 15:14:20
一曲离殇 发表于 2017-3-31 15:00
防火墙已经关闭,这个已经确认过。

常见的错误,但是原因很多,总归一个问题,网络不通造成的,下面可供楼主参考
Hadoop2HA ls出现链接失败Call From 192.168.226.92 to cluster:8020
http://www.aboutyun.com/forum.php?mod=viewthread&tid=9354

eclipse运行出现 Call From to master:8020 failed on connection exception:

http://www.aboutyun.com/forum.php?mod=viewthread&tid=8321

eclipse运行出现 Call From to master:8020 failed on connection exception:

http://www.aboutyun.com/forum.php?mod=viewthread&tid=8321

Call From host to host:9000 failed on connection exception: java.net.ConnectE...

http://www.aboutyun.com/forum.php?mod=viewthread&tid=14152

配置hadoop location时却报错: Call to localhost/127.0.0.1:9000 failed on loca...

http://www.aboutyun.com/forum.php?mod=viewthread&tid=6644



回复

使用道具 举报

einhep 发表于 2017-4-4 18:34:29
可能跟副本也有关系。
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条