断尘居

温柔的男人像海洋。

日志

关于我

青钲

一个伪文青。

文章分类

LOFTER精选

八招诀窍，教你实力撩妹 >

网易考拉推荐

Hadoop集群报错Caused by: java.net.NoRouteToHostException: No route to host

2013-01-30 23:48:15| 分类： Hadoop | 标签： |举报 |字号大中小订阅

下载LOFTER 我的照片书 |

问题描述 | Problem Description

前两天把Hadoop集群搭起来之后出现了一个问题：

从master端启动hadoop，然后jps，可以看到NameNode、JobTracker、SecondaryNameNode均已启动，

但是slave端的DataNode则无法启动，或者启动之后几秒就自动关闭了，所以带着问题查看了log信息。

[root@slave1 hadoop-1.0.4]# cat logs/hadoop-root-datanode-slave1.log

2013-01-30 07:13:36,699 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting DataNode

STARTUP_MSG: host = slave1/10.0.3.124

STARTUP_MSG: args = []

STARTUP_MSG: version = 1.0.4

STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r 1393290; compiled by 'hortonfo' on Wed Oct 3 05:13:58 UTC 2012

************************************************************/

2013-01-30 07:13:36,913 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties

2013-01-30 07:13:36,924 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.

2013-01-30 07:13:36,925 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).

2013-01-30 07:13:36,925 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system started

2013-01-30 07:13:37,031 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.

2013-01-30 07:13:38,357 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 0 time(s).

2013-01-30 07:13:39,359 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 1 time(s).

2013-01-30 07:13:40,360 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 2 time(s).

2013-01-30 07:13:41,373 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 3 time(s).

2013-01-30 07:13:43,376 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 4 time(s).

2013-01-30 07:13:44,377 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 5 time(s).

2013-01-30 07:13:45,379 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 6 time(s).

2013-01-30 07:13:46,380 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 7 time(s).

2013-01-30 07:13:47,381 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 8 time(s).

2013-01-30 07:13:48,383 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/10.0.3.123:9000. Already tried 9 time(s).

2013-01-30 07:13:48,385 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Call to master/10.0.3.123:9000 failed on local exception: java.net.NoRouteToHostException: No route to host

at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)

at org.apache.hadoop.ipc.Client.call(Client.java:1075)

at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)

at $Proxy5.getProtocolVersion(Unknown Source)

at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)

at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:370)

at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:429)

at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:331)

at org.apache.hadoop.ipc.RPC.waitForProxy(RPC.java:296)

at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:356)

at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)

at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)

at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)

at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)

at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1665)

at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1682)

Caused by: java.net.NoRouteToHostException: No route to host

at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)

at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)

at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:489)

at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434)

at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560)

at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184)

at org.apache.hadoop.ipc.Client.getConnection(Client.java:1206)

at org.apache.hadoop.ipc.Client.call(Client.java:1050)

... 14 more

问题分析 | Problem Analysis

从log信息中很明显看出slave尝试连接了10次master，均以失败而告终，于是抛出了java.net.NoRouteToHostException

造成出现这个异常的原因一般有二：

防火墙阻挡。
端口被屏蔽。

于是尝试解决。

解决方案 | Problem Solution

将master端的防火墙关闭

然后重新启动Hadoop，slave端的DataNode已成功启动，log信息中也未出现错误信息。

问题成功解决。

问题总结 | Problem Summary

又是防火墙问题 - -#

评论这张

转发至微博

阅读(5367)| 评论(1)

喜欢推荐转载

历史上的今天

在LOFTER的更多文章

this.p={  m:2,
              b:2,
              loftPermalink:'',
              id:'fks_087065087081087065092081085070072085089065085080081074083',
              blogTitle:'Hadoop集群报错Caused by: java.net.NoRouteToHostException: No route to host',
              blogAbstract:'<p\><span style=\"color:white;\"  \><strong\><span style=\"font-family:Arial; background-color:black;\"  \>  </span\><span style=\"background-color:#c0504d;\"  \>问题描述<span style=\"font-family:Arial;\"  \> | Problem Description </span\></span\></strong\></span\></p\><p\><span style=\"color:black; font-family:微软雅黑; background-color:white;\"  \>    前两天把Hadoop集群搭起来之后出现了一个问题： </span\></p\><p\><span style=\"color:black; font-family:微软雅黑; background-color:white;\"  \>从master端启动hadoop，然后jps，可以看到NameNode、JobTracker、SecondaryNameNode均已启动， </span\></p\><p\><span style=\"color:black; font-family:微软雅黑; background-color:white;\"  \>但是slave端的DataNode则无法启动，或者启动之后几秒就自动关闭了，所以带着问题查看了log信息。 </span\></p\><div style=\"margin-left: 37pt;\"  \><table style=\"border-collapse:collapse; background: #bfbfbf;\"  border=\"0\"  \></table\></div\>',
              blogTag:'',
              blogUrl:'blog/static/382167972013030114815803',
              isPublished:1,
              istop:false,
              type:2,
              modifyTime:0,
              publishTime:1359560895802,
              permalink:'blog/static/382167972013030114815803',
              commentCount:1,
              mainCommentCount:1,
              recommendCount:0,
              bsrk:-100,
              publisherId:0,
              recomBlogHome:false,
              currentRecomBlog:false,
              attachmentsFileIds:[],
              vote:{},
              groupInfo:{},
              friendstatus:'none',
              followstatus:'unFollow',
              pubSucc:'',
              visitorProvince:'',
              visitorCity:'',
              visitorNewUser:false,
              postAddInfo:{},
              mset:'000',
              mcon:'',
              srk:-100,
              remindgoodnightblog:false,
              isBlackVisitor:false,
              isShowYodaoAd:true,
              hostIntro:'一个伪文青。',
              hmcon:'1',
              selfRecomBlogCount:'0',
              lofter_single:'<iframe width="140" height="560" style="overflow:hidden;" src="http://www.lofter.com/mailEntry.do?blogad=1&blog" frameBorder="0"></iframe>'
            }

{list a as x}
    {if !!x}
    <div class="iblock nbw-fce nbw-f40">
      <a class="fc03 noul" target="_blank" hidefocus="true" href="http://blog.163.com/${x.visitorName}/">
      {if x.visitorName==visitor.userName}
      <img alt="${x.visitorNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.visitorName)}&r=${visitor.imageUpdateTime}"/>
      {else}
      <img alt="${x.visitorNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.visitorName)}"/>
      {/if}
      </a>
      <div class="cwd vname thide">
        {if x.moveFrom=='wap'}
          <a class="noul pnt" target="_blank" href="http://blog.163.com/services/wapblog.html?frompersonalbloghome"><span title="来自网易手机博客" class="iblock wapIcon"> </span></a>
        {elseif x.moveFrom=='iphone'}
          <a class="noul pnt" target="_blank"><span title="来自iPhone客户端" class="iblock iphoneIcon"> </span></a>
        {elseif x.moveFrom=='android'}
          <a class="noul pnt" target="_blank"><span title="来自Android客户端" class="iblock androidIcon"> </span></a>
        {elseif x.moveFrom=='mobile'}
          <a class="noul pnt" target="_blank" href="http://blog.163.com/services/emsblog.html?frompersonalbloghome"><span title="来自网易短信写博" class="iblock wapIcon"> </span></a>
        {/if}
        <a class="fc03 m2a"  target="_blank" hidefocus="true" href="http://blog.163.com/${x.visitorName}/">
          ${fn(x.visitorNickname,8)|escape}
        </a>
      </div>
    </div>
    {/if}
    {/list}

<#--最新日志，群博日志--> <#--推荐日志-->

<p class="fc06">推荐过这篇日志的人：</p>
    <div>
      {list a as x}
      {if !!x}
      <div class="iblock nbw-fce nbw-f40">
        <a class="fc03 noul" target="_blank" hidefocus="true" href="http://blog.163.com/${x.recommenderName}/">
        <img alt="${x.recommenderNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.recommenderName)}"/>
        </a>
        <div class="cwd thide">
          <a class="fc03 m2a" target="_blank" hidefocus="true" href="http://blog.163.com/${x.recommenderName}/">
            ${fn(x.recommenderNickname,6)|escape}
          </a>
        </div>
      </div>
      {/if}
      {/list}
    </div>
    {if !!b&&b.length>0}
    <p  class="fc06">他们还推荐了：</p>
    <ul>
    {list b as y}
      {if !!y}
        <li class="rrb"><span class="iblock">·</span><a class="fc03 m2a" target="_blank" href="http://blog.163.com/${y.recommendBlogPermalink}/?from=blog/static/382167972013030114815803">${y.recommendBlogTitle|escape}</a></li>
      {/if}
    {/list}
    </ul>
    {/if}

<#--引用记录--> <#--博主推荐--> <#--随机阅读--> <#--首页推荐--> <#--历史上的今天--> <#--被推荐日志--> <#--上一篇，下一篇--> <#-- 热度 -->

{list a as x}
    {if !!x}
    <div class="hotItem iblock nbw-fce nbw-f40">
      <a class="fc03 noul" target="_blank" hidefocus="true" href="http://blog.163.com/${x.publisherUsername}/">
      {if x.publisherUsername==visitor.userName}
      <img alt="${x.publisherNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.publisherUsername)}&r=${visitor.imageUpdateTime}"/>
      {else}
      <img alt="${x.publisherNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.publisherUsername)}"/>
      {/if}
      </a>
      <div class="cwd vname thide">
        <a class="fc03 m2a"  target="_blank" hidefocus="true" href="http://blog.163.com/${x.publisherUsername}/">
          ${fn(x.publisherNickname,8)|escape}
        </a>
      </div>
      <a class="f-myLikeIcons hottype {if x.type==1} js-liketype{elseif x.type==2} js-reblogtype{elseif x.type==3} js-sharetype{else}{/if}" target="_blank" hidefocus="true" href="http://blog.163.com/${x.publisherUsername}/"> </a>
    </div>
    {/if}
    {/list}

<#-- 网易新闻广告 --> <#--右边模块结构--> <#--评论模块结构--> <#--引用模块结构--> <#--博主发起的投票-->

页脚

我的照片书 - 博客风格 - 手机博客 - 下载LOFTER APP - 订阅此博客

断尘居

导航

日志

Hadoop集群报错Caused by: java.net.NoRouteToHostException: No route to host

历史上的今天

最近读者

热度

在LOFTER的更多文章

评论

页脚