分享

运行MapReduce出错,大家帮忙看看吧

lovejunxia 发表于 2013-10-26 15:08:46 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 1 9304
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:host.name=master-hd4
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_26
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:java.home=/opt/jdk1.6.0_26/jre
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/hadoop/programs/hadoop-1.0.3/libexec/../conf:/opt/jdk1.6.0_26/lib/tools.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/..:/home/hadoop/programs/hadoop-1.0.3/libexec/../hadoop-core-1.0.3.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/asm-3.2.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/aspectjrt-1.6.5.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/aspectjtools-1.6.5.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-beanutils-1.7.0.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-cli-1.2.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-codec-1.4.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-collections-3.2.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-configuration-1.6.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-daemon-1.0.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-digester-1.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-el-1.0.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-httpclient-3.0.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-io-2.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-lang-2.4.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-logging-1.1.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-logging-api-1.0.4.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-math-2.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/commons-net-1.4.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/core-3.1.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/guava-r09.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/hadoop-capacity-scheduler-1.0.3.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/hadoop-fairscheduler-1.0.3.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/hadoop-thriftfs-1.0.3.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/hsqldb-1.8.0.10.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jackson-core-asl-1.8.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jasper-compiler-5.5.12.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jasper-runtime-5.5.12.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jdeb-0.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jersey-core-1.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jersey-json-1.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jersey-server-1.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jets3t-0.6.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jetty-6.1.26.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jetty-util-6.1.26.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jsch-0.1.42.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/junit-4.5.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/kfs-0.2.2.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/log4j-1.2.15.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/mockito-all-1.8.5.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/oro-2.0.8.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/servlet-api-2.5-20081211.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/slf4j-api-1.4.3.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/slf4j-log4j12-1.4.3.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/xmlenc-0.52.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/zookeeper-3.4.3.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jsp-2.1/jsp-2.1.jar:/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/jsp-2.1/jsp-api-2.1.jar
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/hadoop/programs/hadoop-1.0.3/libexec/../lib/native/Linux-amd64-64
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:java.compiler=
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-220.el6.x86_64
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/hadoop/programs/hadoop-1.0.3
13/01/18 09:32:41 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.8.142
                :2181,192.168.8.141:2181,192.168.8.140:2181,192.168.8.137:2181,192.168.8.139:2181,192.168.8.136:2181,192.168.8.138:2181,192.168.8.135:2181,192.168.8.134:2181,192.168.8.133:2181,192.168.8.132:2181,192.168.8.131:2181,192.168.8.66:2181,192.168.8.65:2181,192.168.8.64:2181 sessionTimeout=180000 watcher=hconnection
13/01/18 09:32:41 INFO zookeeper.ClientCnxn: Opening socket connection to server /192.168.8.64:2181
13/01/18 09:32:41 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 13331@master-hd4
13/01/18 09:32:41 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: 无法定位登录配置 occurred when trying to find JAAS configuration.
13/01/18 09:32:41 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/01/18 09:32:41 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/01/18 09:32:41 INFO zookeeper.ClientCnxn: Opening socket connection to server /192.168.8.65:2181
13/01/18 09:32:41 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: 无法定位登录配置 occurred when trying to find JAAS configuration.
13/01/18 09:32:41 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/01/18 09:32:41 INFO zookeeper.ClientCnxn: Socket connection established to master-hd5/192.168.8.65:2181, initiating session
13/01/18 09:32:41 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/01/18 09:32:41 INFO util.RetryCounter: Sleeping 2000ms before retry #1...
13/01/18 09:32:41 INFO zookeeper.ClientCnxn: Session establishment complete on server master-hd5/192.168.8.65:2181, sessionid = 0x23c1d7e1b79006c, negotiated timeout = 40000
13/01/18 09:32:43 ERROR mapreduce.TableInputFormatBase: Cannot resolve the host name for /192.168.8.135 because of javax.naming.NameNotFoundException: DNS name not found [response code 3]; remaining name '135.8.168.192.in-addr.arpa'
13/01/18 09:32:43 INFO mapred.JobClient: Running job: job_201301141515_0021
13/01/18 09:32:44 INFO mapred.JobClient:  map 0% reduce 0%
13/01/18 09:33:11 INFO mapred.JobClient: Task Id : attempt_201301141515_0021_m_000000_0, Status : FAILED
java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details.
        at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.createRecordReader(TableInputFormatBase.java:115)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.[i](MapTask.java:489)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
13/01/18 09:33:24 INFO mapred.JobClient: Task Id : attempt_201301141515_0021_m_000000_1, Status : FAILED
java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details.
        at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.createRecordReader(TableInputFormatBase.java:115)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.[i](MapTask.java:489)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
........

已有(1)人评论

跳转到指定楼层
oChengZi1234 发表于 2013-10-26 15:08:46
从日志上看是
192.168.8.65:2181
这个端口连接不上。
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条