Hbase0.92.2 默认zookeeper 启动问题

环境是：hadoop1.2.1 +hbase0.92.2+nutch2.2.1

问题一：自带的zookeeper启动失败？
hadoop@ktbigdata2:~/hbase-0.92.2/logs$ vi hbase-hadoop-zookeeper-ktbigdata2.log
2015年 08月 10日 星期一 16:51:14 CST Starting zookeeper on ktbigdata2
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 7876
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 7876
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
2015-08-10 16:51:25,356 WARN org.apache.zookeeper.server.quorum.QuorumPeerConfig: No server failure will be tolerated. You need at least 3 servers.
2015-08-10 16:51:25,357 INFO org.apache.zookeeper.server.quorum.QuorumPeerConfig: Defaulting to majority quorums
2015-08-10 16:51:25,417 DEBUG org.apache.hadoop.hbase.util.VersionInfo: preRegister called. Server=com.sun.jmx.mbeanserver.JmxMBeanServer@fcfa52, name=log4j:logger=org.apache.hadoop.hbase.util.VersionInfo
2015-08-10 16:51:25,418 DEBUG org.apache.hadoop.hbase.zookeeper.ZKConfig: preRegister called. Server=com.sun.jmx.mbeanserver.JmxMBeanServer@fcfa52, name=log4j:logger=org.apache.hadoop.hbase.zookeeper.ZKConfig
2015-08-10 16:51:25,418 DEBUG org.apache.hadoop.hbase.HBaseConfiguration: preRegister called. Server=com.sun.jmx.mbeanserver.JmxMBeanServer@fcfa52, name=log4j:logger=org.apache.hadoop.hbase.HBaseConfiguration
2015-08-10 16:51:25,418 DEBUG org.apache.hadoop.hbase: preRegister called. Server=com.sun.jmx.mbeanserver.JmxMBeanServer@fcfa52, name=log4j:logger=org.apache.hadoop.hbase
2015-08-10 16:51:25,418 INFO org.apache.zookeeper.server.quorum.QuorumPeerMain: Starting quorum peer
2015-08-10 16:51:25,442 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: binding to port 0.0.0.0/0.0.0.0:2181
2015-08-10 16:51:25,463 INFO org.apache.zookeeper.server.quorum.QuorumPeer: tickTime set to 3000
2015-08-10 16:51:25,463 INFO org.apache.zookeeper.server.quorum.QuorumPeer: minSessionTimeout set to -1
2015-08-10 16:51:25,463 INFO org.apache.zookeeper.server.quorum.QuorumPeer: maxSessionTimeout set to 180000
2015-08-10 16:51:25,463 INFO org.apache.zookeeper.server.quorum.QuorumPeer: initLimit set to 10
2015-08-10 16:51:25,481 INFO org.apache.zookeeper.server.quorum.QuorumPeer: currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2015-08-10 16:51:25,483 INFO org.apache.zookeeper.server.quorum.QuorumPeer: acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation
2015-08-10 16:51:25,495 INFO org.apache.zookeeper.server.quorum.QuorumCnxManager: My election bind port: 0.0.0.0/0.0.0.0:3888
2015-08-10 16:51:25,502 INFO org.apache.zookeeper.server.quorum.QuorumPeer: LOOKING
2015-08-10 16:51:25,510 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /192.168.100.142:52359
2015-08-10 16:51:25,516 INFO org.apache.zookeeper.server.quorum.QuorumCnxManager: Received connection request /192.168.100.141:45425
2015-08-10 16:51:25,523 INFO org.apache.zookeeper.server.quorum.FastLeaderElection: New election. My id =  1, proposed zxid=0x0
2015-08-10 16:51:25,554 INFO org.apache.zookeeper.server.quorum.FastLeaderElection: Notification: 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)
2015-08-10 16:51:25,563 WARN org.apache.zookeeper.server.NIOServerCnxn: Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
2015-08-10 16:51:25,563 INFO org.apache.zookeeper.server.NIOServerCnxn: Closed socket connection for client /192.168.100.142:52359 (no session established for client)
2015-08-10 16:51:25,563 INFO org.apache.zookeeper.server.quorum.FastLeaderElection: Notification: 0 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 0 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)
2015-08-10 16:51:25,564 INFO org.apache.zookeeper.server.quorum.FastLeaderElection: Notification: 1 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 0 (n.sid), 0x0 (n.peerEPoch), LOOKING (my state)
2015-08-10 16:51:25,603 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /192.168.100.141:47456
2015-08-10 16:51:25,604 WARN org.apache.zookeeper.server.NIOServerCnxn: Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
2015-08-10 16:51:25,604 INFO org.apache.zookeeper.server.NIOServerCnxn: Closed socket connection for client /192.168.100.141:47456 (no session established for client)
2015-08-10 16:51:25,756 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /192.168.100.141:47457
2015-08-10 16:51:25,756 WARN org.apache.zookeeper.server.NIOServerCnxn: Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
2015-08-10 16:51:25,756 INFO org.apache.zookeeper.server.NIOServerCnxn: Closed socket connection for client /192.168.100.141:47457 (no session established for client)
2015-08-10 16:51:25,764 INFO org.apache.zookeeper.server.quorum.QuorumPeer: LEADING
2015-08-10 16:51:25,768 INFO org.apache.zookeeper.server.quorum.Leader: TCP NoDelay set to: true
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:host.name=ktbigdata2
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.version=1.6.0_45
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.vendor=Sun Microsystems Inc.
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.home=/opt/jdk1.6.0_45/jre
@
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.class.path=/home/hadoop/hbase-0.92.2/bin/../conf:/opt/jdk1.6.0_45/lib/tools.jar:/home/hadoop/hbase-0.92.2/bin/..:/home/hadoop/hbase-0.92.2/bin/../hbase-0.92.2.jar:/home/hadoop/hbase-0.92.2/bin/../hbase-0.92.2-tests.jar:/home/hadoop/hbase-0.92.2/bin/../lib/activation-1.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/asm-3.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/asm-3.2.jar:/home/hadoop/hbase-0.92.2/bin/../lib/aspectjrt-1.6.11.jar:/home/hadoop/hbase-0.92.2/bin/../lib/aspectjtools-1.6.11.jar:/home/hadoop/hbase-0.92.2/bin/../lib/avro-1.5.3.jar:/home/hadoop/hbase-0.92.2/bin/../lib/avro-ipc-1.5.3.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-beanutils-1.7.0.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-cli-1.2.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-codec-1.4.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-collections-3.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-configuration-1.6.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-daemon-1.0.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-digester-1.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-el-1.0.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-httpclient-3.0.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-httpclient-3.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-io-2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-lang-2.4.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-lang-2.5.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-logging-1.1.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-logging-api-1.0.4.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-math-2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-net-1.4.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/commons-net-3.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/core-3.1.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/guava-r09.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hadoop-ant-1.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hadoop-client-1.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hadoop-core-1.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hadoop-examples-1.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hadoop-minicluster-1.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hadoop-test-1.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hadoop-tools-1.2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/high-scale-lib-1.1.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/hsqldb-1.8.0.10.jar:/home/hadoop/hbase-0.92.2/bin/../lib/httpclient-4.0.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/httpcore-4.0.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jackson-core-asl-1.8.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jackson-jaxrs-1.8.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jackson-xc-1.8.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jamon-runtime-2.3.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jasper-compiler-5.5.12.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jasper-compiler-5.5.23.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jasper-runtime-5.5.12.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jasper-runtime-5.5.23.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jaxb-api-2.1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jdeb-0.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jersey-core-1.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jersey-json-1.8.jar:/home/hadoop/hbase-0.92.2/bin/../lib/jersey-server-1.8.jar:/home/hadoop/hbase-0.92.2/bin/../
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.library.path=/home/hadoop/hbase-0.92.2/bin/../lib/native/Linux-i386-32
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.io.tmpdir=/tmp
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:java.compiler=<NA>
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.name=Linux
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.arch=i386
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:os.version=3.16.0-30-generic
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.name=hadoop
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.home=/home/hadoop
2015-08-10 16:51:25,778 INFO org.apache.zookeeper.server.ZooKeeperServer: Server environment:user.dir=/home/hadoop/hbase-0.92.2
2015-08-10 16:51:25,780 INFO org.apache.zookeeper.server.ZooKeeperServer: Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 180000 datadir /home/hadoop/hbase-0.92.2/data/tmp/zookeeper/version-2 snapdir /home/hadoop/hbase-0.92.2/data/tmp/zookeeper/version-2
2015-08-10 16:51:25,781 INFO org.apache.zookeeper.server.quorum.Leader: LEADING - LEADER ELECTION TOOK - 258
2015-08-10 16:51:25,785 INFO org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting: 0x0 to /home/hadoop/hbase-0.92.2/data/tmp/zookeeper/version-2/snapshot.0
2015-08-10 16:51:25,802 INFO org.apache.zookeeper.server.quorum.LearnerHandler: Follower sid: 0 : info : org.apache.zookeeper.server.quorum.QuorumPeer$QuorumServer@15f7107
2015-08-10 16:51:25,806 INFO org.apache.zookeeper.server.quorum.LearnerHandler: Synchronizing with Follower sid: 0 maxCommittedLog=0x0 minCommittedLog=0x0 peerLastZxid=0x0
2015-08-10 16:51:25,808 INFO org.apache.zookeeper.server.quorum.LearnerHandler: Sending snapshot last zxid of peer is 0x0  zxid of leader is 0x100000000sent zxid of db as 0x0
2015-08-10 16:51:25,819 WARN org.apache.zookeeper.server.quorum.Leader: Commiting zxid 0x100000000 from /192.168.100.142:2888 not first!
2015-08-10 16:51:25,819 WARN org.apache.zookeeper.server.quorum.Leader: First is 0x0
2015-08-10 16:51:25,819 INFO org.apache.zookeeper.server.quorum.Leader: Have quorum of supporters; starting up and setting last processed zxid: 0x100000000
2015-08-10 16:51:25,918 INFO org.apache.zookeeper.server.persistence.FileTxnLog: Creating new log file: log.100000001
2015-08-10 16:51:32,590 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x4f16ce990e0000 type:delete cxid:0x14 zxid:0x10000000c txntype:-1 reqpath:n/a Error Path:/hbase/backup-masters/ktbigdata1,60000,1439196673572 Error:KeeperErrorCode = NoNode for /hbase/backup-masters/ktbigdata1,60000,1439196673572
2015-08-10 16:51:33,235 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /192.168.100.141:47475
2015-08-10 16:51:33,238 INFO org.apache.zookeeper.server.ZooKeeperServer: Client attempting to establish new session at /192.168.100.141:47475
2015-08-10 16:51:33,244 INFO org.apache.zookeeper.server.ZooKeeperServer: Established session 0x14f16cea5fe0000 with negotiated timeout 180000 for client /192.168.100.141:47475
2015-08-10 16:51:33,691 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /192.168.100.142:52362
2015-08-10 16:51:33,692 INFO org.apache.zookeeper.server.ZooKeeperServer: Client attempting to establish new session at /192.168.100.142:52362
2015-08-10 16:51:33,693 INFO org.apache.zookeeper.server.ZooKeeperServer: Established session 0x14f16cea5fe0001 with negotiated timeout 180000 for client /192.168.100.142:52362
2015-08-10 16:51:33,720 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket connection from /192.168.100.141:47476
2015-08-10 16:51:33,720 INFO org.apache.zookeeper.server.ZooKeeperServer: Client attempting to establish new session at /192.168.100.141:47476
2015-08-10 16:51:33,730 INFO org.apache.zookeeper.server.ZooKeeperServer: Established session 0x14f16cea5fe0002 with negotiated timeout 180000 for client /192.168.100.141:47476
2015-08-10 16:51:39,199 INFO org.apache.zookeeper.server.PrepRequestProcessor: Got user-level KeeperException when processing sessionid:0x4f16ce990e0000 type:delete cxid:0x2a zxid:0x100000015 txntype:-1 reqpath:n/a Error Path:/hbase/root-region-server Error:KeeperErrorCode = NoNode for /hbase/root-region-server
~




问题二：nutch2.2.1 运行情况？（看了nutch2.2.1r 默认zookeeper是3.3.2，而hbase0.92.2的版本是3.4.3，如果要集群运行模式，要怎么修改nutch2.2.1上的文件，使nutch生成的 apache-nutch-2.2.1.job版本与hbase一至呢？）

hadoop@ktbigdata1:~$ /home/hadoop/hadoop-1.2.1/bin/hadoop fs -put /home/hadoop/apache-nutch-2.2.1/urls urls
hadoop@ktbigdata1:~$ /home/hadoop/hadoop-1.2.1/bin/hadoop fs -lsr urls
-rw-r--r--   1 hadoop supergroup        216 2015-08-10 16:59 /user/hadoop/urls/seed.txt
hadoop@ktbigdata1:~$ /home/hadoop/apache-nutch-2.2.1/runtime/deploy/bin/nutch inject urls/seed.txt
15/08/10 17:00:23 INFO crawl.InjectorJob: InjectorJob: starting at 2015-08-10 17:00:23
15/08/10 17:00:23 INFO crawl.InjectorJob: InjectorJob: Injecting urlDir: urls/seed.txt
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:host.name=ktbigdata1
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_45
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:java.home=/opt/jdk1.6.0_45/jre
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/hadoop/hadoop-1.2.1/libexec/../conf:/opt/jdk1.6.0_45/lib/tools.jar:/home/hadoop/hadoop-1.2.1/libexec/..:/home/hadoop/hadoop-1.2.1/libexec/../hadoop-core-1.2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/asm-3.2.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/aspectjrt-1.6.11.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/aspectjtools-1.6.11.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-1.7.0.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-cli-1.2.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-codec-1.4.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-collections-3.2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-configuration-1.6.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-daemon-1.0.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-digester-1.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-el-1.0.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-httpclient-3.0.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-io-2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-lang-2.4.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-1.1.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-logging-api-1.0.4.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-math-2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/commons-net-3.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/core-3.1.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-capacity-scheduler-1.2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-fairscheduler-1.2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/hadoop-thriftfs-1.2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/hsqldb-1.8.0.10.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jackson-core-asl-1.8.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jasper-compiler-5.5.12.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jasper-runtime-5.5.12.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jdeb-0.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jersey-core-1.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jersey-json-1.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jersey-server-1.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jets3t-0.6.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jetty-6.1.26.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jsch-0.1.42.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/junit-4.5.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/kfs-0.2.2.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/log4j-1.2.15.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/mockito-all-1.8.5.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/oro-2.0.8.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/servlet-api-2.5-20081211.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-api-1.4.3.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/slf4j-log4j12-1.4.3.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/xmlenc-0.52.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-2.1.jar:/home/hadoop/hadoop-1.2.1/libexec/../lib/jsp-2.1/jsp-api-2.1.jar:/home/hadoop/apache-nutch-2.2.1/runtime/local/lib/*.jar
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/hadoop/hadoop-1.2.1/libexec/../lib/native/Linux-i386-32
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:os.version=3.16.0-30-generic
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/hadoop
15/08/10 17:00:23 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.100.142:2181 sessionTimeout=180000 watcher=hconnection
15/08/10 17:00:23 INFO zookeeper.ClientCnxn: Opening socket connection to server /192.168.100.142:2181
15/08/10 17:00:23 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 13634@ktbigdata1
15/08/10 17:00:23 INFO zookeeper.ClientCnxn: Socket connection established to ktbigdata2/192.168.100.142:2181, initiating session
15/08/10 17:00:23 INFO zookeeper.ClientCnxn: Session establishment complete on server ktbigdata2/192.168.100.142:2181, sessionid = 0x14f16cea5fe0003, negotiated timeout = 180000
15/08/10 17:00:24 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.100.142:2181 sessionTimeout=180000 watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@13576a2
15/08/10 17:00:24 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 13634@ktbigdata1
15/08/10 17:00:24 INFO zookeeper.ClientCnxn: Opening socket connection to server /192.168.100.142:2181
15/08/10 17:00:24 INFO zookeeper.ClientCnxn: Socket connection established to ktbigdata2/192.168.100.142:2181, initiating session
15/08/10 17:00:24 INFO zookeeper.ClientCnxn: Session establishment complete on server ktbigdata2/192.168.100.142:2181, sessionid = 0x14f16cea5fe0004, negotiated timeout = 180000
15/08/10 17:00:24 INFO zookeeper.ZooKeeper: Session: 0x14f16cea5fe0004 closed
15/08/10 17:00:24 INFO zookeeper.ClientCnxn: EventThread shut down
15/08/10 17:00:25 INFO crawl.InjectorJob: InjectorJob: Using class org.apache.gora.hbase.store.HBaseStore as the Gora storage class.
15/08/10 17:00:27 INFO input.FileInputFormat: Total input paths to process : 1
15/08/10 17:00:27 INFO util.NativeCodeLoader: Loaded the native-hadoop library
15/08/10 17:00:27 WARN snappy.LoadSnappy: Snappy native library not loaded
15/08/10 17:00:27 INFO mapred.JobClient: Running job: job_201508101650_0001
15/08/10 17:00:28 INFO mapred.JobClient:  map 0% reduce 0%
15/08/10 17:00:45 INFO mapred.JobClient: Task Id : attempt_201508101650_0001_m_000000_0, Status : FAILED
java.lang.RuntimeException: x point org.apache.nutch.net.URLNormalizer not found.
        at org.apache.nutch.net.URLNormalizers.<init>(URLNormalizers.java:122)
        at org.apache.nutch.crawl.InjectorJob$UrlMapper.setup(InjectorJob.java:99)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)

15/08/10 17:00:53 INFO mapred.JobClient: Task Id : attempt_201508101650_0001_m_000000_1, Status : FAILED
java.lang.RuntimeException: x point org.apache.nutch.net.URLNormalizer not found.
        at org.apache.nutch.net.URLNormalizers.<init>(URLNormalizers.java:122)
        at org.apache.nutch.crawl.InjectorJob$UrlMapper.setup(InjectorJob.java:99)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)

15/08/10 17:00:59 INFO mapred.JobClient: Task Id : attempt_201508101650_0001_m_000000_2, Status : FAILED
java.lang.RuntimeException: x point org.apache.nutch.net.URLNormalizer not found.
        at org.apache.nutch.net.URLNormalizers.<init>(URLNormalizers.java:122)
        at org.apache.nutch.crawl.InjectorJob$UrlMapper.setup(InjectorJob.java:99)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)

15/08/10 17:01:06 INFO mapred.JobClient: Job complete: job_201508101650_0001
15/08/10 17:01:06 INFO mapred.JobClient: Counters: 8
15/08/10 17:01:06 INFO mapred.JobClient:   Job Counters
15/08/10 17:01:06 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=29948
15/08/10 17:01:06 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
15/08/10 17:01:06 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
15/08/10 17:01:06 INFO mapred.JobClient:     Rack-local map tasks=3
15/08/10 17:01:06 INFO mapred.JobClient:     Launched map tasks=4
15/08/10 17:01:06 INFO mapred.JobClient:     Data-local map tasks=1
15/08/10 17:01:06 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
15/08/10 17:01:06 INFO mapred.JobClient:     Failed map tasks=1
15/08/10 17:01:06 ERROR crawl.InjectorJob: InjectorJob: java.lang.RuntimeException: job failed: name=inject urls/seed.txt, jobid=job_201508101650_0001
        at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:54)
        at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:233)
        at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:251)
        at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:273)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:282)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:160)




日志有点多，帮忙找下问题呀，谢谢了！

来看看哈..

自带是的是几个，需要奇数个

第二个问题：
修改nutch配置文件：在编译nutch源文件前，为了支持hbase存储，需要修改相应的配置：#拷贝hbase的配置文件到nutch   
cp /usr/local/hbase/conf/hbase-site.xml /usr/local/nutch/conf/  

复制hbase的jar包到nutch，把兼容版本，可以从maven中心库下载：

http://central.maven.org/maven2/ ... .2/hbase-0.92.2.jar  

然后将hbase jar包替换nutch

Alkaloid0515 发表于 2015-8-10 17:59
自带是的是几个，需要奇数个

第二个问题：

恩恩，对于配置文件我是都有拷贝到${nutch_home}/conf 下再编译的，会把hbase与hadoop的jar包放到${nutch_home}/lib 下，再编译的。但是ant编译的时候会默认下载之前的默认版本，比如编译完后hbase会有0.90.4（默认的）与0.92.2（是我加的），那deploy 模式的jar包呢，应该也会存在两个吧？（这个问题是解决了），，但又出现zookeeper,我想也有可能是这个兼容性问题，但不懂怎么解决了？  

有个疑问，deploy模式与读取的jar包是哪里呢，在job里么？怎么编译job呢？

aqi915 发表于 2015-8-10 18:13
恩恩，对于配置文件我是都有拷贝到${nutch_home}/conf 下再编译的，会把hbase与hadoop的jar包放到${nutch ...

zookeeper有hbase自带的，看看对应版本

Alkaloid0515 发表于 2015-8-10 18:30
zookeeper有hbase自带的，看看对应版本

恩恩，刚有看了，版本是不一至的呢，hbase的zookeeper3.4.3  而nutch 是3.3.2 不懂的要怎么修改呢？
我的运行模式是deploy  。

aqi915 发表于 2015-8-10 20:07
恩恩，刚有看了，版本是不一至的呢，hbase的zookeeper3.4.3  而nutch 是3.3.2 不懂的要怎么修改呢？
我 ...

nutch不需要zookeeper吧

xuanxufeng 发表于 2015-8-10 20:50
nutch不需要zookeeper吧

而，我是nutch 与hbase 集成的，那要把用nutch把数据注入到hbase 需要zookeeper 么，应该要吧！

但nutch 默认打包到deploy 里job的zookeeper的jar包和安装的hbase 版本不同，好像会冲突，不懂怎么改？


还有一个，先帮我看看第一个问题是什么原因咯？那个是hbase 0.92.2默认的zookeeper 没起来好像，不懂什么原因呢？但是，集群启动好好的，hbase也可以建表和put数据，但zookeeper日志好像是报的，没看懂？求大神知道呀?