请问 HBase开启kerberos认证后 zk是不是必须开啊？

目前环境是 HBase配置了kerberos认证，但是zk没有配置。 我想用java api去操作HBase的时候  zk一直弹debug信息。部分栈如下：
[mw_shl_code=java,true]2017-02-23 16:09:24 DEBUG [TGT Renewer for hadoop/namenode-1@MLOGCN.INN]    org.apache.hadoop.security.UserGroupInformation : Current time is 1487837364742
2017-02-23 16:09:24 DEBUG [TGT Renewer for hadoop/namenode-1@MLOGCN.INN]    org.apache.hadoop.security.UserGroupInformation : Next refresh is 1487895682000
2017-02-23 16:09:24  INFO [    main]    o.a.hadoop.hbase.zookeeper.RecoverableZooKeeper : Process identifier=hconnection-0x105fece7 connecting to ZooKeeper ensemble=datanode-3:2181,datanode-4:2181,datanode-5:2181
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:host.name=namenode-1
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:java.version=1.8.0_121
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:java.vendor=Oracle Corporation
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:java.home=/usr/local/jdk1.8.0_121/jre
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:java.class.path=mlogplatdemo-1.0-SNAPSHOT.jar
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:java.io.tmpdir=/tmp
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:java.compiler=<NA>
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:os.name=Linux
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:os.arch=amd64
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:os.version=3.10.0-514.el7.x86_64
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:user.name=hadoop
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:user.home=/home/hadoop
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Client environment:user.dir=/home/hadoop
2017-02-23 16:09:24  INFO [    main]                     org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=datanode-3:2181,datanode-4:2181,datanode-5:2181 sessionTimeout=90000 watcher=hconnection-0x105fece70x0, quorum=datanode-3:2181,datanode-4:2181,datanode-5:2181, baseZNode=/hbase
2017-02-23 16:09:24 DEBUG [    main]                    org.apache.zookeeper.ClientCnxn : zookeeper.disableAutoWatchReset is false
2017-02-23 16:09:24  INFO [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Opening socket connection to server datanode-3/192.168.130.154:2181. Will not attempt to authenticate using SASL (unknown error)
2017-02-23 16:09:24  INFO [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Socket connection established to datanode-3/192.168.130.154:2181, initiating session
2017-02-23 16:09:24 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Session establishment request sent on datanode-3/192.168.130.154:2181
2017-02-23 16:09:24  INFO [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Session establishment complete on server datanode-3/192.168.130.154:2181, sessionid = 0x159cc42c2cf00d4, negotiated timeout = 40000
2017-02-23 16:09:24 DEBUG [main-EventThread] org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher : hconnection-0x105fece70x0, quorum=datanode-3:2181,datanode-4:2181,datanode-5:2181, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null
2017-02-23 16:09:24 DEBUG [main-EventThread] org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher : hconnection-0x105fece7-0x159cc42c2cf00d4 connected
2017-02-23 16:09:24 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 1,3  replyHeader:: 1,8589937726,0  request:: '/hbase/hbaseid,F  response:: s{8589934927,8589937599,1485358946166,1487762015603,29,0,0,0,67,0,8589934927}
2017-02-23 16:09:24 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 2,4  replyHeader:: 2,8589937726,0  request:: '/hbase/hbaseid,F  response:: #ffffffff000146d61737465723a3136303030ffffff8bfffffff0ffffff8cffffffe6ffffff9cffffffda692c50425546a2436666536623935372d386534352d343130382d623064642d343162356561656662633031,s{8589934927,8589937599,1485358946166,1487762015603,29,0,0,0,67,0,8589934927}
2017-02-23 16:09:24  WARN [    main]    org.apache.hadoop.hbase.util.DynamicClassLoader : Failed to identify the fs of dir /tmp/hbase-hadoop/hbase/lib, ignored
java.io.IOException: No FileSystem for scheme: file
        at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2644)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:355)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
        at org.apache.hadoop.hbase.util.DynamicClassLoader.initTempDir(DynamicClassLoader.java:120)
        at org.apache.hadoop.hbase.util.DynamicClassLoader.<init>(DynamicClassLoader.java:98)
        at org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:243)
        at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
        at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75)
        at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:105)
        at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:905)
        at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:648)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238)
        at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218)
        at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:119)
        at com.mlog.dataplat.hbaseutils.HBaseConn.<init>(HBaseConn.java:46)
        at com.mlog.dataplat.hbaseutils.HBaseConn.<init>(HBaseConn.java:19)
        at com.mlog.dataplat.hbaseutils.HBaseConn$SingletonInstance.<clinit>(HBaseConn.java:56)
        at com.mlog.dataplat.hbaseutils.HBaseConn.getTable(HBaseConn.java:64)
        at com.mlog.dataplat.hbaseutils.HBaseUtil.getRow(HBaseUtil.java:197)
        at com.mlog.dataplat.hbaseservice.HBaseServiceImpl.get_json(HBaseServiceImpl.java:124)
        at com.mlog.dataplat.hbaseservice.HBase.get_json(HBase.java:91)
        at com.mlog.dataplat.Application.main(Application.java:30)
2017-02-23 16:09:25 DEBUG [    main]      org.apache.hadoop.hbase.ipc.AbstractRpcClient : Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b662a77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 3,4  replyHeader:: 3,8589937726,0  request:: '/hbase/meta-region-server,F  response:: #ffffffff0001a726567696f6e7365727665723a3136303230ffffff8b1b1ffffffb928312450425546a16aa646174616e6f64652d3210ffffff947d18ffffffd4ffffff84ffffff9bffffffacffffffa62b100183,s{8589937650,8589937650,1487762021797,1487762021797,0,0,0,0,63,0,8589937650}
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 4,8  replyHeader:: 4,8589937726,0  request:: '/hbase,F  response:: v{'replication,'meta-region-server,'rs,'splitWAL,'backup-masters,'table-lock,'flush-table-proc,'region-in-transition,'online-snapshot,'master,'running,'recovering-regions,'tokenauth,'draining,'namespace,'hbaseid,'table}
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 5,4  replyHeader:: 5,8589937726,0  request:: '/hbase/meta-region-server,F  response:: #ffffffff0001a726567696f6e7365727665723a3136303230ffffff8b1b1ffffffb928312450425546a16aa646174616e6f64652d3210ffffff947d18ffffffd4ffffff84ffffff9bffffffacffffffa62b100183,s{8589937650,8589937650,1487762021797,1487762021797,0,0,0,0,63,0,8589937650}
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 6,8  replyHeader:: 6,8589937726,0  request:: '/hbase,F  response:: v{'replication,'meta-region-server,'rs,'splitWAL,'backup-masters,'table-lock,'flush-table-proc,'region-in-transition,'online-snapshot,'master,'running,'recovering-regions,'tokenauth,'draining,'namespace,'hbaseid,'table}
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 7,4  replyHeader:: 7,8589937726,0  request:: '/hbase/meta-region-server,F  response:: #ffffffff0001a726567696f6e7365727665723a3136303230ffffff8b1b1ffffffb928312450425546a16aa646174616e6f64652d3210ffffff947d18ffffffd4ffffff84ffffff9bffffffacffffffa62b100183,s{8589937650,8589937650,1487762021797,1487762021797,0,0,0,0,63,0,8589937650}
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 8,8  replyHeader:: 8,8589937726,0  request:: '/hbase,F  response:: v{'replication,'meta-region-server,'rs,'splitWAL,'backup-masters,'table-lock,'flush-table-proc,'region-in-transition,'online-snapshot,'master,'running,'recovering-regions,'tokenauth,'draining,'namespace,'hbaseid,'table}
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 9,4  replyHeader:: 9,8589937726,0  request:: '/hbase/meta-region-server,F  response:: #ffffffff0001a726567696f6e7365727665723a3136303230ffffff8b1b1ffffffb928312450425546a16aa646174616e6f64652d3210ffffff947d18ffffffd4ffffff84ffffff9bffffffacffffffa62b100183,s{8589937650,8589937650,1487762021797,1487762021797,0,0,0,0,63,0,8589937650}
2017-02-23 16:09:25 DEBUG [main-SendThread(datanode-3:2181)]                    org.apache.zookeeper.ClientCnxn : Reading reply sessionid:0x159cc42c2cf00d4, packet:: clientPath:null serverPath:null finished:false header:: 10,8  replyHeader:: 10,8589937726,0  request:: '/hbase,F  response:: v{'replication,'meta-region-server,'rs,'splitWAL,'backup-masters,'table-lock,'flush-table-proc,'region-in-transition,'online-snapshot,'master,'running,'recovering-regions,'tokenauth,'draining,'namespace,'hbaseid,'table}
[/mw_shl_code]

望指点下。  我好懵逼啊

即使不配置认证，zookeeper在hbase中也是必须的。楼主需配置zookeeper

nextuser 发表于 2017-2-23 16:34
即使不配置认证，zookeeper在hbase中也是必须的。楼主需配置zookeeper

我知道zk是必须的。我遇到的问题是： 我hbase配置了kerberos。 然后用javaapi去链接的时候。一直报上面的信息。  可是我并不知道是哪里出了问题。

daohaoisbibi 发表于 2017-2-23 16:57
我知道zk是必须的。我遇到的问题是： 我hbase配置了kerberos。 然后用javaapi去链接的时候。一直报上面的 ...

在core-site.xml文件中添加如下内容
<property>  
        <name>fs.hdfs.impl</name>  
        <value>org.apache.hadoop.hdfs.DistributedFileSystem</value>  
        <description>The FileSystem for hdfs: uris.</description>  
</property>  
<property>  
        <name>fs.file.impl</name>  
        <value>org.apache.hadoop.fs.LocalFileSystem</value>  
        <description>The FileSystem for hdfs: uris.</description>  
</property>  
生效后，再试试