图文精华

About云-梭伦科技»专题 › 技术学习(版主发帖区) › 大数据学习 › ZooKeeper › 安装配置› ZooKeeper介绍、伪分布式集群安装及使用
分享

ZooKeeper介绍、伪分布式集群安装及使用

pig2 2014-9-10 12:40:54 发表于 安装配置 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 13 43976
问题导读：
1.什么是zookeeper
2.zookeeper有几种安装方式？
3.zookeeper伪分布如何配置myid？
4.zookeeper包含哪些常用操作命令？




前言
ZooKeeper是Hadoop家族的一款高性能的分布式协作的产品。在单机中，系统协作大都是进程级的操作。分布式系统中，服务协作都是跨服务器才能完成的。在ZooKeeper之前，我们对于协作服务大都使用消息中间件，随着分布式系统的普及，用消息中间件完成协作，会有大量的程序开发。ZooKeeper直接面向于分布式系统，可以减少我们自己的开发，帮助我们更好完成分布式系统的数据管理问题。
目录
  • zookeeper介绍
  • zookeeper单节点安装
  • zookeeper伪分布式集群安装
  • zookeeper命令行操作
  • Java编程现实命令行操作
1. zookeeper介绍
ZooKeeper是一个为分布式应用所设计的分布的、开源的协调服务，它主要是用来解决分布式应用中经常遇到的一些数据管理问题，简化分布式应用协调及其管理的难度，提供高性能的分布式服务。ZooKeeper本身可以以Standalone模式安装运行，不过它的长处在于通过分布式ZooKeeper集群（一个Leader，多个Follower），基于一定的策略来保证ZooKeeper集群的稳定性和可用性，从而实现分布式应用的可靠性。
ZooKeeper是作为分布式协调服务，是不需要依赖于Hadoop的环境，也可以为其他的分布式环境提供服务。
2. zookeeper单节点安装Standalones模式
系统环境：
Linux Ubuntu 12.04.2 LTS 64bit server
Java: 1.6.0_29 64-Bit Server VM

  1. ~ uname -a

  2. Linux conan 3.5.0-23-generic #35~precise1-Ubuntu SMP Fri Jan 25 17:13:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

  3. 

  4. ~ cat /etc/issue

  5. Ubuntu 12.04.2 LTS \n \l

  6. 

  7. ~ java -version

  8. java version "1.6.0_29"

  9. Java(TM) SE Runtime Environment (build 1.6.0_29-b11)

  10. Java HotSpot(TM) 64-Bit Server VM (build 20.4-b02, mixed mode)
复制代码

下载zookeeper

  1. ~ mkdir /home/conan/toolkit

  2. ~ cd /home/conan/toolkit

  3. ~ wget http://apache.dataguru.cn/zookeeper/stable/zookeeper-3.4.5.tar.gz

  4. ~ tar xvf zookeeper-3.4.5.tar.gz

  5. ~ mv zookeeper-3.4.5 zookeeper345

  6. ~ cd zookeeper345

  7. ~ ls -l

  8. drwxr-xr-x  2 conan conan    4096 Aug 12 04:34 bin

  9. -rw-r--r--  1 conan conan   75988 Aug 12 04:34 build.xml

  10. -rw-r--r--  1 conan conan   70223 Aug 12 04:34 CHANGES.txt

  11. drwxr-xr-x  2 conan conan    4096 Aug 12 04:34 conf

  12. drwxr-xr-x 10 conan conan    4096 Aug 12 04:34 contrib

  13. drwxr-xr-x  2 conan conan    4096 Aug 12 04:34 dist-maven

  14. drwxr-xr-x  6 conan conan    4096 Aug 12 04:34 docs

  15. -rw-r--r--  1 conan conan    1953 Aug 12 04:34 ivysettings.xml

  16. -rw-r--r--  1 conan conan    3120 Aug 12 04:34 ivy.xml

  17. drwxr-xr-x  4 conan conan    4096 Aug 12 04:34 lib

  18. -rw-r--r--  1 conan conan   11358 Aug 12 04:34 LICENSE.txt

  19. -rw-r--r--  1 conan conan     170 Aug 12 04:34 NOTICE.txt

  20. -rw-r--r--  1 conan conan    1770 Aug 12 04:34 README_packaging.txt

  21. -rw-r--r--  1 conan conan    1585 Aug 12 04:34 README.txt

  22. drwxr-xr-x  5 conan conan    4096 Aug 12 04:34 recipes

  23. drwxr-xr-x  8 conan conan    4096 Aug 12 04:34 src

  24. -rw-r--r--  1 conan conan 1315806 Aug 12 04:34 zookeeper-3.4.5.jar

  25. -rw-r--r--  1 conan conan     833 Aug 12 04:34 zookeeper-3.4.5.jar.asc

  26. -rw-r--r--  1 conan conan      33 Aug 12 04:34 zookeeper-3.4.5.jar.md5

  27. -rw-r--r--  1 conan conan      41 Aug 12 04:34 zookeeper-3.4.5.jar.sha1
复制代码

修改配置文件conf/zoo.cfg

  1. ~ mkdir /home/conan/zoo/zk0

  2. ~ cp conf/zoo_sample.cfg conf/zoo.cfg

  3. 

  4. ~ vi conf/zoo.cfg

  5. tickTime=2000

  6. initLimit=10

  7. syncLimit=5

  8. dataDir=/home/conan/zoo/zk0

  9. clientPort=2181
复制代码

非常简单，我们已经配置好了的zookeeper单节点
启动zookeeper
  1. ~ bin/zkServer.sh

  2. JMX enabled by default

  3. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg

  4. Usage: bin/zkServer.sh {start|start-foreground|stop|restart|status|upgrade|print-cmd}

  5. conan@conan:~/zoo/zk0/zookeeper345$ bin/zkServer.sh start

  6. JMX enabled by default

  7. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg

  8. Starting zookeeper ... STARTED

  9. 

  10. #zk的服务显示为QuorumPeerMain

  11. ~ jps

  12. 5321 QuorumPeerMain

  13. 5338 Jps

  14. 

  15. #查看运行状态

  16. ~ bin/zkServer.sh status

  17. JMX enabled by default

  18. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg

  19. Mode: standalone
复制代码


单节点的时，Mode会显示为standalone
停止ZooKeeper服务
  1. ~ bin/zkServer.sh stop

  2. JMX enabled by default

  3. Using config: /home/conan/zoo/zk0/zookeeper345/bin/../conf/zoo.cfg

  4. Stopping zookeeper ... STOPPED
复制代码


3. zookeeper伪分布式集群安装
所谓 “伪分布式集群” 就是在，在一台PC中，启动多个ZooKeeper的实例。“完全分布式集群” 是每台PC，启动一个ZooKeeper实例。
由于我的测试环境PC数量有限，所以在一台PC中，启动3个ZooKeeper的实例。
创建环境目录
  1. ~ mkdir /home/conan/zoo/zk1

  2. ~ mkdir /home/conan/zoo/zk2

  3. ~ mkdir /home/conan/zoo/zk3

  4. 

  5. #新建myid文件

  6. ~ echo "1" > /home/conan/zoo/zk1/myid

  7. ~ echo "2" > /home/conan/zoo/zk2/myid

  8. ~ echo "3" > /home/conan/zoo/zk3/myid
复制代码

分别修改配置文件
修改：dataDir,clientPort
增加：集群的实例，server.X，”X”表示每个目录中的myid的值
  1. ~ vi /home/conan/toolkit/zookeeper345/conf/zk1.cfg

  2. tickTime=2000

  3. initLimit=10

  4. syncLimit=5

  5. dataDir=/home/conan/zoo/zk1

  6. clientPort=2181

  7. server.1=192.168.1.201:2888:3888

  8. server.2=192.168.1.201:2889:3889

  9. server.3=192.168.1.201:2890:3890

  10. 

  11. ~ vi /home/conan/toolkit/zookeeper345/conf/zk2.cfg

  12. tickTime=2000

  13. initLimit=10

  14. syncLimit=5

  15. dataDir=/home/conan/zoo/zk2

  16. clientPort=2182

  17. server.1=192.168.1.201:2888:3888

  18. server.2=192.168.1.201:2889:3889

  19. server.3=192.168.1.201:2890:3890

  20. 

  21. ~ vi /home/conan/toolkit/zookeeper345/conf/zk3.cfg

  22. tickTime=2000

  23. initLimit=10

  24. syncLimit=5

  25. dataDir=/home/conan/zoo/zk3

  26. clientPort=2183

  27. server.1=192.168.1.201:2888:3888

  28. server.2=192.168.1.201:2889:3889

  29. server.3=192.168.1.201:2890:3890
复制代码


3个节点的ZooKeeper集群配置完成，接下来我们的启动服务。
启动集群
  1. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh start zk1.cfg

  2. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh start zk2.cfg

  3. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh start zk3.cfg

  4. 

  5. ~ jps

  6. 5422 QuorumPeerMain

  7. 5395 QuorumPeerMain

  8. 5463 QuorumPeerMain

  9. 5494 Jps

  10. 

  11. #查看节点状态

  12. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh status zk1.cfg

  13. JMX enabled by default

  14. Using config: /home/conan/toolkit/zookeeper345/bin/../conf/zk1.cfg

  15. Mode: follower

  16. 

  17. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh status zk2.cfg

  18. JMX enabled by default

  19. Using config: /home/conan/toolkit/zookeeper345/bin/../conf/zk2.cfg

  20. Mode: leader

  21. 

  22. ~ /home/conan/toolkit/zookeeper345/bin/zkServer.sh status zk3.cfg

  23. JMX enabled by default

  24. Using config: /home/conan/toolkit/zookeeper345/bin/../conf/zk3.cfg

  25. Mode: follower
复制代码


我们可以看到zk2是leader，zk1和zk3是follower
查看ZooKeeper物理文件目录结构
  1. ~ tree  -L 3 /home/conan/zoo

  2. /home/conan/zoo

  3. ├── zk0

  4. ├── zk1

  5. │   ├── myid

  6. │   ├── version-2

  7. │   │   ├── acceptedEpoch

  8. │   │   ├── currentEpoch

  9. │   │   ├── log.100000001

  10. │   │   └── snapshot.0

  11. │   └── zookeeper_server.pid

  12. ├── zk2

  13. │   ├── myid

  14. │   ├── version-2

  15. │   │   ├── acceptedEpoch

  16. │   │   ├── currentEpoch

  17. │   │   ├── log.100000001

  18. │   │   └── snapshot.0

  19. │   └── zookeeper_server.pid

  20. └── zk3

  21.     ├── myid

  22.     ├── version-2

  23.     │   ├── acceptedEpoch

  24.     │   ├── currentEpoch

  25.     │   ├── log.100000001

  26.     │   └── snapshot.100000000

  27.     └── zookeeper_server.pid

  28. 

  29. 7 directories, 18 files
复制代码


4. zookeeper命令行操作
我们通过客户端连接ZooKeeper的集群，我们可以任意的zookeeper是进行连接。
  1. ~ /home/conan/toolkit/zookeeper345/bin/zkCli.sh -server 192.168.1.201:2181

  2. 

  3. Connecting to 192.168.1.201

  4. 2013-08-12 05:25:39,260 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT

  5. 2013-08-12 05:25:39,267 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=conan

  6. 2013-08-12 05:25:39,269 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.6.0_29

  7. 2013-08-12 05:25:39,269 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Sun Microsystems Inc.

  8. 2013-08-12 05:25:39,270 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/home/conan/toolkit/jdk16/jre

  9. 2013-08-12 05:25:39,270 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/home/conan/toolkit/zookeeper345/bin/../build/classes:/home/conan/toolkit/zookeeper345/bin/../build/lib/*.jar:/home/conan/toolkit/zookeeper345/bin/../lib/slf4j-log4j12-1.6.1.jar:/home/conan/toolkit/zookeeper345/bin/../lib/slf4j-api-1.6.1.jar:/home/conan/toolkit/zookeeper345/bin/../lib/netty-3.2.2.Final.jar:/home/conan/toolkit/zookeeper345/bin/../lib/log4j-1.2.15.jar:/home/conan/toolkit/zookeeper345/bin/../lib/jline-0.9.94.jar:/home/conan/toolkit/zookeeper345/bin/../zookeeper-3.4.5.jar:/home/conan/toolkit/zookeeper345/bin/../src/java/lib/*.jar:/home/conan/toolkit/zookeeper345/bin/../conf:

  10. 2013-08-12 05:25:39,271 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/home/conan/toolkit/jdk16/jre/lib/amd64/server:/home/conan/toolkit/jdk16/jre/lib/amd64:/home/conan/toolkit/jdk16/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

  11. 2013-08-12 05:25:39,275 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp

  12. 2013-08-12 05:25:39,276 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=

  13. 2013-08-12 05:25:39,276 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux

  14. 2013-08-12 05:25:39,277 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64

  15. 2013-08-12 05:25:39,281 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.5.0-23-generic

  16. 2013-08-12 05:25:39,282 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=conan

  17. 2013-08-12 05:25:39,282 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/home/conan

  18. 2013-08-12 05:25:39,283 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/home/conan/zoo

  19. 2013-08-12 05:25:39,284 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=192.168.1.201 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@22ba6c83

  20. Welcome to ZooKeeper!

  21. JLine support is enabled

  22. [zk: 192.168.1.201(CONNECTING) 0] 2013-08-12 05:25:39,336 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@966] - Opening socket connection to server 192.168.1.201/192.168.1.201:2181. Will not attempt to authenticate using SASL (Unable to locate a login configuration)

  23. 2013-08-12 05:25:39,345 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@849] - Socket connection established to 192.168.1.201/192.168.1.201:2181, initiating session

  24. 2013-08-12 05:25:39,384 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@1207] - Session establishment complete on server 192.168.1.201/192.168.1.201:2181, sessionid = 0x1406f3c1ef90001, negotiated timeout = 30000

  25. 

  26. WATCHER::

  27. 

  28. WatchedEvent state:SyncConnected type:None path:null

  29. 

  30. [zk: 192.168.1.201(CONNECTED) 0]
复制代码


集群已连接，下面我们要使用一下，ZooKeeper的命令行操作。
命令行操作
通过help打印命令行帮助
  1. [zk: 192.168.1.201(CONNECTED) 1] help

  2. ZooKeeper -server host:port cmd args

  3.         connect host:port

  4.         get path [watch]

  5.         ls path [watch]

  6.         set path data [version]

  7.         rmr path

  8.         delquota [-n|-b] path

  9.         quit

  10.         printwatches on|off

  11.         create [-s] [-e] path data acl

  12.         stat path [watch]

  13.         close

  14.         ls2 path [watch]

  15.         history

  16.         listquota path

  17.         setAcl path acl

  18.         getAcl path

  19.         sync path

  20.         redo cmdno

  21.         addauth scheme auth

  22.         delete path [version]

  23.         setquota -n|-b val path
复制代码

ZooKeeper的结构，很像是目录结构，我们看到了像ls这样熟悉的命令。
  1. #ls,查看/目录内容

  2. [zk: 192.168.1.201(CONNECTED) 1] ls /

  3. [zookeeper]

  4. 

  5. #create,创建一个znode节点

  6. [zk: 192.168.1.201(CONNECTED) 2] create /node conan

  7. Created /node

  8. 

  9. #ls,再查看/目录

  10. [zk: 192.168.1.201(CONNECTED) 3] ls /

  11. [node, zookeeper]

  12. 

  13. #get,查看/node的数据信息

  14. [zk: 192.168.1.201(CONNECTED) 4] get /node

  15. conan

  16. cZxid = 0x100000006

  17. ctime = Mon Aug 12 05:32:49 CST 2013

  18. mZxid = 0x100000006

  19. mtime = Mon Aug 12 05:32:49 CST 2013

  20. pZxid = 0x100000006

  21. cversion = 0

  22. dataVersion = 0

  23. aclVersion = 0

  24. ephemeralOwner = 0x0

  25. dataLength = 5

  26. numChildren = 0

  27. 

  28. #set,修改数据

  29. [zk: 192.168.1.201(CONNECTED) 5] set /node fens.me

  30. cZxid = 0x100000006

  31. ctime = Mon Aug 12 05:32:49 CST 2013

  32. mZxid = 0x100000007

  33. mtime = Mon Aug 12 05:34:32 CST 2013

  34. pZxid = 0x100000006

  35. cversion = 0

  36. dataVersion = 1

  37. aclVersion = 0

  38. ephemeralOwner = 0x0

  39. dataLength = 7

  40. numChildren = 0

  41. 

  42. #get,再查看/node的数据信息，已改为fens.me

  43. [zk: 192.168.1.201(CONNECTED) 6] get /node

  44. fens.me

  45. cZxid = 0x100000006

  46. ctime = Mon Aug 12 05:32:49 CST 2013

  47. mZxid = 0x100000007

  48. mtime = Mon Aug 12 05:34:32 CST 2013

  49. pZxid = 0x100000006

  50. cversion = 0

  51. dataVersion = 1

  52. aclVersion = 0

  53. ephemeralOwner = 0x0

  54. dataLength = 7

  55. numChildren = 0

  56. 

  57. #delete,删除/node

  58. [zk: 192.168.1.201(CONNECTED) 7] delete /node

  59. [zk: 192.168.1.201(CONNECTED) 8] ls /

  60. [zookeeper]

  61. 

  62. #quit,退出客户端连接

  63. [zk: 192.168.1.201(CONNECTED) 19] quit

  64. Quitting...

  65. 2013-08-12 05:40:29,304 [myid:] - INFO  [main:ZooKeeper@684] - Session: 0x1406f3c1ef90002 closed

  66. 2013-08-12 05:40:29,305 [myid:] - INFO  [main-EventThread:ClientCnxn$EventThread@509] - EventThread shut down
复制代码


5. Java编程现实命令行操作
  1. package org.conan.zookeeper.demo;

  2. 

  3. import java.io.IOException;

  4. 

  5. import org.apache.zookeeper.CreateMode;

  6. import org.apache.zookeeper.KeeperException;

  7. import org.apache.zookeeper.WatchedEvent;

  8. import org.apache.zookeeper.Watcher;

  9. import org.apache.zookeeper.ZooDefs.Ids;

  10. import org.apache.zookeeper.ZooKeeper;

  11. 

  12. public class BasicDemo1 {

  13. 

  14.     public static void main(String[] args) throws IOException, KeeperException, InterruptedException {

  15.         // 创建一个与服务器的连接

  16.         ZooKeeper zk = new ZooKeeper("192.168.1.201:2181", 60000, new Watcher() {

  17.             // 监控所有被触发的事件

  18.             public void process(WatchedEvent event) {

  19.                 System.out.println("EVENT:" + event.getType());

  20.             }

  21.         });

  22. 

  23.         // 查看根节点

  24.         System.out.println("ls / => " + zk.getChildren("/", true));

  25. 

  26.         // 创建一个目录节点

  27.         if (zk.exists("/node", true) == null) {

  28.             zk.create("/node", "conan".getBytes(), Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT);

  29.             System.out.println("create /node conan");

  30.             // 查看/node节点数据

  31.             System.out.println("get /node => " + new String(zk.getData("/node", false, null)));

  32.             // 查看根节点

  33.             System.out.println("ls / => " + zk.getChildren("/", true));

  34.         }

  35. 

  36.         // 创建一个子目录节点

  37.         if (zk.exists("/node/sub1", true) == null) {

  38.             zk.create("/node/sub1", "sub1".getBytes(), Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT);

  39.             System.out.println("create /node/sub1 sub1");

  40.             // 查看node节点

  41.             System.out.println("ls /node => " + zk.getChildren("/node", true));

  42.         }

  43. 

  44.         // 修改节点数据

  45.         if (zk.exists("/node", true) != null) {

  46.             zk.setData("/node", "changed".getBytes(), -1);

  47.             // 查看/node节点数据

  48.             System.out.println("get /node => " + new String(zk.getData("/node", false, null)));

  49.         }

  50. 

  51.         // 删除节点

  52.         if (zk.exists("/node/sub1", true) != null) {

  53.             zk.delete("/node/sub1", -1);

  54.             zk.delete("/node", -1);

  55.             // 查看根节点

  56.             System.out.println("ls / => " + zk.getChildren("/", true));

  57.         }

  58. 

  59.         // 关闭连接

  60.         zk.close();

  61.     }

  62. }
复制代码

运行结果：
  1. 2013-08-12 15:33:29,699 [myid:] - INFO  [main:Environment@97] - Client environment:zookeeper.version=3.3.1-942149, built on 05/07/2010 17:14 GMT

  2. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:host.name=PC201304202140

  3. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:java.version=1.6.0_45

  4. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:java.vendor=Sun Microsystems Inc.

  5. 2013-08-12 15:33:29,702 [myid:] - INFO  [main:Environment@97] - Client environment:java.home=D:\toolkit\java\jdk6\jre

  6. 2013-08-12 15:33:29,703 [myid:] - INFO  [main:Environment@97] - Client environment:java.class.path=D:\workspace\java\zkdemo\target\classes;C:\Users\Administrator\.m2\repository\org\apache\hadoop\zookeeper\3.3.1\zookeeper-3.3.1.jar;C:\Users\Administrator\.m2\repository\log4j\log4j\1.2.15\log4j-1.2.15.jar;C:\Users\Administrator\.m2\repository\javax\mail\mail\1.4\mail-1.4.jar;C:\Users\Administrator\.m2\repository\javax\activation\activation\1.1\activation-1.1.jar;C:\Users\Administrator\.m2\repository\jline\jline\0.9.94\jline-0.9.94.jar;C:\Users\Administrator\.m2\repository\junit\junit\3.8.1\junit-3.8.1.jar

  7. 2013-08-12 15:33:29,703 [myid:] - INFO  [main:Environment@97] - Client environment:java.library.path=D:\toolkit\java\jdk6\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;D:\toolkit\Rtools\bin;D:\toolkit\Rtools\gcc-4.6.3\bin;C:\Program Files (x86)\Common Files\NetSarang;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;D:\toolkit\Git\cmd;D:\toolkit\Git\bin;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;c:\Program Files (x86)\Common Files\Ulead Systems\MPEG;C:\Program Files (x86)\QuickTime\QTSystem\;D:\toolkit\MiKTex\miktex\bin\x64\;D:\toolkit\sshclient;D:\toolkit\ant19\bin;D:\toolkit\eclipse;D:\toolkit\gradle15\bin;D:\toolkit\java\jdk6\bin;D:\toolkit\maven3\bin;D:\toolkit\mysql56\bin;D:\toolkit\python27;D:\toolkit\putty;C:\Program Files\R\R-3.0.1\bin\x64;D:\toolkit\mongodb243\bin;D:\toolkit\php54;D:\toolkit\nginx140;D:\toolkit\nodejs;D:\toolkit\npm12\bin;D:\toolkit\java\jdk6\jre\bin\server;.

  8. 2013-08-12 15:33:29,703 [myid:] - INFO  [main:Environment@97] - Client environment:java.io.tmpdir=C:\Users\ADMINI~1\AppData\Local\Temp\

  9. 2013-08-12 15:33:29,704 [myid:] - INFO  [main:Environment@97] - Client environment:java.compiler=

  10. 2013-08-12 15:33:29,704 [myid:] - INFO  [main:Environment@97] - Client environment:os.name=Windows 7

  11. 2013-08-12 15:33:29,704 [myid:] - INFO  [main:Environment@97] - Client environment:os.arch=amd64

  12. 2013-08-12 15:33:29,705 [myid:] - INFO  [main:Environment@97] - Client environment:os.version=6.1

  13. 2013-08-12 15:33:29,705 [myid:] - INFO  [main:Environment@97] - Client environment:user.name=Administrator

  14. 2013-08-12 15:33:29,705 [myid:] - INFO  [main:Environment@97] - Client environment:user.home=C:\Users\Administrator

  15. 2013-08-12 15:33:29,706 [myid:] - INFO  [main:Environment@97] - Client environment:user.dir=D:\workspace\java\zkdemo

  16. 2013-08-12 15:33:29,707 [myid:] - INFO  [main:ZooKeeper@373] - Initiating client connection, connectString=192.168.1.201:2181 sessionTimeout=60000 watcher=org.conan.zookeeper.demo.BasicDemo1$1@3dfeca64

  17. 2013-08-12 15:33:29,731 [myid:] - INFO  [main-SendThread():ClientCnxn$SendThread@1000] - Opening socket connection to server /192.168.1.201:2181

  18. 2013-08-12 15:33:38,736 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@908] - Socket connection established to 192.168.1.201/192.168.1.201:2181, initiating session

  19. 2013-08-12 15:33:38,804 [myid:] - INFO  [main-SendThread(192.168.1.201:2181):ClientCnxn$SendThread@701] - Session establishment complete on server 192.168.1.201/192.168.1.201:2181, sessionid = 0x1406f3c1ef9000d, negotiated timeout = 60000

  20. EVENT:None

  21. ls / => [zookeeper]

  22. EVENT:NodeCreated

  23. EVENT:NodeChildrenChanged

  24. create /node conan

  25. get /node => conan

  26. ls / => [node, zookeeper]

  27. EVENT:NodeCreated

  28. create /node/sub1 sub1

  29. ls /node => [sub1]

  30. EVENT:NodeDataChanged

  31. get /node => changed

  32. EVENT:NodeDeleted

  33. EVENT:NodeChildrenChanged

  34. EVENT:NodeChildrenChanged

  35. ls / => [zookeeper]

  36. 2013-08-12 15:33:38,877 [myid:] - INFO  [main:ZooKeeper@538] - Session: 0x1406f3c1ef9000d closed
复制代码

pom.xml，maven配置文件
  1. <?xml version="1.0" encoding="UTF-8"?>

  2. <project

  3. xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"

  4. xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">

  5. <modelVersion>4.0.0</modelVersion>

  6. <groupId>org.conan.zookeeper</groupId>

  7. <artifactId>zkdemo</artifactId>

  8. <version>0.0.1</version>

  9. <name>zkdemo</name>

  10. <description>zkdemo</description>

  11. 

  12. <dependencies>

  13. <dependency>

  14. <groupId>org.apache.hadoop</groupId>

  15. <artifactId>zookeeper</artifactId>

  16. <version>3.3.1</version>

  17. <exclusions>

  18. <exclusion>

  19. <groupId>javax.jms</groupId>

  20. <artifactId>jms</artifactId>

  21. </exclusion>

  22. <exclusion>

  23. <groupId>com.sun.jdmk</groupId>

  24. <artifactId>jmxtools</artifactId>

  25. </exclusion>

  26. <exclusion>

  27. <groupId>com.sun.jmx</groupId>

  28. <artifactId>jmxri</artifactId>

  29. </exclusion>

  30. </exclusions>

  31. </dependency>

  32. </dependencies>

  33. </project>
复制代码






http://blog.fens.me/hadoop-zookeeper-intro/


关注公众号，获取大数据、人工智能20套、区块链资源5阶段等资源，随时更新，获取最新技术资源
回复

使用道具 举报

自定义广告语

已有(11)人评论

跳转到指定楼层
正序浏览
linhai1023 发表于 2014-9-10 13:49:42
好东西，学习了，谢楼主
回复

使用道具 举报

茅草屋-单眼皮 发表于 2014-9-11 00:48:14
Linux Ubuntu 12.04.2 LTS 64bit 非SERVER版不可以用吗？
回复

使用道具 举报

pig2 发表于 2014-9-11 00:53:59
茅草屋-单眼皮 发表于 2014-9-11 00:48
Linux Ubuntu 12.04.2 LTS 64bit 非SERVER版不可以用吗？

可以用
回复

使用道具 举报

星星星星笑 发表于 2014-9-18 22:35:35
有没有最新的版本的安装文档？
回复

使用道具 举报

rola 发表于 2014-9-29 14:56:29
楼主的无私奉献真是让人敬佩！
回复

使用道具 举报

轩辕依梦Q 发表于 2014-10-28 22:13:51
多谢版主分享，学习中
回复

使用道具 举报

轩辕依梦Q 发表于 2014-11-1 22:17:08
本帖最后由 轩辕依梦Q 于 2014-11-1 22:24 编辑

版本你好，请教一个问题：一台机器上安装多个zookeeper，那么hbase配置zookeeper端口的时候怎么配置呢？怎么指定那么端口是哪台机器的呢？
回复

使用道具 举报

yunduo 发表于 2014-11-4 09:49:24
我在VMware的3台centos虚拟机安装zookeeper集群遇到这个奇葩问题：[zk: localhost:2181(CONNECTING) 0] 2014-11-02 23:10:11,841 [myid:] - INFO  [main-SendThread(localhost.localdomain:2181):ClientCnxn$SendThread@975] - Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration)
2014-11-02 23:10:11,843 [myid:] - INFO  [main-SendThread(localhost.localdomain:2181):ClientCnxn$SendThread@852] - Socket connection established to localhost.localdomain/127.0.0.1:2181, initiating session
2014-11-02 23:10:11,845 [myid:] - INFO  [main-SendThread(localhost.localdomain:2181):ClientCnxn$SendThread@1098] - Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect。但是同样的配置，换到真实环境3台集群则可以运行成功。我怀疑你是虚拟机ip映射的问题。请问大家有在VMware安装zookeeper成功的吗？我打算在虚拟机安装jstorm学习。因为真实环境不能一直使用。
回复

使用道具 举报

muyannian 发表于 2014-11-4 09:52:09
yunduo 发表于 2014-11-4 09:49
我在VMware的3台centos虚拟机安装zookeeper集群遇到这个奇葩问题：[zk: localhost:2181(CONNECTING) 0] 201 ...
可以使用虚拟机，zookeeper的配置注意机器个数的配置
回复

使用道具 举报

12下一页
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

发表新帖
pig2

超级版主

关注

  • 2332

    主题

  • 3342

    帖子

  • 1972

    粉丝

欢迎大家如about云官方2群322273151，更新咨询，更新资源，随时关注
TA的主题
关闭

推荐上一条 /2 下一条

关于我们· 联系我们· 加入我们· 小黑屋· 合作伙伴   

Copyright © 2001-2024 About云-梭伦科技 Powered by Discuz! X3.4 Licensed Discuz Team.

简书 / Smrz 京ICP备2020039040号 Wxb 简书网举报电话：021-34700000