Hadoop生态圈-zookeeper本地搭建以及常用命令介绍
Hadoop生态圈-zookeeper本地搭建以及常用命令介绍
作者:尹正杰
版权声明:原创作品,谢绝转载!否则将追究法律责任。
一.下载zookeeper软件
下载地址:https://www.apache.org/dyn/closer.cgi/zookeeper/
二.安装zookeeper
1>.解压源文件
[yinzhengjie@s101 ~]$ tar zxf zookeeper-3.4.12.tar.gz -C /soft/
2>.创建软连接
[yinzhengjie@s101 ~]$ ln -s /soft/zookeeper-3.4.12/ /soft/zk
3>.配置环境变量
[yinzhengjie@s101 ~]$ tail -3 /etc/profile #ADD zooKeeper ZOOKEEPER=/soft/zk PATH=$PATH:$ZOOKEEPER/bin [yinzhengjie@s101 ~]$
4>.使配置的环境变量生效
[yinzhengjie@s101 ~]$ source /etc/profile
三.启动zookeeper服务
1>.创建出zookeeper配置文件(我们这里直接把配置文件拷贝过来就好)
[yinzhengjie@s101 ~]$ cp /soft/zk/conf/zoo_sample.cfg /soft/zk/conf/zoo.cfg
2>.启动zookeeper
[yinzhengjie@s101 ~]$ zkServer.sh start ZooKeeper JMX enabled by default Using config: /soft/zk/bin/../conf/zoo.cfg Starting zookeeper ... STARTED [yinzhengjie@s101 ~]$
3>.检查是否启动成功
[yinzhengjie@s101 ~]$ netstat -untalp | grep 2181 (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) tcp6 0 0 :::2181 :::* LISTEN 2377/java [yinzhengjie@s101 ~]$
4>.启动成功后zookeeper有个QuorumPeerMain进程
[yinzhengjie@s101 ~]$ jps 2377 QuorumPeerMain 2396 Jps [yinzhengjie@s101 ~]$
四.zookeeper服务端脚本用法
1>.查看服务的状态,我们这是本地模式,显示的状态为standalone
[yinzhengjie@s101 ~]$ zkServer.sh status ZooKeeper JMX enabled by default Using config: /soft/zk/bin/../conf/zoo.cfg Mode: standalone [yinzhengjie@s101 ~]$
2>.重启zookeeper服务
[yinzhengjie@s101 ~]$ zkServer.sh restart ZooKeeper JMX enabled by default Using config: /soft/zk/bin/../conf/zoo.cfg ZooKeeper JMX enabled by default Using config: /soft/zk/bin/../conf/zoo.cfg Stopping zookeeper ... STOPPED ZooKeeper JMX enabled by default Using config: /soft/zk/bin/../conf/zoo.cfg Starting zookeeper ... STARTED [yinzhengjie@s101 ~]$
3>.停止zookeeper服务
[yinzhengjie@s101 ~]$ zkServer.sh stop ZooKeeper JMX enabled by default Using config: /soft/zk/bin/../conf/zoo.cfg Stopping zookeeper ... STOPPED [yinzhengjie@s101 ~]$
4>.zookeeper服务端的其他用法
[yinzhengjie@s101 ~]$ zkServer.sh ZooKeeper JMX enabled by default Using config: /soft/zk/bin/../conf/zoo.cfg Usage: /soft/zk/bin/zkServer.sh {start|start-foreground|stop|restart|status|upgrade|print-cmd} [yinzhengjie@s101 ~]$
五.zookeeper客户端脚本用法
1>.连接客户端(连接成功后需要敲回车执行你需要执行的命令哟!,如果只连接本地的zookeeper的话,直接在命令行输入zkCli.sh即可)
[yinzhengjie@s101 ~]$ zkCli.sh -server localhost:2181 Connecting to localhost:2181 2018-05-28 20:36:33,351 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.12-e5259e437540f349646870ea94dc2658c4e44b3b, built on 03/27/2018 03:55 GMT 2018-05-28 20:36:33,354 [myid:] - INFO [main:Environment@100] - Client environment:host.name=s101 2018-05-28 20:36:33,354 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.8.0_131 2018-05-28 20:36:33,356 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation 2018-05-28 20:36:33,356 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/soft/jdk1.8.0_131/jre 2018-05-28 20:36:33,356 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/soft/zk/bin/../build/classes:/soft/zk/bin/../build/lib/*.jar:/soft/zk/bin/../lib/slf4j-log4j12-1.7.25.jar:/soft/zk/bin/../lib/slf4j-api-1.7.25.jar:/soft/zk/bin/../lib/netty-3.10.6.Final.jar:/soft/zk/bin/../lib/log4j-1.2.17.jar:/soft/zk/bin/../lib/jline-0.9.94.jar:/soft/zk/bin/../lib/audience-annotations-0.5.0.jar:/soft/zk/bin/../zookeeper-3.4.12.jar:/soft/zk/bin/../src/java/lib/*.jar:/soft/zk/bin/../conf: 2018-05-28 20:36:33,356 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA> 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=amd64 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:os.version=3.10.0-327.el7.x86_64 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:user.name=yinzhengjie 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/home/yinzhengjie 2018-05-28 20:36:33,357 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/home/yinzhengjie 2018-05-28 20:36:33,358 [myid:] - INFO [main:ZooKeeper@441] - Initiating client connection, connectString=localhost:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@277050dc Welcome to ZooKeeper! 2018-05-28 20:36:33,378 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1028] - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) JLine support is enabled 2018-05-28 20:36:33,439 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@878] - Socket connection established to localhost/0:0:0:0:0:0:0:1:2181, initiating session 2018-05-28 20:36:33,446 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1302] - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x10000b217fa0001, negotiated timeout = 30000WATCHER::WatchedEvent state:SyncConnected type:None path:null [zk: localhost:2181(CONNECTED) 0] [zk: localhost:2181(CONNECTED) 0]
[yinzhengjie@s101 ~]$ zkCli.sh -server localhost:2181
2>.查看帮助信息(其实你输入任何一条没有特殊含义的指令都会弹出帮助信息哟)
[zk: localhost:2181(CONNECTED) 0] help ZooKeeper -server host:port cmd args stat path [watch] set path data [version] ls path [watch] delquota [-n|-b] path ls2 path [watch] setAcl path acl setquota -n|-b val path history redo cmdno printwatches on|off delete path [version] sync path listquota path rmr path get path [watch] create [-s] [-e] path data acl addauth scheme auth quit getAcl path close connect host:port [zk: localhost:2181(CONNECTED) 1]
[zk: localhost:2181(CONNECTED) 0] help
3>.列出"/"下的节点
[zk: localhost:2181(CONNECTED) 2] ls / [zookeeper] [zk: localhost:2181(CONNECTED) 3]
[zk: localhost:2181(CONNECTED) 2] ls /
4>.创建“name”节点,并添加数据“yinzhengjie”
[zk: localhost:2181(CONNECTED) 3] create /name yinzhengjie Created /name [zk: localhost:2181(CONNECTED) 4]
[zk: localhost:2181(CONNECTED) 3] create /name yinzhengjie
5>.创建空节点
[zk: localhost:2181(CONNECTED) 4] create /hadoop '' Created /hadoop [zk: localhost:2181(CONNECTED) 5]
[zk: localhost:2181(CONNECTED) 4] create /hadoop ''
6>.查看“/name”节点的数据
[zk: localhost:2181(CONNECTED) 5] get /name yinzhengjie cZxid = 0x900000009 //(create)节点创建事务的id ctime = Thu May 31 08:47:48 CST 2018 //创建时间 mZxid = 0x900000009 //(modify)节点修改事务的id mtime = Thu May 31 08:47:48 CST 2018 //(modify)时间,当当前节点被修改时时间会跟着变化 pZxid = 0x900000009 //最新子节点的CZxid cversion = 0 //创建的版本号 dataVersion = 0 //删除时指定此版本 aclVersion = 0 //ACL : Access Control List ephemeralOwner = 0x0 //临时拥有者 dataLength = 0 //数据长度 numChildren = 0 //子节点个数 [zk: localhost:2181(CONNECTED) 6]
[zk: localhost:2181(CONNECTED) 5] get /name
7>.设置根节点数据为“yinzhengjie”
[zk: localhost:2181(CONNECTED) 6] set / yinzhengjie cZxid = 0x0 ctime = Wed Dec 31 16:00:00 PST 1969 mZxid = 0xa mtime = Mon May 28 20:43:47 PDT 2018 pZxid = 0x9 cversion = 1 dataVersion = 1 aclVersion = 0 ephemeralOwner = 0x0 dataLength = 11 numChildren = 3 [zk: localhost:2181(CONNECTED) 7]
[zk: localhost:2181(CONNECTED) 6] set / yinzhengjie
8>.删除单个节点
[zk: localhost:2181(CONNECTED) 7] ls / [name, hadoop, zookeeper] [zk: localhost:2181(CONNECTED) 8] ls /hadoop [] [zk: localhost:2181(CONNECTED) 9] delete /hadoop [zk: localhost:2181(CONNECTED) 10] [zk: localhost:2181(CONNECTED) 10] ls / [name, zookeeper] [zk: localhost:2181(CONNECTED) 11]
[zk: localhost:2181(CONNECTED) 9] delete /hadoop
9>.递归删除节点
[zk: localhost:2181(CONNECTED) 17] ls / [name, zookeeper] [zk: localhost:2181(CONNECTED) 18] [zk: localhost:2181(CONNECTED) 18] create /name/zookeeper zk Created /name/zookeeper [zk: localhost:2181(CONNECTED) 19] ls / [name, zookeeper] [zk: localhost:2181(CONNECTED) 20] ls /name [zookeeper] [zk: localhost:2181(CONNECTED) 21] [zk: localhost:2181(CONNECTED) 21] rmr /name [zk: localhost:2181(CONNECTED) 22] [zk: localhost:2181(CONNECTED) 22] ls / [zookeeper] [zk: localhost:2181(CONNECTED) 23]
[zk: localhost:2181(CONNECTED) 21] rmr /name
10>.退出客户端程序
[zk: localhost:2181(CONNECTED) 23] quit Quitting... 2018-05-28 20:50:21,796 [myid:] - INFO [main:ZooKeeper@687] - Session: 0x10000b217fa0004 closed 2018-05-28 20:50:21,798 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@521] - EventThread shut down for session: 0x10000b217fa0004 [yinzhengjie@s101 ~]$ [yinzhengjie@s101 ~]$
[zk: localhost:2181(CONNECTED) 23] quit
六.配置文件简介
1>.日志文件(zookeeper.out)
2>.核心配置文件(/soft/zk/conf/zoo.cfg)
Hadoop生态圈-zookeeper本地搭建以及常用命令介绍相关推荐
- Hadoop生态圈-Zookeeper的工作原理分析
Hadoop生态圈-Zookeeper的工作原理分析 作者:尹正杰 版权声明:原创作品,谢绝转载!否则将追究法律责任. 无论是是Kafka集群,还是producer和consumer都依赖于Zoo ...
- Hadoop 学习笔记(三)常用命令
Hadoop 学习笔记(三)常用命令 进入HADOOP_HOME目录. 执行sh bin/start-all.sh 进入HADOOP_HOME目录. 执行sh bin/stop-all.sh Usag ...
- Hadoop常用命令介绍
下面分享一篇 常用的Hadoop命令介绍,希望对Hadoop初学者的朋友有所帮助~ Hadoop常用命令介绍
- linux系统防火墙相关问题及常用命令介绍
今天介绍关于linux系统防火墙:centos5.centos6.redhat6系统自带的是iptables防火墙,centos7.redhat7自带firewall防火墙,ubuntu系统使用的是u ...
- alsa-util常用命令介绍
目录 版本获取 前言 常用命令介绍 amixer aplay arecord 前言 我们在audio启动调试的时候,经常会遇到这样一个问题,就是我们调试时间很紧迫,并且所有的组件都在开机调试,有可能这 ...
- Linux中sysstat服务,Linux sysstat常用命令介绍
一.sysstat 软件安装 下载sysstat软件包,解压 tar zxvf *.tar.gz ./configure make make install 二.sar 命令介绍 sar -h 用法: ...
- php基础命令,PHP命令行下的11个常用命令介绍
本文整理了PHP命令行下的11个常用命令,下面介绍给大家,它们分别是php -m.php -v.php --ini.php -h.php --info.php --rf .php --rc .php ...
- Hadoop的集群搭建及HDFS命令
环境信息 1. 硬件: 内存ddr3 4G及以上的x86架构主机一部 系统环境:windows 2. 软件: virtualbox 3. 其他: 无 步骤与方法 1. 安装Hadoop并进行集群搭建 ...
- ZooKeeper入门之数据模型和常用命令介绍
1.zookeeper简介 1.1 什么是zookeeper zookeeper官网:https://zookeeper.apache.org/ ZooKeeper是一个分布式的,开放源码的分布式应用 ...
最新文章
- app-》h5同步身份
- 【洛谷P3846】【TJOI2007】—可爱的质数(BSGS模板)
- centOS7 Minima无法上网解决方案(Linux设置开机自动获取ip地址)
- 官网快速搭建spring boot 项目
- 2.2tensorflow2官方demo
- php实现父子评论,关于php:将一系列父子关系转换为层次树?
- 百度地图iOS API
- matlab中std函数怎么写,Matlab中求均值和标准差的函数分别是mean(x)和std(x)。
- python三维可视化图,如何使用Python在(交互式)3D中可视化图形?
- mysql5.6设置日志路径_mysql5.6.12切换binlog二进制日志路径_MySQL
- YouTube视频数据分析报告
- python爬取豆丁网文章_百度文库爬取分析 - osc_tgjycqas的个人空间 - OSCHINA - 中文开源技术交流社区...
- LoRa网关实现水表抄表无线远程数采方案
- M3DGIS三维数字沙盘开发教程第51课可视化交互大数据地理信息系统开发教程第51课
- 最新PyCharm基本使用(3)------编码(Code)、重构(Refactor)
- 神经网络基础原理(三)-----分类问题实弹演练及一些小干货
- 石油大学个人训练赛(一)补题----问题 A: 斗地主
- 文明重启哪个服务器最多,文明重启攻略 新手快速霸服技巧分享[多图]
- 《MySQL安装流程详解》及《MySQL安装一直失败,重新安装显示已安装》
- OpenCV的区域分割、轮廓检测和阈值处理