通过Cloudera Manager部署CDH5.15.1的webUI界面详解

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　 　　作者：尹正杰

版权声明：原创作品，谢绝转载！否则将追究法律责任。

　　本篇博客CDH的部署完全通过Cloudera Manager的webUI的安装向导来完成的，关于CM的部署详情请参考：https://www.cnblogs.com/yinzhengjie/p/9495964.html。

一.安装CHD的服务

1>.CM的webUI界面默认的用户名/密码都是小写的admin,我们输入用户名和密码进行登录。操作如下：

2>.同一CM的协议，点击继续

3>.选择CM的免费版本

4>.点击继续

5>.为 CDH 群集安装指定主机

6>.选择CDH本地版本（即我们自己下载好的版本）

7>.CDH的默认存放路径介绍

8>.当CDH安装完毕后，点击继续

9>.等待检查主机完成

10>.我们可以根据下面的提示去相应的服务器做具体的操作，做完操作后点击“重新运行”以验证你是否配置成功！

11>.解决告警信息后，点击完成

[root@node101 ~]# xcall.sh date -R
============= node101.yinzhengjie.org.cn : date -R ============
Thu, 13 Sep 2018 12:32:15 +0800
命令执行成功
============= node102.yinzhengjie.org.cn : date -R ============
Thu, 13 Sep 2018 12:32:11 +0800
命令执行成功
============= node103.yinzhengjie.org.cn : date -R ============
Thu, 13 Sep 2018 12:32:11 +0800
命令执行成功
[root@node101 ~]#

验证时区是否修改过来了（[root@node101 ~]# xcall.sh date -R）

[root@node101 ~]# xcall.sh "echo 10 > /proc/sys/vm/swappiness"
============= node101.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============
命令执行成功
============= node102.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============
命令执行成功
============= node103.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============
命令执行成功
[root@node101 ~]#
[root@node101 ~]# xcall.sh cat /proc/sys/vm/swappiness
============= node101.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============
10
命令执行成功
============= node102.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============
10
命令执行成功
============= node103.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============
10
命令执行成功
[root@node101 ~]#

[root@node101 ~]# xcall.sh "echo 10 > /proc/sys/vm/swappiness"

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag"
============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============
命令执行成功
============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============
命令执行成功
============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============
命令执行成功
[root@node101 ~]#
[root@node101 ~]# xcall.sh cat  /sys/kernel/mm/transparent_hugepage/defrag
============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============
always madvise [never]
命令执行成功
============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============
always madvise [never]
命令执行成功
============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============
always madvise [never]
命令执行成功
[root@node101 ~]#

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag"

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled"
============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============
命令执行成功
============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============
命令执行成功
============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============
命令执行成功
[root@node101 ~]#
[root@node101 ~]# xcall.sh "cat /sys/kernel/mm/transparent_hugepage/enabled"
============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============
always madvise [never]
命令执行成功
============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============
always madvise [never]
命令执行成功
============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============
always madvise [never]
命令执行成功
[root@node101 ~]#

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled"

12>.自定义需要安装的服务

13>.分配角色

14>.等待审核

15>.集群设置

16>.等待安装完成

17>.完成安装后，点击继续

18>.CDH部署成功界面

19>.进入CDH主界面

 二.验证CHD服务是否可用

1>.验证zookeeper是否可以正常使用

[root@node101 ~]# zookeeper-client -server node101.yinzhengjie.org.cn
Connecting to node101.yinzhengjie.org.cn
2018-09-15 11:26:03,624 [myid:] - INFO  [main:Environment@100] - Client environment:zookeeper.version=3.4.5-cdh5.15.1--1, built on 08/09/2018 16:19 GMT
2018-09-15 11:26:03,628 [myid:] - INFO  [main:Environment@100] - Client environment:host.name=node101.yinzhengjie.org.cn
2018-09-15 11:26:03,628 [myid:] - INFO  [main:Environment@100] - Client environment:java.version=1.8.0_131
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.home=/soft/jdk1.8.0_131/jre
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.class.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/classes:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/lib/*.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf::/etc/zookeeper/conf:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/jline-2.11.jar
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>
2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-327.el7.x86_64
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root
2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/root
2018-09-15 11:26:03,632 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=node101.yinzhengjie.org.cn sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@506c589e
Welcome to ZooKeeper!
2018-09-15 11:26:03,650 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@975] - Opening socket connection to server node101.yinzhengjie.org.cn/172.30.1.101:2181. Will not attempt to authenticate using SASL (unknown error)
JLine support is enabled
2018-09-15 11:26:03,710 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@852] - Socket connection established, initiating session, client: /172.30.1.101:60205, server: node101.yinzhengjie.org.cn/172.30.1.101:2181
2018-09-15 11:26:03,720 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server node101.yinzhengjie.org.cn/172.30.1.101:2181, sessionid = 0x265db13b97d0001, negotiated timeout = 30000WATCHER::WatchedEvent state:SyncConnected type:None path:null
[zk: node101.yinzhengjie.org.cn(CONNECTED) 0]

登录zookeeper集群（[root@node101 ~]# zookeeper-client -server node101.yinzhengjie.org.cn Connecting to node101.yinzhengjie.org.cn）

[zk: node101.yinzhengjie.org.cn(CONNECTED) 0] ls /
[zookeeper]
[zk: node101.yinzhengjie.org.cn(CONNECTED) 1] quit
Quitting...
2018-09-15 11:27:09,798 [myid:] - INFO  [main:ZooKeeper@684] - Session: 0x265db13b97d0001 closed
2018-09-15 11:27:09,799 [myid:] - INFO  [main-EventThread:ClientCnxn$EventThread@512] - EventThread shut down
You have new mail in /var/spool/mail/root
[root@node101 ~]#
[root@node101 ~]#

2>.查看hdfs目录信息（注意权限，如果你想要往指定目录写数据的话，可以指定ACL）

[root@node101 ~]# hdfs dfs -ls -R /
drwxrwxrwt   - hdfs supergroup          0 2018-09-15 11:06 /tmp
drwxrwxrwt   - mapred hadoop              0 2018-09-15 11:06 /tmp/logs
drwxr-xr-x   - hdfs   supergroup          0 2018-09-15 11:06 /user
drwxrwxrwx   - mapred hadoop              0 2018-09-15 11:06 /user/history
drwxrwx---   - mapred hadoop              0 2018-09-15 11:06 /user/history/done
ls: Permission denied: user=root, access=READ_EXECUTE, inode="/user/history/done":mapred:hadoop:drwxrwx---
drwxrwxrwt   - mapred hadoop              0 2018-09-15 11:06 /user/history/done_intermediate
[root@node101 ~]#

3>.查看hdfs的webUI界面

　　查看hdfs的界面如下，试试有种似曾相识的感脚？

通过Cloudera Manager部署CDH5.15.1的webUI界面详解相关推荐

  1. 使用cloudera manager 安装CDH5

    [size=small]使用cloudera manager安装cdh5 # cat /etc/issue CentOS release 6.5 (Final) Kernel \r on an \m ...

  2. 使用Cloudera Manager部署oozie

    使用Cloudera Manager部署oozie 作者:尹正杰 版权声明:原创作品,谢绝转载!否则将追究法律责任. 1>.进入CM服务安装向导 2>.选择要添加的oozie服务 3> ...

  3. Cloudera Manager部署StreamSets

    参考:https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Installati ...

  4. Cloudera Manager部署配置Phoenix

    Phoenix,从直观上来看,是构建在HBase值上的SQL接口,在使用上和关系型数据库非常接近,同时具备大数据分析和低延迟的特性.Phoenix目前在Hadoop操作分析领域应用很广泛. Phoen ...

  5. Jrebel实现tomcat热部署,遇到的问题以及解决办法,详解

    Jrebel实现tomcat热部署,遇到的问题以及解决办法,详解 参考文章: (1)Jrebel实现tomcat热部署,遇到的问题以及解决办法,详解 (2)https://www.cnblogs.co ...

  6. Cloudera Manager和CDH5.8离线安装

    https://blog.csdn.net/zzq900503/article/details/52982828 简介 我们在上篇文章中已经了解了CDH,为了后续的学习,我们本章就来安装CDH5.8. ...

  7. [转]Cloudera Manager和CDH5.8离线安装

    https://blog.csdn.net/zzq900503/article/details/52982828 https://www.cnblogs.com/felixzh/p/9082344.h ...

  8. Solr系列二：solr-部署详解（solr两种部署模式介绍、独立服务器模式详解、SolrCloud分布式集群模式详解）...

    一.solr两种部署模式介绍 Standalone Server 独立服务器模式:适用于数据规模不大的场景 SolrCloud  分布式集群模式:适用于数据规模大,高可靠.高可用.高并发的场景 二.独 ...

  9. Sqoop安装部署和数据的导入导出案例详解

    目录 一.概述 二.Sqoop的工作机制 三.Sqoop1与Sqoop2架构对比 四.Sqoop安装部署 五.Sqoop的数据导入 1. 列举出所有的数据库 2. 准备表数据 3. 导入数据库表数据到 ...

最新文章

  1. 在DB中存储图像-是或否？
  2. 法国拟将雷诺与日产合并 代表团抵日进行谈判
  3. python函数返回多个变量_Python 3：通过多个函数返回变量
  4. c语言二叉排序树的创建与查找,C语言实现二叉查找树的插入和删除操作问题求教...
  5. 郊游 ID：PICNIC
  6. 使用vue的transition完成滑动过渡
  7. 智慧城市这份试卷 国外城市怎么答题？
  8. java中能对属性封装吗_JAVA中的封装
  9. Linux系统实现ICMP ping功能，并计算时延
  10. 基于JAVA+Servlet+JSP+MYSQL的电影院购票系统
  11. 控制网页frame vba_V8 bindings 设计isolate，context，world，frame之间的关系（翻译）
  12. Windows 8 各个版本区别对比
  13. 服务器主板支持nvme,给老主板刷上一个加入支持NVMe模块的改版“BIOS”
  14. 安装Petalinux
  15. Windows 10 微软官方下载工具
  16. 产品经理--用户研究
  17. 最新H5网页分享到Twitter、Facebook带缩略图
  18. Tomcat优化思路
  19. 该如何提升自己的编程能力?
  20. intellij idea 缓存清理,c盘 系统盘清理

热门文章

  1. java的反射和它的类加载机制
  2. 《iOS网络编程与云端应用最佳实践》微博转发送书了！
  3. 20180828 上课截图
  4. Flask安装首页显示
  5. javascript权威指南(6) - 对象
  6. 20非常有用的Java程序片段(11-15)
  7. 有关DataVisualization类组件的研究——Silverlight学习笔记[43]
  8. LeetCode-MySQL196. 删除重复的电子邮箱
  9. 这里有一个让你变成技术大牛的机会
  10. c语言宏定义_C语言宏定义