ClouderaManager6.3 单机搭建

1、修改主机名

hostnamectl set-hostname n68

2、开启ntpd 自动同步时间，并加入开机启动

systemctl status ntpd \
&& systemctl start ntpd \
&& systemctl enable ntpd \
&& systemctl status ntpd

3、下载Cloudera-Manager安装包，到/data/src/cm-6.3/cloudera-repos/ 文件夹下

下载地址：https://archive.cloudera.com/cm6/6.3.0/(不同版本，不同路径)

下载一：https://archive.cloudera.com/cm6/6.3.0/allkeys.asc

下载二：https://archive.cloudera.com/cm6/6.3.0/redhat7/yum/RPMS/x86_64/ 此地址下的所有文件，如下

4、创建本地yum源

安装apache（在CentOS系统里，是httpd），并启动，加入开机启动

yum -y install httpd createrepo \
&& systemctl start httpd \
&& systemctl enable httpd

验证访问：http://IP:80/

拷贝刚下载的rpm文件到apache下

cd 到/var/www/html/ 目录下（apache的默认文件目录）

createrepo /data/src/cm-6.3/cloudera-repos/ \
&& cp -r /data/src/cm-6.3/cloudera-repos /var/www/html/

验证：http://IP/cloudera-repos/

5 安装JDK

[root@n68 cm-6.3]# cd /var/www/html/cloudera-repos/
[root@n68 cloudera-repos]# rpm -ivh oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm
warning: oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID b0b19c9f: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...1:oracle-j2sdk1.8-1.8.0+update181-1################################# [100%]

6、安装mysql，并初始化MySQL数据库

安装文档：https://www.cnblogs.com/luohanguo/p/9045391.html

初始化数据，执行以下命令

CREATE DATABASE scm DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE amon DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE rman DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE hue DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE metastore DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE sentry DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE nav DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE navms DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
CREATE DATABASE oozie DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
GRANT ALL ON scm.* TO 'scm'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON amon.* TO 'amon'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON rman.* TO 'rman'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON hue.* TO 'hue'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON metastore.* TO 'hive'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON sentry.* TO 'sentry'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON nav.* TO 'nav'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON navms.* TO 'navms'@'%' IDENTIFIED BY 'mypass7789';
GRANT ALL ON oozie.* TO 'oozie'@'%' IDENTIFIED BY 'mypass7789';
SHOW DATABASES;

7、配置mysql jdbc驱动

cd /data/src/mysql-jdbc/
wget https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.48.tar.gz
tar -zxvf mysql-connector-java-5.1.48.tar.gz
cp mysql-connector-java-5.1.48/mysql-connector-java-5.1.48.jar /usr/share/java/mysql-connector-java.jar

8、安装Cloudera Manager

配置 cloudera-manager 本地yum源

(
cat <<EOF
[cloudera-manager]
name=Cloudera Manager 6.3.0
baseurl=http://localhost/cloudera-repos/
gpgcheck=0
enabled=1
EOF
) >> /etc/yum.repos.d/cloudera-manager.repo \
&& yum clean all \
&& yum makecache

执行：

sudo yum install -y  cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server

安装成功以后，在自动生成/opt/cloudera

9、下载并配置Parcel包，并放入/opt/cloudera/parcel-repo目录下

下载文件一：https://archive.cloudera.com/cdh6/6.3.0/parcels/CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel

下载文件二：https://archive.cloudera.com/cdh6/6.3.0/parcels/manifest.json

授予权限给cloudera-scm用户

cd /opt/cloudera/parcel-repo
sha1sum CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel| awk '{ print $1 }' >CDH-6.3.0-1.cdh6.3.0.p0.1279813-el7.parcel.sha
chown -R cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/*

10、初始化scm库

执行：

/opt/cloudera/cm/schema/scm_prepare_database.sh mysql scm scm mypass7789

结果：

JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera
Verifying that we can write to /etc/cloudera-scm-server
Creating SCM configuration file in /etc/cloudera-scm-server
Executing:  /usr/java/jdk1.8.0_181-cloudera/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connector-java.jar:/opt/cloudera/cm/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db.
Wed Aug 14 11:39:18 CST 2019 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
[main] DbCommandExecutor INFO  Successfully connected to database.
All done, your SCM database is configured correctly!

11、启动cloudera服务

systemctl start cloudera-scm-server

查看日志

tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

执行结果：成功

2019-08-14 11:42:34,191 INFO WebServerImpl:com.cloudera.server.cmf.WebServerImpl: Started Jetty server.

查到日志出现这句话，就可以浏览器访问CM了，默认用户名密码：admin/admin，http://IP:7180

此文感谢：

https://blog.csdn.net/qq_39680564/article/details/99479703#212_JDK_184

ClouderaManager6.3 单机搭建相关推荐

大数据调度平台Airflow（三）：Airflow单机搭建
目录 Airflow单机搭建一.安装Anconda及python3.7 1.官网下载Anconda ,选择linux版本,并安装 2.将下载好的anconda安装包上传至mynode4节点,进行安装 ...
单机搭建kafka集群本地_Kafka单机环境搭建简记
最近在搞kettle整合kafka producer插件,于是自己搭建了一套单机的kafka环境,以便用于测试.现整理如下的笔记,发上来和大家分享.后续还会有kafka的研究笔记,依然会与大家分享! ...
Kafka 概念、单机搭建与使用
目录 Kafka 概念.单机搭建与使用基本概念介绍 Topic Producer Consumer Kafka单机配置,一个Broker 环境: 配置zookeeper 配置Kafka 使用Kafk ...
统信UOS 飞腾平台单机搭建ETCD 无Leader节点
问题说明由于某项目限制,需要在一个飞腾平台,装有统信UOS桌面专业版的机器上单机搭建一个三节点的ETCD集群.从githup拉下当时最新的3.5.5版本的arm包,根据单机搭建的流程搭起来之后,一直 ...
单机搭建kafka集群本地_单机快速搭建多节点kafka集群
有时候为了更好地了解kafka集群的运行机制,需要自己搭建kafka集群.本文的目的就是让大家在单机上快速搭建kafka集群(仅作为单机测试使用). 环境及工具版本 mac OS 10.15.5 ka ...
大数据统计分析平台之一、Kafka单机搭建
1.zookeeper搭建 Kafka集群依赖zookeeper,需要提前搭建好zookeeper 单机模式(7步)(集群模式进阶请移步:http://blog.51cto.com/nileader/ ...
Eureka单机搭建
Eureka详解 Eureka Spring Cloud Eureka 是Netflix 开发的注册发现组件,本身是一个基于 REST 的服务.提供注册与发现,同时还提供了负载均衡.故障转移等能力 E ...
第二章、FastDFS单机搭建过程
上章我们初始了FastDFS的介绍,发展历程和结构,不多说,本章带你走进FastDFS单机版安装步骤,以及相关web项目演示上传下载等功能. 1.准备环境系统:Centos7.x 相 ...
doker zookeeper kafka单机搭建
因工作需求,环境需要搭建zookeeper,kafka集群,也是刚接触从零开始搭建,此文章是用docker搭建的单机版, 搭建过程还是比较顺利的,此前用传统方式搭建了一遍,后面才知道用docker也可 ...

ClouderaManager6.3 单机搭建

ClouderaManager6.3 单机搭建相关推荐

最新文章

热门文章