Hadoop 管理监控工具 Apache Ambari

Apache Ambari是一种基于Web的工具,支持Apache Hadoop集群的供应、管理和监控。Ambari目前已支持大多数Hadoop组件,包括HDFS、MapReduce、Hive、Pig、 Hbase、Zookeper、Sqoop和Hcatalog等。

Apache Ambari 支持HDFS、MapReduce、Hive、Pig、Hbase、Zookeper、Sqoop和Hcatalog等的集中管理。也是5个顶级hadoop管理工具之一。

Step1: Download the Ambari repository on the Ambari Server host

[root@jifeng02 ~]# cd /etc/yum.repos.d/

Choose an appropriate <ambari-repo-url> based on the platform used:

[root@jifeng02 yum.repos.d]# wget http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/1.6.1/ambari.repo
--2014-10-17 22:30:35--  http://public-repo-1.hortonworks.com/ambari/centos6/1.x/updates/1.6.1/ambari.repo
正在解析主机 public-repo-1.hortonworks.com... 54.192.157.143, 54.230.158.152, 54.230.158.197, ...
正在连接 public-repo-1.hortonworks.com|54.192.157.143|:80... 已连接。
已发出 HTTP 请求,正在等待回应... 200 OK
长度:472 [binary/octet-stream]
正在保存至: “ambari.repo”100%[======================================================================>] 472         --.-K/s   in 0s      2014-10-17 22:30:35 (81.0 MB/s) - 已保存 “ambari.repo” [472/472])

Step 2: Install, Setup, and Start Ambari Server

yum install ambari-server

[root@jifeng02 jifeng]# yum install ambari-server
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile* base: centos.ustc.edu.cn* extras: centos.ustc.edu.cn* updates: centos.ustc.edu.cn
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package ambari-server.noarch 0:1.6.1-98 will be installed
--> Processing Dependency: postgresql-server >= 8.1 for package: ambari-server-1.6.1-98.noarch
--> Running transaction check
---> Package postgresql-server.i686 0:8.4.20-1.el6_5 will be installed
--> Processing Dependency: postgresql-libs(x86-32) = 8.4.20-1.el6_5 for package: postgresql-server-8.4.20-1.el6_5.i686
--> Processing Dependency: postgresql(x86-32) = 8.4.20-1.el6_5 for package: postgresql-server-8.4.20-1.el6_5.i686
--> Processing Dependency: libssl.so.10(libssl.so.10) for package: postgresql-server-8.4.20-1.el6_5.i686
--> Processing Dependency: libcrypto.so.10(libcrypto.so.10) for package: postgresql-server-8.4.20-1.el6_5.i686
--> Running transaction check
---> Package openssl.i686 0:1.0.0-27.el6 will be updated
--> Processing Dependency: openssl = 1.0.0-27.el6 for package: openssl-devel-1.0.0-27.el6.i686
---> Package openssl.i686 0:1.0.1e-30.el6_5.2 will be an update
---> Package postgresql.i686 0:8.4.13-1.el6_3 will be updated
--> Processing Dependency: postgresql(x86-32) = 8.4.13-1.el6_3 for package: postgresql-devel-8.4.13-1.el6_3.i686
---> Package postgresql.i686 0:8.4.20-1.el6_5 will be an update
---> Package postgresql-libs.i686 0:8.4.13-1.el6_3 will be updated
---> Package postgresql-libs.i686 0:8.4.20-1.el6_5 will be an update
--> Running transaction check
---> Package openssl-devel.i686 0:1.0.0-27.el6 will be updated
---> Package openssl-devel.i686 0:1.0.1e-30.el6_5.2 will be an update
---> Package postgresql-devel.i686 0:8.4.13-1.el6_3 will be updated
---> Package postgresql-devel.i686 0:8.4.20-1.el6_5 will be an update
--> Finished Dependency ResolutionDependencies Resolved================================================================================================================Package                     Arch             Version                      Repository                      Size
================================================================================================================
Installing:ambari-server               noarch           1.6.1-98                     Updates-ambari-1.6.1            39 M
Installing for dependencies:postgresql-server           i686             8.4.20-1.el6_5               updates                        3.4 M
Updating for dependencies:openssl                     i686             1.0.1e-30.el6_5.2            updates                        1.5 Mopenssl-devel               i686             1.0.1e-30.el6_5.2            updates                        1.2 Mpostgresql                  i686             8.4.20-1.el6_5               updates                        2.6 Mpostgresql-devel            i686             8.4.20-1.el6_5               updates                        810 kpostgresql-libs             i686             8.4.20-1.el6_5               updates                        205 kTransaction Summary
================================================================================================================
Install       2 Package(s)
Upgrade       5 Package(s)Total download size: 49 M
Is this ok [y/N]: y
Downloading Packages:
(1/7): ambari-server-1.6.1-98.noarch.rpm                                                 |  39 MB     09:05
(2/7): openssl-1.0.1e-30.el6_5.2.i686.rpm                                                | 1.5 MB     00:01
(3/7): openssl-devel-1.0.1e-30.el6_5.2.i686.rpm                                          | 1.2 MB     00:01
(4/7): postgresql-8.4.20-1.el6_5.i686.rpm                                                | 2.6 MB     00:03
(5/7): postgresql-devel-8.4.20-1.el6_5.i686.rpm                                          | 810 kB     00:01
(6/7): postgresql-libs-8.4.20-1.el6_5.i686.rpm                                           | 205 kB     00:00
(7/7): postgresql-server-8.4.20-1.el6_5.i686.rpm                                         | 3.4 MB     00:03
----------------------------------------------------------------------------------------------------------------
Total                                                                            89 kB/s |  49 MB     09:20
warning: rpmts_HdrFromFdno: Header V4 RSA/SHA1 Signature, key ID 07513cad: NOKEY
Retrieving key from http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
Importing GPG key 0x07513CAD:Userid: "Jenkins (HDP Builds) <jenkin@hortonworks.com>"From  : http://public-repo-1.hortonworks.com/ambari/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running TransactionUpdating   : openssl-1.0.1e-30.el6_5.2.i686                                                              1/12 Updating   : postgresql-libs-8.4.20-1.el6_5.i686                                                         2/12 Updating   : openssl-devel-1.0.1e-30.el6_5.2.i686                                                        3/12 Updating   : postgresql-8.4.20-1.el6_5.i686                                                              4/12 Installing : postgresql-server-8.4.20-1.el6_5.i686                                                       5/12 Installing : ambari-server-1.6.1-98.noarch                                                               6/12 Updating   : postgresql-devel-8.4.20-1.el6_5.i686                                                        7/12 Cleanup    : postgresql-devel-8.4.13-1.el6_3.i686                                                        8/12 Cleanup    : postgresql-8.4.13-1.el6_3.i686                                                              9/12 Cleanup    : postgresql-libs-8.4.13-1.el6_3.i686                                                        10/12 Cleanup    : openssl-devel-1.0.0-27.el6.i686                                                            11/12 Cleanup    : openssl-1.0.0-27.el6.i686                                                                  12/12 Verifying  : postgresql-8.4.20-1.el6_5.i686                                                              1/12 Verifying  : postgresql-devel-8.4.20-1.el6_5.i686                                                        2/12 Verifying  : openssl-1.0.1e-30.el6_5.2.i686                                                              3/12 Verifying  : ambari-server-1.6.1-98.noarch                                                               4/12 Verifying  : postgresql-server-8.4.20-1.el6_5.i686                                                       5/12 Verifying  : openssl-devel-1.0.1e-30.el6_5.2.i686                                                        6/12 Verifying  : postgresql-libs-8.4.20-1.el6_5.i686                                                         7/12 Verifying  : postgresql-8.4.13-1.el6_3.i686                                                              8/12 Verifying  : openssl-1.0.0-27.el6.i686                                                                   9/12 Verifying  : postgresql-libs-8.4.13-1.el6_3.i686                                                        10/12 Verifying  : postgresql-devel-8.4.13-1.el6_3.i686                                                       11/12 Verifying  : openssl-devel-1.0.0-27.el6.i686                                                            12/12 Installed:ambari-server.noarch 0:1.6.1-98                                                                               Dependency Installed:postgresql-server.i686 0:8.4.20-1.el6_5                                                                       Dependency Updated:openssl.i686 0:1.0.1e-30.el6_5.2                       openssl-devel.i686 0:1.0.1e-30.el6_5.2                 postgresql.i686 0:8.4.20-1.el6_5                       postgresql-devel.i686 0:8.4.20-1.el6_5                 postgresql-libs.i686 0:8.4.20-1.el6_5                 Complete!

Run the setup command to configure your Ambari Server, Database, JDK, LDAP, and other options:

[root@jifeng02 jifeng]# ambari-server setup
Using python  /usr/bin/python2.6
Setup ambari-server
Checking SELinux...
SELinux status is 'enabled'
SELinux mode is 'enforcing'
Temporarily disabling SELinux
WARNING: SELinux is set to 'permissive' mode and temporarily disabled.
OK to continue [y/n] (y)? y
Customize user account for ambari-server daemon [y/n] (n)? y
Enter user account for ambari-server daemon (root):jifeng
Adjusting ambari-server permissions and ownership...
Checking iptables...
Checking JDK...
[1] - Oracle JDK 1.7
[2] - Oracle JDK 1.6
[3] - Custom JDK
==============================================================================
Enter choice (1): 1
To download the Oracle JDK you must accept the license terms found at http://www.oracle.com/technetwork/java/javase/terms/license/index.html and not accepting will cancel the Ambari Server setup.
Do you accept the Oracle Binary Code License Agreement [y/n] (y)? y
Downloading JDK from http://public-repo-1.hortonworks.com/ARTIFACTS/jdk-7u45-linux-x64.tar.gz to /var/lib/ambari-server/resources/jdk-7u45-linux-x64.tar.gz
JDK distribution size is 138094686 bytes
jdk-7u45-linux-x64.tar.gz... 2% (3.0 MB of 131.7 MB)^C
Aborting ... Keyboard Interrupt.

选择:1 会自动下载jdk,终止掉

再次继续

[root@jifeng02 ~]# ambari-server setup
Using python  /usr/bin/python2.6
Setup ambari-server
Checking SELinux...
SELinux status is 'enabled'
SELinux mode is 'permissive'
WARNING: SELinux is set to 'permissive' mode and temporarily disabled.
OK to continue [y/n] (y)? y
Ambari-server daemon is configured to run under user 'jifeng'. Change this setting [y/n] (n)? y
Enter user account for ambari-server daemon (root):jifeng
Adjusting ambari-server permissions and ownership...
Checking iptables...
Checking JDK...
[1] - Oracle JDK 1.7
[2] - Oracle JDK 1.6
[3] - Custom JDK
==============================================================================
Enter choice (1): 3
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /home/jifeng/jdk1.7.0_45
Validating JDK on Ambari Server...done.
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? y
==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL
[4] - PostgreSQL
==============================================================================
Enter choice (1): 3
Hostname (localhost): 10.6.3.241
Port (3306):
Database Name (ambari): ambari
Username (ambari): dss
Enter Database Password (bigdata):
Re-enter password:
WARNING: Before starting Ambari Server, you must copy the MySQL JDBC driver JAR file to /usr/share/java.
Press <enter> to continue.
ERROR: Before starting Ambari Server, you must copy the MySQL JDBC driver JAR file to /usr/share/java.
ERROR: Exiting with exit code -1.
REASON: Before starting Ambari Server, you must copy the MySQL JDBC driver JAR file to /usr/share/java.

需要copy mysql的jdbc包到/usr/share/java

再来:

[root@jifeng02 ~]# ambari-server setup
Using python  /usr/bin/python2.6
Setup ambari-server
Checking SELinux...
SELinux status is 'enabled'
SELinux mode is 'permissive'
WARNING: SELinux is set to 'permissive' mode and temporarily disabled.
OK to continue [y/n] (y)? y
Ambari-server daemon is configured to run under user 'jifeng'. Change this setting [y/n] (n)? y
Enter user account for ambari-server daemon (root):jifeng
Adjusting ambari-server permissions and ownership...
Checking iptables...
Checking JDK...
Do you want to change Oracle JDK [y/n] (n)? y
[1] - Oracle JDK 1.7
[2] - Oracle JDK 1.6
[3] - Custom JDK
==============================================================================
Enter choice (1): 3
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /home/jifeng/jdk1.7.0_45
Validating JDK on Ambari Server...done.
Completing setup...
Configuring database...
Enter advanced database configuration [y/n] (n)? y
==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL
[4] - PostgreSQL
==============================================================================
Enter choice (1): 3
Hostname (localhost): 10.6.3.241
Port (3306):
Database Name (ambari): ambari
Username (ambari): dss
Enter Database Password (bigdata):
Re-enter password:
Copying JDBC drivers to server resources...
Configuring remote database connection properties...
WARNING: Before starting Ambari Server, you must run the following DDL against the database to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
Proceed with configuring remote database connection properties [y/n] (y)? y
Copying JDBC drivers to server resources...
Ambari Server 'setup' completed successfully.

成功了!!

Start Ambari Server:

ambari-server start

启动之前,先把/var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql 在mysql中ambari库执行

否则出现如下错误:

[root@jifeng02 ~]# ambari-server start
Using python  /usr/bin/python2.6
Starting ambari-server
Ambari Server running with 'root' privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Waiting for server start...
sh: line 0: ulimit: open files: cannot modify limit: 不允许的操作
ERROR: Exiting with exit code -1.
REASON: Ambari Server java process died with exitcode 255. Check /var/log/ambari-server/ambari-server.out for more information.

执行/var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql 后

启动:

[root@jifeng02 ~]# ambari-server start
Using python  /usr/bin/python2.6
Starting ambari-server
Ambari Server running with 'root' privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Waiting for server start...
sh: line 0: ulimit: open files: cannot modify limit: 不允许的操作
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Ambari Server 'start' completed successfully.

Step 3: Deploy Cluster using Ambari Web UI

访问地址 http://jifeng02:8080.

用户名和密码都是: admin

参考:https://cwiki.apache.org/confluence/display/AMBARI/Install+Ambari+1.6.1+from+Public+Repositories

centos安装Ambari相关推荐

  1. 基于【CentOS-7+ Ambari 2.7.0 + HDP 3.0】搭建HAWQ数据仓库01 —— 准备环境,搭建本地仓库,安装ambari...

    一.集群软硬件环境准备: 操作系统:  centos 7 x86_64.1804 Ambari版本:2.7.0 HDP版本:3.0.0 HAWQ版本:2.3.0 5台PC作为工作站: ep-bd01 ...

  2. CentOS7.6下安装Ambari

    一.准备工作 1.1.准备三台CentOS 1.2.配置静态IP.DNS vi /etc/sysconfig/network-scripts/ficfg-ens33 IPADDR为 配置的ip NET ...

  3. 安装Ambari 2.7.5 + HDP3.1.5(附安装包)

    目录: 前置准备 1. 安装包准备 2.服务器配置 3.配置静态IP 4.配置主机名 5.关闭防火墙及selinux 6.配置ssh互信 7.安装pssh工具(非必须) 8. 配置ntp时钟同步 9. ...

  4. CentOS 安装docker.ce报错提示containerd.io >= 1.2.2-3问题

    centos安装docker.ce遇到报错,提示如下 # yum install -y docker-ce Last metadata expiration check: 0:01:49 ago on ...

  5. CentOS安装crontab

    CentOS安装crontab: yum install crontabs 说明: service crond start //启动服务 service crond stop //关闭服务 servi ...

  6. CentOS 安装Apache

    # centOS 安装A M P 环境 [参考简书作者,非常感谢!!!](https://www.jianshu.com/p/bc14ff0ab1c7) ## 一 Apache 环境安装 1 安装Ap ...

  7. centos 安装 NTFS支持

    2019独角兽企业重金招聘Python工程师标准>>> 参考的原文网址: centos安装完之后,默认是不支持NTFS磁盘格式的,解决的方法之一就是安装NTFS-3G模块,但是默认的 ...

  8. centos安装及网络配置

    感谢老师传授,共同学习!谢谢!仅供自己日后复习之用! centos安装关键点: 创建分区: / 系统分区 /boot 启动分区 SWAP 交换分区,虚拟内存.主要是缓解物理内存不足. 虚拟化软件: V ...

  9. centos安装tensorFlow的java环境

    参考问题汇总 centos安装tensorFlow版本的时候会遇到的一些问题,参考这个链接:https://blog.csdn.net/luoyexuge/article/details/783212 ...

最新文章

  1. ASP.NET XML Web 服务的工作流解决方案
  2. SharePoint 上传附件
  3. K8s-Demo实现
  4. bzoj1003[ZJOI2006]物流运输
  5. LVS负载均衡中arp_ignore和arp_annonuce参数配置的含义
  6. 《MATLAB 神经网络43个案例分析》:第23章 Elman神经网络的数据预测----电力负荷预测模型研究
  7. SpringMVC 406状态码
  8. 把Android源码导入Android Studio进行调试
  9. 励志名言名句,2018励志名言名句大全
  10. 微信小程序创建节点选择器获取宽高wx.createSelectorQuery
  11. Leetcode 2020/12/03打卡 204计算质数(简单)
  12. 【Unity】Unity中的异步编程技术详解
  13. 功能测试——抓包工具(fiddler)
  14. 基于PHP的视频社交管理系统
  15. 通过组策略编辑器关闭Windows自动更新
  16. 天池算法大赛思路和代码分享
  17. 转载:Build.VERSION.SDK_INT = Build.VERSION_CODES.HONEYCOMB
  18. 宏杰文件加密 linux,笔者教您宏杰文件加密【图文介绍】
  19. 英语作文计算机的问题,计算机的调查英语作文带翻译
  20. 世界杯-门将黄油手送大礼奇兵救主 俄罗斯1-1韩国

热门文章

  1. 微服务架构学习 之 什么是微服务
  2. 如何复制java卡,使用java做一个简单的集卡程序
  3. polkit 重新安装_CentOS Linux 7.4中polkit服务启动失败
  4. 【小白学习PyTorch教程】十六、在多标签分类任务上 微调BERT模型
  5. 八十四、搜索框动画效果实现,React-Redux 进行应用数据的管理
  6. 机器学习认识聚类(KMeans算法)
  7. BERT原理、代码、相关模型、精调技巧,看这个就够了
  8. 知识图谱理论与实践(以问答系统为例)
  9. 探寻AI未来式,百度AI Studio两周年寻最强锦鲤送超大惊喜
  10. 详解GAN的谱归一化(Spectral Normalization)