hue安装及基本测试-笔记
#########################################################################################################
hue安装:
操作系统 安装以下软件:
CentOS/RHEL:
Oracle's JDK (read more here)
ant
asciidoc
cyrus-sasl-devel
cyrus-sasl-gssapi
cyrus-sasl-plain
gcc
gcc-c++
krb5-devel
libffi-devel
libtidy (for unit tests only)
libxml2-devel
libxslt-devel
make
mvn (from apache-maven package or maven3 tarball)
mysql
mysql-devel
openldap-devel
python-devel
sqlite-devel
openssl-devel (for version 7+)
gmp-devel
解压hue tar包
cd 解压目录
export PATH=/usr/local/mysql/bin:$PATH
make apps
编译成功后目录下会多出两个文件。
*******************************************
配置:
desktop/conf/hue.init
[desktop]
# Set this to a random string, the longer the better.
# This is used for secure hashing in the session store.
secret_key=jFE93j;2[290-eiw.KEiwN2s3['d;/.q[eIW^y#e=+Iei*@Mn<qW5o
# Webserver listens on this address and port
http_host=chavin.king
http_port=8888
# Time zone name
time_zone=Asia/Shanghai
# Enable or disable Django debug mode.
django_debug_mode=false
# Enable or disable backtrace for server error
http_500_debug_mode=false
**************************************
启动hue
$ build/env/bin/supervisor
浏览器登录:http:chavin.king:8888
注册用户名密码:admin admin
****************************************
配置集成hdfs、yarn组件:
Configure WebHdfs
You need to enable WebHdfs or run an HttpFS server. To turn on WebHDFS, add this to your hdfs-site.xml and restart your HDFS cluster. Depending on your setup, your hdfs-site.xml might be in /etc/hadoop/conf.
<property>
<name>dfs.webhdfs.enabled</name>
<value>true</value>
</property>
You also need to add this to core-site.html.
<property>
<name>hadoop.proxyuser.hue.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.hue.groups</name>
<value>*</value>
</property>
---desktop/conf/hue.init
[hadoop]
# Configuration for HDFS NameNode
# ------------------------------------------------------------------------
[[hdfs_clusters]]
# HA support by using HttpFs
[[[default]]]
# Enter the filesystem uri
fs_defaultfs=hdfs://chavin.king:9000
# NameNode logical name.
## logical_name=
# Use WebHdfs/HttpFs as the communication mechanism.
# Domain should be the NameNode or HttpFs host.
# Default port is 14000 for HttpFs.
webhdfs_url=http://chavin.king:50070/webhdfs/v1
# Change this if your HDFS cluster is Kerberos-secured
## security_enabled=false
# Default umask for file and directory creation, specified in an octal value.
## umask=022
# Directory of the Hadoop configuration
hadoop_conf_dir=/opt/cdh-5.3.6/hadoop-2.5.0-cdh5.3.6/etc/hadoop
# Configuration for YARN (MR2)
# ------------------------------------------------------------------------
[[yarn_clusters]]
[[[default]]]
# Enter the host on which you are running the ResourceManager
resourcemanager_host=chavin.king
# The port where the ResourceManager IPC listens on
resourcemanager_port=8032
# Whether to submit jobs to this cluster
submit_to=True
# Resource Manager logical name (required for HA)
## logical_name=
# Change this if your YARN cluster is Kerberos-secured
## security_enabled=false
# URL of the ResourceManager API
resourcemanager_api_url=http://chavin.king:8088
# URL of the ProxyServer API
proxy_api_url=http://chavin.king:8088
# URL of the HistoryServer API
history_server_api_url=http://chavin.king:19888
# In secure mode (HTTPS), if SSL certificates from Resource Manager's
# Rest Server have to be verified against certificate authority
## ssl_cert_ca_verify=False
# HA support by specifying multiple clusters
# e.g.
# [[[ha]]]
# Resource Manager logical name (required for HA)
## logical_name=my-rm-name
# Configuration for MapReduce (MR1)
# ------------------------------------------------------------------------
hue配置连接hive:
hive-site.xml配置:
<property>
<name>hive.server2.thrift.port</name>
<value>10000</value>
</property>
<property>
<name>hive.server2.thrift.bind.host</name>
<value>chavin.king</value>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://chavin.king:9083</value>
</property>
并且启动hiveserver2 和 hive metastore
#bin/hiveserver2 &
#bin/hive --service metastore &
配置hue.ini文件:
###########################################################################
# Settings to configure Beeswax with Hive
###########################################################################
[beeswax]
# Host where HiveServer2 is running.
# If Kerberos security is enabled, use fully-qualified domain name (FQDN).
hive_server_host=chavin.king
# Port where HiveServer2 Thrift server runs on.
hive_server_port=10000
# Hive configuration directory, where hive-site.xml is located
hive_conf_dir=/opt/cdh-5.3.6/hive-0.13.1-cdh5.3.6/conf
# Timeout in seconds for thrift calls to Hive service
server_conn_timeout=120
****************************************************************************
配置连接关系型数据库:
[[databases]]
# sqlite configuration.
[[[sqlite]]]
# Name to show in the UI.
nice_name=SQLite
# For SQLite, name defines the path to the database.
name=/opt/cdh-5.3.6/hue-3.7.0-cdh5.3.6/desktop/desktop.db
# Database backend to use.
engine=sqlite
# Database options to send to the server when connecting.
# https://docs.djangoproject.com/en/1.4/ref/databases/
## options={}
# mysql, oracle, or postgresql configuration.
[[[mysql]]]
# Name to show in the UI.
nice_name="My SQL DB"
# For MySQL and PostgreSQL, name is the name of the database.
# For Oracle, Name is instance of the Oracle server. For express edition
# this is 'xe' by default.
name=chavin
# Database backend to use. This can be:
# 1. mysql
# 2. postgresql
# 3. oracle
engine=mysql
# IP or hostname of the database to connect to.
host=chavin.king
# Port the database server is listening to. Defaults are:
# 1. MySQL: 3306
# 2. PostgreSQL: 5432
# 3. Oracle Express Edition: 1521
port=3306
# Username to authenticate with when connecting to the database.
user=root
# Password matching the username to authenticate with when
# connecting to the database.
password=mysql
# Database options to send to the server when connecting.
# https://docs.djangoproject.com/en/1.4/ref/databases/
## options={}
bin/oozie-setup.sh sharelib create -fs hdfs://chavin.king:9000 -locallib oozie-sharelib-4.0.0-cdh5.3.6-yarn.tar.gz
转载于:https://www.cnblogs.com/wcwen1990/p/6652023.html
hue安装及基本测试-笔记相关推荐
- 【RobotStudio学习笔记】(一)软件的安装与初步测试
RobotStudio 6.03.02 的安装 链接:https://pan.baidu.com/s/1NyDTu_OCcPJLbfaQLtCHCw 提取码:robo 1. 安装注意事项 (1)PC用 ...
- linux 安装jeakens_Chapter 2. OpenSSL的安装和配置学习笔记
Chapter 2. OpenSSL的安装和配置学习笔记 2.1 在linux上面安装OpenSSL 我还是做点No paper事情比较在行,正好和老师的课程接轨一下. 以前尝试过在Windows上面 ...
- Power架构云小机测试笔记
Power架构云小机测试笔记 一.云小机介绍 云小机是IBM与启创卓越推出的虚拟云主机,与常见的阿里.百度.网宿的云主机不同,云小机是基于Power架构的,而传统的云主机几乎都是基于x86架构的.我有 ...
- 【转载】VINS-Mono环境配置与测试笔记
VINS-Mono环境配置与测试笔记 标签: SLAM VINS-mono 本文转载自: VINS-Mono环境配置与测试笔记 error:cv_bridge---opencv和ros连接起来的桥 1 ...
- VINS-Mono环境配置与测试笔记
VINS-Mono环境配置与测试笔记 标签: 旭 linux SLAM 1.简介 VINS-Mono和VINS-Mobile是香港科技大学沈劭劼团队开源的单目视觉惯导SLAM方案.是基于优化和滑动窗口 ...
- 关于Keil5 jlink 与DFP包安装及排错经验笔记
关于Keil5 jlink 与DFP包安装及排错经验笔记 折腾Keil5(MDK)起因及目的 起因(比较啰嗦,可以跳过) 由于年后项目开发需要使用jlink来对nRF51822这款蓝牙Soc进行程序烧 ...
- 朋友入职字节跳动,测开岗,分享面试经验,大厂版测试笔记分享
就在前几天,一个学妹入职了字节跳动,测开岗,还特意给我发来了信息表示感谢,因为我之前给了他蛮多帮助. 大家都知道,字节跳动的面试还是挺难的,毕竟字节在国内的互联网已经属于头部,所以我还是非常替我的这位 ...
- Redis第二集:Linux下安装Redis和测试,包含命令代码和问题处理办法,超详细版
Redis第二集:Linux下安装Redis和测试,包含命令代码和问题处理办法,超详细版 一.资源 Linux下的Redis的下载地址 二.安装与测试 上传至自己的Linux平台 解压安装包 tar ...
- Redis第一集:Windows下安装Redis和测试
Redis第一集:Windows下安装Redis和测试 一.资源 Windows下的Redis的下载地址 点击这里即可下载,如果进不去GitHub的话,可以上网搜一下怎么进GitHub,搭个梯子(●ˇ ...
最新文章
- 一、multiprocessing.pool.RemoteTraceback
- Linux 内核 动态设备
- python培训好学吗-Python0基础好学吗?
- (PASS)JAVA数组去重 三种方法 (不用集合)
- Java练习 SDUT-2401最大矩形面积
- Oracle ADF和Oracle Jet一起工作。 建筑模式
- libpng warning: iCCP: known incorrect sRGB profile
- c语言程序可以从任何函数开始执行,C语言-基本选择题及参考答案
- STM32F1开发指南笔记46----字库原理及汉字库创建
- 数据库 课程设计 仓库管理系统
- 什么是消息队列及消息队列原理和应用场景详解
- win2008服务器虚拟内存设置,电脑虚拟内存设置(Win 7/8/10、Windows Server 2003 - 2019)...
- 【阅】天才在左 疯子在右
- c语言用控制台写——俄罗斯方块
- shapely包导入问题
- putty下载与安装
- Java字符串反转常用的2种方式
- PCL:投影滤波(二)将点云投影至球面
- 配置Log4j(很详细)
- 深圳MPD大会 讲师演讲稿 2014-10
热门文章
- java的编译和连接方法_Java:编译时解析和“最具体的方法”
- java二维码生成并可以转换
- ta是什么职位_想好了吗~你为什么来博智林
- c语言输入字符串的格式不正确的是,关于c#:输入字符串的格式不正确
- python爬取b站用户_用Python爬取bilibili全站用户信息
- oracle巡检 博客,自己总结了一下巡检的工作 for Oracle RAC
- java创建一个人函数类_Java对象和类–学习如何创建和实现
- sql server agent会自动关闭_经常用微信支付,要关闭这个开关,不然每个月都会自动扣钱...
- 矩阵的秩到底描述了什么?
- spark 1.6.0 简单使用