storm2.1.0搭建教程

一、确定安装storm版本，这里默认安装storm2.1.0

二、搭建storm集群步骤开始（Here's a summary of the steps for setting up a Storm cluster:）

安装一个Zookeeper集群（一般3台足够)(Set up a Zookeeper cluster)
（问题：单机需要装Zookeeper么）

Zookeeper需要加入监控（It’s critical that you run Zookeeper under supervision, since Zookeeper is fail-fast and will exit the process if it encounters any error case. See here for more details.）

Zookeeper需要安装压缩Zookeeper数据和日志（It’s critical that you set up a cron to compact Zookeeper’s data and transaction logs. The Zookeeper daemon does not do this on its own, and if you don’t set up a cron, Zookeeper will quickly run out of disk space. See here for more details.）
安装依赖包（Install dependencies on Nimbus and worker machines）
Java 8+ (Apache Storm 2.x is tested through travisci against a java 8 JDK)
Python 2.6.6 (Python 3.x should work too,but is not tested as part of our CI enviornment)
下载解压strom的release包 (_Download and extract a Storm release to Nimbus
and worker machines _)
```
 wget http://mirror.bit.edu.cn/apache/storm/apache-storm-2.1.0/apache-storm-2.1.0.tar.gz
```
填写相应的配置（Fill in mandatory configurations into storm.yaml）
1) 设置storm依赖的zk集群
```
storm.zookeeper.servers:- "111.222.333.444"- "555.666.777.888"
```
2）设置storm.local.dir(The Nimbus and Supervisor daemons require a directory on the local disk to store small amounts of state (like jars, confs, and things like that). You should create that directory on each machine, give it proper permissions, and then fill in the directory location using this config.)
For example:
```
storm.local.dir: "/mnt/storm"
```
3)设置主备nimbus机子(_nimbus.seeds: The worker nodes need to know which machines are the candidate of master in order to download topology jars and confs. _)
For example:
```
nimbus.seeds: ["111.222.333.44"]
```
4)设置supervisor的slots端口（supervisor.slots.ports: For each worker machine, you configure how many workers run on that machine with this config. Each worker uses a single port for receiving messages, and this setting defines which ports are open for use. If you define five ports here, then Storm will allocate up to five workers to run on this machine. If you define three ports, Storm will only run up to three. By default, this setting is configured to run 4 workers on the ports 6700, 6701, 6702, and 6703.)
For example:
```
supervisor.slots.ports:- 6700- 6701- 6702- 6703
```
⚠️如果Zookeeeper集群使用的端口跟默认的不同，那么需要设置storm.zookeeper.port
（If the port that your Zookeeper cluster uses is different than the default, you should set storm.zookeeper.port as well.）
运行daemons监控 (Launch daemons under supervision using"storm" script and a supervisor of your choice)
安装DRPC服务器（可选）Setup DRPC servers (Optional)

三、启动Storm进程
1、启动Nimbus。Run the command bin/storm nimbus under supervision on the master machine.

bin/storm nimubs &

2、启动Supervisor: Run the command bin/storm supervisor under supervision on each worker machine. The supervisor daemon is responsible for starting and stopping worker processes on that machine.

bin/storm supervisor &

3、启动UI: Run the Storm UI (a site you can access from the browser that gives diagnostics on the cluster and topologies) by running the command “bin/storm ui” under supervision. The UI can be accessed by navigating your web browser to http://{ui host}:8080.

bin/storm ui &

4、UI界面如下

四、查看log
log日志在storm包的logs文件夹中

storm2.1.0搭建教程相关推荐

Mycat2.0搭建教程
Mycat2.0搭建基础环境准备安装JDK1.8:我使用的JDK版本是 JDK1.8.0_181 安装MySQL:MySQL5.7安装教程 Mycat2官方文档安装Mycat2.0 下载安装包 ...
最新版的SSM框架spring5.0搭建教程(附源码)
<p>用SSM框架已经有一段时间了,但都没有完整地搭建过一次工程.前段时间比较有时间就自己试着搭建了一下,差不多都是用的最新的spring版本了,然后就在这个基础上做了很多的实验测试.最近 ...
java web 显示项目下的图片_[适合初中级Java程序员修炼手册从0搭建整个Web项目]（一）...
前言文本已收录至我的GitHub仓库,欢迎Star:https://github.com/bin392328206种一棵树最好的时间是十年前,其次是现在 six-finger-web 一个Web后端 ...
java web项目_[适合初中级Java程序员修炼手册从0搭建整个Web项目]（二）
前言文本已收录至我的GitHub仓库,欢迎Star:https://github.com/bin392328206种一棵树最好的时间是十年前,其次是现在 six-finger-web 一个Web后端 ...
apache为什么更适合处理动态请求_[适合初中级Java程序员修炼手册从0搭建整个Web项目]（一）...
前言文本已收录至我的GitHub仓库,欢迎Star:https://github.com/bin392328206种一棵树最好的时间是十年前,其次是现在 six-finger-web 一个Web后端 ...
php iis mysql windows2003,Windows Server 2003 IIS6.0+PHP5(FastCGI)+MySQL5环境搭建教程 | 系统运维...
准备篇一.环境说明: 操作系统:Windows Server 2003 SP2 32位 PHP版本:php 5.3.14 MySQL版本:MySQL5.5.25 二.相关软件下载: 1.PHP下载地 ...
ESP8266的MQTT客户端搭建教程（基于NONS_SDK_v2.0）
前言 MQTT是IBM开发的一个即时通讯协议,面向M2M和物联网的连接,采用轻量级发布和订阅消息传输机制,并且有可能成为物联网的重要组成部分. ESP8266是一款物美价廉的Wi-Fi芯片,集成Ten ...
mysql+server+80_Windows Server 2019 IIS10.0+PHP(FastCGI)+MySQL环境搭建教程
准备篇一.环境说明: 操作系统:Windows Server 2019 PHP版本:php 7.3.11 MySQL版本:MySQL 8.0.18.0 二.相关软件下载: 1.PHP下载地址: ht ...
php7 iis10 mysql_Windows Server 2019 IIS10.0+PHP(FastCGI)+MySQL环境搭建教程
准备篇一.环境说明: 操作系统:Windows Server 2019 PHP版本:php 7.3.11 MySQL版本:MySQL 8.0.18.0 二.相关软件下载: 1.PHP下载地址: ht ...

storm2.1.0搭建教程

storm2.1.0搭建教程相关推荐

最新文章

热门文章