原文地址:http://docs.graylog.org/en/latest/pages/architecture.html

Architectural considerations

There are a few rules of thumb when scaling resources for Graylog:

  • graylog-server nodes should have a focus on CPU power.
  • Elasticsearch nodes should have as much RAM as possible and the fastest disks you can get. Everything depends on I/O speed here.
  • MongoDB is only being used to store configuration and the dead letter messages, and can be sized fairly small.
  • graylog-web-interface nodes are mostly waiting for HTTP answers of the rest of the system and can also be rather small.
  • graylog-radio nodes act as workers. They don’t know each other and you can shut them down at any point in time without changing the cluster state at all.

Also keep in mind that messages are only stored in Elasticsearch. If you have data loss on Elasticsearch, the messages are gone - except if you have created backups of the indices.

MongoDB is only storing meta information and will be abstracted with a general database layer in future versions. This will allow you to use other databases like MySQL instead.

Minimum setup

This is a minimum Graylog setup that can be used for smaller, non-critical, or test setups. None of the components is redundant but it is easy and quick to setup.

Bigger production setup

This is a setup for bigger production environments. It has several graylog-server nodes behind a load balancer that share the processing load. The load balancer can ping the graylog-server nodes via REST/HTTP to check if they are alive and take dead nodes out of the cluster.

Highly available setup with Graylog Radio

Beginning with Graylog 1.0 on we do no longer recommend running Graylog Radio because we are now using a high-performant message journal (from the Apache Kafka project) in every graylog-server instance which is spooling all incoming messages to disk immediately and is able to buffer load spikes just at least as good as Graylog Radio was, but with less dependencies and maintenance overhead.

If you are running a setup with Graylog Radio we recommend to shut down the Graylog Radio architecture including AMQP or Kafka brokers completely and directly send messages to thegraylog-server nodes. If you have been using Graylog Radio for load balancing, you should now put a classic load balancer in front of your graylog-server nodes.

This approach has been proven to work great in large high-throughput setups of several of our large scale customers and immensely reduced complexity of their setups.

The Kafka and AMQP inputs are still supported and can be used to build a custom setup using message brokers, if you want to keep using that. A reason for this might be that Graylog is not the only subscriber to the messages on the bus. However we would recommend to use Graylog forwarders to either write to a message bus after processing or write to other systems directly.

转载于:https://www.cnblogs.com/davidwang456/p/4486778.html

graylog2 架构--转载相关推荐

  1. wcf系列学习5天速成——第四天 wcf之分布式架构(转载)

    今天是wcf系列的第四天,也该出手压轴戏了.嗯,现在的大型架构,都是神马的, nginx鸡群,iis鸡群,wcf鸡群,DB鸡群,由一个人作战变成了群殴....... 今天我就分享下wcf鸡群,高性能架 ...

  2. IoC~MVC3+EF+Autofac实现松耦合的系统架构 [转载]

    MVC3+EF+Autofac网上这种文章确实没有,呵呵,今天就写一个,代大家分享! 这个系列的文章将带我们进入一种新的开发模式,注入开发模式,或者叫它IOC模式,说起IOC你可以这样去理解它,它为你 ...

  3. 数据库高可用架构 转载

    数据库高可用架构对于我们这些应用端开发的人来说是一个比较陌生的领域,是在具体的数据库产品之上搭建的环境,需要像DBA这样对数据库产品有足够的了解才能有所涉及,虽然不能深入其中,但可以通过一些经典的高可 ...

  4. 一步步构建大型网站架构(转载)

    之前我简单向大家介绍了各个知名大型网站的架构,亿万用户网站MySpace的成功秘密.Flickr架构.YouTube网站架构.PlentyOfFish 网站架构学习.WikiPedia技术架构学习笔记 ...

  5. Gobelieve 架构(转载)

    Gobelieve 架构 Gobelieve github地址 im 客户连接服务器 (可分布式部署,暂无负载均衡模块) imr 路由查询服务器(主要解决im分布式部署的问题) ims 存储服务器 ( ...

  6. 大型高并发高负载网站的系统架构[转载]

    我在Cernet做过拨号接入平台的搭建,而后在Yahoo3721负载搜索引擎前端平台开发,又在猫扑处理过大型社区猫扑大杂烩的架构升级等工作,同时自己接触和开发过不少大中型网站的模块,因此在大型网站应对 ...

  7. B/S三层架构[转载]

    三层架构(3-tier application) 通常意义上的三层架构就是将整个业务应用划分为:表现层(UI).业务逻辑层(BLL).数据访问层(DAL).区分层次的目的即为了"高内聚,低耦 ...

  8. OPC协议解析-OPC UA OPC统一架构(转载)

    1    什么是OPC UA 为了应对标准化和跨平台的趋势,为了更好的推广OPC,OPC基金会近些年在之前OPC成功应用的基础上推出了一个新的OPC标准-OPC UA.OPC UA接口协议包含了之前的 ...

  9. 性能测试分享:系统架构

    性能测试分享:系统架构 转载于:https://www.cnblogs.com/poptest/p/4904584.html

最新文章

  1. c语言中热河输入空格,承德市2020年(春秋版)小学英语六年级上册期中考试模拟试卷(1)C卷...
  2. cocos2d-x jni相关目录分析
  3. div弹窗如何设置不超出页面_js实现弹窗功能(以支付方式为例)
  4. pycharm 进行远程服务器修改与调试
  5. python3爬虫初探(三)之正则表达式
  6. .NET6之MiniAPI(十九):NLog
  7. linux查看登录服务器的ip历史记录,通过登陆IP记录Linux所有用户登录所操作日志的方法...
  8. WEB安全基础-SQL相关
  9. String类的equals()与==的区别
  10. scala apply是什么
  11. 03.Java多线程并发库API使用2
  12. Win32 Application和Win32 Console Application区别
  13. Revit二次开发——依据两条平曲线创建一条三维曲线
  14. vmlogin效果怎么样?亚马逊防关联超级浏览器,电商多账号管理神器
  15. 2021-10-18 构建电影数据库MovieDB(数据库第一次实验)
  16. 微信公众号推送文图片什么尺寸最佳?(转)
  17. vue 手写签名_真正的艺术签名!让你的名字充满明星范!
  18. Kubuntu终端中文显示一半解决办法
  19. 如何阻止搜索引擎收录指定网页
  20. 两年多工作心得和体会

热门文章

  1. python函数能否增强代码可读性_总结的几个Python函数方法设计原则
  2. python解密md5值_Python之POST提交解密MD5
  3. 巡检水中机器人_海洋与地球学院学子在2020年国际水中机器人大赛中获得佳绩...
  4. 爬虫+数据分析,制作一个世界疫情人数增长动态柱状竞赛图
  5. python判断实例的类型
  6. StackToQueue
  7. linux 内存 shared,Linux Shared Memory的查看与设置
  8. app.vue只执行一次吗_面包可以只发酵一次吗?
  9. c++ 头文件 .h 理解与实践
  10. Linux 下的动态链接库问题