Mellanox IB交换机SM HA

官网参考链接：https://community.mellanox.com/s/article/understanding-subnet-manager–sm–high-availability–ha–on-mellanox-infiniband-switches

一、Mellanox SM HA Solution (Mellanox InfiniBand Switches)

When enabling SM HA (configuration synchronization) on Mellanox IB switches, the SM database is synchronized with all the switches enabled with SM.
The synchronization is done out-of-band using an Ethernet management network. All switches participating in the SM HA should be connected to the same management subnet (same network) without the need to go through a router. This is because the switches send multicast control frames that do not cross routers normally.
All the switches that participate in the Mellanox SM HA are joined to the InfiniBand subnet ID. Once joined, the synchronized SMs are launched. One of the nodes is elected as SM Master and the others are Slaves.
The SM HA allows the systems’ manager to enter and modify all InfiniBand SM configuration of the different subnet managers from a single location using a Virtual IP (VIP). All subnet managers can be controlled, started, or stopped from this VIP address. The user is expected to use the VIP address for SM configuration. Trying to configure SM parameters on a master or slave IP will be disabled.

二、实验环境

IB交换机	IP
SF6036-01	172.16.0.251
SF6036-02	172.16.0.252

三、配置

1、配置集群VIP

SF6036-01 [standalone: master] > enable
SF6036-01 [standalone: master] # config terminal
SF6036-01 [standalone: master] (config) # ib ha cluster ip 172.16.0.253 255.255.240.0
SF6036-01 [cluster: master] (config) #

2、添加第二个交换机到集群

SF6036-02 [standalone: master] (config) # ib ha cluster
SF6036-02 [cluster: standby] (config) #

3、开启集群

SF6036-01 [cluster: master] (config) # ib smnode SF6036-01 enable
SF6036-01 [cluster: master] (config) # ib smnode SF6036-02 enable

4、设置优先级（0-15）

SF6036-01 [cluster: master] (config) # ib smnode SF6036-01 sm-priority 1
SF6036-01 [cluster: master] (config) # ib smnode SF6036-02 sm-priority 2

四、查看集群

可以进行测试，断掉一台IB交换机的电源，Master会转移，且不会影响业务运行

1、查看IB高可用状态

SF6036-01 [cluster: master] (config) # show ib haGlobal HA state
==================
IB Subnet HA name: cluster
HA IP address:     172.16.0.253/20
Active HA nodes:   2HA node local informationName:         SF6036-01 (active)  <--- (local node)SM-HA state:  masterIP:           172.16.0.251Virtual switch membership:    infiniband-defaultHA node local informationName:         SF6036-02 (active)SM-HA state:  standbyIP:           172.16.0.252Virtual switch membership:    infiniband-defaultSF6036-01 [cluster: master] (config) # show ib ha briefGlobal HA state
==================
IB Subnet HA name: cluster
HA IP address:     172.16.0.253/20
Active HA nodes:   2ID                   SM-HA state   IP              Virtual switch membership
--------------------------------------------------------------------------------
*SF6036-01            master        172.16.0.251    infiniband-defaultSF6036-02            standby       172.16.0.252    infiniband-default

2、查看IB SM状态

SF6036-01 [cluster: master] (config) # show ib smnodesHA state of switch infiniband-default
========================================
IB Subnet HA name: cluster
HA IP address:     172.16.0.253/20
Active HA nodes:   2HA node local informationName:         SF6036-01 (active)  <--- (local node)SM-HA state:  masterSM Licensed:  yesSM Running:   runningSM Enabled:   enabled - masterSM Priority:  1IP:           172.16.0.251HA node local informationName:         SF6036-02 (active)SM-HA state:  standbySM Licensed:  yesSM Running:   runningSM Enabled:   enabledSM Priority:  2IP:           172.16.0.252

3、连接查看状态

此时我们可以通过172.16.0.253（VIP）进行连接！！！

保存配置信息（也可以在界面上面点击save保存）：

SF6036-01 [cluster-6036: master] (config) # write memory
SF6036-02 [cluster-6036: standby] (config) # write memory

Mellanox IB交换机SM HA相关推荐

两台IB交换机使用server side方式做高可用的记录
两台IB交换机使用server side方式做高可用的记录额外注意:IB交换机也分可不可以管理,比如SX6036就是可以管理的IB交换机, 两台可以管理的IB交换机可以在IB交换机上配置高可用来实现 ...
Mellanox IB卡驱动的安装和小记录
以centos8.2 + CX354A卡为例驱动: 系统默认自带核内驱动[INBOX]:插上卡开机lspci -k 就能看到对应的卡已经有mlx4_core这样的驱动加载了,这个是内核自带的驱动,对 ...
IB驱动及IB交换机模式切换
IB驱动及IB交换机模式切换 1.GPU驱动安装步骤如下: 参考之前安装GPU 驱动:[链接] 注意:A100 等nvlink版本的GPU需要安装额外的驱动包cuda-drivers-fabricm ...
Exadata X8M-2 不再使用IB交换机而换成了网络交换机
@[ED X8M-2 节点互联不再使用之前的IB交换机] Exadata X8-2 及之前的Exadata 一体机,都是使用Infiniband交换机,40Gbps速度新的ED X8M-2一体机则使 ...
IB交换机配置命令总结
串口通过远程CRT登录,波特率9600 用户名和密码都是admin Do you want to use the wizard for initial configuration? 选择no 打开ip ...
Mellanox IB卡虚拟化
IB卡型号: MT27500 1.BIOS里开启SRIOV,CPU开启VT以及安装网卡对应的驱动等过程略 2.修改启动菜单参数执行命令vi /etc/default/grub,按"i&qu ...
ib交换机 postgresql_postgresql关于访问视图需要的权限
某个用户访问一个视图,这个用户需要具备这个视图的schema的usage和这个视图本身的select权限,如果视图的基表来自其他schema,可能还需要其他schema的usage权限(根据postg ...
软件定义存储 HBA卡 IB交换机
HBA卡一般指主机总线适配器主机总线适配器是网络与交换,是能插入计算机或大型主机的板卡.光纤通道HBA(Host Bus Adapter)卡是将主机接入FC网络必不可少的设备. 能插入计算机.服务器 ...
一周一论文（翻译总结）—— [DSN 18] RDMC A Reliable RDMA Multicast for Large Objects :一个面向大型对象的可靠的RDMA广播框架
目录 Abstract 1.Introduction 2. Background On RDMA 3. High level RDMC summary 4. System Design 4.1 Ext ...

Mellanox IB交换机SM HA

一、Mellanox SM HA Solution (Mellanox InfiniBand Switches)

二、实验环境

三、配置

1、配置集群VIP

2、添加第二个交换机到集群

3、开启集群

4、设置优先级（0-15）

四、查看集群

1、查看IB高可用状态

2、查看IB SM状态

3、连接查看状态

Mellanox IB交换机SM HA相关推荐

最新文章

热门文章