openeuler22.03安装Mellanox网卡驱动

1,确定服务器的是mlx的网卡

[root@e610-x ~]# lspci | grep Mell
71:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
71:00.1 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
72:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
72:00.1 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]

2,下载对应的驱动
https://network.nvidia.com/products/infiniband-drivers/linux/mlnx_ofed/

下载iso即可,下载将ISO上传到服务器上.
3,挂载ISO并执行安装

mount MLNX_OFED_LINUX-5.9-0.5.6.0--openeuler22.03-x86_64.iso /mnt
cd /mnt
./mlnxofedinstall 
提示:
Logs dir: /tmp/MLNX_OFED_LINUX.176007.logs
General log file: /tmp/MLNX_OFED_LINUX.176007.logs/general.log
Error: One or more required packages for installing MLNX_OFED_LINUX are missing.
Please install the missing packages using your Linux distribution Package Management tool.
Run:
yum install fuse-devel tcsh pciutils-devel lsof

安装包:

yum install fuse-devel tcsh pciutils-devel lsof	

成功后继续执行:

./mlnxofedinstall 

安装过程会检测FM版本并自动升级到最新版本.
完成后提示:

Real log file: /tmp/MLNX_OFED_LINUX.177086.logs/fw_update.log
You may need to update your initramfs before next boot. To do that, run:

   dracut -f
To load the new driver, run:
/etc/init.d/openibd restat

执行上述命令即可完成安装,如果提示有占用,需要将对应的卸载掉再重新restart就行了.

补充查询命令:

[root@e610-x ~]# lsmod |grep mlx
mlx5_ib               479232  0
ib_uverbs             155648  2 rdma_ucm,mlx5_ib
ib_core               487424  8 rdma_cm,ib_ipoib,iw_cm,ib_umad,rdma_ucm,ib_uverbs,mlx5_ib,ib_cm
mlx5_core            2191360  1 mlx5_ib
mlxfw                  40960  1 mlx5_core
psample                20480  1 mlx5_core
auxiliary              16384  2 mlx5_ib,mlx5_core
tls                   118784  1 mlx5_core
mlxdevm               380928  1 mlx5_core
mlx_compat             69632  12 rdma_cm,ib_ipoib,mlxdevm,iw_cm,auxiliary,ib_umad,ib_core,rdma_ucm,ib_uverbs,mlx5_ib,ib_cm,mlx5_core
pci_hyperv_intf        16384  1 mlx5_core
[root@e610-x ~]# modinfo mlx5_core
filename:       /lib/modules/5.10.0-60.18.0.50.oe2203.x86_64/extra/mlnx-ofa_kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko
alias:          auxiliary:mlx5_core.eth-rep
alias:          auxiliary:mlx5_core.eth
basedon:        Korg 6.0-rc4
version:        5.9-0.5.5
license:        Dual BSD/GPL
description:    Mellanox 5th generation network adapters (ConnectX series) core driver
author:         Eli Cohen <eli@mellanox.com>
srcversion:     7040E2CBB5B50515F38D586
alias:          pci:v000015B3d0000A2DFsv*sd*bc*sc*i*
alias:          pci:v000015B3d0000A2DCsv*sd*bc*sc*i*
alias:          pci:v000015B3d0000A2D6sv*sd*bc*sc*i*
alias:          pci:v000015B3d0000A2D3sv*sd*bc*sc*i*
alias:          pci:v000015B3d0000A2D2sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001023sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001021sv*sd*bc*sc*i*
alias:          pci:v000015B3d0000101Fsv*sd*bc*sc*i*
alias:          pci:v000015B3d0000101Esv*sd*bc*sc*i*
alias:          pci:v000015B3d0000101Dsv*sd*bc*sc*i*
alias:          pci:v000015B3d0000101Csv*sd*bc*sc*i*
alias:          pci:v000015B3d0000101Bsv*sd*bc*sc*i*
alias:          pci:v000015B3d0000101Asv*sd*bc*sc*i*
alias:          pci:v000015B3d00001019sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001018sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001017sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001016sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001015sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001014sv*sd*bc*sc*i*
alias:          pci:v000015B3d00001013sv*sd*bc*sc*i*
alias:          auxiliary:mlx5_core.sf
depends:        mlx_compat,auxiliary,mlxfw,mlxdevm,pci-hyperv-intf,psample,tls
retpoline:      Y
name:           mlx5_core
vermagic:       5.10.0-60.18.0.50.oe2203.x86_64 SMP mod_unload modversions
parm:           guids:charp
parm:           node_guid:guids configuration. This module parameter will be obsolete!
parm:           num_of_groups:Eswitch offloads number of big groups in FDB table. Valid range 1 - 1024. Default 15 (uint)
parm:           debug_mask:debug mask: 1 = dump cmd data, 2 = dump cmd exec time, 3 = both. Default=0 (uint)
parm:           prof_sel:profile selector. Valid range 0 - 3 (uint)
parm:           probe_vf:probe VFs or not, 0 = not probe, 1 = probe. Default = 1 (bool)

通过flint查询:
[root@e610-x ~]# lspci | grep Mell
71:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
71:00.1 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
72:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
72:00.1 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
[root@e610-x ~]# flint -d 71:00.0 q
Image type:            FS4
FW Version:            16.35.2000
FW Release Date:       24.11.2022
Product Version:       16.35.2000
Rom Info:              type=UEFI version=14.28.16 cpu=AMD64
                       type=PXE version=3.6.805 cpu=AMD64
Description:           UID                GuidsNumber
Base GUID:             b8cef6030083af1a        8
Base MAC:              b8cef683af1a            8
Image VSD:             N/A
Device VSD:            N/A
PSID:                  MT_0000000012
Security Attributes:   N/A

查看网卡映射
[root@e610-x ~]# ibdev2netdev | grep mlx
mlx5_0 port 1 ==> ens27f0np0 (Down)
mlx5_1 port 1 ==> ens27f1np1 (Up)
mlx5_2 port 1 ==> ens28f0np0 (Down)
mlx5_3 port 1 ==> ens28f1np1 (Up)