固件、驱动安装完成并重启后，确保RoCE功能已使能。执行配置操作之前，请正确安装perftest工具，如在CentOS系统上执行yum install perftest。

执行hiroce3 gids命令查看RoCE设备的ib_dev、idx和ip。

[root@localhost~]# hiroce3 gids
ib_dev          net_dev         port idx  gid                                      type     ip              link
----------      ----------      ---- ---  ---------------------------------------  -------  --------------  ----
hrn3_bond_0     bond0           1    0    fe80:0000:0000:0000:aedc:caff:feb9:b5de  RoCE v2                  up
hrn3_bond_0     bond0           1    1    0000:0000:0000:0000:0000:ffff:0a0a:0a22  RoCE v2  192.168.1.23    up

可以使用OFED自带的测试工具rping测试RoCE基础功能。

服务端：rping -s -P

客户端：rping -a ip -c -v

[root@localhost ~]# rping -a 192.168.1.23 -c -v
ping data: rdma-ping-0: ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqr
ping data: rdma-ping-1: BCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrs
ping data: rdma-ping-2: CDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrst
ping data: rdma-ping-3: DEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstu
ping data: rdma-ping-4: EFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuv
ping data: rdma-ping-5: FGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvw
ping data: rdma-ping-6: GHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwx
ping data: rdma-ping-7: HIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxy
ping data: rdma-ping-8: IJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz
ping data: rdma-ping-9: JKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzA
ping data: rdma-ping-10: KLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzA
ping data: rdma-ping-11: LMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzAB
ping data: rdma-ping-12: MNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzABC
ping data: rdma-ping-13: NOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzABCD
ping data: rdma-ping-14: OPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzABCDE
ping data: rdma-ping-15: PQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzABCDEF
ping data: rdma-ping-16: QRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzABCDEFG

可以使用OFED自带的测试工具ib_write_bw测试RoCE基础功能。

服务端：ib_write_bw -c RC -F -d ib_dev -D 1 -x idx

客户端：ib_write_bw -c RC -F -d ib_dev -D 1 -x idx ip

[root@localhost ~]# ib_write_bw -c RC -F -d hrn3_bond_0 -D 1 -x 1 192.168.1.23
---------------------------------------------------------------------------------------
                    RDMA_Write BW Test
 Dual-port       : OFF          Device         : hrn3_bond_0
 Number of qps   : 1            Transport type : IB
 Connection type : RC           Using SRQ      : OFF
 TX depth        : 128
 CQ Moderation   : 100
 Mtu             : 1024[B]
 Link type       : Ethernet
 GID index       : 1
 Max inline data : 0[B]
 rdma_cm QPs     : OFF
 Data ex. method : Ethernet
---------------------------------------------------------------------------------------
 local address: LID 0000 QPN 0x5eae PSN 0x27890e RKey 0x009000 VAddr 0x007fd3901ac000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:10:10:10:231
 remote address: LID 0000 QPN 0x2500 PSN 0x15f10e RKey 0x009200 VAddr 0x007ff394f9e000
 GID: 00:00:00:00:00:00:00:00:00:00:255:255:10:10:10:229
---------------------------------------------------------------------------------------
 #bytes     #iterations    BW peak[MB/sec]    BW average[MB/sec]   MsgRate[Mpps]
 65536      157000           0.00               9811.96            0.156991
---------------------------------------------------------------------------------------

RoCE基本配置