(Optional) Enabling SR-IOV Passthrough

This section explains how to create VFs for devices that support SR-IOV, such as SR-IOV-enabled NVMe drives and NICs.

Currently, Huawei ES3000 V6 NVMe drives (using the NVMe driver) and SP680 SmartNIC are supported. The SP680 NIC supports VF RoCE.

1. Create VFs.
   • NVMe driver

     echo ${VF_NUM} > /sys/class/nvme/nvme0/device/sriov_numvfs

     1. Allocate resources.

        nvme virt-mgmt -c ${CTRL_ID} -a 7 /dev/nvme0
        nvme virt-mgmt -c ${CTRL_ID} -r 0 -a 8 -n 8 /dev/nvme0
        nvme virt-mgmt -c ${CTRL_ID} -a 9 /dev/nvme0

     2. Search for available namespaces.

        nvme list-ns -a /dev/nvme0

     3. Create a namespace (if no namespace is available).

        nvme create-ns /dev/nvme0 --nsze ${NS_SIZE} --ncap ${NS_SIZE} --flbas 0x0 --dps 0 --nmic 0

     4. Attach the namespace to the CTRL_ID corresponding to the VF.

        nvme attach-ns -n ${NSID} -c ${CTRL_ID} /dev/nvme0

        

        CTRL_ID indicates the controller ID corresponding to the VF. The controller ID for the first VF is 0x2, and so on.

        NSID indicates the namespace ID. Each VF must be assigned a dedicated namespace.

   • SP680 and Mellanox NICs

     echo ${VF_NUM} > /sys/class/net/eth0/device/sriov_numvfs

2. Destroy the VFs.
   • NVMe driver

     echo 0 > /sys/class/nvme/nvme0/device/sriov_numvfs

   • SP680 and Mellanox NICs

     echo 0 > /sys/class/net/eth0/device/sriov_numvfs