Environment Requirements
This section details the verified hardware and software environments suitable for the dynamic core isolation feature.
Hardware Requirements
Item |
Description |
|---|---|
Inference server |
Atlas 800I A3 inference server |
NPU |
8 × Ascend 910 |
CPU |
4 × Kunpeng 920 processor |
OS Requirements
Item |
Version |
Description |
|---|---|---|
openEuler |
22.03 LTS SP4 |
Verified Linux distribution. |
Software Requirements
Item |
Version |
Description |
|---|---|---|
vLLM |
- |
Used to start the intelligent computing inference service. |
vLLM-ascend |
- |
Used to adapt to vLLM on A3. |
Python |
3.10 or later |
Dynamic core isolation requires Python 3.10 or later. If an earlier version is used, dynamic core isolation will not take effect. |