Rate This Document
Findability
Accuracy
Completeness
Readability

Environment Requirements

This document uses FlashAttention 2.8.3 as an example to describe how to install FlashAttention on openEuler 24.03 LTS SP3. In addition, this section describes other environments supported by FlashAttention installed on Kunpeng servers.

Supported Versions

Table 1 Supported versions

OS

Python

FlashAttention

openEuler 24.03 LTS SP3

Python 3.11.6

FlashAttention 2.8.x

openEuler 22.03 LTS SP4

Python 3.9.9

FlashAttention 2.8.3 requires Python 3.9 or later, and must meet the PyTorch CUDA wheel, CUDA Toolkit, and NVIDIA GPU environment requirements.

Dependent Component Requirements

Table 2 Dependent components and versions

Component

Version

python3

3.11.6-20.oe2403sp3

python3-pip

23.3.1-7.oe2403sp3

CUDA Toolkit

13.0

PyTorch

2.11.0+cu130

FlashAttention

2.8.3

To use the GPU capability, the system must provide an accessible NVIDIA GPU device, CUDA Toolkit, and the matching NVIDIA driver user-mode library.