Environment Requirements
This document uses Tokenizers 0.22.2 as an example to describe how to install Tokenizers on openEuler 24.03 LTS SP3. In addition, this section describes other environments supported by Tokenizers installed on Kunpeng servers.
Supported Versions
OS |
Python |
Tokenizers |
|---|---|---|
openEuler 24.03 LTS SP3 |
Python 3.11.6 |
Tokenizers 0.22.x (Tokenizers 0.22.2 is recommended.) |
openEuler 22.03 LTS SP4 |
Python 3.9.9 |
Tokenizers 0.22.x (Tokenizers 0.22.2 is recommended.) |
Tokenizers 0.22.2 requires Python 3.9 or later. The default Python version of openEuler 22.03 LTS SP4 is 3.9.9, which meets the requirement for building and installing Tokenizers 0.22.2.
Dependent Component Requirements
Component |
Version |
|---|---|
python3 |
3.11.6-20.oe2403sp3 |
python3-pip |
23.3.1-7.oe2403sp3 |
pip |
26.1.1 |
setuptools |
82.0.1 |
wheel |
0.47.0 |
Tokenizers |
0.22.2 |
Parent topic: Installation Preparations