Environment Requirements
This document uses Tokenizers 0.22.2 as an example to describe how to compile and build Tokenizers on openEuler 24.03 LTS SP3. In addition, this section describes other environments supported by source code build verification.
Supported Versions
OS |
Python |
Tokenizers |
|---|---|---|
openEuler 24.03 LTS SP3 |
Python 3.11.6 |
Tokenizers 0.22.x (Tokenizers 0.22.2 is recommended.) |
openEuler 22.03 LTS SP4 |
Python 3.9.9 |
Tokenizers 0.22.x (Tokenizers 0.22.2 is recommended.) |
Tokenizers 0.22.2 requires Python 3.9 or later. The default Python version of openEuler 22.03 LTS SP4 is 3.9.9, which meets the requirement for building and installing Tokenizers 0.22.2.
Dependent Component Requirements
Component |
Version |
|---|---|
python3 |
3.11.6-20.oe2403sp3 |
python3-pip |
23.3.1-7.oe2403sp3 |
python3-devel |
3.11.6-20.oe2403sp3 |
GCC |
12.3.1-105.oe2403sp3 |
GCC-C++ |
12.3.1-105.oe2403sp3 |
Git |
2.43.0-10.oe2403sp3 |
Rust |
1.90.0-2.oe2403sp3 |
cargo |
1.90.0-2.oe2403sp3 |
pip |
26.1.1 |
setuptools |
82.0.1 |
wheel |
0.47.0 |
maturin |
1.13.3 |
packaging |
26.2 |