Environment Requirements
Before the performance test, ensure that the environment meets the hardware and software requirements. The hardware configuration includes CPUs. The software configuration includes the OS and applications.
Hardware requirements
Table 1 lists the hardware requirement.
OS requirements
Table 2 lists the OS requirement.
Software Requirements
The software requirements for model training and inference are different, as shown in Table 3 and Table 4.
Item |
Version |
Description |
Build Mode |
|---|---|---|---|
TensorFlow |
1.15.5 |
Training models from ModelZoo |
Build it using source code. |
Python |
3.7 |
Dependency for TensorFlow 1.15 installation |
Obtain it from Conda. |
CMake |
3.22.0 or later |
Cross-platform build system generator with cross-compiling support. |
Install it using a Yum repository. |
GCC/G++ |
10.3.1/12.3.1 |
GNU Compiler Collection (GCC), a compiler system developed by the GNU project, supporting multiple programming languages. |
Install it using a Yum repository. |
Bazel |
0.26.0 |
Build tool for TensorFlow 1.15.5 installation |
Build it using source code. |
Git |
No version requirement |
Code management tool |
Install it using a Yum repository. |
Table 4 describes the software requirements in the model inference phase.
Item |
Version |
Description |
Build Mode |
|---|---|---|---|
TensorFlow Serving |
2.15 |
Server for model deployment and inference request processing in the benchmarking system |
Build it using source code. |
Python |
3.9 or later |
Python execution environment |
Obtain it from Conda. |
CMake |
3.22.0 or later |
Cross-platform build system generator with cross-compiling support. |
Install it using a Yum repository. |
GCC/G++ |
12.3.1 |
GNU Compiler Collection (GCC), a compiler system developed by the GNU project, supporting multiple programming languages. |
Install it using a Yum repository. |
Bazel |
6.5.0 |
Fast and scalable build tool, required for compiling TensorFlow Serving 2.15. |
Build it using source code. |
TritonServer (Triton server) |
24.05 |
Performance test tool |
Pull an image from Docker. |
Git |
No version requirement |
Code management tool |
Install it using a Yum repository. |