Rate This Document
Findability
Accuracy
Completeness
Readability

Software Architecture

Figure 1 shows the TF Serving software architecture, and Table 1 describes the module functions.

Figure 1 TF Serving software architecture
Table 1 TF Serving module functions

Module

Description

TF Serving

Dedicated, high-performance inference server optimized for TensorFlow model deployment

TensorFlow

Open source machine learning framework specializing in deep learning model training and inference

SavedModel

TensorFlow's standardized model format enabling seamless model import, inference, and retraining across diverse TensorFlow implementations