Kunpeng BoostKit for SRA
Getting Started
- What's new
Provides the latest updates in documents of Kunpeng BoostKit for SRA.
- Technical white paper
Describes the solution architecture, advantages, and key features of Kunpeng BoostKit for SRA.
- List of Fixed Vulnerabilities
Provides the list of fixed vulnerabilities in open-source and third-party software involved in the Kunpeng BoostKit software packages.
BoostCore Basic Acceleration
Boost-X Application Acceleration
- BoostKit BoostSRA Before You Start
A recall algorithm library optimized for the Kunpeng platform. It optimizes the instruction set architecture and memory access mechanism of the Kunpeng processor at the bottom layer, improving the computing efficiency and throughput of the recall algorithm. It is especially suitable for high-concurrency recall scenarios.
Open-Source Enablement
- oneDNN
Guide for porting the oneDNN deep neural network library.
- PyTorch
Guide for porting the PyTorch open-source deep learning framework.
- TensorFlow
Guide for porting the TensorFlow deep learning framework.
- TensorFlow Serving
Guide for porting TensorFlow Serving, a high-performance system for serving machine learning models.
- ScaNN
Guide for porting ScaNN, an open-source vector similarity search library.
- DLRM
Guide for porting the DLRM deep learning recommendation model.
- TVM
Guide for porting TVM, an open-source deep learning compiler stack.
- ONNX Runtime
Guide for porting ONNX Runtime, a high-performance cross-platform engine for accelerating model inference in the ONNX format.
- Elasticsearch
Guide for porting Elasticsearch, a distributed search engine.
Performance Evaluation
- Inference Performance Benchmark Testing for Search and Recommendation Ranking Models
Describes how to deploy a benchmarking system to measure the inference performance of search and recommendation models, covering server and client environment setup and performance evaluation during the inference phase.