Kunpeng BoostKit for Database
Kunpeng BoostKit for Database provides application acceleration features, including those for MySQL OLAP performance acceleration and OLTP lock performance tuning. These features help improve OLAP query and analysis efficiency, as well as the OLTP online transaction processing to unleash the performance of multi-core computing power. Best practices of mainstream open-source and commercial databases are provided to help developers efficiently port and tune open-source components.
Getting Started
- What's new
Describes the latest updates in documents of Kunpeng BoostKit for Database.
- Feature list
Provides an overview of basic and application acceleration features.
- Technical white paper
Describes the solution architecture, networking, typical configuration, and key features of Kunpeng BoostKit for Database.
Basic Acceleration Features
Application Acceleration Features
- Milvus KBest optimization
Integrates Milvus reserved interfaces with the KBest algorithm to leverage Kunpeng advantages and enhance query performance.
- Milvus vector instruction optimization
Reduces distance function computing overhead using SVE instruction sets and hardware/software prefetching techniques to improve query performance.
- Milvus KScaNN optimization
Integrates Milvus reserved interfaces with the KScaNN algorithm to leverage Kunpeng advantages and enhance query performance.
- Network multipathing optimization
Binds NIC queue interrupts to CPUs across different NUMA nodes so that the NICs of the corresponding node preferentially handle service traffic, thereby establishing affinity between network requests and interrupts.
- Redis network asynchronization
Asynchronously executes network I/Os in batches through KBAIO to reduce system calls and context switching, enabling non-blocking operations and improving throughput.
- MySQL computing path optimization
Record matching optimization, SIMD-based character set processing optimization, and migration of unaligned memory access policies from x86 to the Arm architecture are used to improve the query, comparison, and calculation efficiency.
- MySQL binlog optimization
The binlog pre-allocation, lock splitting, and writeset_history data structure optimization are used to improve system performance.
- MySQL pluggable online vectorized analysis engine
Maximizes Kunpeng CPU multi-core capabilities through parallel execution plans while supporting pluggable dynamic loading.
- MySQL parallel query tuning
Accelerates OLAP queries by implementing parallel data reading and processing.
- MySQL fine-grained lock tuning
Replaces global lock_sys->mutex with fine-grained locks in OLTP scenarios to reduce contention and increase concurrency.
- MySQL lock-free tuning
Maintains transaction units with lock-free hash tables in OLTP scenarios to reduce contention and increase concurrency.
- MySQL NUMA scheduling tuning
Implements NUMA affinity scheduling for precise thread management of MySQL threads in OLTP scenarios.
- MySQL pluggable thread pool
Stabilizes CPU parallel task counts in high-concurrency OLTP scenarios via thread pool queue management.
- CRC32 instruction optimization
Replaces software-based CRC32 implementations with Kunpeng CRC32 hardware instructions to reduce computing overhead.
- Other MySQL features
Introduces optimizations for MySQL hash_table_locks, undo_spaces_lock, and thread counters.
- MySQL compatibility between features
Documents compatibility relationships between MySQL features.
System Tuning Guide
Open-Source Enablement
- Milvus
Guide for installation of Milvus.
- MySQL
Guide for porting, installation, deployment, and tuning of MySQL.
- MariaDB
Guide for porting, installation, and tuning of MariaDB.
- MongoDB
Guide for porting, installation, and tuning of MongoDB.
- Greenplum
Guide for porting, installation, deployment, and tuning of Greenplum.
- Percona
Guide for porting, installation, and tuning of Percona.
- TiDB
Guide for porting and installation of TiDB.
- OceanBase
Guide for deployment and tuning of OceanBase.
- Kapacitor
Guide for installation of Kapacitor.
- InfluxDB
Guide for porting and installation of InfluxDB.
- PostgreSQL
Guide for porting, installation, and tuning of PostgreSQL.
- Redis
Guide for porting, deployment, and tuning of Redis.
- FastDB
Guide for installation of FastDB.
- etcd
Guide for installation, deployment, and testing of etcd.
- RocksDB
Guide for installation and testing of RocksDB.
- Porting and tuning using the Kunpeng DevKit
Instructions for MySQL porting and tuning using the Kunpeng DevKit.
- Automatic deployment tool
Usage guide for the automatic database deployment and tuning tool.
- Database porting guide
Reference for modifying instructions when porting open-source database code to the Kunpeng platform.