Added support for the Pool, Batch Normalization (bnormal), Local Response Normalization (lrn), Reduction, PReLU, Binary, and RNN deep neural network operators on the Kunpeng platform.
Added support for the new Kunpeng 920 processor model.
When multiple TensorFlow sessions run concurrently and share operators, they rely on a common thread pool for execution. This can lead to resource contention and significantly reduce the performance. The TensorFlow Serving thread scheduling optimization feature is provided by Kunpeng to improve graph execution efficiency under the high-concurrency scenarios. The operator scheduling algorithm is improved and thread management is optimized, which greatly improves the model inference throughput in the high-concurrency scenarios.
This site uses cookies to improve your browsing experience. By continuing to browse this site, you agree to our use of cookies.View Details