Test Guide
Introduction
Acceptance Criteria
This document provides guidance for accepting cloud phone products. Before the acceptance, ensure that the physical environment, system environment, and software version are correct. The test cases in this document are designed by the cloud phone product test team, covering the basic functions, performance, and reliability.
Important Notes
- Before the acceptance, ensure that the physical environment, system environment, and software version are correct and matched.
- Before executing the acceptance test cases, deploy the end-to-end environment of the video stream cloud phone. For details, see Installation Guide.
- Ensure that the acceptance items are confirmed by Huawei and the customer.
- During the product acceptance and preliminary acceptance tests, both parties should strictly observe applicable test criteria. Because some items have been tested before delivery, you can omit or sample such items if site conditions are limited.
Note:
Perform the acceptance in accordance with the contract and agreement reached by both parties. This document serves as a reference only.
Test Preparations
For details about the server hardware and software package information, environment deployment before test case acceptance, and the density test method, see Installation Guide. For details about the BIOS, iBMC, and CPLD versions, see Version Mappings.
Test Conventions
Result Description
The test results are defined as follows:
- PASS: The test result is consistent with the expected result after a test is performed based on the prerequisites and preset procedure.
- FAIL: The test result is inconsistent with the expected result after a test is performed based on the prerequisites and preset procedure.
- NT: The test is not implemented because the requirements have changed or the test environment does not meet the requirements.
Test Cases and Records
Basic Functional Tests
Video Stream Cloud Phone Codec Test
| Item | Content |
|---|---|
| Case No. | 4.1.1 |
| Test Objective | Verify the video codec function of the video stream cloud phone. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. The client has been connected to the video stream cloud phone. 3. An app has been installed on the video stream cloud phone. (You are advised to select an app from the compatibility list, such as Subway Surfers and KuGou.) |
| Test Procedure | Run the app on the client for 10 minutes and observe the screen display of each scenario. |
| Expected Result | The encoding and decoding modules of the video stream cloud phone run properly. During the running of the app, the image rendering, interface switching, and functions are normal. No artifact, black screen, crash, serious frame freezing, or unresponsiveness occurs. The screen orientation switchover is normal. The video stream cloud phone container does not crash, hang, or exhibit other anomalies. |
| Test Result | |
| Remarks |
Video Stream Cloud Phone Touch Test
| Item | Content |
|---|---|
| Case No. | 4.1.2 |
| Test Objective | Verify the touch control function of the video stream cloud phone. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. The client has been connected to the video stream cloud phone. 3. An app has been installed on the video stream cloud phone. (You are advised to select an app from the compatibility list, such as Subway Surfers and KuGou.) |
| Test Procedure | On the client, perform click or swipe operations for 10 minutes on the cloud phone or the app screen. |
| Expected Result | The touch control function is normal and smooth without frame freezing. |
| Test Result | |
| Remarks |
Video Stream Cloud Phone Audio Test
| Item | Content |
|---|---|
| Case No. | 4.1.3 |
| Test Objective | Verify the audio function of the video stream cloud phone. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. The client has been connected to the video stream cloud phone. 3. KuGou has been installed on the video stream cloud phone. |
| Test Procedure | Start KuGou, play a song, and adjust the volume. |
| Expected Result | The audio is properly played and the volume can be adjusted. |
| Test Result | |
| Remarks |
Video Stream Cloud Phone Microphone Test
| Item | Content |
|---|---|
| Case No. | 4.1.4 |
| Test Objective | Verify the microphone function of the video stream cloud phone. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. The client has been connected to the video stream cloud phone. 3. A voice recording app has been installed on the video stream cloud phone. |
| Test Procedure | Start the voice recording app and record voices. |
| Expected Result | The recording is successful, and the recording file is played properly. |
| Test Result | |
| Remarks |
Video Stream Cloud Phone GPS Passthrough Test
| Item | Content |
|---|---|
| Case No. | 4.1.5 |
| Test Objective | Verify the GPS passthrough function of the video stream cloud phone. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. The client has been connected to the video stream cloud phone. 3. AMap has been installed on the video stream cloud phone. |
| Test Procedure | Open AMap on the cloud phone and view the current location. |
| Expected Result | The positioning result is the actual location of the user's mobile phone. |
| Test Result | |
| Remarks |
Video Stream Cloud Phone Sensor Passthrough Test
| Item | Content |
|---|---|
| Case No. | 4.1.6 |
| Test Objective | Verify the sensor passthrough function of the video stream cloud phone. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. The client has been connected to the video stream cloud phone. 3. sensors_test.apk has been installed on both the video stream cloud phone and mobile phone. |
| Test Procedure | Open sensors_test.apk on both the video stream cloud phone and mobile phone. |
| Expected Result | The sensor data of the user's mobile phone is obtained, and the difference between the obtained results and the actual sensor data of the mobile phone is less than 5%. |
| Test Result | |
| Remarks |
Video Stream Cloud Phone High Resolution Test
| Item | Content |
|---|---|
| Case No. | 4.1.7 |
| Test Objective | Verify that the video stream cloud phone supports high resolution. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. Change the resolution to 1080p by referring to "Software Deployment" in Installation Guide, and then start the video stream cloud phone. 3. An app has been installed on the video stream cloud phone. (You are advised to select an app from the compatibility list, such as Subway Surfers and KuGou.) |
| Test Procedure | 1. Connect a physical phone to the cloud phone client and run the installed app. 2. Start the app and try it out for 10 minutes. |
| Expected Result | 1. The video stream cloud phone and app are running properly without frame freezing or black screen. 2. Run the docker exec -it android_x sh command to log in to the cloud phone, and then run the wm size command to check the resolution. The 1080p resolution is set successfully. |
| Test Result | |
| Remarks | In the test procedure, x in android_x indicates the ID of the created video stream cloud phone container. |
Video Stream Cloud Phone High Frame Rate Test
| Item | Content |
|---|---|
| Case No. | 4.1.8 |
| Test Objective | Verify that the video stream cloud phone supports a high frame rate. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. Change the frame rate to 60 fps by referring to "Software Deployment" in Installation Guide, and then start the video stream cloud phone. 3. An app has been installed on the video stream cloud phone. (You are advised to select an app from the compatibility list, such as Subway Surfers and KuGou.) |
| Test Procedure | 1. Connect a physical phone to the cloud phone client and run the installed app. 2. Start the app and try it out for 10 minutes. |
| Expected Result | The video stream cloud phone and app are running properly. The frame rate displayed in the floating window in the upper left corner on the video stream cloud phone client APK is stable at 55 fps to 60 fps. |
| Test Result | |
| Remarks |
Video Stream Component Version Query
| Item | Content |
|---|---|
| Case No. | 4.1.9 |
| Test Objective | Verify the function of querying the video stream component version. |
| Test Networking | None |
| Prerequisites | 1. The video stream cloud phone environment has been deployed. 2. A video stream cloud phone container has been created and connected to the ADB. |
| Test Procedure | 1. Run the sudo docker exec -it android_x sh command to access the video stream cloud phone container. Expected result 1 is displayed.2. Run the cat /vendor/etc/videoengine_version.txt command to query the version information. Expected result 2 is displayed. |
| Expected Result | 1. The container can be accessed. 2. The correct version information of the video stream component is displayed as follows. (The actual version number prevails.) Product Name: Kunpeng BoostKit |
| Test Result | |
| Remarks | In the test procedure, x in android_x indicates the ID of the created video stream cloud phone container. |
Performance Test
Video Stream Cloud Phone Density Test
| Item | Content |
|---|---|
| Case No. | 4.2.1 |
| Test Objective | Verify the density of the video stream cloud phone. |
| Test Networking | None |
| Prerequisites | The video stream cloud phone environment has been deployed. |
| Test Procedure | Start 120 video stream cloud phones with the specification of 720 x 1280@30 fps. Run Honor of Kings stably on the login page for 30 minutes. Then connect the client to the video stream cloud phones and collect frame rate statistics using a self-developed pressure test tool. |
| Expected Result | The 120 video stream cloud phones run stably. No error is reported during the test and the system performance is normal. The proportion of frame rates below 27 fps is not higher than 3%. |
| Test Result | |
| Remarks |
Test Results
Basic Test Information
| Item | Content |
|---|---|
| Device Manufacturer | |
| Device Model | |
| Test Location | |
| Test Personnel | |
| Test Time | |
| Other Information |
Test Result List
| Test Type | Case No. | Test Case | Test Result (PASS/FAIL/NT) |
|---|---|---|---|
| Basic functional tests | 4.1.1 | Video Stream Cloud Phone Codec Test | |
| 4.1.2 | Video Stream Cloud Phone Touch Test | ||
| 4.1.3 | Video Stream Cloud Phone Audio Test | ||
| 4.1.4 | Video Stream Cloud Phone Microphone Test | ||
| 4.1.5 | Video Stream Cloud Phone GPS Passthrough Test | ||
| 4.1.6 | Video Stream Cloud Phone Sensor Passthrough Test | ||
| 4.1.7 | Video Stream Cloud Phone High Resolution Test | ||
| 4.1.8 | Video Stream Cloud Phone High Frame Rate Test | ||
| 4.1.9 | Video Stream Component Version Query | ||
| Performance test | 4.2.1 | Video Stream Cloud Phone Density Test |
Customer Suggestions and Result Confirmation
Customer Suggestions
Result Confirmation
| Tested Party: Huawei Technologies Co., Ltd. | Testing Party: |
|---|---|
| Test Personnel Signature: | Test Personnel Signature: |
| Time: | Time: |