Installing TritonServer SDK

This section describes how to install Docker using the Yum repository, and then use Docker to pull the TritonServer SDK image and install it.

1. Use PuTTY to log in to a server as the root user.
2. Go to the Yum configuration directory.

   cd /etc/yum.repos.d/

3. Add the openEuler image repository.
   1. Go to /etc/yum.repos.d and create an openEuler.repo file.

      cd /etc/yum.repos.d/
      vi openEuler.repo

   2. Press i to enter the insert mode and add the following content to the openEuler.repo file:

      [OS]
      name=OS
      baseurl=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/OS/$basearch/
      metalink=https://mirrors.openeuler.org/metalink?repo=$releasever/OS&arch=$basearch
      metadata_expire=1h
      enabled=1
      gpgcheck=1
      gpgkey=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/OS/$basearch/RPM-GPG-KEY-openEuler
      
      [everything]
      name=everything
      baseurl=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/everything/$basearch/
      metalink=https://mirrors.openeuler.org/metalink?repo=$releasever/everything&arch=$basearch
      metadata_expire=1h
      enabled=1
      gpgcheck=1
      gpgkey=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/everything/$basearch/RPM-GPG-KEY-openEuler
      
      [EPOL]
      name=EPOL
      baseurl=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/EPOL/main/$basearch/
      metalink=https://mirrors.openeuler.org/metalink?repo=$releasever/EPOL/main&arch=$basearch
      metadata_expire=1h
      enabled=1
      gpgcheck=1
      gpgkey=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/OS/$basearch/RPM-GPG-KEY-openEuler
      
      [debuginfo]
      name=debuginfo
      baseurl=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/debuginfo/$basearch/
      metalink=https://mirrors.openeuler.org/metalink?repo=$releasever/debuginfo&arch=$basearch
      metadata_expire=1h
      enabled=1
      gpgcheck=1
      gpgkey=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/debuginfo/$basearch/RPM-GPG-KEY-openEuler
      
      [source]
      name=source
      baseurl=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/source/
      metalink=https://mirrors.openeuler.org/metalink?repo=$releasever&arch=source
      metadata_expire=1h
      enabled=1
      gpgcheck=1
      gpgkey=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/source/RPM-GPG-KEY-openEuler
      
      [update]
      name=update
      baseurl=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/update/$basearch/
      metalink=https://mirrors.openeuler.org/metalink?repo=$releasever/update&arch=$basearch
      metadata_expire=1h
      enabled=1
      gpgcheck=1
      gpgkey=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/OS/$basearch/RPM-GPG-KEY-openEuler
      
      [update-source]
      name=update-source
      baseurl=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/update/source/
      metalink=https://mirrors.openeuler.org/metalink?repo=$releasever/update&arch=source
      metadata_expire=1h
      enabled=1
      gpgcheck=1
      gpgkey=http://repo.openeuler.org/openEuler-22.03-LTS-SP3/source/RPM-GPG-KEY-openEuler

   3. Press Esc, type :wq!, and press Enter to save the settings and exit.
4. Install Docker.

   yum install -y docker-engine

5. Verify the installed Docker version.

   docker --version

   If the version is 18.09.0 in the command output, the installation is successful.

6. Configure the Docker image repository and proxy.
   1. Create a Docker global configuration file.

      sudo mkdir -p /etc/docker
      sudo vi /etc/docker/daemon.json

   2. Press i to enter the insert mode and add the following content to the daemon.json file:

      {
          "registry-mirrors": [
              "https://docker.mirrors.ustc.edu.cn",
              "https://registry.docker-cn.com"
          ],
          "insecure-registries":[
              "production.cloudflare.docker.com",
              "nvcr.io"
      
          ],
          "data-root": "/home/docker",
          "log-opts": {
              "max-size": "50m",
              "max-file": "1"
          }
      }

      

      The downloaded image repository is stored in data-root, which is the root directory where the Docker daemon stores data. The size of the Docker image of TritonServer SDK 24.05 is about 11.3 GB. Ensure that the specified directory has enough space.

   3. Press Esc, type :wq, and press Enter to save the file and exit.
   4. Create a Docker proxy configuration file.

      sudo mkdir -p /etc/systemd/system/docker.service.d
      sudo vim /etc/systemd/system/docker.service.d/http-proxy.conf

   5. Press i to enter the insert mode and add the following content to the http-proxy.conf file.
      Set the user name, password, proxy IP address, and proxy port based on your requirements.

      [Service]
      Environment="HTTP_PROXY=http://Username:Password@Proxy_IP_address:Proxy_port"
      Environment="HTTPS_PROXY=https://Username:Password@Proxy_IP_address:Proxy_port"
      Environment="NO_PROXY=localhost,127.0.0.1,huawei.com"

   6. Press Esc, type :wq, and press Enter to save the file and exit.
   7. Reload the daemon file and restart Docker.

      sudo systemctl daemon-reload
      sudo systemctl restart docker

7. Pull the TritonServer SDK Docker image.

   docker pull nvcr.io/nvidia/tritonserver:24.05-py3-sdk

8. Verify and install the image.

   docker images | grep 24.05-py3-sdk

   If the corresponding information is displayed, the installation is successful.