Installing the Triton Server SDK

This section describes how to install Docker using the Yum repository, and then use Docker to pull the Triton Server SDK image and install it.

1. Install Docker.

   1	yum install -y docker-engine

2. Verify the installed Docker version.

   1	docker --version

   If the version is 18.09.0 in the command output, the installation is successful.

3. Configure the Docker image repository and proxy.
   1. Create a Docker global configuration file.

      1 2	sudo mkdir -p /etc/docker sudo vi /etc/docker/daemon.json

   2. Press i to enter the insert mode and edit the daemon.json file. Set the image acceleration address, that is, add or modify the registry-mirrors field by replacing https://<docker-mirror> in the following information with the actual image acceleration address.

      {
          "registry-mirrors" : [   
              "https://2a6bf1988cb6428c877f723ec7530dbc.mirror.swr.myhuaweicloud.com",
              "https://docker.m.daocloud.io", 
              "https://hub-mirror.c.163.com",
              "https://mirror.baidubce.com",
              "https://your_preferred_mirror",
              "https://dockerhub.icu",
              "https://docker.registry.cyou",
              "https://docker-cf.registry.cyou",
              "https://dockercf.jsdelivr.fyi",
              "https://docker.jsdelivr.fyi",
              "https://dockertest.jsdelivr.fyi",
              "https://mirror.aliyuncs.com",
              "https://dockerproxy.com",
              "https://docker.nju.edu.cn",
              "https://docker.mirrors.sjtug.sjtu.edu.cn",
              "https://docker.mirrors.ustc.edu.cn",
              "https://mirror.iscas.ac.cn",
              "https://docker.rainbond.cc"
          ],
          "insecure-registries":[
              "production.cloudflare.docker.com",
              "nvcr.io"
          ],
          "data-root": "/home/docker",
          "log-opts": {
              "max-size": "50m",
              "max-file": "1"
          }
      }

      

      The Docker image of TritonServer SDK 24.05 is about 11.3 GB. Ensure that the download directory has sufficient space for it.

   3. Press Esc to exit the insert mode. Type :wq! and press Enter to save the file and exit.
   4. Create a Docker proxy configuration file.

      1 2	sudo mkdir -p /etc/systemd/system/docker.service.d sudo vim /etc/systemd/system/docker.service.d/http-proxy.conf

   5. Press i to enter the insert mode and add the following content to the http-proxy.conf file.
      Set the user name, password, proxy IP address, and proxy port based on your requirements.

      [Service]
      Environment="HTTP_PROXY=http://Username:Password@Proxy_IP_address:Proxy_port"
      Environment="HTTPS_PROXY=https://Username:Password@Proxy_IP_address:Proxy_port"
      Environment="NO_PROXY=localhost,127.0.0.1,huawei.com"

   6. Press Esc to exit the insert mode. Type :wq! and press Enter to save the file and exit.
   7. Reload the daemon file and restart Docker.

      1 2	sudo systemctl daemon-reload sudo systemctl restart docker

4. Pull the Triton Server SDK Docker image.

   1	docker pull nvcr.io/nvidia/tritonserver:24.05-py3-sdk

5. Check whether the image is successfully pulled.

   1	docker images | grep 24.05-py3-sdk

   If the corresponding information is displayed, the image has been pulled successfully.