Rate This Document
Findability
Accuracy
Completeness
Readability

Installing OmniMV on openEuler 22.03

  1. Download the Conda software package and activate the Conda virtual environment.
    1. Download Conda.
      cd /opt
      wget -k https://repo.anaconda.com/archive/Anaconda3-2022.05-Linux-aarch64.sh
    2. Install Conda, for example, in the /opt/anaconda3 directory.
      bash Anaconda3-2022.05-Linux-aarch64.sh
    3. Initialize Conda.
      source /opt/anaconda3/etc/profile.d/conda.sh
    4. Create a Conda virtual environment named omnimv.
      conda create -n omnimv python=3.10
    5. Activate the Conda virtual environment.
      conda activate omnimv
  2. Use pip to download the Python dependencies.
    • Spark engine dependency packages
      pip install Cython==0.29.24
      pip install numpy==1.22.3
      pip install pandas==1.3.5
      pip install PyYAML==6.0
      pip install mo-sql-parsing
      pip install sql-metadata==2.6.0
      pip install scikit-learn==1.1.2
      pip install xgboost==1.7.3
      pip install pyspark==3.1.1
      pip install pydoop==2.0.0
    • ClickHouse engine dependency packages
      pip install Cython==0.29.24
      pip install numpy==1.22.3
      pip install pandas==1.3.5
      pip install PyYAML==6.0
      pip install mo-sql-parsing
      pip install sql-metadata==2.6.0
      pip install clickhouse-driver==0.2.4
      pip install scikit-learn==1.1.2
      pip install xgboost==1.7.3
  3. Download the software package of the materialized view recommendation algorithm.
    • Spark engine: Download the materialized view recommendation algorithm software package, and save the JAR package of the Spark SQL plugin and log parser JAR package to the server node of the Spark cluster. For details about how to obtain the software packages, see Obtaining Software. There is no special requirement on the software package paths. For example, you can store them in /opt/omnimv.
      mkdir -p /opt/omnimv
      mv boostkit-omnimv-spark-3.1.1-1.1.0-aarch64.jar /opt/omnimv
      mv boostkit-omnimv-logparser-spark-3.1.1-1.1.0-aarch64.jar /opt/omnimv
      mv BoostKit-omnimv_1.1.0.zip /opt/omnimv
    • ClickHouse engine:
      mkdir -p /opt/omnimv
      mv BoostKit-omnimv_1.1.0.zip /opt/omnimv
  4. Decompress the OmniMV component package and remove the read and execute permissions of other user groups on the generated folder.
    cd /opt/omnimv
    unzip BoostKit-omnimv_1.1.0.zip
    chmod -R o-r BoostKit-omnimv_1.1.0

    You are advised to decompress the package as a non-root user so that the generated directory has the minimum permission to prevent files from being replaced.