Installing OmniMV on openEuler 22.03
- Download the Conda software package and activate the Conda virtual environment.
- Download Conda.
cd /opt wget -k https://repo.anaconda.com/archive/Anaconda3-2022.05-Linux-aarch64.sh
- Install Conda, for example, in the /opt/anaconda3 directory.
bash Anaconda3-2022.05-Linux-aarch64.sh
- Initialize Conda.
source /opt/anaconda3/etc/profile.d/conda.sh
- Create a Conda virtual environment named omnimv.
conda create -n omnimv python=3.10
- Activate the Conda virtual environment.
conda activate omnimv
- Download Conda.
- Use pip to download the Python dependencies.
- Spark engine dependency packages
pip install Cython==0.29.24 pip install numpy==1.22.3 pip install pandas==1.3.5 pip install PyYAML==6.0 pip install mo-sql-parsing pip install sql-metadata==2.6.0 pip install scikit-learn==1.1.2 pip install xgboost==1.7.3 pip install pyspark==3.1.1 pip install pydoop==2.0.0
- ClickHouse engine dependency packages
pip install Cython==0.29.24 pip install numpy==1.22.3 pip install pandas==1.3.5 pip install PyYAML==6.0 pip install mo-sql-parsing pip install sql-metadata==2.6.0 pip install clickhouse-driver==0.2.4 pip install scikit-learn==1.1.2 pip install xgboost==1.7.3
- Spark engine dependency packages
- Download the software package of the materialized view recommendation algorithm.
- Spark engine: Download the materialized view recommendation algorithm software package, and save the JAR package of the Spark SQL plugin and log parser JAR package to the server node of the Spark cluster. For details about how to obtain the software packages, see Obtaining Software. There is no special requirement on the software package paths. For example, you can store them in /opt/omnimv.
mkdir -p /opt/omnimv mv boostkit-omnimv-spark-3.1.1-1.1.0-aarch64.jar /opt/omnimv mv boostkit-omnimv-logparser-spark-3.1.1-1.1.0-aarch64.jar /opt/omnimv mv BoostKit-omnimv_1.1.0.zip /opt/omnimv
- ClickHouse engine:
mkdir -p /opt/omnimv mv BoostKit-omnimv_1.1.0.zip /opt/omnimv
- Spark engine: Download the materialized view recommendation algorithm software package, and save the JAR package of the Spark SQL plugin and log parser JAR package to the server node of the Spark cluster. For details about how to obtain the software packages, see Obtaining Software. There is no special requirement on the software package paths. For example, you can store them in /opt/omnimv.
- Decompress the OmniMV component package and remove the read and execute permissions of other user groups on the generated folder.
cd /opt/omnimv unzip BoostKit-omnimv_1.1.0.zip chmod -R o-r BoostKit-omnimv_1.1.0
You are advised to decompress the package as a non-root user so that the generated directory has the minimum permission to prevent files from being replaced.
Parent topic: Installing the Materialized View Feature