Rate This Document
Findability
Accuracy
Completeness
Readability

Installing OmniStream

Installing the OmniStream Binary Package

When Flink is deployed separately, install and deploy the OmniStream binary package. A plugin-based deployment is supported.

  1. Create the /usr/local/OmniStream path on the physical machine. Decompress the BoostKit-omnistream_1.0.0.zip installation package obtained from Table 3 to the /usr/local/OmniStream path.
    1
    2
    3
    4
    unzip BoostKit-omnistream_1.0.0.zip
    mkdir -p /usr/local/OmniStream
    cp -r OmniStream_Default/* /usr/local/OmniStream/
    chmod -R 550 /usr/local/OmniStream/*
    
  2. Check the decompressed files.
    1
    ls
    

    After the binary package is decompressed, the four JAR packages, some SO files, basic library, and the include directory are obtained:

     1
     2
     3
     4
     5
     6
     7
     8
     9
    10
    11
    flink-tnel-0.1-SNAPSHOT.jar
    omni-flink-table-planner.jar
    omni-table-planer-0.1-SNAPSHOT.jar
    original-flink-tnel-0.1-SNAPSHOT.jar
    libtnel.so
    libsecurec.so
    libboostkit-omniop-codegen-1.8.0-aarch64.so
    libboostkit-omniop-operator-1.8.0-aarch64.so
    libboostkit-omniop-vector-1.8.0-aarch64.so
    libbasictypes
    include
    
  3. Update the configuration content in the /usr/local/flink/bin/config.sh file.
    1. Open the /usr/local/flink/bin/config.sh file.
      1
      vi /usr/local/flink/bin/config.sh
      
    2. Press i to enter the insert mode and add the library loading path. Modify constructFlinkClassPath(), comment out the native echo line, and add the new patch loading path.
      1
      2
      3
      # echo "$FLINK_CLASSPATH""$FLINK_DIST"
      PATCH=/usr/local/OmniStream/flink-tnel-0.1-SNAPSHOT.jar:/usr/local/OmniStream/omni-table-planer-0.1-SNAPSHOT.jar
      echo $PATCH:"$FLINK_CLASSPATH""$FLINK_DIST"
      

      The updated configuration file is as follows:

    3. Press Esc, type :wq!, and press Enter to save the file and exit.
  4. Update the configuration content in the /usr/local/flink/conf/flink-conf.yaml file.
    1. Open the /usr/local/flink/conf/flink-conf.yaml file.
      1
      vi /usr/local/flink/conf/flink-conf.yaml
      
    2. Press i to enter the insert mode and add the libtnel.so file configuration, that is, the directory where the .so file is decompressed in 2.
      1
      env.java.opts: -Djava.library.path=/usr/local/OmniStream/
      
    3. Press Esc, type :wq!, and press Enter to save the file and exit.
  5. If you need to use OmniStateStore as the state backend, configure it by following instructions in Starting OmniStateStore.