Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

Deploying the Meta Service

This section describes how to deploy the metadata management service on the Meta node.

  1. Obtain the binary file and configuration file from the compilation server.
    mkdir -p /var/log/3fs 
mkdir -p /opt/3fs/{bin,etc} 
rsync -avz meta:/home/3fs/build/bin/meta_main /opt/3fs/bin 
rsync -avz meta:/home/3fs/configs/{meta_main_launcher.toml,meta_main.toml,meta_main_app.toml} /opt/3fs/etc 
rsync -avz meta:/home/3fs/deploy/systemd/meta_main.service /usr/lib/systemd/system
  2. Update the meta_main_app.toml configuration file.
    1. Open /opt/3fs/etc/meta_main_app.toml. 
      vim /opt/3fs/etc/meta_main_app.toml
    2. Press i to enter the insert mode and update the file as follows: 
      allow_empty_node_id = true 
node_id = 100 # Update the node ID.
    3. Press Esc to exit the insert mode. Type :wq! and press Enter to save the file and exit.
  3. Update the meta_main_launcher.toml configuration file.
    1. Open /opt/3fs/etc/meta_main_launcher.toml. 
      vim /opt/3fs/etc/meta_main_launcher.toml
    2. Press i to enter the insert mode and update the file as follows: 
      ... 
cluster_id = "stage" 
... 
[mgmtd_client] 
mgmtd_server_addresses = ["RDMA://192.168.65.10:8000"] 
...
    3. Press Esc to exit the insert mode. Type :wq! and press Enter to save the file and exit.
  4. Update the meta_main.toml configuration file.
    1. Open /opt/3fs/etc/meta_main.toml. 
      vim /opt/3fs/etc/meta_main.toml
    2. Press i to enter the insert mode and update the file as follows: 
      ... 
[server.mgmtd_client] 
mgmtd_server_addresses = ["RDMA://192.168.65.10:8000"]  
[common.monitor.reporters.monitor_collector] 
remote_ip = "192.168.65.10:10000" 
... 
[server.fdb] 
clusterFile = '/opt/3fs/etc/fdb.cluster' 
... 
[server.base.groups.listener] 
filter_list = ['enp1s0f0np0'] 
listen_port = 8001 
... 
[server.base.groups.listener] 
filter_list = ['enp1s0f0np0'] 
listen_port = 9001 
...
    3. Press Esc to exit the insert mode. Type :wq! and press Enter to save the file and exit.
  5. Update the Meta node configuration to the Mgmtd Service.
    /opt/3fs/bin/admin_cli -cfg /opt/3fs/etc/admin_cli.toml "set-config --type META --file /opt/3fs/etc/meta_main.toml"
  6. Start the service.
    systemctl start meta_main
  7. Check the service status.
    systemctl status meta_main

  8. Check nodes.
    /opt/3fs/bin/admin_cli -cfg /opt/3fs/etc/admin_cli.toml "list-nodes"

    Command output:

    # Id     Type     Status               Hostname  Pid      Tags  LastHeartbeatTime    ConfigVersion  ReleaseVersion 
# 1      MGMTD    PRIMARY_MGMTD        meta      2281735  []    N/A                  1(UPTODATE)   250228-dev-1-999999-923bdd7c 
# 100    META     HEARTBEAT_CONNECTED  meta      2281842  []    2025-03-12 17:01:32  1(UPTODATE)   250228-dev-1-999999-923bdd7c