Deploying Trains Server: Linux and macOS

Deploy the Trains Server in Linux or macOS using our prebuilt Docker image.

Trains on Docker Hub

For Trains docker images, including previous versions, see Trains in Docker Hub. However, pulling the Trains Docker image directly is not required. We provide a docker compose YAML file that does this for you. The docker compose file is included in the instructions on this page.

Prerequisites

For Linux users only:

  • Your Linux distribution must support Docker. For more information, see this explanation in the Docker documentation.
  • You must be logged in as a user with sudo privileges.
  • Use bash for all command-line instructions in this installation.
  • The ports 8080, 8081, and 8008 must be available for the Trains Server services.

Deploying

Securing deployment

By default, Trains Server deploys as an open network. To restrict Trains Server access, follow the instructions in the Securing deployment section, on the "Configuring Trains Server" page.

To launch your Trains Server on Linux or macOS, do the following:

  1. Install Docker. The instructions depend upon your operating system:
  2. Verify the Docker CE installation. Execute the command:
    sudo docker run hello-world
    The expected is output is:
    Hello from Docker!
    This message shows that your installation appears to be working correctly.
    To generate this message, Docker took the following steps:
    
    1. The Docker client contacted the Docker daemon.
    2. The Docker daemon pulled the "hello-world" image from the Docker Hub. (amd64)
    3. The Docker daemon created a new container from that image which runs the executable that produces the output you are currently reading.
    4. The Docker daemon streamed that output to the Docker client, which sent it to your terminal.
    
  3. For Linux, only, install docker-compose. Execute the following commands (for more information, see Install Docker Compose in the Docker documentation):
    sudo curl -L "https://github.com/docker/compose/releases/download/1.24.1/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
    sudo chmod +x /usr/local/bin/docker-compose
    
  4. Increase vm.max_map_count for Elasticsearch in Docker. Execute the following commands, depending upon your operating system:
    • Linux:
      echo "vm.max_map_count=262144" > /tmp/99-trains.conf
      sudo mv /tmp/99-trains.conf /etc/sysctl.d/99-trains.conf
      sudo sysctl -w vm.max_map_count=262144
      sudo service docker restart
    • macOS:
      screen ~/Library/Containers/com.docker.docker/Data/vms/0/tty
      sysctl -w vm.max_map_count=262144
  5. Remove any previous installation of Trains Server.

    This clears all existing Trains SDK databases.

    sudo rm -R /opt/trains/
  6. Create local directories for the databases and storage.
    sudo mkdir -p /opt/trains/data/elastic
    sudo mkdir -p /opt/trains/data/mongo/db
    sudo mkdir -p /opt/trains/data/mongo/configdb
    sudo mkdir -p /opt/trains/data/redis
    sudo mkdir -p /opt/trains/logs
    sudo mkdir -p /opt/trains/config
    sudo mkdir -p /opt/trains/data/fileserver
  7. For macOS, only, do the following:
    1. Open the Docker app.
    2. Select Preferences.
    3. On the File Sharing tab, add /opt/trains.

  8. Grant access to the Dockers, depending upon your operating system.
    • Linux:

      sudo chown -R 1000:1000 /opt/trains

    • macOS:

      sudo chown -R $(whoami):staff /opt/trains


  9. Download the Trains Server docker-compose YAML file.

    sudo curl https://raw.githubusercontent.com/allegroai/trains-server/master/docker-compose.yml -o /opt/trains/docker-compose.yml

  10. Run docker-compose with the downloaded configuration file.

    sudo docker-compose -f /opt/trains/docker-compose.yml up -d

    Your server is now running on http://localhost:8080.

Port mapping

After deploying Trains Server, the services expose the following ports:

  • Web server on port 8080.
  • API server on port 8008.
  • File server on port 8081.

Restarting

To restart your Trains Server Docker deployment, do the following:

  • To restart Trains Server, first stop and then restart the Docker containers by executing the following commands:
    docker-compose -f /opt/trains/docker-compose.yml down
    docker-compose -f /opt/trains/docker-compose.yml up -d

Upgrading

To upgrade your Trains Server Docker deployment, do the following:

  1. Shut down the docker containers. Execute the following command:
    docker-compose -f docker-compose.yml down
  2. We recommend backing up your data and, if your configuration folder is not empty, backing up your configuration.

    For example:

    If your data and configuration folders are in /opt/trains, then archive all data into ~/trains_backup_data.tgz, and your configuration into ~/trains_backup_config.tgz:

    • backup your data and configuration.
      sudo tar czvf ~/trains_backup_data.tgz -C /opt/trains/data .
      sudo tar czvf ~/trains_backup_config.tgz -C /opt/trains/config .
    • restore your data and configuration.
      sudo rm -fR /opt/trains/data/* /opt/trains/config/*
      sudo tar -xzf ~/trains_backup_data.tgz -C /opt/trains/data
      sudo tar -xzf ~/trains_backup_config.tgz -C /opt/trains/config
  3. Download the latest docker-compose.yml file.
    curl https://raw.githubusercontent.com/allegroai/trains-server/master/docker-compose.yml -o /opt/trains/docker-compose.yml
  4. For Linux only, configure the Trains Agent Services. If TRAINS_HOST_IP is not provided, then Trains Agent Services will use the external public address of the Trains Server. If TRAINS_AGENT_GIT_USER / TRAINS_AGENT_GIT_PASS are not provided, then Trains Agent Services will not be able to access any private repositories for running service tasks.
    export TRAINS_HOST_IP=server_host_ip_here
    export TRAINS_AGENT_GIT_USER=git_username_here
    export TRAINS_AGENT_GIT_PASS=git_password_here
  5. Spin up the docker containers. This automatically pulls the latest Trains Server build.
    docker-compose -f /opt/trains/docker-compose.yml pull
    docker-compose -f /opt/trains/docker-compose.yml up -d

If issues arise during your upgrade, see the FAQ page, How do I fix Docker upgrade errors?.

Next Step