Experiments Table

This page describes the Trains Web-App Profile page, Experiments tab, experiments table which is a list of experiments in a project or all projects. The Overview section of this page provides details about the information in an experiments table, and the Features section highlights features and actions you can perform using the experiments table.

Overview

On the Projects page, experiments table, you can view the following for experiments in the projects:

  • TYPE - Type of experiment, including training and testing experiments. Use this field to sort and / or filter the list.
  • NAME - Experiment name. Use this field to sort the list.
  • STATUS - Experiment state (status). Use this field to sort and / or filter the list. The following describes the statuses:
    • Draft - The experiment is editable (only Draft is editable), is not running, is not queued, and can be Enqueued to run.
    • Pending - The experiment is queued, is not running, and can be Dequeued.
    • Running - The experiment is running, and can be Published or Aborted.
    • Completed - The experiment finished running (manually or automatically), and can be Published or Reset (resetting deletes previous output, makes the experiment editable, and the status becomes Draft).
    • Failed - The experiment is not running, and a failure occurred. It can be Reset and may run (without changed) depending upon the reason for the failure.
    • Aborted - The experiment is not running, and a user terminated it. It can be Reset and may run (without changes) depending upon the reason for the failure.
    • Published - The experiment is not running and is read-only. Its model is in a shared library, and it can be used by other experiments. The experiment cannot be edited, but it can be cloned (an editable copy created).
  • PROJECT - Experiment's project. Use this field to sort the list.
  • USER - User creating or cloning the experiment. This is the only default column that is neither sortable nor a filter.
  • STARTED - Elapsed time since the experiment started. To view the date and time, hover over the elapsed time. Use this field to sort the list.
  • UPDATES - Elapsed time since the experiment was last updated. To view the date and time, hover over the elapsed time. Use this field to sort the list.
  • ITERATION - Last or most recent iteration of the experiment. Use this field to sort the list.

Additionally, to organize your current, active work more easily, Trains provides an archive for experiments (and models). Experiments in the archive only appear when you open the archive, not when you open the Projects page. You can restore archived experiments from the archive.

Features

View experiment details

Manage experimentation

The Trains Web-App supports features allowing you to manage your experimentation.

Experiment context menu

The experiment context menu, which appears by right clicking an experiment, shows the options you can perform on the experiment. Depending upon the experiment's current status, some options are disabled.

To manage an experiment (perform an experiment action), on the experiments table, right click an experiment and then on the experiment context menu click one of the following options:

  • Results - Open the experiment's details panel in full screen mode.
  • Manage Queue - For enqueued experiments, open the Workers & Queues page, Queues tab.
  • View worker - For running experiments, open Workers & Queues page, Workers tab.
  • Enqueue - Add a Draft status experiment to the queue you select. To create a queue, see Add queues. To run a worker listening to a queue, see Trains Agent Reference.
  • Dequeue - Remove a Pending status experiment from a queue.
  • Reset - Make a Completed, Aborted, or Failed status experiment editable. The status becomes Draft. Any output from the previous run is deleted.
  • Abort - Terminate a running experiment. The status becomes Aborted.
  • Publish - Prevent changes to the experiment and its models. The status becomes Published and is read-only. To make changes to a Published experiment, clone it and edit the cloned experiment.
  • Clone - Create an editable copy of the experiment. The status of the cloned experiment is Draft.
  • Move To Project - Change the project to which the experiment belongs.
  • Archive - Move an experiment to the Archive.
  • Restore from archive - If you are in the archive, this option allows you to move an experiment back to the experiments table that appears when you open the Projects page.

Compare experiments

From the experiments table, you can select experiments to compare and open the comparison window where differences are highlighted.

To compare experiments, do the following:

  1. Select the checkbox of each experiment to compare, or select the checkbox at the top to select all experiments.
  2. In the comparison footer, click COMPARE. The comparison window appears.
  3. To view differences, click any tab and then expand a highlighted section.
  4. Use any of the following comparison features:
    • Change the base experiment (experiment to which the other are compared).
    • Compare experiments in progress by enabling auto refresh.
    • Add experiments to the comparison.
    • Remove experiments from the comparison.
    • In the DETAILS or HYPER PARAMETERS tabs, show only differing fields by hiding the identical ones.
    • In the SCALARS or PLOTS tabs, view by value or graph, hide selected scalars or plots, and use plot controls (for example, download the plot as a PNG or JSON file, or zoom into a portion of the plot).

Customize the experiments table

Sort, filter, and add or remove default columns, metrics, and hyperparameters in an experiments table. Also, save the customized table for reuse or share it with another user.

To customize an experiments table, do any combination of the following:

  • Sort by any column except USER.
  • Filter by TYPE of experiment or STATUS.
  • Add / remove columns by clicking settings and then doing any of the following:
    • Default columns - Select / clear default columns.
    • Metrics - Click + METRIC, expand a metric group, and then select your metrics.
    • Hyperparameters - Click + HYPER PARAMETER, and then select your hyperparameters.

Your customizations are added to the URL as parameters and values. You can bookmark this customized table for reuse and share it with other users.

Sort by model metrics

To sort models by metrics, do the following:

  1. Click + METRIC, expand a metric group, and then select your metrics.
  2. Sort by the new metric column.