Working with a Project Page

A project page contains all experiments and models associated with a project. Experiments appear in the experiments table, in the EXPERIMENTS tab. Models appear in the models table, in the MODELS tab.

The Trains Web-App (UI) also provides an All projects page containing all experiments and models in all projects.

Archiving experiments and models

To assist you in focusing on active experimentation, you can archive experiments and models. They appear in the archive area only, not in the active experiments and models tables.

The experiments table

The experiments table is a customizable list of experiments associated with a project. Use it to open the experiment info panel containing the experiment details, and to work with experiments. Also, use it as tracking leaderboard to monitor experimentation.

image

The default experiments table columns, in their default order, are the following:

  • TYPE - Type of experiment. Trains supports multiple task types for experimentation, and a variety of workflows and use cases.
  • NAME - Experiment name.
  • TAGS - Descriptive, user-defined, color-coded tags assigned to the experiment. Use tags to classify experiments, and filter the list. See Using experiment tags.

  • STATUS - Experiment state (status), including:

    • Draft - The experiment is editable, not running locally, not in any stage of remote execution (Pending, Running, Completed, Failed, or Aborted), and can be run (see rerunning, reproducing, and tuning experiments).
    • Pending - The experiment in a queue, and is awaiting a worker to fetch and execute it. It can be dequeued.
    • Running - The experiment is running, either locally or remotely. It can be published or aborted.
    • Completed - The experiment terminated successfully. It can be published or reset.
    • Failed - The experiment terminated with an error. It can be Reset and may run successfully without changes, depending upon the reason for the failure.
    • Aborted - The experiment terminated. A user aborted the experiment, or it was terminated programmatically. It can be Reset and may run successfully without changes, depending upon the reason for the failure.
    • Published - The experiment is not running, locally or remotely, and is read-only. Its model is in a shared library, and can be used by other experiments. The experiment can be cloned.
  • PROJECT - Experiment's project.

  • USER - User creating or cloning the experiment. By default, this column is hidden.
  • STARTED - Elapsed time since the experiment started. To view the date and time, hover over the elapsed time.
  • UPDATED - Elapsed time since the last update to the experiment. To view the date and time, hover over the elapsed time.
  • ITERATION - Last or most recent iteration of the experiment.
  • DESCRIPTION - A description of the experiment. For cloned experiments, the description indicates it is auto generated with a timestamp. By default, the DESCRIPTION column is hidden.

Customizing the experiments table

You can customize the experiments table by adding and hiding columns, sorting, and filtering. Changes are persistent (cached in the browser), and represented in the URL so that you can save customized settings in a browser bookmark and share it with teammates.

image

Use experiment table customization for various use cases, including:

  • Sorting models by metrics - Models are associated with the experiments that created them. To sort models by metrics, we use the experiments table. For each metric, use the last value, the minimal value, and / or the maximal value.
  • Tracking hyperparameters - Track hyperparameters by adding them as columns, and applying filters and sorting.

Customize any combination of the following:

  • Add metrics - Click image > + METRICS > Expand a metric > Select the LAST (value), MIN (minimal value), and / or MAX (maximal value) checkboxes.
  • Add hyperparameters - Click image > HYPER PARAMETERS > Expand a section > Select the hyperparameter checkboxes.
  • Show / hide columns - Click image > select or clear the checkboxes of columns to show or hide.
  • Filter columns - Type of experiment, experiment status (state), user
  • Sort columns - Metrics and hyperparameters, type of experiment, experiment name, start and last update elapsed time, and last iteration.
  • Dynamic column ordering - Drag a column title to a different position.
  • Column resizing - In the column heading, drag to a new size.
  • Column autofit - In the column heading, double click a resizer (column separator).

Auto refresh

Auto refresh allows you to continually monitor experiments by providing regular updates to the experiments table. The Trains Web-App (UI) keeps your auto refresh setting consistent between the experiments table, and the experiments comparison page.

Go to experiment details

  • On a project page, in the experiments table, click the experiment. The experiment info panel slides open. The info panel contains execution and general information, hyperparameters, artifacts, and experiment results.

Go to resources utilization monitoring

If an experiment is running in a worker, you can view resource utilization by the experiment.

  • In the experiments table, right click the experiment > View worker. The Workers & Queues page opens, showing the Workers tab containing the metrics chart and worker information, see the Workers and Queues documentation page.

Go to queues management

If an experiment is enqueued, you manage that queue, including reordering experiments in it, moving experiments to other queues, and removing experiments. This opens the Workers & Queues page, in the Queues tab, where you can also view resource metrics for queues.

An enqueued experiment has a status of Pending, and is awaiting a worker to fetch and execute it.

  • In the experiments table, right click the experiment > Click Manage Queue.

Archiving experiments

Archive experiments so that they do not appear on the active experiments table. They only appear in the archive. You can restore from the archive later.

To archive an experiment:

  • In the experiments table:
    • Archive one experiment - Right click the experiment Archive > ARCHIVE.
    • Archive multiple experiments - Select the experiment checkboxes > In the footer menu that appears at the bottom of the page, click ARCHIVE.
  • In the experiment info panel - Click image (menu) > Archive > ARCHIVE.

To restore an experiment:

  1. Click OPEN ARCHIVE
  2. Do any of the following:
    • In the experiments table:
      • Restore one experiment - Right click the experiment Restore > RESTORE.
      • Restore multiple experiments - Select the experiment checkboxes > Restore > RESTORE.
    • In the info panel, restore one experiment - Click image (menu) > Restore > RESTORE.

Moving experiments to projects

To better organize experimentation, you can change the project with which an experiment is associated by moving it to another project.

To move an experiment to another project:

  • In the experiments table, right click the experiment > Click Moving To Project > Select a project > Click MOVE.

You can also move experiments from one project to another from the experiment info panel menu.