PyTorch with TensorBoard

The example demonstrates the integration of ClearML into code which uses PyTorch and TensorBoard. It trains a simple deep neural network on the PyTorch built-in MNIST dataset. It creates a TensorBoard SummaryWriter object to log scalars during training, scalars and debug samples during testing, and a test text message to the console (a test message to demonstrate ClearML). When the script runs, it creates an experiment named pytorch with tensorboard which is associated with the examples project.


In the example script, the train and test functions call the TensorBoard SummaryWriter.add_scalar method to log loss. These scalars appear in RESULTS > SCALARS, along with the resource utilization plots, which are titled :monitor: machine.


Debug samples

ClearML automatically tracks images and text output to TensorFlow. They appear in RESULTS > DEBUG SAMPLES.



ClearML automatically logs TensorFlow Definitions. They appear in CONFIGURATIONS > HYPER PARAMETERS > TF_DEFINE.



Text printed to the console for training progress, as well as all other console output, appear in RESULTS > LOG.



Model artifacts associated with the experiment appear in the experiment info panel (in the EXPERIMENTS tab), and in the model info panel (in the MODELS tab).

The experiment info panel shows model tracking, including the model name and design (in this case, no design was stored).


The model info panel contains the model details, including the model URL, framework, and snapshot locations.