Keras Tuner Integration¶
ClearMLTunerLogger class provides the required binding for ClearML automatic logging. Instantiate a
ClearMLTunerLogger object and assign it as the logger for a Keras Tuner tuner.
This is demonstrated in the keras_tuner_cifar.py example, which uses Keras Tuner’s
Hyperband tuner. It finds the best hyperparameters to train a network on a CIFAR10 dataset.
Hyperband object is created, instantiate a
ClearMLTunerLogger object and assign it to the
tuner = kt.Hyperband( build_model, project_name='kt examples', logger=ClearMLTunerLogger(), objective='val_accuracy', max_epochs=10, hyperband_iterations=6)
When the script runs, it logs a tabular summary of hyperparameters tested and their metrics by trial Id, and a scalar plot showing metrics for all runs, and summary plot, as well as the output model with its configuration and snapshot location.
ClearML logs the scalars from training each network. They appear in RESULTS > SCALARS.
Summary of hyperparameter optimization¶
ClearML automatically logs the parameters of each experiment run in the hyperparameter search. They appear in tabular form in RESULTS > PLOTS.
ClearML automatically stores the output model. It appears in ARTIFACTS > Output Model.
Model details include snap locations. Model details appear in the MODELS tab.
The model configuration is stored with the model.