Use parallel coordinates plot to analyse multiple experiments

Outline

1. Fetch multiple experiments and analyse the relations between parameters, metrics and properties.
2. Save visualization as html (optionally).
3. Setup the visualization to your liking.
4. Inspect experiments lineage.

Before we start, make sure that you have dependencies installed

• neptune-client
• neptune-contrib[viz]
• hiplot

Example notebooks in Neptune

• credit-default-prediction
• example-project

These notebooks are tracked in Neptune public projects. You are free to play with the plots - they are interactive.

Learn more

Check integration documentation for more details.

Set project

Remember to set the project before you call visualization function

import neptune

from neptunecontrib.viz.parallel_coordinates_plot import make_parallel_coordinates_plot

neptune.init('USERNAME/example-project')

Make and save visualization to standalone html file

# magic happens here :)
# use parameter 'html_file_path' to save interactive plot to standalone html file.
make_parallel_coordinates_plot(html_file_path='my_visual.html',
                               metrics= ['epoch_accuracy', 'epoch_loss', 'eval_accuracy', 'eval_loss'],
                               params = ['activation', 'batch_size', 'dense_units', 'dropout', 'learning_rate', 'optimizer'],
                               tag='optuna')

Customize visualization to your need

1. Set axes order,
2. Drop unused axes,
3. Apply coloring to axis,
4. Sort by clicking on axis,
5. Select range in axis & slide.

Inspect experiments lineage

1. Right-click on the axis name,
2. Use options ‘Set as X axis’ and ‘Set as Y axis’ (in the menu XY group at the bottom),
3. When both are selected, you will see lineage plot below parallel coordinates plot.

Visualize axis distribution

1. Right-click on the column name,
2. Select “View distribution” at the bottom,
3. You will see distribution chart below the parallel plot.