Weights & Biases

Weights & Biases is an excellent tool to support training by running a series of alternate parameters on your models and logging the results. Wandb makes it easy to fine the best parameters and recall them to train your final model with.

The project page is at https://app.wandb.ai/mcdomx/cs109b_groupproject

Install and Setup:
pip install --upgrade wandb
wandb login <wandb token> (visit project page and login)

Include WANDB in Training Script:

import wandb wandb.init(project="cs109b_groupproject") Model instantiation code ... \# Log metrics with wandb

for _ in range(num_epochs): train_model() loss = calulate_loss() wandb.log({"Loss": loss})

\# Save model to wandb

np.save("weights", weights) wandb.save("weights.npy")

Execute training script as normal. Additional wandb logging entries will be displayed.