Code

Implement New Optimizers#828

Code

Open

WhenWen wants to merge 5 commits intostanford-crfm:mainstanford-crfm/levanter:mainfrom WhenWen:mainWhenWen/levanter-2024:mainCopy head branch name to clipboard

+373

Commits

Commits on Jan 1, 2024

• logs

  

  Kaiyue Wen

  committed
  86d6556

• try dataset path

  WhenWen

  committed
  8b0900f

Commits on Dec 3, 2024

• Merge branch 'main' of github.com:WhenWen/levanter-2024 into main

  

  Kaiyue Wen

  committed
  b8f28f4

• Implement MARS (tested) and Muon (have bug in saving), example config in config/llama2_100M_{mars/muon}.yaml

  

  Kaiyue Wen

  committed
  f98e376

• Implement MARS (tested) and Muon (have bug in saving), example config in config/llama2_100M_{mars/muon}.yaml

  

  Kaiyue Wen

  committed
  e961c95