Add support for tensor parallelism and add OLMo2-26B model config / train script #849

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Test (GPU)	3m 0s
Test checkpoint (GPU)	5m 44s
Lint	18s
Test	1m 23s
Test MoE (GPU)	2m 19s
Test checkpoint	1m 3s
Type check	20s
Build	25s
Style	20s
Docs	46s
Lint (min Python)	18s
Release	0s
	15m 56s