Add support for tensor parallelism and add OLMo2-26B model config / train script #838

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Test (GPU)	1m 26s
Lint	20s
Test checkpoint (GPU)	1m 53s
Test	1m 21s
Test MoE (GPU)	56s
Test checkpoint	56s
Type check	20s
Build	23s
Style	26s
Docs	41s
Lint (min Python)	20s
Release	0s
	9m 2s