Add support for tensor parallelism and add OLMo2-26B model config / train script #841

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Test (GPU)	1m 34s
Test checkpoint (GPU)	2m 1s
Lint	23s
Test MoE (GPU)	55s
Test	1m 26s
Test checkpoint	1m 2s
Type check	20s
Build	22s
Style	33s
Docs	45s
Lint (min Python)	18s
Release	0s
	9m 39s