Add support for tensor parallelism and add OLMo2-26B model config / train script #843

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Test (GPU)	1m 28s
Lint	19s
Test checkpoint (GPU)	2m 56s
Test	1m 21s
Test MoE (GPU)	2m 14s
Test checkpoint	1m 4s
Type check	22s
Build	32s
Style	33s
Docs	50s
Lint (min Python)	19s
Release	0s
	11m 58s