Add support for tensor parallelism and add OLMo2-26B model config / train script #842

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Test (GPU)	1m 47s
Lint	30s
Test checkpoint (GPU)	2m 58s
Test	1m 21s
Test checkpoint	1m 3s
Test MoE (GPU)	2m 8s
Type check	21s
Build	26s
Style	22s
Docs	53s
Lint (min Python)	19s
Release	0s
	12m 8s