Skip to content

Add support for tensor parallelism and add OLMo2-26B model config / train script #847

Add support for tensor parallelism and add OLMo2-26B model config / train script

Add support for tensor parallelism and add OLMo2-26B model config / train script #847

Annotations

1 warning

Test MoE (GPU)

succeeded Dec 3, 2024 in 3m 6s