Skip to content

Add support for tensor parallelism and add OLMo2-26B model config / train script #848

Add support for tensor parallelism and add OLMo2-26B model config / train script

Add support for tensor parallelism and add OLMo2-26B model config / train script #848

Annotations

1 warning

Test MoE (GPU)

succeeded Dec 3, 2024 in 3m 16s