[Pytorch] Is the fwd_amx_history of first module is used before required allreduce communication
#725
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
just as the titile
https://github.com/NVIDIA/TransformerEngine/blob/main/transformer_engine/pytorch/module/base.py#L541
Beta Was this translation helpful? Give feedback.
All reactions