Release 22.05

This is a stable release of FlexFlow in preparation for the Unity merge.

Frontend support:

• FlexFlow now supports training HuggingFace models using the PyTorch fx interface. An example of training HuggingFace MT5 in FlexFlow is available at https://github.com/flexflow/FlexFlow/tree/master/examples/python/pytorch/mt5

PyTorch Alignment:

• Added unit tests for aligning FlexFlow's operators with PyTorch's. For each operator, the unit test checks if FlexFlow and PyTorch return identical activations/gradients when given the same inputs. More details of the PyTorch alignment is available at https://github.com/flexflow/FlexFlow/tree/master/align

Documentation:

• Initial documentation support added: https://github.com/flexflow/FlexFlow/tree/master/docs

Operators:

• Multiple bug fixes for FlexFlow operators

Broadcast:

• FlexFlow now supports broadcasting for a subset of operators, include elementwise unary and elementwise binary operators. The broadcasting semantic is identical to that of Numpy's