- Changes
- Upgrade Jax from 0.4.33 to 0.4.34.
- Changes
- Upgrade Jax from 0.4.30 to 0.4.33.
- Changes
- Upgrade Python to 3.10
- Fall back to triton backend for qkv in fp32 or with bias on gpu flash attention.
- Changes
- Upgrade Jax from 0.4.28 to 0.4.30.
- Changes
- Add changelog.