Vectorize GEMM output dequantization and fuse bias & activation #2363

Job	Run time
build-and-push-docker-images	33m 35s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	7m 16s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	6m 40s
build-and-test-cpp-x86_64 (macos-11, mkl)	7m 30s
build-and-test-cpp-x86_64 (macos-11, dnnl)	7m 33s
build-python-wheels (ubuntu-20.04, auto64)	39m 55s
build-python-wheels (macos-11, auto64)	40m 9s
build-python-wheels (windows-2019, auto64)	1h 0m 6s
build-python-wheels (ubuntu-20.04, aarch64)	2h 16m 15s
build-python-wheels (macos-11, arm64)	10m 5s
build-and-test-cpp-aarch64 (openblas)	5m 59s
check-python-style	10s
build-and-deploy-docs	55s
test-python-wheels (ubuntu-20.04)	4m 49s
test-python-wheels (macos-11)	4m 44s
test-python-wheels (windows-2019)	4m 30s
publish-python-wheels-on-pypi	0s
	6h 10m 11s

Provide feedback