tensorrt-layernorm-plugin

A Project for Layernorm TensorRT Plugin.

Layernorm implementation is modified from oneflow.

build and test step:

# change the CUDA_PATH and TRT_PATH in Makefile then
make
python testPlugin.py

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.gitignore		.gitignore
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
checkMacrosPlugin.cpp		checkMacrosPlugin.cpp
checkMacrosPlugin.h		checkMacrosPlugin.h
cnpy.cpp		cnpy.cpp
cnpy.h		cnpy.h
cuda_tools.cpp		cuda_tools.cpp
cuda_tools.hpp		cuda_tools.hpp
ilogger.cpp		ilogger.cpp
ilogger.hpp		ilogger.hpp
layerNormalizationPlugin.cpp		layerNormalizationPlugin.cpp
layerNormalizationPlugin.h		layerNormalizationPlugin.h
layer_norm.cu		layer_norm.cu
plugin.h		plugin.h
serialize.hpp		serialize.hpp
testPlugin.py		testPlugin.py
trt_tensor.cpp		trt_tensor.cpp
trt_tensor.hpp		trt_tensor.hpp

Provide feedback