How to convert model.onnx and model.onnx_data to trt model

[Sdamuu]

I want to convert the onnx model to trt model, but the onnx model is larger than 2Gb, so it has two files, 'model.onnx' and 'model.onnx_data'，how can I convert the model to trt by using trtexec ? or python scripts ?
onnx model like multilingual-e5-large

model like:

thank a lot, looking forward to your reply!

[lix19937]

You can see https://github.com/onnx/onnx/blob/main/docs/PythonAPIOverview.md#loading-an-onnx-model-with-external-data, or use polygraphy to load model.onnx_data fusion to model.onnx, then get a new onnx.

graph = gs.import_onnx(onnx.load("model.onnx"))

model = gs.export_onnx(graph)

from onnx.external_data_helper import convert_model_to_external_data

convert_model_to_external_data(model, location="model.onnx_data")

onnx.save(model, "model_fusion.onnx")

then use trtexec as normal.

[Sdamuu]

You can see https://github.com/onnx/onnx/blob/main/docs/PythonAPIOverview.md#loading-an-onnx-model-with-external-data, or use polygraphy to load model.onnx_data fusion to model.onnx, then get a new onnx.

graph = gs.import_onnx(onnx.load("model.onnx"))

model = gs.export_onnx(graph)

from onnx.external_data_helper import convert_model_to_external_data

convert_model_to_external_data(model, location="model.onnx_data")

onnx.save(model, "model_fusion.onnx")
then use trtexec as normal.

thanks a lot, it works!