Translate

The commands to convert onnx model to trt model

For static batchsize:

/usr/src/tensorrt/bin/trtexec --onnx=model.onnx --saveEngine=model.engine --explicitBatch --fp16 --verbose --workspace=8192 --dumpOutput


For dynamic batchsize:

/usr/src/tensorrt/bin/trtexec --onnx=model.onnx --saveEngine=model.engine --explicitBatch --fp16 --verbose --dumpOutput --minShapes='input':1x3x640x640 --optShapes='input':6x3x640x640  --maxShapes='input':12x3x640x640 --exportTimes=trace.json --dumpProfile --exportProfile=prof.json 


No comments:

Post a Comment