For static batchsize:
/usr/src/tensorrt/bin/trtexec --onnx=model.onnx --saveEngine=model.engine --explicitBatch --fp16 --verbose --workspace=8192 --dumpOutput
For dynamic batchsize:
/usr/src/tensorrt/bin/trtexec --onnx=model.onnx --saveEngine=model.engine --explicitBatch --fp16 --verbose --dumpOutput --minShapes='input':1x3x640x640 --optShapes='input':6x3x640x640 --maxShapes='input':12x3x640x640 --exportTimes=trace.json --dumpProfile --exportProfile=prof.json
No comments:
Post a Comment