Performance of SMZF V1.0.0
Introduction of Model-Zoo Single Model Flow
The time spent on preProcess + Graph + postProcess can represent the main time it takes for one model to complete a single execution.
The time consumed by the Engine represents the true time of the inference, which is included in the Graph's time.
Performance Table
NN model name | Input data | preProcess | Graph | Engine | postProcess |
AgeU8 | resource/image/face.jpg | 1.887ms | 7.241ms | 6.722ms | 0.173ms |
Det10gI16 | resource/image/light_face.jpg | 9.528ms | 56.006ms | 51.793ms | 14.928ms |
GenderAgeU8 | resource/image/face.jpg | 0.939ms | 4.072ms | 3.544ms | 0.257ms |
HumanAttrHybridU8 | resource/image/humanAttr.jpg | 7.675ms | 6.237ms | 5.664ms | 0.235ms |
HumanAttrI16 | resource/image/humanAttr.jpg | 7.280ms | 7.502ms | 6.907ms | 0.266ms |
LightFaceHybridU8 | resource/image/light_face.jpg | 6.655ms | 5.928ms | 4.527ms | 1.322ms |
LightFaceI16 | resource/image/light_face.jpg | 6.537ms | 7.377ms | 5.363ms | 1.271ms |
OcrClsI16 | resource/image/ch_fz.jpg | 0.811ms | 5.767ms | 5.309ms | 0.322ms |
OcrDetI16 | resource/image/time.jpg | 122.965ms | 64.961ms | 58.253ms | 13.877ms |
OcrRecI16 | resource/image/ocr_rec.jpg | 0.877ms | 28.867ms | 21.458ms | 4.029ms |
ReidI16 | resource/image/humanAttr.jpg | 7.287ms | 6.358ms | 5.784ms | 0.272ms |
RtmdetsI16 | resource/image/person.jpg | 7.791ms | 112.648ms | 101.921ms | 6.036ms |
VehicleAttrHybridU8 | resource/image/vehicleAttr.jpg | 1.367ms | 6.575ms | 6.042ms | 0.244ms |
VehicleAttrI16 | resource/image/vehicleAttr.jpg | 1.351ms | 8.262ms | 7.691ms | 0.290ms |
W600kR50I16 | resource/image/person640x640.jpg | 2.992ms | 44.607ms | 43.893ms | 0.345ms |
Yolo11sClassifyHybridI8 | resource/image/classify_input.jpg | 29.261ms | 8.667ms | 8.050ms | 0.375ms |
Yolo11sDetectionHybridI8 | resource/image/person.jpg | 9.622ms | 96.148ms | 74.153ms | 24.103ms |
Yolo11sObbHybridI8 | resource/image/obb_input.jpg | 14.890ms | 238.365ms | 223.491ms | 9.306ms |
Yolo11sPoseHybridI8 | resource/image/pose_input.jpg | 10.968ms | 91.313ms | 76.076ms | 9.968ms |
Yolo11sSegmentationHybridI8 | resource/image/segment_input.jpg | 7.134ms | 114.257ms | 83.593ms | 29.087ms |
Yolov10sDetectionHybridI8 | resource/image/person.jpg | 9.771ms | 101.288ms | 80.173ms | 47.330ms |
Yolov5sDetectionU8 | resource/image/person.jpg | 9.902ms | 51.325ms | 39.572ms | 8.870ms |
Yolov8nCcpdDetectionOptiU8 | resource/image/license_plate.jpg | 11.925ms | 27.831ms | 26.309ms | 9.137ms |
Yolov8nClassifyHybridI8 | resource/image/classify_input.jpg | 29.799ms | 6.068ms | 5.394ms | 0.400ms |
Yolov8nDetectionOptiI16 | resource/image/person.jpg | 9.858ms | 52.035ms | 43.662ms | 23.233ms |
Yolov8nObbOptiI16 | resource/image/obb_input.jpg | 5.811ms | 133.764ms | 126.478ms | 24.730ms |
Yolov8nPoseOptiI16 | resource/image/pose_input.jpg | 11.085ms | 50.549ms | 44.573ms | 25.343ms |
Yolov8nSegmentationOptiI16 | resource/image/pose_input.jpg | 10.884ms | 65.228ms | 52.397ms | 34.294ms |
Yolov8sClassifyHybridI8 | resource/image/classify_input.jpg | 29.030ms | 7.789ms | 7.150ms | 0.376ms |
Yolov8sDetectionHybridI8 | resource/image/person.jpg | 9.699ms | 87.516ms | 65.508ms | 24.451ms |
Yolov8sDetectionI16 | resource/image/person.jpg | 9.681ms | 104.366ms | 93.669ms | 26.273ms |
Yolov8sDetectionOptiI16 | resource/image/person.jpg | 9.644ms | 101.687ms | 92.716ms | 23.627ms |
Yolov8sObbHybridI8 | resource/image/obb_input.jpg | 6.311ms | 181.833ms | 167.234ms | 9.261ms |
Yolov8sPoseI16 | resource/image/pose_input.jpg | 12.883ms | 126.709ms | 120.727ms | 12.765ms |
Yolov8sSegmentationHybridI8 | resource/image/segment_input.jpg | 7.307ms | 104.511ms | 75.375ms | 29.020ms |
Yolov8sSegmentationI16 | resource/image/segment_input.jpg | 6.762ms | 130.629ms | 116.752ms | 16.653ms |