Performance of SMZF V1.0.0

Performance of SMZF V1.0.0

Introduction of Model-Zoo Single Model Flow

image-20250427-020040.png

The time spent on preProcess + Graph + postProcess can represent the main time it takes for one model to complete a single execution.

The time consumed by the Engine represents the true time of the inference, which is included in the Graph's time.

Performance Table

NN model name

Input data

preProcess

Graph

Engine

postProcess

AgeU8

resource/image/face.jpg

1.887ms

7.241ms

6.722ms

0.173ms

Det10gI16

resource/image/light_face.jpg

9.528ms

56.006ms

51.793ms

14.928ms

GenderAgeU8

resource/image/face.jpg

0.939ms

4.072ms

3.544ms

0.257ms

HumanAttrHybridU8

resource/image/humanAttr.jpg

7.675ms

6.237ms

5.664ms

0.235ms

HumanAttrI16

resource/image/humanAttr.jpg

7.280ms

7.502ms

6.907ms

0.266ms

LightFaceHybridU8

resource/image/light_face.jpg

6.655ms

5.928ms

4.527ms

1.322ms

LightFaceI16

resource/image/light_face.jpg

6.537ms

7.377ms

5.363ms

1.271ms

OcrClsI16

resource/image/ch_fz.jpg

0.811ms

5.767ms

5.309ms

0.322ms

OcrDetI16

resource/image/time.jpg

122.965ms

64.961ms

58.253ms

13.877ms

OcrRecI16

resource/image/ocr_rec.jpg

0.877ms

28.867ms

21.458ms

4.029ms

ReidI16

resource/image/humanAttr.jpg

7.287ms

6.358ms

5.784ms

0.272ms

RtmdetsI16

resource/image/person.jpg

7.791ms

112.648ms

101.921ms

6.036ms

VehicleAttrHybridU8

resource/image/vehicleAttr.jpg

1.367ms

6.575ms

6.042ms

0.244ms

VehicleAttrI16

resource/image/vehicleAttr.jpg

1.351ms

8.262ms

7.691ms

0.290ms

W600kR50I16

resource/image/person640x640.jpg

2.992ms

44.607ms

43.893ms

0.345ms

Yolo11sClassifyHybridI8

resource/image/classify_input.jpg

29.261ms

8.667ms

8.050ms

0.375ms

Yolo11sDetectionHybridI8

resource/image/person.jpg

9.622ms

96.148ms

74.153ms

24.103ms

Yolo11sObbHybridI8

resource/image/obb_input.jpg

14.890ms

238.365ms

223.491ms

9.306ms

Yolo11sPoseHybridI8

resource/image/pose_input.jpg

10.968ms

91.313ms

76.076ms

9.968ms

Yolo11sSegmentationHybridI8

resource/image/segment_input.jpg

7.134ms

114.257ms

83.593ms

29.087ms

Yolov10sDetectionHybridI8

resource/image/person.jpg

9.771ms

101.288ms

80.173ms

47.330ms

Yolov5sDetectionU8

resource/image/person.jpg

9.902ms

51.325ms

39.572ms

8.870ms

Yolov8nCcpdDetectionOptiU8

resource/image/license_plate.jpg

11.925ms

27.831ms

26.309ms

9.137ms

Yolov8nClassifyHybridI8

resource/image/classify_input.jpg

29.799ms

6.068ms

5.394ms

0.400ms

Yolov8nDetectionOptiI16

resource/image/person.jpg

9.858ms

52.035ms

43.662ms

23.233ms

Yolov8nObbOptiI16

resource/image/obb_input.jpg

5.811ms

133.764ms

126.478ms

24.730ms

Yolov8nPoseOptiI16

resource/image/pose_input.jpg

11.085ms

50.549ms

44.573ms

25.343ms

Yolov8nSegmentationOptiI16

resource/image/pose_input.jpg

10.884ms

65.228ms

52.397ms

34.294ms

Yolov8sClassifyHybridI8

resource/image/classify_input.jpg

29.030ms

7.789ms

7.150ms

0.376ms

Yolov8sDetectionHybridI8

resource/image/person.jpg

9.699ms

87.516ms

65.508ms

24.451ms

Yolov8sDetectionI16

resource/image/person.jpg

9.681ms

104.366ms

93.669ms

26.273ms

Yolov8sDetectionOptiI16

resource/image/person.jpg

9.644ms

101.687ms

92.716ms

23.627ms

Yolov8sObbHybridI8

resource/image/obb_input.jpg

6.311ms

181.833ms

167.234ms

9.261ms

Yolov8sPoseI16

resource/image/pose_input.jpg

12.883ms

126.709ms

120.727ms

12.765ms

Yolov8sSegmentationHybridI8

resource/image/segment_input.jpg

7.307ms

104.511ms

75.375ms

29.020ms

Yolov8sSegmentationI16

resource/image/segment_input.jpg

6.762ms

130.629ms

116.752ms

16.653ms

Related content