Table 7 The SOTA comparison experiment.
From: YOLOFM: an improved fire and smoke object detection algorithm based on YOLOv5n
Model | Class | Precision (%) | Recall (%) | mAP50 (%) | F1 (%) | FPS (%) | Params (MB) | GFLOPs (G) |
|---|---|---|---|---|---|---|---|---|
SSD9 | All | 86.5 | 81.9 | 87.1 | 84.0 | 63.70 | 90.58 | 60.91 |
Fire | 82.9 | 75.5 | 83.1 | 79.0 | ||||
Smoke | 90.1 | 88.2 | 91.1 | 89.0 | ||||
CenterNet11 | All | 96.7 | 68.7 | 89.1 | 80.0 | 57.98 | 124.81 | 69.94 |
Fire | 96.4 | 67.5 | 87.9 | 79.0 | ||||
Smoke | 96.9 | 69.8 | 90.3 | 81.0 | ||||
EfficientDet7 | All | 93.0 | 88.0 | 92.9 | 91.0 | 47.95 | 14.78 | 4.63 |
Fire | 92.2 | 89.8 | 92.9 | 91.0 | ||||
Smoke | 93.8 | 86.2 | 92.9 | 90.0 | ||||
Fast R-CNN6 | All | 63.8 | 92.0 | 89.9 | 75.0 | 43.51 | 136.71 | 369.74 |
Fire | 64.6 | 90.5 | 88.7 | 75.0 | ||||
Smoke | 62.9 | 93.4 | 91.1 | 75.0 | ||||
RetinaNet10 | All | 93.4 | 90.8 | 94.5 | 92.0 | 43.44 | 36.35 | 145.65 |
Fire | 90.8 | 88.0 | 92.2 | 89.0 | ||||
Smoke | 96.0 | 93.5 | 96.7 | 95.0 | ||||
YOLOv313 | All | 89.5 | 76.6 | 86.6 | 83.0 | 88.86 | 61.53 | 65.60 |
Fire | 86.8 | 69.0 | 82.3 | 77.0 | ||||
Smoke | 92.1 | 84.1 | 90.8 | 88.0 | ||||
EfficientNet- YOLOv312 | All | 88.9 | 69.5 | 84.0 | 78.0 | 50.87 | 7.22 | 4.04 |
Fire | 86.1 | 59.7 | 78.1 | 70.0 | ||||
Smoke | 91.7 | 79.2 | 89.8 | 85.0 | ||||
YOLOv452 | All | 92.1 | 77.5 | 91.0 | 84.0 | 40.96 | 54.18 | 59.77 |
Fire | 89.9 | 70.6 | 87.8 | 79.0 | ||||
Smoke | 94.3 | 84.4 | 94.1 | 89.0 | ||||
YOLOv4-Tiny14 | All | 90.0 | 77.9 | 89.4 | 84.0 | 234.70 | 22.44 | 6.82 |
Fire | 88.7 | 73.0 | 86.9 | 80.0 | ||||
Smoke | 91.3 | 82.7 | 91.8 | 87.0 | ||||
YOLOX (n)21 | All | 86.3 | 72.1 | 83.6 | 78.0 | 78.41 | 34.10 | 55.67 |
Fire | 84.0 | 63.6 | 78.6 | 72.0 | ||||
Smoke | 88.6 | 80.6 | 88.5 | 84.0 | ||||
YOLOv717 | All | 97.1 | 94.2 | 97.3 | 96.0 | 70.80 | 37.20 | 105.13 |
Fire | 95.8 | 93.6 | 96.4 | 95.0 | ||||
Smoke | 98.3 | 94.7 | 98.1 | 96.0 | ||||
YOLOv7-Tiny18 | All | 94.8 | 75.5 | 93.2 | 84.0 | 107.10 | 6.02 | 13.19 |
Fire | 92.0 | 75.3 | 90.9 | 83.0 | ||||
Smoke | 97.5 | 75.7 | 95.4 | 85.0 | ||||
YOLOv819 | All | 93.8 | 94.0 | 96.8 | 94.0 | 71.20 | 6.91 | 4.40 |
Fire | 92.0 | 93.0 | 95.7 | 94.0 | ||||
Smoke | 95.5 | 94.9 | 97.9 | 94.0 | ||||
YOLOv5n10 | All | 91.8 | 90.9 | 95.3 | 91.0 | 80.90 | 6.72 | 4.10 |
Fire | 89.3 | 89.6 | 94.2 | 91.0 | ||||
Smoke | 94.2 | 92.1 | 96.4 | 91.0 | ||||
YOLOFM | All | 94.9 | 94.8 | 97.5 | 94.0 | 66.58 | 13.87 | 6.40 |
Fire | 93.5 | 94.2 | 96.3 | 94.0 | ||||
Smoke | 96.2 | 95.4 | 98.7 | 94.0 |
