Table 3 Per class and weighted average measures for method in29, stand-alone CNNs and stacking ensemble of our method.
Model per class parameter | Inception V3 | VGG16 | VGG19 | Xception | Method in29 | MLP ensemble |
|---|---|---|---|---|---|---|
Accuracy | ||||||
Abnormal | 0.948 | 0.792 | 0.922 | 0.883 | 0.931 | 0.974 |
MA | 0.883 | 0.883 | 0.987 | 0.922 | 0.962 | 0.987 |
Normal | 0.935 | 0.948 | 0.922 | 0.857 | 0.943 | 0.961 |
Vessel | 0.896 | 0.961 | 0.987 | 0.974 | 0.946 | 1 |
Weighted average accuracy | 0.913 | 0.91 | 0.958 | 0.916 | 0.945 | 0.982 |
Precision | ||||||
Abnormal | 0.813 | 0.464 | 1 | 0.619 | 0.952 | 0.928 |
MA | 0.682 | 1 | 0.945 | 0.739 | 0.964 | 0.944 |
Normal | 0.895 | 0.944 | 0.797 | 1 | 0.97 | 0.947 |
Vessel | 0.95 | 1 | 0.963 | 1 | 0.964 | 1 |
Weighted average precision | 0.851 | 0.888 | 0.921 | 0.873 | 0.963 | 0.961 |
Recall (sensitivity) | ||||||
Abnormal | 0.929 | 0.929 | 0.571 | 0.929 | 0.86 | 0.928 |
MA | 0.882 | 0.471 | 1 | 1 | 0.913 | 1 |
Normal | 0.85 | 0.85 | 0.95 | 0.45 | 0.907 | 0.9 |
Vessel | 0.731 | 0.885 | 1 | 0.923 | 0.883 | 1 |
Weighted average recall | 0.831 | 0.792 | 0.909 | 0.818 | 0.890 | 0.961 |
Specificity | ||||||
Abnormal | 0.952 | 0.762 | 1 | 0.873 | 0.866 | 0.984 |
MA | 0.883 | 1 | 0.983 | 0.9 | 0.941 | 0.983 |
Normal | 0.964 | 0.982 | 0.912 | 1 | 0.86 | 0.982 |
Vessel | 0.980 | 1 | 0.980 | 1 | 0.887 | 1 |
Weighted average specificity | 0.95 | 0.952 | 0.967 | 0.818 | 0.888 | 0.989 |
F1-score | ||||||
Abnormal | 0.867 | 0.619 | 0.727 | 0.743 | – | 0.928 |
MA | 0.769 | 0.64 | 0.971 | 0.85 | – | 0.971 |
Normal | 0.872 | 0.895 | 0.863 | 0.621 | – | 0.923 |
Vessel | 0.826 | 0.939 | 0.981 | 0.96 | – | 1 |
Weighted average F1-score | 0.833 | 0.803 | 0.902 | 0.808 | – | 0.961 |
Weighted average ROC-AUC score | 0.981 | 0.97 | 0.99 | 0.989 | – | 0.998 |