Table 3 Validation metrics of ABRicate and ResFinder tools for resistance genes.
Tool | Gene | Metric | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
|---|---|---|---|---|---|---|---|---|---|
ABRicate | Carbapenem resistance genes | Repeatability | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
Reproducibility | – | 100% | – | – | – | – | – | ||
Accuracy | 99.99% | 99.99% | 100% | 100% | 100% | 99.98% | 100% | ||
Precision | 90.19% | 95.45% | 100% | 100% | 100% | 100% | 0 | ||
Sensitivity | 92.00% | 82.89% | 100% | 100% | 100% | 55.55% | 0 | ||
Specificity | 99.99% | 99.99% | 100% | 100% | 100% | 100% | 100% | ||
All antimicrobial resistance genes | Repeatability | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
Reproducibility | – | 44.92% | – | – | – | – | – | ||
Accuracy | 99.88% | 99.88% | 99.97% | 99.94% | 99.97% | 99.85% | 100% | ||
Precision | 93.79% | 97.76% | 96.85% | 95.95% | 97.39% | 100% | 100% | ||
Sensitivity | 74.28% | 79.59% | 96.63% | 90.97% | 97.90% | 72.36% | 100% | ||
Specificity | 99.98% | 99.99% | 99.98% | 99.98% | 99.98% | 100% | 100% | ||
ResFinder | Carbapenem resistance genes | Repeatability | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
Reproducibility | – | 100% | – | – | – | – | – | ||
Accuracy | 99.99% | 99.99% | 100% | 100% | 100% | 99.98% | 100% | ||
Precision | 91.07% | 95.45% | 100% | 100% | 100% | 100% | 0 | ||
Sensitivity | 92.72% | 82.89% | 100% | 100% | 100% | 55.55% | 0 | ||
Specificity | 99.99% | 99.99% | 100% | 100% | 100% | 100% | 100% | ||
All antimicrobial resistance genes | Repeatability | 100% | 100% | 100% | 100% | 100% | 100% | 100% | |
Reproducibility | – | 36.23% | – | – | – | – | – | ||
Accuracy | 99.80% | 99.79% | 99.94% | 99.86% | 99.97% | 99.84% | 100% | ||
Precision | 90.44% | 89.12% | 92.14% | 90.96% | 97.79% | 100% | 100% | ||
Sensitivity | 72.88% | 79.36% | 96.75% | 85.93% | 98.51% | 76.92% | 100% | ||
Specificity | 99.95% | 99.93% | 99.95% | 99.94% | 99.98% | 100% | 100% |
