Table 4 Performance of radiologists alone and RENALNet-assisted radiologists for the multicenter validation cohorts
AUC (95% CI) | Sensitivity | Specificity | Accuracy | P | |
|---|---|---|---|---|---|
Validation Cohort Ⅰ | |||||
Radiologist alone | |||||
Junior radiologist | 0.619(0.561–0.675) | 0.333 | 0.905 | 0.865 | |
Attending radiologist | 0.676(0.620–0.729) | 0.429 | 0.924 | 0.889 | |
Senior radiologist | 0.760(0.707–0.808) | 0.571 | 0.949 | 0.922 | |
Radiologists with RENALNet | |||||
Junior radiologist | 0.761(0.708–0.808) | 0.667 | 0.785 | 0.777 | 0.010* |
Attending radiologist | 0.788(0.737–0.833) | 0.619 | 0.898 | 0.878 | 0.017* |
Senior radiologist | 0.855(0.810–0.893) | 0.714 | 0.92 | 0.905 | 0.024* |
Validation Cohort Ⅱ | |||||
Radiologist alone | |||||
Junior radiologist | 0.556(0.482–0.629) | 0.349 | 0.764 | 0.668 | |
Attending radiologist | 0.667(0.594–0.734) | 0.465 | 0.868 | 0.775 | |
Senior radiologist | 0.776(0.709–0.833) | 0.628 | 0.924 | 0.856 | |
Radiologists with RENALNet | |||||
Junior radiologist | 0.770(0.703–0.828) | 0.814 | 0.618 | 0.663 | <0.001* |
Attending radiologist | 0.777(0.711–0.835) | 0.674 | 0.806 | 0.775 | 0.001* |
Senior radiologist | 0.848(0.788–0.896) | 0.698 | 0.903 | 0.856 | 0.005* |
Validation Cohort Ⅲ | |||||
Radiologist alone | |||||
Junior Radiologist | 0.660(0.596–0.721) | 0.761 | 0.739 | 0.219 | |
Attending radiologist | 0.684(0.621–0.743) | 0.809 | 0.782 | 0.259 | |
Senior radiologist | 0.733(0.671–0.789) | 0.866 | 0.838 | 0.349 | |
Radiologists with RENALNet | |||||
Junior Radiologist | 0.734(0.672–0.789) | 0.799 | 0.778 | 0.263 | 0.028* |
Attending radiologist | 0.767(0.711–0.820) | 0.699 | 0.705 | 0.232 | 0.013* |
Senior radiologist | 0.796(0.788–0.846) | 0.847 | 0.825 | 0.333 | 0.040* |
Validation Cohort Ⅳ | |||||
Radiologist alone | |||||
Junior Radiologist | 0.611(0.530–0.688) | 0.304 | 0.917 | 0.827 | |
Attending radiologist | 0.684(0.605–0.756) | 0.391 | 0.977 | 0.891 | |
Senior radiologist | 0.753(0.678–0.819) | 0.522 | 0.985 | 0.917 | |
Radiologists with RENALNet | |||||
Junior Radiologist | 0.716(0.638–0.785) | 0.522 | 0.865 | 0.814 | 0.0497* |
Attending radiologist | 0.748(0.673–0.814) | 0.478 | 0.977 | 0.904 | 0.197 |
Senior radiologist | 0.809(0.739–0.868) | 0.609 | 0.985 | 0.929 | 0.226 |