Extended Data Fig. 2: Raters choose an asymmetric decision cutoff for malignancy. | Nature Medicine

Extended Data Fig. 2: Raters choose an asymmetric decision cutoff for malignancy.

From: Human–computer collaboration for skin cancer recognition

Extended Data Fig. 2

a, When changing answers from benign to malignant (dark blue) or malignant to benign (light blue) diagnoses, the average cutoff for the AI-provided malignancy-probability was not 50% but <25% (yellow dotted line). b, On the ROC-curve for detecting malignant cases of the underlying AI (black line), this cutoff chosen inherently by the users (yellow dot), that is without instructions or prior knowledge about the AI accuracy, had a higher sensitivity and was closer to the ideal cutoff (blue dot), as measured by Youden’s index, than the ‘symmetric’ 50% cutoff (black dot).

Back to article page