Fig. 3
Model predictions compared with pathologist evaluations. (a) Agreement coefficient and (b) Cohen’s kappa coefficient (Kcoef) for every pair. (c) Variations in agreement coefficient and (d) variations in Kcoef between pathologist–pathologist pairs (P-P) and machine–pathologist pairs (M-P) are shown. The Kcoef is based on the difference between the observed agreement (po) and the probability of chance (pe) and is calculated as po − pe / 1 − pe. P values were calculated using Welch’s t-test (n = 3). G, P#3, P#4 and M indicate ground truth, pathologist #3, pathologist #4 and machine.
