Table 2 Human-BERT group assignment agreement.

From: Analysis of conceptual overlap among formal thought disorder rating scales in psychosis: a systematic semantic synthesis

Ratings

Fleiss' kappa

SE

95% CI

Lower

Upper

Overall

0.617

0.016

0.585

0.648

Group 1

0.636

0.028

0.582

0.690

Group 2

0.476

0.028

0.422

0.530

Group 3

0.589

0.028

0.535

0.643

Group 4

0.716

0.028

0.662

0.770

  1. Overall and per-group Fleiss’ kappa values on agreement between six human raters and the BERT-based 4-group cluster assignments for 103 FTD items. Confidence intervals (CI) are asymptotic and indicate the precision of each kappa estimate.
Back to article page