Table 12 Results of consistency check for expert evaluation.
From: Evaluation of teaching effect factors based on probabilistic language set
Consistency index | Computed value | Reference standard | Conclusion |
|---|---|---|---|
Kendall’s W Coefficient | 0.82 | > 0.7 (good) | The expert evaluations are highly consistent. |
Intra-class correlation coefficient (ICC) | 0.78 | > 0.75 (excellent) | The reliability of the evaluation is excellent. |