Table 12 Results of consistency check for expert evaluation.

From: Evaluation of teaching effect factors based on probabilistic language set

Consistency index

Computed value

Reference standard

Conclusion

Kendall’s W Coefficient

0.82

> 0.7 (good)

The expert evaluations are highly consistent.

Intra-class correlation coefficient (ICC)

0.78

> 0.75 (excellent)

The reliability of the evaluation is excellent.