Table 2 A summary of G-coefficients for rater ratings across subjects, grades, and tasks.

From: Rater variability and reliability of constructed response questions in New York state high-stakes tests of English language arts and mathematics: implications for educational assessment policy

Task

Number of raters

G-coefficient

Task

Number of raters

G-coefficient

ELA

grade 4

task 1

1

0.59

ELA

Grade 4

Task 2

1

0.68

2

0.74

2

0.81

3

0.81

3

0.86

10

0.93

10

0.96

ELA

grade 6

task 1

1

0.58

ELA

Grade 6

Task 2

1

0.65

2

0.74

2

0.78

3

0.81

3

0.85

10

0.93

10

0.95

Math

grade 4

task 1

1

0.96

Math

Grade 4

Task 2

1

0.61

2

0.97

2

0.76

3

0.98

3

0.83

10

0.99

10

0.94

Math

grade 4

task 3

1

0.82

Math

Grade 4

Task 4

1

0.75

2

0.90

2

0.86

3

0.93

3

0.90

10

0.98

10

0.97

Math

grade 5

task 1

1

0.83

Math

Grade 5

Task 2

1

0.73

2

0.90

2

0.85

3

0.93

3

0.89

10

0.98

10

0.96

Math

grade 5

task 3

1

0.64

Math

Grade 5

Task 4

1

0.92

2

0.78

2

0.96

3

0.84

3

0.97

10

0.95

10

0.99