Table 8 ML predicted novice to expert distribution of responses for Biomass.

From: FEW questions, many answers: using machine learning to assess how students connect food–energy–water (FEW) concepts

Level

Components

# of Part A responses

Components

# of Part B responses

4

A + (B, D, or E)

103 (21.4%)

(A2) + (B2) + (C2 or C3)

0

3

A or B

267 (55.6%)

(A1) + (B1) + (C1)

51 (10.9%)

2

C

0 (0%)

Two of the following: (A1 or A2), (B1 or B2), and/or (C1 or C2 or C3)

229 (49.2%)

1

None of the above

110 (22.9%)

One of the following: (A1 or A2), (B1 or B2), or (C1 or C2 or C3)

104 (22.3%)

0

 

N/A

None of the above

81 (17.4%)

Total

 

480

 

465

  1. Due to data rebalancing, not all responses had predicted scores in all categories. In these cases, we used the human score for the given category for a response.