Table 6 Human vs. AI Summary Results: Mixed-Effects Ordinal Logit (MEOL), OLS, & OLS with ad fixed effects (OLS-FE). SE’s in parentheses; bootstrapped SE’s in brackets; OLS and OLS-FE SE’s are robust & ad (OLS) or rater (OLS-FE) clustered.
From: Using AI to Summarize US Presidential Campaign TV Advertisement Videos, 1952–2012
Coherence | Consistency | Fluency | Relevance | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
MEOL | OLS | OLS-FE | MEOL | OLS | OLS-FE | MEOL | OLS | OLS-FE | MEOL | OLS | OLS-FE | |
AI | 0.335** | 0.147* | 0.147*** | −0.171 | −0.072 | −0.072 | 0.620** | 0.147** | 0.147*** | 0.332** | 0.083 | 0.083 |
(0.164) | (0.078) | (0.055) | (0.186) | (0.072) | (0.056) | (0.177) | (0.069) | (0.052) | (0.165) | (0.073) | (0.055) | |
[0.179] | [0.194] | [0.193] | [0.179] | |||||||||
Republican | 0.300 | −2.655 | 0.341 | 4.280 | 0.317 | −5.917 | 0.236 | 8.417 | ||||
(0.278) | (11.035) | (0.283) | (10.921) | (0.265) | (8.901) | (.265) | (10.407) | |||||
[0.226] | [0.233] | [0.216] | [0.218] | |||||||||
Election Year | 0.013 | 0.002 | 0.020* | 0.007* | 0.008 | 0.0004 | 0.019* | 0.006 | ||||
(0.011) | (0.004) | (0.011) | (0.004) | (0.010) | (0.003) | (0.010) | (0.004) | |||||
[0.009] | [0.010] | [0.009] | [0.009] | |||||||||
Republican × Election Year | −0.008 | 0.001 | −0.002 | −0.002 | 0.006 | 0.003 | −0.021 | −0.004 | ||||
(0.016) | (0.006) | (0.016) | (0.005) | (0.015) | (0.004) | (0.015) | (0.005) | |||||
[0.014] | [0.014] | [0.013] | [0.013] | |||||||||
Observations | 720 | 720 | 720 | 720 | 720 | 720 | 720 | 720 | 720 | 720 | 720 | 720 |
