Table 2 This table shows the scores available for each combination of target type and prediction element (where these combinations are represented by rows).

From: The Zoltar forecast archive, a tool to standardize and store interdisciplinary prediction research

target

elem.

point scores

probabilistic scores

error

abs

log score

CRPS

Brier

PIT

int. score

continuous

point

x

x

—

xa

—

—

—

bin

—

—

x

x

x

x

—

named

—

—

x

x

—

x

—

sample

—

—

xb

x

—

x

—

quantile

—

—

—

—

—

—

x

discrete

point

x

x

—

xa

—

—

—

bin

—

—

x

x

x

x

—

named

—

—

x

x

—

x

—

sample

—

—

xb

x

—

x

—

quantile

—

—

—

—

—

—

x

nominal

point

—

—

—

—

—

—

—

bin

—

—

x

—

x

—

—

sample

—

—

xa

—

x

—

—

binary

point

x

x

—

xa

—

—

—

bin

—

—

x

x

x

—

—

sample

—

—

xb

x

x

—

—

date

point

x

x

—

xa

—

—

—

bin

—

—

x

x

x

x

—

sample

—

—

xb

x

—

x

—

quantile

—

—

—

—

—

—

x

  1. An ‘x’ indicates that score in the column is available; a ‘—’ indicates that the given score is not available for that particular combination. a denotes that CRPS is equivalent to absolute error for point forecasts. b denotes that log score is required to be computed by approximation. CRPS and Brier scores are part of a future planned implementation.
Back to article page