Table 6 Evaluation of chord and key annotations in the generated JAMS files on the test samples, reported for times, durations, and labels of their observations, and averaged for each subset. Coverage of observation values ranges from 0 (all the expected values are not found in the generated annotation) to 1 (all the expected values are included). Errors are given as seconds (audio) or beats (symbolic) for times and durations, respectively; and as normalised text similarities for labels.
From: ChoCo: a Chord Corpus and a Data Transformation Workflow for Musical Harmony Knowledge Graphs
subset | type | Key coverages ↑ | Key errors ↓ | Chord coverages ↑ | Chord errors ↓ | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
time | duration | label | time | duration | label | time | duration | label | time | duration | label | ||
billboard | audio | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
chordify | audio | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
isophonics | audio | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
jaah | audio | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.95 ± 0.1 | 0.95 ± 0.1 | 1.0 ± 0.0 | 0.06 ± 0.13 | 0.06 ± 0.13 | 0.0 ± 0.0 |
robbie-williams | audio | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
rwc-pop | audio | — | — | — | — | — | — | 1.0 ± 0.0 | 0.53 ± 0.45 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
schubert-winterreise | audio | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
uspop2002 | audio | — | — | — | — | — | — | 1.0 ± 0.0 | 0.3 ± 0.26 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
weimar | audio | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
biab-internet-corpus | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.95 ± 0.1 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.05 ± 0.1 | 0.0 ± 0.0 | 0.0 ± 0.0 |
ireal-pro | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.00 | 0.0 ± 0.0 | 0.0 ± 0.0 |
jazz-corpus | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
mozart-piano-sonatas | score | 0.5 ± 0.58 | 0.0 ± 0.0 | 0.5 ± 0.58 | 62.55 ± 125.03 | 139.75 ± 83.75 | 0.25 ± 0.29 | 0.85 ± 0.3 | 0.88 ± 0.25 | 0.75 ± 0.5 | 0.25 ± 0.5 | 0.15 ± 0.19 | 0.15 ± 0.3 |
nottingham | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.75 ± 0.25 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.85 ± 0.6 | 0.0 ± 0.0 | 0.0 ± 0.0 |
real-book | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
rock-corpus | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
schubert-winterreise | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
when-in-rome | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 |
wikifonia | score | 1.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 0.0 ± 0.0 | 1.0 ± 0.0 | 0.92 ± 0.17 | 0.75 ± 0.35 | 0.0 ± 0.0 | 0.1 ± 0.2 | 0.11 ± 0.18 |
