Table 3 Model performance and statistical comparisons of video featuring paired macaques (Experiment 2). Bolded p-values indicate significant at \(p<0.05\).

From: The MacqD deep-learning-based model for automatic detection of socially housed laboratory macaques

Model

Dataset

Precision

Recall

F1

Model performance

 MacqD - Macaque Single

‘Same’

0.79

0.66

0.71

 MacqD - Macaque Curriculum

 

0.94

0.87

0.90

 MacqD - Macaque Combine

 

0.97

0.81

0.87

 MacqD - Macaque Single

‘Different’

0.72

0.54

0.60

 MacqD - Macaque Curriculum

 

0.89

0.72

0.81

 MacqD - Macaque Combine

 

0.95

0.70

0.81

 BE

 

0.45

0.40

0.42

Comparison

Dataset

N

DOF

Metric of comparison

\(\chi ^{2}\)

p-value

Friedman test statistics

 MacqD - Macaque Single versus MacqD - Macaque Curriculum versus MacqD - Macaque Combine

‘Same’

10

2

Precision

8.16

0.017

   

Recall

6.53

0.038

   

F1

7.59

0.023

 MacqD - Macaque Single versus MacqD - Macaque Curriculum versus MacqD - Macaque Combine versus BE

‘Different’

 

3

Precision

25.56

0.000

   

Recall

10.16

0.017

   

F1

11.42

0.010

Comparison

Dataset

N

DOF

Metric of comparison

\(T^{+}\)

Corrected p-value

Wilcoxon test statistics

 MacqD - Macaque Single versus MacqD - Macaque Curriculum

‘Same’

10

1

Precision

6.5

0.041

   

Recall

5

0.059

   

F1

2

0.038

 MacqD - Macaque Single versus MacqD - Macaque Combine

   

Precision

0.0

0.035

   

Recall

14.5

0.193

   

F1

3.5

0.038

 MacqD - Macaque Curriculum versus MacqD - Macaque Combine

   

Precision

20.5

0.812

   

Recall

6

0.139

   

F1

7.5

0.141

 MacqD - Macaque Single versus MacqD - Macaque Curriculum

‘Different’

  

Precision

4.5

0.016

   

Recall

12

0.157

   

F1

8.5

0.073

 MacqD - Macaque Single versus MacqD - Macaque Combine

   

Precision

0

0.004

   

Recall

22

0.625

   

F1

18.5

0.441

 MacqD - Macaque Curriculum versus MacqD - Macaque Combine

   

Precision

11

0.105

   

Recall

7

0.157

   

F1

16

0.441

 MacqD - Macaque Single versus BE

   

Precision

1

0.006

   

Recall

9

0.157

   

F1

3

0.041

 MacqD - Macaque Curriculum versus BE

   

Precision

0

0.002

   

Recall

7

0.157

   

F1

4

0.041

 MacqD - Macaque Combine versus BE

   

Precision

0

0.002

   

Recall

11

0.157

   

F1

6

0.055