Table 6 Metrics for the inter-observer agreement analysis.

From: Automatic deep learning-based consolidation/collapse classification in lung ultrasound images for COVID-19 induced pneumonia

Comparison

% Agreement

Data after exclusion criteria

Frame-based

All-or-nothing video

Sampled binary video

Sampled quaternary video

Expert 1/algorithm

{Y and Y*}

(90.088)

(87.626)

(87.823)

(89.791)

{Y}

(91.106)

(89.154)

(89.240)

(90.994)

Expert 2/algorithm

{Y and Y*}

(90.144)

(87.767)

(87.87.835)

(89.956)

{Y}

(91.602)

(89.186)

(89.202)

(91.026)

  1. (% agreement), {clinical criteria (unhealthy (consolidation/collapse)/healthy dataset) Y: Optimal, Y*: Good, N: Poor}.