Table 8 Ratio of model performance between the baseline view and the standardized view.

From: A benchmark for domain adaptation and generalization in smartphone-based human activity recognition

Model

Time

Frequency

KH

MS

RW-T

RW-W

UCI

WDM

Mean

KH

MS

RW-T

RW-W

UCI

WDM

Mean

KNN

1.16x

0.82x

1.41x

1.16x

1.22x

1.01x

1.08x

1.00x

1.02x

0.89x

1.08x

1.00x

0.96x

0.99x

Random Forest

1.00x

1.01x

0.84x

0.87x

1.03x

0.93x

0.95x

1.04x

1.02x

0.96x

0.98x

1.01x

0.92x

0.99x

SVM

1.06x

1.00x

0.80x

0.95x

0.92x

0.81x

0.91x

1.02x

0.97x

0.87x

0.92x

0.92x

0.80x

0.91x

CNN (1D)12

1.01x

0.99x

0.86x

1.01x

1.00x

0.95x

0.97x

0.98x

1.00x

0.91x

0.98x

1.00x

0.94x

0.97x

CNN (2D)12

1.06x

1.01x

1.04x

0.98x

0.98x

0.96x

1.00x

0.97x

1.00x

0.94x

1.03x

1.02x

0.94x

0.98x

CNN PF34

1.00x

1.02x

0.99x

1.07x

1.01x

0.97x

1.01x

0.98x

0.99x

0.85x

1.01x

1.03x

0.94x

0.97x

CNN PFF34

1.01x

1.01x

0.92x

1.11x

1.01x

0.98x

1.00x

0.92x

1.02x

0.82x

1.00x

1.03x

0.94x

0.96x

ConvNet13

1.05x

1.02x

0.93x

1.05x

1.06x

0.96x

1.01x

0.93x

1.01x

0.94x

1.03x

0.99x

0.94x

0.97x

IMU CNN14

1.04x

1.00x

1.00x

1.08x

1.03x

0.99x

1.02x

0.96x

1.02x

0.86x

1.03x

1.01x

0.95x

0.97x

IMU Transf.14

0.98x

0.91x

0.86x

0.99x

0.68x

0.51x

0.81x

0.98x

1.06x

0.81x

1.01x

1.00x

0.60x

0.90x

MLP (2 Layers)

1.01x

1.01x

0.74x

0.99x

1.00x

0.89x

0.94x

1.00x

0.98x

0.90x

1.04x

1.00x

0.92x

0.97x

MLP (3 layers)

1.01x

1.02x

0.75x

0.99x

1.01x

0.92x

0.95x

1.00x

1.01x

0.92x

1.04x

1.00x

0.92x

0.98x

ResNet15

1.02x

0.92x

0.91x

0.97x

0.93x

0.87x

0.93x

1.02x

1.00x

0.83x

1.13x

0.98x

0.91x

0.97x

ResNetSE67

1.03x

0.91x

0.97x

0.98x

0.93x

0.83x

0.94x

0.88x

1.02x

0.87x

0.98x

0.92x

0.90x

0.93x

ResNetSE-567

1.05x

0.95x

1.06x

0.92x

0.97x

0.91x

0.97x

0.94x

0.98x

0.87x

1.00x

0.99x

0.86x

0.94x

Max (Ratio)

1.03x

1.02x

0.91x

1.04x

0.99x

0.95x

0.98x

0.99x

1.01x

0.94x

1.01x

1.01x

0.93x

0.97x

  1. Values close to one indicate no significant difference between the two views, values below one indicate better performance in the baseline view, and values above one indicate better performance in the standardized view. The Max (Ratio) line is the ratio between both maximum values of the two views.
Back to article page