Scientific Data

Table 10 Ratio of model performance between standard training and cross-dataset training using a leave-one-dataset-out strategy.

From: A benchmark for domain adaptation and generalization in smartphone-based human activity recognition

Model	Time							Frequency
Model	KH	MS	RW-T	RW-W	UCI	WDM	Mean	KH	MS	RW-T	RW-W	UCI	WDM	Mean
KNN	1.18x	0.75x	0.87x	0.69x	0.52x	0.72x	0.77x	0.70x	0.90x	1.02x	0.79x	0.73x	0.80x	0.82x
Random Forest	0.67x	0.68x	0.76x	0.63x	0.75x	0.69x	0.70x	0.76x	0.89x	0.83x	0.93x	0.86x	0.80x	0.84x
SVM	0.85x	0.81x	0.77x	0.76x	0.85x	0.75x	0.80x	0.74x	0.98x	0.98x	0.93x	0.85x	0.88x	0.90x
CNN (1D)¹²	0.81x	0.86x	1.03x	0.93x	0.85x	0.78x	0.87x	0.90x	0.93x	0.96x	0.85x	0.82x	0.82x	0.88x
CNN (2D)¹²	0.76x	0.75x	0.84x	0.89x	0.75x	0.69x	0.78x	0.86x	0.91x	0.99x	0.86x	0.83x	0.82x	0.88x
CNN PF³⁴	0.78x	0.71x	0.93x	0.83x	0.77x	0.64x	0.77x	0.89x	0.91x	1.08x	0.84x	0.82x	0.81x	0.88x
CNN PFF³⁴	0.79x	0.71x	0.96x	0.84x	0.77x	0.64x	0.77x	0.90x	0.92x	1.08x	0.85x	0.81x	0.82x	0.89x
ConvNet¹³	0.81x	0.68x	0.74x	0.79x	0.72x	0.62x	0.72x	0.86x	0.93x	0.92x	0.84x	0.87x	0.87x	0.88x
IMU CNN¹⁴	0.69x	0.71x	0.72x	0.70x	0.71x	0.71x	0.71x	0.87x	0.92x	1.05x	0.88x	0.83x	0.82x	0.89x
IMU Transf.¹⁴	0.86x	0.91x	0.57x	0.79x	1.00x	1.30x	0.88x	0.95x	1.08x	1.07x	0.88x	0.97x	1.27x	1.03x
MLP (2 Layers)	0.73x	0.85x	0.96x	0.88x	0.86x	0.75x	0.83x	0.85x	0.92x	0.95x	0.80x	0.81x	0.81x	0.85x
MLP (3 layers)	0.67x	0.88x	0.94x	0.88x	0.82x	0.73x	0.81x	0.91x	0.94x	0.98x	0.84x	0.81x	0.83x	0.88x
ResNet¹⁵	0.72x	0.85x	0.61x	0.90x	0.84x	0.72x	0.78x	0.87x	0.93x	0.99x	0.81x	0.82x	0.81x	0.87x
ResNetSE⁶⁷	0.75x	0.83x	0.68x	0.91x	0.81x	0.70x	0.78x	0.86x	0.92x	0.98x	0.90x	0.88x	0.79x	0.89x
ResNetSE-5⁶⁷	0.59x	0.79x	0.67x	0.96x	0.79x	0.63x	0.73x	0.92x	0.92x	0.98x	0.84x	0.82x	0.87x	0.89x
Max (Ratio)	0.77x	0.82x	0.97x	0.85x	0.84x	0.78x	0.86x	0.90x	0.92x	0.92x	0.84x	0.86x	0.86x	0.88x

Values close to one indicate no significant difference between the two scenarios, values below one indicate better performance in the standard training scenario, and values above one indicate better performance in the cross-dataset scenario. The Max (Ratio) line is the ratio between both maximum values of the two scenarios.

Back to article page

Search

Advanced search

Quick links