Table 2 Three architectures found by MicroNAS for the SkodaR dataset compared to SOTA classifiers8,19,21,25.
Model | Device | #Params | Latency (ms) | Peak memory (B) | Accuracy non-quant (%) | Accuracy quant (%) | F1-Score non-quant (%) | F1-Score quant (%) |
|---|---|---|---|---|---|---|---|---|
MicroNAS 1 | NUCLEO | 4602.00 | 48.00 | 8640.00 | \(90.30 \pm 0.00\) | \(90.71 \pm 0.00\) | \(91.32 \pm 0.03\) | \(90.14 \pm 0.06\) |
MicroNAS 2 | NUCLEO | 31258.00 | 225.00 | 24576.00 | \(96.39 \pm 0.06\) | \(95.81 \pm 0.03\) | \(96.41 \pm 0.38\) | \(95.30 \pm 0.55\) |
MicroNAS 3 | NUCLEOF446RE | 5678.00 | 28.00 | 5840.00 | \(91.02 \pm 0.44\) | \(92.59 \pm 0.64\) | \(91.14 \pm 0.14\) | \(91.87 \pm 0.05\) |
MicroNAS 4 | NUCLEOF446RE | 50018.00 | 189.00 | 28800.00 | \(96.99 \pm 0.15\) | \(97.50 \pm 0.32\) | \(97.00 \pm 0.14\) | \(96.62 \pm 0.50\) |
MicroNAS 5 | PORTENTA | 3567.00 | 4.25 | 7248.00 | \(92.76 \pm 0.32\) | \(92.46 \pm 0.21\) | \(91.44 \pm 0.28\) | \(91.49 \pm 0.69\) |
MicroNAS 6 | PORTENTA | 81675.00 | 60.50 | 33120.00 | \(97.93 \pm 0.16\) | \(97.52 \pm 0.11\) | \(97.27 \pm 0.11\) | \(96.57 \pm 0.03\) |
DeepConvLSTM | Desktop | 1.1M | NA* | NA* | NA* | NA* | 98.99 | NA* |
Mahmud et al. | Desktop | NA* | NA* | NA* | NA* | NA* | 97 | NA* |
TinyHar | Desktop | 114540 | ND* | ND* | 98.45 | ND* | 98.27 | ND* |
MLP-HAR | Desktop | 175054 | ND* | ND* | 94.74 | ND* | 93.11 | ND* |
SVC | Desktop | – | – | – | 83.28 | – | 77.73 | – |
RF | Desktop | – | – | – | 92.88 | – | 91.67 | – |
DT | Desktop | – | – | – | 87.62 | – | 85.58 | – |
LR | Desktop | – | – | – | 89.47 | – | 87.52 | – |
DARTS-softmax | Nucleo-L552ZE-Q | 126414 | 1125.76 | 30768 | 91.26 | 90.77 | 91.26 | 86.16 |
DARTS-gumbel | Nucleo-L552ZE-Q | Failed** | ||||||
