Table 1 Three architectures found by MicroNAS for the UCI-HAR dataset compared to SOTA classifiers19,25,51,52.
Model | Device | #Params | Latency (ms) | Peak Memory (B) | Accuracy non-quant (%) | Accuracy quant (%) | F1-Score non-quant (%) | F1-Score quant (%) |
|---|---|---|---|---|---|---|---|---|
MicroNAS 1 | NUCLEO | 2019.33 | 19.00 | 3504.00 | \(94.62 \pm 1.03\) | \(93.44 \pm 0.71\) | \(94.97 \pm 0.96\) | \(93.91 \pm 0.69\) |
MicroNAS 2 | NUCLEO | 43976.67 | 163.00 | 14997.33 | \(99.18 \pm 0.27\) | \(95.58 \pm 0.30\) | \(99.26 \pm 0.24\) | \(96.00 \pm 0.27\) |
MicroNAS 3 | NUCLEOF446RE | 998.00 | 10.00 | 5856.00 | \(94.02 \pm 0.85\) | \(93.17 \pm 0.79\) | \(94.43 \pm 0.74\) | \(93.71 \pm 0.81\) |
MicroNAS 4 | NUCLEOF446RE | 68790.00 | 127.00 | 15360.00 | \(99.34 \pm 0.12\) | \(96.34 \pm 0.26\) | \(99.37 \pm 0.11\) | \(96.64 \pm 0.22\) |
MicroNAS 5 | PORTENTA | 3340.00 | 2.00 | 4044.00 | \(95.88 \pm 0.07\) | \(93.92 \pm 0.41\) | \(96.26 \pm 0.06\) | \(94.50 \pm 0.34\) |
MicroNAS 6 | PORTENTA | 114608.00 | 40.75 | 16800.00 | \(99.60 \pm 0.04\) | \(96.37 \pm 0.18\) | \(99.63 \pm 0.04\) | \(96.70 \pm 0.17\) |
Kolkar et al. | Desktop | NA* | NA* | NA* | 96.83 | NA* | NA* | NA* |
Dua et al. | Desktop | NA* | NA* | NA* | 96.20 | NA* | 96.19 | NA* |
TinyHar | Desktop | 71532 | ND* | ND* | 99.18 | ND* | 99.20 | ND* |
MLP-HAR | Desktop | 41924 | ND* | ND* | 95.65 | ND* | 95.96 | ND* |
SVC | Desktop | – | – | – | 77.72 | – | 74.21 | – |
RF | Desktop | – | – | – | 95.11 | – | 95.10 | – |
DT | Desktop | – | – | – | 95.65 | – | 95.36 | – |
LR | Desktop | – | – | – | 82.34 | – | 81.51 | – |
DARTS-softmax | Nucleo-L552ZE-Q | 80098 | 212.28 | 18492 | 95.08 | 93.45 | 95.15 | 93.54 |
DARTS-gumbel | Nucleo-L552ZE-Q | 56390 | 337.52 | 20480 | 93.99 | 92.35 | 94.1 | 92.27 |