Table 1 Three architectures found by MicroNAS for the UCI-HAR dataset compared to SOTA classifiers19,25,51,52.

From: MicroNAS for memory and latency constrained hardware aware neural architecture search in time series classification on microcontrollers

Model

Device

#Params

Latency (ms)

Peak Memory (B)

Accuracy non-quant (%)

Accuracy quant (%)

F1-Score non-quant (%)

F1-Score quant (%)

MicroNAS 1

NUCLEO

2019.33

19.00

3504.00

\(94.62 \pm 1.03\)

\(93.44 \pm 0.71\)

\(94.97 \pm 0.96\)

\(93.91 \pm 0.69\)

MicroNAS 2

NUCLEO

43976.67

163.00

14997.33

\(99.18 \pm 0.27\)

\(95.58 \pm 0.30\)

\(99.26 \pm 0.24\)

\(96.00 \pm 0.27\)

MicroNAS 3

NUCLEOF446RE

998.00

10.00

5856.00

\(94.02 \pm 0.85\)

\(93.17 \pm 0.79\)

\(94.43 \pm 0.74\)

\(93.71 \pm 0.81\)

MicroNAS 4

NUCLEOF446RE

68790.00

127.00

15360.00

\(99.34 \pm 0.12\)

\(96.34 \pm 0.26\)

\(99.37 \pm 0.11\)

\(96.64 \pm 0.22\)

MicroNAS 5

PORTENTA

3340.00

2.00

4044.00

\(95.88 \pm 0.07\)

\(93.92 \pm 0.41\)

\(96.26 \pm 0.06\)

\(94.50 \pm 0.34\)

MicroNAS 6

PORTENTA

114608.00

40.75

16800.00

\(99.60 \pm 0.04\)

\(96.37 \pm 0.18\)

\(99.63 \pm 0.04\)

\(96.70 \pm 0.17\)

Kolkar et al.

Desktop

NA*

NA*

NA*

96.83

NA*

NA*

NA*

Dua et al.

Desktop

NA*

NA*

NA*

96.20

NA*

96.19

NA*

TinyHar

Desktop

71532

ND*

ND*

99.18

ND*

99.20

ND*

MLP-HAR

Desktop

41924

ND*

ND*

95.65

ND*

95.96

ND*

SVC

Desktop

77.72

74.21

RF

Desktop

95.11

95.10

DT

Desktop

95.65

95.36

LR

Desktop

82.34

81.51

DARTS-softmax

Nucleo-L552ZE-Q

80098

212.28

18492

95.08

93.45

95.15

93.54

DARTS-gumbel

Nucleo-L552ZE-Q

56390

337.52

20480

93.99

92.35

94.1

92.27

  1. NA* Data not available from the source (experiment from the literature)
  2. ND* Model cannot run on MCUs (self-conducted experiment)