Table 6 Test results of the long sequence processing efficiency.
From: Unbalanced power anomaly detection model based on improved transformer and countermeasure encoder
Model type | Memory (GB) | Delay (ms) | F1 maintenance rate (%) |
|---|---|---|---|
Transformer | 18.7 | 412 | 82.1 |
Mem-ATT (2023) | 12.5 | 298 | 85.7 |
LSH-Transformer | 8.9 | 183 | 89.3 |