Table 21 “Shunyi” transformer model parameters (PC).

From: Air quality prediction based on factor analysis combined with Transformer and CNN-BILSTM-ATTENTION models

Parameter

Value

Input shape

(5, 2)

Dense layer units

128

Number of attention heads

2

Key dimension

32

Global average pooling

GlobalAveragePooling1D

Output layer units

2

Back to article page