Table 3 Parameter settings for the FCNN and MHA-FCNN models.
Parameter | FCNN | MHA-FCNN |
|---|---|---|
Number of Dense Layers | 3 | 3 |
Hidden Neurons | [128, 64, 32] | [128, 64, 32] |
Dropout Rate | 0.3 | 0.3 |
Attention Mechanism | N/A | Multi-Head Attention |
Optimizer | Adam | Adam |
Learning Rate | 0.001 | 0.001 |
Loss Function | Binary Cross Entropy | Binary Cross Entropy |
Activation Function (Hidden Layers) | ReLU | ReLU |
Activation Function (Output) | Sigmoid | Sigmoid |
