Figure 3
From: Diabetic retinopathy classification using a multi-attention residual refinement architecture
The design of the Squeeze-and-Excitation block. First, we passed the feature matrix \(\textbf{U}\) through to the squeeze operation to generate the embedding space \(\textbf{Z}\) with \(1 \times 1 \times C\), then we utilized the gating mechanism with a sigmoid activation to implement the excitation process to get excitation output \(\textbf{S}\). Finally, the feature matrix \(\textbf{U}\) is reweighted according to the excitation output \(\textbf{S}\) to get the output \(\tilde{\textbf{X}}\) of the Squeeze-and-Excitation block.
