Fig. 7: This figure visualizes the four attention heads in the first and second layers of CVTC model processing brain MRI images.
From: A lightweight CVTC model for accurate Alzheimer’s MRI analysis and lesion annotation
(a) First layer long attention; (b) Second layer long attention. Each major layer has four long attention mechanisms and four short attention mechanisms. They interact with each other to enhance the model's performance.
