Table 2 Weight analysis of multi-cross attention modules in the final CGS-Net weights. The queries were initialized to 0 while the keys and values were initialized to 1. The average value of the weights is provided.
From: Context-guided segmentation for histopathologic cancer segmentation
Cross | Queries | Keys | Values |
|---|---|---|---|
Weight init | 0 | 1 | 1 |
First cross | 3.43e−09 | − 1.42e−08 | 2.59e−09 |
Second cross | 7.88e−09 | − 2.33e−09 | 9.13e−09 |
Third cross | − 4.84e−10 | − 3.63e−09 | − 2.97e−09 |
Fourth cross | 1.85e−09 | − 1.41e−09 | − 8.12e−10 |
