Table 1 Summary of EHR features incorporated during pretraining. We pretrain multimodal MSN using each of the EHR features summarized below.
From: Multimodal masked siamese network improves chest X-ray representation learning
Group | Feature | Type | Values | Dimension |
|---|---|---|---|---|
Demographic (\(x_{D}\)) | Age | Numeric | \(\{ x \in \mathbb {N} | 18 \le x \le 100 \}\) | \(x_{age} \in \mathbb {R}^{1}\) |
Sex | Binary | \(\{Male, Female\}\) | \(x_{sex} \in \mathbb {R}^{2}\) | |
Scan medatadata (\(x_{SM}\)) | View | Multiclass | \(\{AP, L, PA, LL\}\) | \(x_{view} \in \mathbb {R}^{4}\) |
Position | Binary | \(\{Erect, Recumbent\}\) | \(x_{pos} \in \mathbb {R}^{2}\) | |
Inpatient stay information (\(x_{SI}\)) | ICU admission | Binary | \(\{Negative, Positive\}\) | \(x_{icu} \in \mathbb {R}^{2}\) |
In-hospital mortality | Binary | \(\{Negative, Positive\}\) | \(x_{mort} \in \mathbb {R}^{2}\) |