Fig. 2: T-SNE visualization depicting the ESOL molecule embeddings for intermediate fusion in Section 5.3.2 alongside molecules within the highlighted region.
From: Multimodal fusion with relational learning for molecular property prediction
Each point in the heatmap corresponds to the embeddings of respective molecules in ESOL, with color indicating solubility levels. Red denotes higher solubility, while blue indicates lower solubility. The embeddings derived from individual modalities prior to fusion do not display a clear pattern; the embeddings by intermediate fusion form a gradient that extends from the bottom left (indicating lower solubility) to the upper center (representing higher solubility).
