Fig. 5: Visualization of the Transformer’s latent space. | Nature Communications

Fig. 5: Visualization of the Transformer’s latent space.

From: Physics-informed transformers for electronic quantum states

Fig. 5

Results are shown for Ne = 10 electrons at different values of t/U for the band, chiral and HF bases. Each point represents a basis state s, which is colored according to the class label \({{{\mathcal{E}}}}({{{\boldsymbol{s}}}})\) [cf. Equation (9)], and has been obtained by projecting the respective latent space features H(s) onto the first two principal components (PCs)  using PCA. All simulations use embedding dimension demb = 300 with single attention head and decoder layer (Nh = Ndec = 1).

Back to article page