Multimodal fusion of digital pathology and transcriptomics can improve cancer diagnosis, but remains impractical in clinical settings. Here, the authors develop a crossmodal generative model, PathGen, to synthesise transcriptomic data from histopathology slides, and show how the combination of these multimodal data improves cancer diagnosis and prognosis prediction.
- Samiran Dey
- Christopher R. S. Banerji
- Tapabrata Chakraborti