TY - GEN
T1 - TileDVP
T2 - 14th International Workshop on Clinical Image-based Procedures: Towards Holistic Patient Models for Personalized Healthcare, CLIP 2025 held in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2025
AU - Mathian, Émilie
AU - Oldenburg, Lukas
AU - Chelebian, Eduard
AU - Schweizer, Lisa
AU - Zonderland, Gijs
AU - Egebjerg, Kristian
AU - Ummat, Ishani
AU - Mund, Andreas
AU - Strauss, Maximillian T.
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2026.
PY - 2026
Y1 - 2026
N2 - Recent advances in multimodal deep learning have successfully begun to link molecular data with tissue morphology. To date, this work has largely focused on transcriptomics, a limited surrogate for protein expression. The direct prediction of proteins, the functional endpoints of gene expression, remains underexplored, largely due to the difficulty in generating spatially resolved proteomic data. Early efforts to predict proteomic data from tissue morphology were hindered by low specificity and limited multiplexing capacity, constraints inherent to immunohistochemistry and multiplexed immunofluorescence techniques. This proof-of-concept study presents a novel data generation pipeline to address these throughput and specificity challenges and decode the proteome from H&E slides via high-throughput tile-level mass spectrometry profiling. This approach enables a direct one-to-one correspondence between histological features and proteomic measurements, which is an essential prerequisite for training robust foundation models. By applying this pipeline to gastric cancer biopsies, the study demonstrated that morphologically distinct clusters corresponded to distinct proteomic profiles. Notably, tumor regions were enriched for clinically relevant markers such as HMGB1, LGALS3, and ERBB2, all of which are associated with poor prognosis. This work establishes the foundation for a new generation of AI-driven proteomics, demonstrating that routine histological images contain sufficient information to predict thousands of proteins across diverse biological conditions. TileDVP represents a paradigm shift toward accessible, high-throughput spatial proteomics that could transform biomarker discovery and precision medicine applications.
AB - Recent advances in multimodal deep learning have successfully begun to link molecular data with tissue morphology. To date, this work has largely focused on transcriptomics, a limited surrogate for protein expression. The direct prediction of proteins, the functional endpoints of gene expression, remains underexplored, largely due to the difficulty in generating spatially resolved proteomic data. Early efforts to predict proteomic data from tissue morphology were hindered by low specificity and limited multiplexing capacity, constraints inherent to immunohistochemistry and multiplexed immunofluorescence techniques. This proof-of-concept study presents a novel data generation pipeline to address these throughput and specificity challenges and decode the proteome from H&E slides via high-throughput tile-level mass spectrometry profiling. This approach enables a direct one-to-one correspondence between histological features and proteomic measurements, which is an essential prerequisite for training robust foundation models. By applying this pipeline to gastric cancer biopsies, the study demonstrated that morphologically distinct clusters corresponded to distinct proteomic profiles. Notably, tumor regions were enriched for clinically relevant markers such as HMGB1, LGALS3, and ERBB2, all of which are associated with poor prognosis. This work establishes the foundation for a new generation of AI-driven proteomics, demonstrating that routine histological images contain sufficient information to predict thousands of proteins across diverse biological conditions. TileDVP represents a paradigm shift toward accessible, high-throughput spatial proteomics that could transform biomarker discovery and precision medicine applications.
KW - Deep Learning
KW - Deep Visual Proteomics
KW - Histopathology
UR - https://www.scopus.com/pages/publications/105019291706
U2 - 10.1007/978-3-032-05479-1_3
DO - 10.1007/978-3-032-05479-1_3
M3 - Article in proceedings
AN - SCOPUS:105019291706
SN - 9783032054784
T3 - Lecture Notes in Computer Science
SP - 21
EP - 31
BT - Clinical Image-Based Procedures - 14th International Workshop, CLIP 2025, Held in Conjunction with MICCAI 2025, Proceedings
A2 - Erdt, Marius
A2 - Chen, Yufei
A2 - Wesarg, Stefan
A2 - Drechsler, Klaus
A2 - Freiman, Moti
A2 - Thomas, Sarina
A2 - Khawaled, Samah
PB - Springer Science and Business Media Deutschland GmbH
Y2 - 23 September 2025 through 23 September 2025
ER -