Predicting Multiomics Histopathology Features with Surface Parameterizations

Kai Huang , Zhong-Heng Tan , Wenlong Yu , Xiaowei Wang , Yan Ding , Shihui Xu , Zaozao Chen , Yi Zhang , Yun Liu , Wen-Wei Lin , Tiexiang Li , Shing-Tung Yau , Zhongze Gu

Engineering ››

PDF (4646KB)
Engineering ›› DOI: 10.1016/j.eng.2025.07.026
review-article
Predicting Multiomics Histopathology Features with Surface Parameterizations
Author information +
History +
PDF (4646KB)

Abstract

To improve patient stratification and therapeutic response prediction in computational pathology, clinical-grade decision-making has been enhanced by deep learning models, including those used for microsatellite instability (MSI) prediction and molecular subtype classification. However, prior models and training settings have been largely based on the natural image domain, which differs from histopathology data. To mitigate the inductive bias, we introduced surface parameterization, a geometric mapping from the surface to a suitable domain, to transform whole slide images into fixed-sized squares using conformal energy minimization (CEM) and stretch energy minimization (SEM) algorithms. These transformations are tissue-perceptive, enhancing the region of interest (e.g., cancerous areas) to improve model performance. For example, our method improved MSI prediction, achieving an area under the receiver operating characteristic curve (AUROC) of 0.87 for CEM and SEM with a reduced training set, compared with 0.70 for original slides. To validate its clinical applicability, we analyzed consensus molecular subtype (CMS) classification in 17 colorectal cancer (CRC) patients, with concordance rates of 47.1 % (CEM) and 41.2 % (SEM), outperforming the original slides (29.4 %). As a proof-of-concept, we also linked CMS calls to organoid morphology, demonstrating that cystic organoids were more strongly associated with CMS3. This phenotypic feature may be integrated into CMS and improve the evaluation of tissue differentiation. Overall, our method provides new insight into the data processing of computational pathology and demonstrates the performance of state-of-the-art (SOTA) in multiomics prediction.

Keywords

Surface parameterization / Colorectal cancer / Consensus molecular subtype / Patient-derived organoids

Cite this article

Download citation ▾
Kai Huang, Zhong-Heng Tan, Wenlong Yu, Xiaowei Wang, Yan Ding, Shihui Xu, Zaozao Chen, Yi Zhang, Yun Liu, Wen-Wei Lin, Tiexiang Li, Shing-Tung Yau, Zhongze Gu. Predicting Multiomics Histopathology Features with Surface Parameterizations. Engineering DOI:10.1016/j.eng.2025.07.026

登录浏览全文

4963

注册一个新账户 忘记密码

References

[1]

Siegel RL, Wagle NS, Cercek A, Smith RA, Jemal A.Colorectal cancer statistics, 2023.CA Cancer J Clin 2023; 73:233-254.

[2]

Skrede OJ, De SRaedt, Kleppe A, Hveem TS, Liest Køl, Maddison J, et al.Deep learning for prediction of colorectal cancer outcome: a discovery and validation study.Lancet 2020; 395:350-360.

[3]

Fujii M, Sekine S, Sato T.Decoding the basis of histological variation in human cancer.Nat Rev Cancer 2024; 24:141-158.

[4]

Shmatko A, Ghaffari NLaleh, Gerstung M, Kather JN.Artificial intelligence in histopathology: enhancing cancer research and clinical oncology.Nat Cancer 2022; 3:1026-1038.

[5]

Kather JN, Pearson AT, Halama N, Jäger D, Krause J, Loosen SH, et al.Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer.Nat Med 2019; 25:1054-1056.

[6]

Yamashita R, Long J, Longacre T, Peng L, Berry G, Martin B, et al.Deep learning model for the prediction of microsatellite instability in colorectal cancer: a diagnostic study.Lancet Oncol 2021; 22:132-141.

[7]

Sirinukunwattana K, Domingo E, Richman SD, Redmond KL, Blake A, Verrill C, et al.Image-based consensus molecular subtype (imCMS) classification of colorectal cancer using deep learning.Gut 2021; 70:544-554.

[8]

Wagner SJ, Reisenbüchler D, West NP, Niehues JM, Zhu J, Foersch S, et al.Transformer-based biomarker prediction from colorectal cancer histology: a large-scale multicentric study.Cancer Cell 2023; 41:1650-1661.e4.

[9]

Song AH, Jaume G, Williamson DFK, Lu MY, Vaidya A, Miller TR, et al.Artificial intelligence for digital and computational pathology.Nat Rev Bioeng 2023; 1:930-949.

[10]

Xu H, Usuyama N, Bagga J, Zhang S, Rao R, Naumann T, et al.A whole-slide foundation model for digital pathology from real-world data.Nature 2024; 630:181-188.

[11]

Vorontsov E, Bozkurt A, Casson A, Shaikovski G, Zelechowski M, Severson K, et al.A foundation model for clinical-grade computational pathology and rare cancers detection.Nat Med 2024; 30:2924-2935.

[12]

Wang X, Yang S, Zhang J, Wang M, Zhang J, Yang W, et al.Transformer-based unsupervised contrastive learning for histopathological image classification.Med Image Anal 2022; 81:102559.

[13]

Lu MY, Williamson DFK, Chen TY, Chen RJ, Barbieri M, Mahmood F.Data-efficient and weakly supervised computational pathology on whole-slide images.Nat Biomed Eng 2021; 5:555-570.

[14]

Macenko M, Niethammer M, Marron JS, Borland D, Woosley JT, Guan X, et al.A method for normalizing histology slides for quantitative analysis.In: Proceedings of the 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro; 2009 Jun 28–Jul 1; Boston, M A, USA. IEE E; 2009. p. 1107–10.

[15]

Vahadane A, Peng T, Sethi A, Albarqouni S, Wang L, Baust M, et al.Structure-preserving color normalization and sparse stain separation for histological images.IEEE Trans Med Imaging 2016; 35:1962-1971.

[16]

Reasat T, Sushmit A, Smith DS.Data efficient contrastive learning in histopathology using active sampling.MLWA 2024; 17:100577.

[17]

Fujii M, Shimokawa M, Date S, Takano A, Matano M, Nanki K, et al.A colorectal tumor organoid library demonstrates progressive loss of niche factor requirements during tumorigenesis.Cell Stem Cell 2016; 18:827-838.

[18]

Yueh MH, Lin WW, Wu CT, Yau ST.An efficient energy minimization for conformal parameterizations.J Sci Comput 2017; 73:203-227.

[19]

Yueh MH, Lin WW, Wu CT, Yau ST.A novel stretch energy minimization algorithm for equiareal parameterizations.J Sci Comput 2019; 78:1353-1386.

[20]

Floater MS, Hormann K.Surface parameterization: a tutorial and survey.N.A. Dodgson, M.S. Floater, M.A. Sabin (Eds.), Advances in multiresolution for geometric modelling, Springer, Berlin, Heidelberg 2005; 157-186.

[21]

Lin WW, Juang C, Yueh MH, Huang TM, Li T, Wang S, et al.3D brain tumor segmentation using a two-stage optimal mass transport algorithm.Sci Rep 2021; 11:1-19.

[22]

Guinney J, Dienstmann R, Wang X, de AReyniès, Schlicker A, Soneson C, et al.The consensus molecular subtypes of colorectal cancer.Nat Med 2015; 21:1350-1356.

[23]

Kuo YC, Lin WW, Yueh MH, Yau ST.Convergent conformal energy minimization for the computation of disk parameterizations.SIAM J Imaging Sci 2021; 14:1790-1815.

[24]

Tan ZH, Li T, Lin WW, Yau ST.n-Dimensional volumetric stretch energy minimization for volume-/mass-preserving parameterizations. ar Xiv:2402.00380.

[25]

Colling R, Pitman H, Oien K, Rajpoot N, Macklin P, Group C-P A in HW, et al.Artificial intelligence in digital pathology: a roadmap to routine use in clinical practice. J Pathol 2019;249:143–50.

[26]

Kingma DP, Ba J.Adam: a method for stochastic optimization. ar Xiv:1412.6980.

[27]

Lu MY, Chen B, Williamson DFK, Chen RJ, Liang I, Ding T, et al.A visual-language foundation model for computational pathology.Nat Med 2024; 30:863-874.

[28]

Chen RJ, Ding T, Lu MY, Williamson DFK, Jaume G, Song AH, et al.Towards a general-purpose foundation model for computational pathology.Nat Med 2024; 30:850-862.

[29]

Kather JN, Krisam J, Charoentong P, Luedde T, Herpel E, Weis CA, et al.Predicting survival from colorectal cancer histology slides using deep learning: a retrospective multicenter study.PLoS Med 2019; 16:e1002730.

[30]

He K, Zhang X, Ren S, Sun J.Deep residual learning for image recognition. ar Xiv:1512.03385.

[31]

Farin HF, Mosa MH, Ndreshkjana B, Grebbin BM, Ritter B, Menche C, et al.Colorectal cancer organoid–stroma biobank allows subtype-specific assessment of individualized therapy responses.Cancer Discov 2023; 13:2192-2211.

[32]

Kim SC, Park JW, Seo HY, Kim M, Park JH, Kim GH, et al.Multifocal organoid capturing of colon cancer reveals pervasive intratumoral heterogenous drug responses.Adv Sci 2022; 9:e2103360.

[33]

Cho EJ, Kim M, Jo D, Kim J, Oh JH, Chung HC, et al.Immuno-genomic classification of colorectal cancer organoids reveals cancer cells with intrinsic immunogenic properties associated with patient survival.J Exp Clin Cancer Res 2021; 40:230.

[34]

Huang K, Li M, Li Q, Chen Z, Zhang Y, Gu Z.Image-based profiling and deep learning reveal morphological heterogeneity of colorectal cancer organoids.Comput Biol Med 2024; 173:108322.

[35]

Ilse M, Tomczak JM, Welling M.Attention-based deep multiple instance learning.In: Proceedings of the 35th International Conference on Machine Learning; Stockholm, Sweden; 2018 Jul 10–15. International Machine Learning Society; 2018. p. 3376–91.

[36]

Lin WW, Lin JW, Huang TM, Li T, Yueh MH, Yau ST.A novel 2-phase residual U-net algorithm combined with optimal mass transportation for 3D brain tumor detection and segmentation.Sci Rep 2022; 12:1-16.

[37]

Tsai PC, Lee TH, Kuo KC, Su FY, Lee TLM, Marostica E, et al.Histopathology images predict multi-omics aberrations and prognoses in colorectal cancer patients.Nat Commun 2023; 14:2102.

[38]

Toyota M, Ahuja N, Ohe-Toyota M, Herman JG, Baylin SB, Issa JP.CpG island methylator phenotype in colorectal cancer.Proc Natl Acad Sci U S A 1999; 96:8681-8686.

[39]

Carroll KJ.On the use and utility of the Weibull model in the analysis of survival data.Control Clin Trials 2003; 24:682-701.

[40]

Shaban MT, Baur C, Navab N, Albarqouni S.Staingan: stain style transfer for digital histological images 2018.In: Proceedings of the 2019 IEE E16th International Symposium on Biomedical Imaging (ISB I 2019); Venice, Italy; 2019 Apr 8–11. IEE E; 2019. p. 953–6.

[41]

Lafarge MW, Domingo E, Sirinukunwattana K, Wood R, Samuel L, Murray G, et al.Image-based consensus molecular subtyping in rectal cancer biopsies and response to neoadjuvant chemoradiotherapy.npj Precis Oncol 2024; 8:1-11.

[42]

Raghavan S, Winter PS, Navia AW, Williams HL, DenAdel A, Lowder KE, et al.Microenvironment drives cell state, plasticity, and drug response in pancreatic cancer.Cell 2021; 184:6119-6137.e26.

[43]

Kawasaki K, Toshimitsu K, Matano M, Fujita M, Fujii M, Togasaki K, et al.An organoid biobank of neuroendocrine neoplasms enables genotype-phenotype mapping.Cell 2020; 183:1420-1435.e21.

[44]

Fessler E, Medema JP.Colorectal cancer subtypes: developmental origin and microenvironmental regulation.Trends Cancer 2016; 2:505-518.

[45]

Sato T, Stange DE, Ferrante M, Vries RGJ, Van JHEs, Van Sden Brink, et al.Long-term expansion of epithelial organoids from human colon, adenoma, adenocarcinoma, and Barrett’s epithelium.Gastroenterology 2011; 141:1762-1772.

[46]

Zhan T, Ambrosi G, Wandmacher AM, Rauscher B, Betge J, Rindtorff N, et al.MEK inhibitors activate Wnt signalling and induce stem cell plasticity in colorectal cancer.Nat Commun 2019; 10:1-17.

[47]

Betge J, Rindtorff N, Sauer J, Rauscher B, Dingert C, Gaitantzi H, et al.The drug-induced phenotypic landscape of colorectal cancer organoids.Nat Commun 2022; 13:1-15.

[48]

Ayyaz A, Kumar S, Sangiorgi B, Ghoshal B, Gosio J, Ouladan S, et al.Single-cell transcriptomes of the regenerating intestine reveal a revival stem cell.Nature 2019; 569:121-125.

[49]

Nusse YM, Savage AK, Marangoni P, Rosendahl-Huber AKM, Landman TA, De FJSauvage, et al.Parasitic helminths induce fetal-like reversion in the intestinal stem cell niche.Nature 2018; 559:109-113.

[50]

Roulis M, Kaklamanos A, Schernthanner M, Bielecki P, Zhao J, Kaffe E, et al.Paracrine orchestration of intestinal tumorigenesis by a mesenchymal niche.Nature 2020; 580:524-529.

[51]

Chen L, Qiu X, Dupre A, Pellon-Cardenas O, Fan X, Xu X, et al.TGFB1 induces fetal reprogramming and enhances intestinal regeneration.Cell Stem Cell 2023; 30:1520-1537.e8.

[52]

Qin X, Cardoso FRodriguez, Sufi J, Vlckova P, Claus J, Tape CJ.An oncogenic phenoscape of colonic stem cell polarization.Cell 2023; 186:5554-5568.e18.

[53]

Geurts MH, Gandhi S, Boretto MG, Akkerman N, Derks LLM, van GSon, et al.One-step generation of tumor models by base editor multiplexing in adult stem cell-derived organoids.Nat Commun 2023; 14:4998.

[54]

Michels BE, Mosa MH, Grebbin BM, Yepes D, Darvishi T, Hausmann J, et al.Human colon organoids reveal distinct physiologic and oncogenic Wnt responses.J Exp Med 2019; 216:704-720.

[55]

Jänne PA, Mayer RJ.Chemoprevention of colorectal cancer.N Engl J Med 2000; 342:1960-1968.

[56]

Zhang Y, Tang C, Span PN, Rowan AE, Aalders TW, Schalken JA, et al.Polyisocyanide hydrogels as a tunable platform for mammary gland organoid formation.Adv Sci 2020; 7:2001797.

[57]

Joanito I, Wirapati P, Zhao N, Nawaz Z, Yeo G, Lee F, et al.Single-cell and bulk transcriptome sequencing identifies two epithelial tumor cell states and refines the consensus molecular classification of colorectal cancer.Nat Genet 2022; 54:963-975.

[58]

Malla SB, Byrne RM, Lafarge MW, Corry SM, Fisher NC, Tsantoulis PK, et al.Pathway level subtyping identifies a slow-cycling biological phenotype associated with poor clinical outcomes in colorectal cancer.Nat Genet 2024; 56:458-472.

[59]

Nunes L, Li F, Wu M, Luo T, Hammarström K, Torell E, et al.Prognostic genome and transcriptome signatures in colorectal cancers.Nature 2024; 633:137-146.

[60]

Yan M, Xie L, Tang J, Liang K, Mei Y, Kong B.Recent advances in heterosilica-based micro/nanomotors: designs, biomedical applications, and future perspectives.Chem Mater 2021; 33:3022-3046.

[61]

Yan M, Chen Q, Liu T, Li X, Pei P, Zhou L, et al.Site-selective superassembly of biomimetic nanorobots enabling deep penetration into tumor with stiff stroma.Nat Commun 2023; 14:4628.

[62]

Liu T, Xie L, C-A-Price H, Liu J, He Q, Kong B.Controlled propulsion of micro/nanomotors: operational mechanisms, motion manipulation and potential biomedical applications.Chem Soc Rev 2022; 51:10083-10119.

[63]

Liu Y, Xie L, Gao M, Zhang R, Gao J, Sun J, et al.Super-assembled periodic mesoporous organosilica frameworks for real-time hypoxia-triggered drug release and monitoring.ACS Appl Mater Interfaces 2021; 13:50246-50257.

[64]

Zeng J, Xie L, Liu T, He Y, Liu W, Zhang Q, et al.Super-assembled multilayered mesoporous TiO2 nanorockets for light-powered space-confined microfluidic catalysis.ACS Appl Mater Interfaces 2024; 16:23484-23496.

PDF (4646KB)

180

Accesses

0

Citation

Detail

Sections
Recommended

/