Transformer-based biomarker prediction from colorectal cancer histology: A large-scale multicentric study.
Transformer-based biomarker prediction from colorectal cancer histology: A large-scale multicentric study.
复制标题
DOI:
10.1016/j.ccell.2023.08.002
复制
发表时间:
2023-09-11
期刊:
影响因子:
50.3
通讯作者:
Kather, Jakob Nikolas
中科院分区:
文献类型:
--
作者:
Wagner, Sophia J.;Reisenbuechler, Daniel;West, Nicholas P.;Niehues, Jan Moritz;Zhu, Jiefu;Foersch, Sebastian;Veldhuizen, Gregory Patrick;Quirke, Philip;Grabsch, Heike I.;van den Brandt, Piet A.;Hutchins, Gordon G. A.;Richman, Susan D.;Yuan, Tanwei;Langer, Rupert;Jenniskens, Josien C. A.;Offermans, Kelly;Mueller, Wolfram;Gray, Richard;Gruber, Stephen B.;Greenson, Joel K.;Rennert, Gad;Bonner, Joseph D.;Schmolze, Daniel;Jonnagaddala, Jitendra;Hawkins, Nicholas J.;Ward, Robyn L.;Morton, Dion;Seymour, Matthew;Magill, Laura;Nowak, Marta;Hay, Jennifer;Koelzer, Viktor H.;Church, David N.;Matek, Christian;Geppert, Carol;Peng, Chaolong;Zhi, Cheng;Ouyang, Xiaoming;James, Jacqueline A.;Loughrey, Maurice B.;Salto-Tellez, Manuel;Brenner, Hermann;Hoffmeister, Michael;Truhn, Daniel;Schnabel, Julia A.;Boxberg, Melanie;Peng, Tingying;Kather, Jakob Nikolas
Deep learning (DL) can accelerate the prediction of prognostic biomarkers from routine pathology slides in colorectal cancer (CRC). However, current approaches rely on convolutional neural networks (CNNs) and have mostly been validated on small patient cohorts. Here, we develop a new transformer-based pipeline for end-to-end biomarker prediction from pathology slides by combining a pre-trained transformer encoder with a transformer network for patch aggregation. Our transformer-based approach substantially improves the performance, generalizability, data efficiency, and interpretability as compared with current state-of-the-art algorithms. After training and evaluating on a large multicenter cohort of over 13,000 patients from 16 colorectal cancer cohorts, we achieve a sensitivity of 0.99 with a negative predictive value of over 0.99 for prediction of microsatellite instability (MSI) on surgical resection specimens. We demonstrate that resection specimen-only training reaches clinical-grade performance on endoscopic biopsy tissue, solving a long-standing diagnostic problem. AI-based prediction of biomarkers (MSI, BRAF, and KRAS) using transformers MSI prediction reaches clinical-grade performance on biopsies of colorectal cancer Transformer-based biomarker prediction generalizes better and is more data efficient Large-scale multi-cohort evaluation on over 13,000 patients from 16 cohorts Wagner et al. show that transformer-based prediction of biomarkers from histology substantially improves the performance, generalizability, data efficiency, and interpretability as compared with current state-of-the-art algorithms. The method significantly outperforms existing approaches for microsatellite instability detection in surgical resections and reaches clinical-grade performance on biopsies of colorectal cancer, solving a long-standing diagnostic problem.
登录
查看更多内容
DOI:
10.1056/nejmoa2201445
发表时间:
2022-06-23
期刊:
The New England journal of medicine
影响因子:
--
作者:
通讯作者:
--
影响因子:
8.8
作者:
Gray RT;Loughrey MB;Bankhead P;Cardwell CR;McQuaid S;O'Neill RF;Arthur K;Bingham V;McGready C;Gavin AT;James JA;Hamilton PW;Salto-Tellez M;Murray LJ;Coleman HG
通讯作者:
Coleman HG
影响因子:
11.5
作者:
Grabsch, H;Dattani, M;Mueller, W
通讯作者:
Mueller, W
影响因子:
78.8
作者:
Bera, Kaustav;Schalper, Kurt A.;Madabhushi, Anant
通讯作者:
Madabhushi, Anant
影响因子:
168.9
作者:
Gray, Richard;Barnwell, Jennifer;Kerr, David J.
通讯作者:
Kerr, David J.