期刊首页 优先出版 当期阅读 过刊浏览 作者中心 关于期刊 English

《工程(英文)》 >> 2023年 第23卷 第4期 doi: 10.1016/j.eng.2022.10.015

贝叶斯推理和动态神经反馈促进先天性心脏病智能诊断的临床应用

a Shanghai Key Laboratory of Intelligent Information Processing, School of Computer Science, Fudan University, Shanghai 200433, China
b Cardiovascular Center & Clinical Laboratory Center, Children’s Hospital of Fudan University, National Children’s Medical Center, Shanghai 201102, China

# These authors contributed equally to this work.

收稿日期: 2022-03-26 修回日期: 2022-09-01 录用日期: 2022-10-10 发布日期: 2023-01-16

下一篇 上一篇

摘要

先天性心脏病(CHD)是婴幼儿死亡的主要原因。基于人工智能的先天性心脏病诊断网络(CHDNet)是一种基于超声心动图视频的二分类模型,用于判别超声心动图视频是否包含心脏缺陷。现有的CHDNet模型表现出与医学专家相当甚至更好的判别性能,但它们在训练集之外的样本上的不可靠性已成为模型部署的关键瓶颈。而这是当前大多数基于AI 诊断方法的共性问题。为了克服这一挑战,本文提出了两种基本机制——贝叶斯推理和动态神经反馈——分别用于衡量和提高人工智能诊断的可靠性。贝叶斯推理允许神经网络模型输出CHD判别的可靠性而不仅仅是单一的判别结果,而动态神经反馈是一个计算神经反馈单元,允许神经网络将知识从输出层反馈给浅层,使神经网络有选择地激活相关神经元。为了评估这两种机制的有效性,我们在包含三种常见CHD 缺陷的4151 个超声心动图视频上训练了CHDNet,并在1037 个超声心动图视频的内部测试集和从其他心血管成像设备新收集的692 个外部视频集上对其进行了测试。每个超声心动图视频对应于一位患者和一次就诊。我们在多种代表性神经网络架构上展示了贝叶斯推理获得的可靠性如何解释和量化神经网络内部和外部测试集之间的性能显著差异,以及尽管输入被噪声破坏或使用外部测试集时,设计的反馈单元如何帮助神经网络保持高精度和可靠性。

补充材料

图片

图1

图2

图3

图4

图5

参考文献

[ 1 ] Erikssen G, Liestøl K, Seem E, Birkeland S, Saatvedt KJ, Hoel TN, et al. Achievements in congenital heart defect surgery: a prospective, 40-year study of 7038 patients. Circulation 2015;131(4):337‒46, Discussion 346. 链接1

[ 2 ] Luo H, Qin G, Wang L, Ye Z, Pan Y, Huang L, et al. Outcomes of infant cardiac surgery for congenital heart disease concomitant with persistent pneumonia: a retrospective cohort study. J Cardiothorac Vasc Anesth 2019;33(2):428‒32. 链接1

[ 3 ] Liu S, Wang Y, Yang X, Lei B, Liu L, Li SX, et al. Deep learning in medical ultrasound analysis: a review. Engineering. 2019;5(2):261‒75. 链接1

[ 4 ] Rong G, Mendez A, Bou Assi E, Zhao B, Sawan M. Artificial intelligence in healthcare: review and prediction case studies. Engineering. 2020;6(3):291‒301. 链接1

[ 5 ] Sedghi S, Huang B. Real-time sssessment and diagnosis of process operating performance. Engineering 2017;3(2):214‒9. 链接1

[ 6 ] O’Neill S. Handheld ultrasound advances diagnosis. Engineering 2021;7(11):1505‒7. 链接1

[ 7 ] Cui Z, Yang B, Li RK. Application of biomaterials in cardiac repair and regeneration. Engineering 2016;2(1):141‒8. 链接1

[ 8 ] Li C, Pisignano D, Zhao Y, Xue J. Advances in medical applications of additive manufacturing. Engineering 2020;6(11):1222‒31. 链接1

[ 9 ] Ouyang D, He B, Ghorbani A, Yuan N, Ebinger J, Langlotz CP, et al. Video-based AI for beat-to-beat assessment of cardiac function. Nature 2020;580(7802):252‒6. 链接1

[10] Arnaout R, Curran L, Zhao Y, Levine JC, Chinn E, Moon-Grady AJ. An ensemble of neural networks provides expert-level prenatal detection of complex congenital heart disease. Nat Med 2021;27(5):882‒91. 链接1

[11] Bates S, Angelopoulos A, Lei L, Malik J, Jordan M. Distribution-free, risk-controlling prediction sets. J Assoc Comput Mach 2021;68(6):1‒34. 链接1

[12] Sadinle M, Lei J, Wasserman L. Least ambiguous set-valued classifiers with bounded error levels. J Am Stat Assoc 2019;114(525):223‒34. 链接1

[13] Affenit RN, Barns ER, Furst JD, Rasin A, Raicu DS. Building confidence and credibility into CAD with belief decision trees. In: Proceedings of the Medical Imaging 2017: Computer-Aided Diagnosis; 2017 Mar 3, Orlando, FL, USA. 链接1

[14] Scheffe H, Tukey JW. Non-parametric estimation. I. validation of order statistics. Ann Math Stat 1945;16(2):187‒92. 链接1

[15] McClure P, Kriegeskorte N. Robustly representing uncertainty in deep neural networks through sampling. In: Proceedings of the Second Workshop on Bayesian Deep Learning (NIPS 2017); LongBeach, CA, USA. 链接1

[16] Gal Y, Ghahramani Z. Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: Proceedings of the 33rd International Conference on Machine Learning; 2016 Jun 16‒24; New York, NY, USA. JMLR: W&CP; 2016. p.1050‒9.

[17] Vishnevskiy V, Walheim J, Kozerke S. Deep variational network for rapid 4D flow MRI reconstruction. Nat Mach Intell 2020;2(4):228‒35. 链接1

[18] Piray P, Daw ND. A model for learning based on the joint estimation of stochasticity and volatility. Nat Commun 2021;12(1):6587. 链接1

[19] Lazar A, Lewis C, Fries P, Singer W, Nikolic D. Visual exposure enhances stimulus encoding and persistence in primary cortex. Proc Natl Acad Sci USA 2021;118(43):e2105276118. 链接1

[20] Chariker L, Shapley R, Hawken M, Young LS. A theory of direction selectivity for macaque primary visual cortex. Proc Natl Acad Sci USA 2021;118(32):e2105062118. 链接1

[21] Ferro D, van Kempen J, Boyd M, Panzeri S, Thiele A. Directed information exchange between cortical layers in macaque V1 and V4 and its modulation by selective attention. Proc Natl Acad Sci USA 2021;118(12):e2022097118. 链接1

[22] Gilbert CD, Sigman M. Brain states: top-down influences in sensory processing. Neuron 2007;54(5):677‒96. 链接1

[23] Hupé JM, James AC, Payne BR, Lomber SG, Girard P, Bullier J. Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature 1998;394(6695):784‒7. 链接1

[24] Stollenga MF, Masci J, Gomez F, Schmidhuber J. Deep networks with internal selective attention through feedback connections. In: Proceedings of the 27th International Conference on Neural Information Processing Systems; 2014 Dec 8‒13; Montreal, Canada. Cambridge, MA: MIT Press; 2014. p. 3545‒53. 链接1

[25] Ozawa T, Ycu EA, Kumar A, Yeh LF, Ahmed T, Koivumaa J, et al. A feedback neural circuit for calibrating aversive memory strength. Nat Neurosci 2017;20(1):90‒7. 链接1

[26] Williams MA, Baker CI, Op de Beeck HP, Shim WM, Dang S, Triantafyllou C, et al. Feedback of visual object information to foveal retinotopic cortex. Nat Neurosci 2008;11(12):1439‒45. 链接1

[27] Cao C, Huang Y, Yang Y, Wang L, Wang Z, Tan T. Feedback convolutional neural network for visual localization and segmentation. IEEE Trans Pattern Anal Mach Intell 2019;41(7):1627‒40. 链接1

[28] Cao C, Liu X, Yang Y, Yu Y, Wang J, Wang Z, et al. Look and think twice: capturing top-down visual attention with feedback convolutional neural networks. In: Proceedings of the 2015 IEEE International Conference on Computer Vision; 2015 Dec 7‒13; Santiago, Chile. Washington, DC: IEEE Computer Society; 2015. p. 2956‒64. 链接1

[29] Haris M, Shakhnarovich G, Ukita N. Deep back-projection networks for super-resolution. In: Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2018 Jun 18‒23; Salt Lake City, UT, USA. Washington, DC: IEEE; 2018. p. 1664‒73. 链接1

[30] Gal Y, Islam R, Ghahramani Z. Deep Bayesian active learning with image data. In: Proceedings of the 34th International Conference on Machine Learning; 2017 Aug 6‒11; Sydney, NSW, Australia. JMLR.org; 2017. p. 1183‒92.

[31] Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 2017;542(7639):115‒8. 链接1

[32] Coudray N, Ocampo PS, Sakellaropoulos T, Narula N, Snuderl M, Fenyö D, et al. Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med 2018;24(10):1559‒67. 链接1

[33] Ardila D, Kiraly AP, Bharadwaj S, Choi B, Reicher JJ, Peng L, et al. End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography. Nat Med 2019;25(6):954‒61. 链接1

[34] Arnaout R. Toward a clearer picture of health. Nat Med 2019;25(1):12. 链接1

[35] Howard A, Sandler M, Chen B, Wang W, Chen L, Tan M, et al. Searching for mobileNetV3. In: Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision; 2019 Oct 27‒Nov 2; Seoul, Republic of Korea. Washington, DC: IEEE; 2019. 链接1

[36] He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE Computer Society Conference on Computer Vision and Pattern Recognition; 2016 Jun 27‒30; Las Vegas, NV, USA. Washington, DC: IEEE; 2016. p. 770‒8. 链接1

[37] Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 2017;39(6):1137‒49. 链接1

[38] Lin TY, Dollár P, Girshick R, He K, Hariharan B, Belongie S. Feature pyramid networks for object detection. In: Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition; 2017 Jul 21‒26; Honolulu, HI, USA. Washington, DC: IEEE; 2017. p.: 936‒44. 链接1

[39] Liu Z, Hu J, Weng L, Yang Y. Rotated region based CNN for ship detection. In: Proceedings of the 2017 IEEE International Conference on Image Processing; 2017 Sep 17‒20; Beijing, China. Washington, DC: IEEE; 2017.p. 900‒4. 链接1

[40] Frazer J, Notin P, Dias M, Gomez A, Min JK, Brock K, et al. Disease variant prediction with deep generative models of evolutionary data. Nature 2021;599(7883):91‒5. 链接1

[41] Badrinarayanan V, Kendall A, Cipolla R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 2017;39(12):2481‒95. 链接1

[42] Krygier MC, LaBonte T, Martinez C, Norris C, Sharma K, Collins LN, et al. Quantifying the unknown impact of segmentation uncertainty on image-based simulations. Nat Commun 2021;12(1):5414. 链接1

[43] Lemhadri I, Ruan F, Abraham L, Tibshirani R. LassoNet: neural networks with feature sparsity. J Mach Learn Res 2021;22:1‒29.

[44] Suway SB, Schwartz AB. Activity in primary motor cortex related to visual feedback. Cell Rep 2019;29(12):3872‒84.e4. 链接1

[45] Marques T, Nguyen J, Fioreze G, Petreanu L. The functional organization of cortical feedback inputs to primary visual cortex. Nat Neurosci 2018;21(5):757‒64. 链接1

相关研究