Diagnostic Accuracy of Deep Learning Models for Early Diabetic Retinopathy Detection from Fundus Images: A Systematic Review and Meta-Analysis

Authors

DOI:

https://doi.org/10.66687/JMRIS

Keywords:

artificial intelligence, deep learning, diabetic retinopathy

Abstract

Background: Diabetic retinopathy (DR) remains a major cause of preventable visual loss, while access to trained retinal graders and ophthalmologists is uneven. Deep learning systems can classify color fundus photographs at the point of screening and may enable earlier referral before progression to vision-threatening disease.
Objective
: To synthesize high-quality external and clinical validation evidence for deep learning detection of actionable DR and to estimate pooled sensitivity and specificity.
Methods: A focused systematic review was conducted for peer-reviewed external, prospective, pivotal and post-deployment validations published through December 2025. The quantitative synthesis included eight independent validation cohorts from six Q1-journal reports in which sensitivity, specificity and 95% confidence intervals were available for referable, moderate-or-worse or more-than-mild DR. Sensitivity and specificity were logit transformed and pooled separately using DerSimonian-Laird random-effects models. Heterogeneity was summarized with I2. 
Results: Across the eight cohorts, sensitivity ranged from 87.0% to 95.5% and specificity from 85.0% to 98.5%. Pooled sensitivity was 90.5% (95% CI, 88.8%-91.9%; I2=52.5%), while pooled specificity was 93.9% (95% CI, 90.8%-96.1%; I2=98.2%). Leave-one-out analyses produced pooled sensitivity estimates of 90.1%-90.8% and specificity estimates of 92.7%-94.7%, indicating stable average performance but substantial threshold-related heterogeneity in specificity. Later real-world and post-deployment studies continued to report sensitivities above 90% for sight-threatening or severe DR, although ungradable images, disease threshold, camera type and workflow design materially affected performance.
Conclusion: Deep learning analysis of fundus photographs provides high sensitivity and generally high specificity for identifying actionable DR, supporting its use as a screening and referral technology. The principal implementation challenge is no longer whether these systems can detect disease, but how programs manage operating thresholds, image gradability, population shift and false-positive referral burden.

References

Wong TY, Cheung CMG, Larsen M, Sharma S, Simo R. Diabetic retinopathy. Nat Rev Dis Primers. 2016;2:16012. doi:10.1038/nrdp.2016.12.

Teo ZL, Tham YC, Yu M, Chee ML, Rim TH, Cheung N, et al. Global prevalence of diabetic retinopathy and projection of burden through 2045: systematic review and meta-analysis. Ophthalmology. 2021;128(11):1580-1591. doi:10.1016/j.ophtha.2021.04.027.

Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316(22):2402-2410. doi:10.1001/jama.2016.17216.

Ting DSW, Cheung CYL, Lim G, Tan GSW, Quang ND, Gan A, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA. 2017;318(22):2211-2223. doi:10.1001/jama.2017.18152.

Abràmoff MD, Lavin PT, Birch M, Shah N, Folk JC. Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit Med. 2018;1:39. doi:10.1038/s41746-018-0040-6.

Li Z, Keel S, Liu C, He Y, Meng W, Scheetz J, et al. An automated grading system for detection of vision-threatening referable diabetic retinopathy on the basis of color fundus photographs. Diabetes Care. 2018;41(12):2509-2516. doi:10.2337/dc18-0147.

Bellemo V, Lim ZW, Lim G, Nguyen QD, Xie Y, Yip MYT, et al. Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study. Lancet Digit Health. 2019;1(1):e35-e44. doi:10.1016/S2589-7500(19)30004-4.

Gulshan V, Rajan RP, Widner K, Wu D, Wubbels P, Rhodes T, et al. Performance of a deep-learning algorithm vs manual grading for detecting diabetic retinopathy in India. JAMA Ophthalmol. 2019;137(9):987-993. doi:10.1001/jamaophthalmol.2019.2004.

Ruamviboonsuk P, Krause J, Chotcomwongse P, Sayres R, Raman R, Widner K, et al. Deep learning versus human graders for classifying diabetic retinopathy severity in a nationwide screening program. NPJ Digit Med. 2019;2:25. doi:10.1038/s41746-019-0099-8.

Ipp E, Liljenquist D, Bode B, Shah VN, Silverstein S, Regillo CD, et al. Pivotal evaluation of an artificial intelligence system for autonomous detection of referrable and vision-threatening diabetic retinopathy. JAMA Netw Open. 2021;4(11):e2134254. doi:10.1001/jamanetworkopen.2021.34254.

Heydon P, Egan C, Bolter L, Chambers R, Anderson J, Aldington S, et al. Prospective evaluation of an artificial intelligence-enabled algorithm for automated diabetic retinopathy screening of 30,000 patients. Br J Ophthalmol. 2021;105(5):723-728. doi:10.1136/bjophthalmol-2020-316594.

Wang TW, Luo WT, Tu YK, Chou YB, Wu YT. Systematic review and meta-analysis of regulator-approved deep learning systems for fundus diabetic retinopathy detections. NPJ Digit Med. Published online December 19, 2025. doi:10.1038/s41746-025-02223-8.

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi:10.1136/bmj.n71.

Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529-536. doi:10.7326/0003-4819-155-8-201110180-00009.

Ruamviboonsuk P, et al. Real-time diabetic retinopathy screening by deep learning in a multisite national screening programme: a prospective interventional cohort study. Lancet Digit Health. 2022;4(4):e235-e244.

Brant A, Singh P, Yin X, et al. Performance of a deep learning diabetic retinopathy algorithm in India. JAMA Netw Open. 2025;8(3):e250984. doi:10.1001/jamanetworkopen.2025.0984.

Downloads

Published

2026-08-24

Similar Articles

You may also start an advanced similarity search for this article.