1
|
Grzybowski A, Peeters F, Barão RC, Brona P, Rommes S, Krzywicki T, Stalmans I, Jacob J. Evaluating the efficacy of AI systems in diabetic retinopathy detection: A comparative analysis of Mona DR and IDx-DR. Acta Ophthalmol 2025; 103:388-395. [PMID: 39655810 DOI: 10.1111/aos.17428] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2024] [Accepted: 12/01/2024] [Indexed: 05/14/2025]
Abstract
PURPOSE To compare two artificial intelligence (AI)-based Automated Diabetic Retinopathy Image Assessment (ARIA) softwares in terms of concordance with specialist human graders and referable diabetic retinopathy (DR) diagnostic capacity. METHODS Retrospective comparative study including 750 consecutive diabetes mellitus patients imaged for non-mydriatic fundus photographs. For each patient four images (45 degrees field of view) were captured, centered on the optic disc and macula. Images were manually graded for severity of DR as no DR, any DR (mild non-proliferative diabetic retinopathy [NPDR] or more), referable DR (RDR (more than mild DR)), or sight-threatening DR (severe NPDR or more severe disease and/or clinically significant diabetic macular edema [CSDME]). IDx-DR and MONA DR output was compared with manual grading and with each other. RESULTS Total sample size was 750 patients, of which 55 were excluded due to ungradable images. Out of the remaining 695 patients 522 (75%) were considered as having no DR by manual consensus grading, and 106 (15%) as having RDR. Agreement between raters varied between moderate to substantial. IDx-DR showed moderate agreement with human grading (k = 0.4285) while MONA DR had substantial agreement (k = 0.6797). Out of 106 patients with a ground truth of RDR, IDx-DR identified 105 and MONA DR identified 99. The sensitivity and specificity rates for RDR detection of IDx-DR were 99.1 and 71.5% compared with MONA DR of 93.4 and 89.3% respectively. Of note, both ARIAs had 100% sensitivity for the detection of STDR. CONCLUSION Both ARIAs performed well in this study population, both with sensitivity for RDR screening over 90%, with IDx-DR showing higher sensitivity and MONA DR higher specificity. MONA DR showed superior agreement with human certified graders.
Collapse
Affiliation(s)
- Andrzej Grzybowski
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland
| | - Freya Peeters
- Department of Ophthalmology, University Hospitals UZ Leuven, Leuven, Belgium
- Department of Neurosciences, Research Group of Ophthalmology, Leuven, Belgium
| | - Rafael Correia Barão
- Department of Ophthalmology, Hospital de Santa Maria, ULSSM, Lisbon, Portugal
- Center for Visual Sciences Study, Faculty of Medicine, University of Lisbon, Lisbon, Portugal
| | - Piotr Brona
- Department of Ophthalmology, Poznan City Hospital, Poznan, Poland
| | | | - Tomasz Krzywicki
- Department of Mathematical Methods of Informatics, University of Warmia and Mazury, Olsztyn, Poland
| | - Ingeborg Stalmans
- Department of Ophthalmology, University Hospitals UZ Leuven, Leuven, Belgium
- Department of Neurosciences, Research Group of Ophthalmology, Leuven, Belgium
| | - Julie Jacob
- Department of Ophthalmology, University Hospitals UZ Leuven, Leuven, Belgium
- Department of Neurosciences, Research Group of Ophthalmology, Leuven, Belgium
| |
Collapse
|
2
|
Zhu Z, Wang Y, Qi Z, Hu W, Zhang X, Wagner SK, Wang Y, Ran AR, Ong J, Waisberg E, Masalkhi M, Suh A, Tham YC, Cheung CY, Yang X, Yu H, Ge Z, Wang W, Sheng B, Liu Y, Lee AG, Denniston AK, Wijngaarden PV, Keane PA, Cheng CY, He M, Wong TY. Oculomics: Current concepts and evidence. Prog Retin Eye Res 2025; 106:101350. [PMID: 40049544 DOI: 10.1016/j.preteyeres.2025.101350] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2024] [Revised: 03/03/2025] [Accepted: 03/03/2025] [Indexed: 03/20/2025]
Abstract
The eye provides novel insights into general health, as well as pathogenesis and development of systemic diseases. In the past decade, growing evidence has demonstrated that the eye's structure and function mirror multiple systemic health conditions, especially in cardiovascular diseases, neurodegenerative disorders, and kidney impairments. This has given rise to the field of oculomics-the application of ophthalmic biomarkers to understand mechanisms, detect and predict disease. The development of this field has been accelerated by three major advances: 1) the availability and widespread clinical adoption of high-resolution and non-invasive ophthalmic imaging ("hardware"); 2) the availability of large studies to interrogate associations ("big data"); 3) the development of novel analytical methods, including artificial intelligence (AI) ("software"). Oculomics offers an opportunity to enhance our understanding of the interplay between the eye and the body, while supporting development of innovative diagnostic, prognostic, and therapeutic tools. These advances have been further accelerated by developments in AI, coupled with large-scale linkage datasets linking ocular imaging data with systemic health data. Oculomics also enables the detection, screening, diagnosis, and monitoring of many systemic health conditions. Furthermore, oculomics with AI allows prediction of the risk of systemic diseases, enabling risk stratification, opening up new avenues for prevention or individualized risk prediction and prevention, facilitating personalized medicine. In this review, we summarise current concepts and evidence in the field of oculomics, highlighting the progress that has been made, remaining challenges, and the opportunities for future research.
Collapse
Affiliation(s)
- Zhuoting Zhu
- Centre for Eye Research Australia, Ophthalmology, University of Melbourne, Melbourne, VIC, Australia; Department of Surgery (Ophthalmology), University of Melbourne, Melbourne, VIC, Australia.
| | - Yueye Wang
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, Hong Kong, China
| | - Ziyi Qi
- Centre for Eye Research Australia, Ophthalmology, University of Melbourne, Melbourne, VIC, Australia; Department of Surgery (Ophthalmology), University of Melbourne, Melbourne, VIC, Australia; Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, National Clinical Research Center for Eye Diseases, Shanghai, China
| | - Wenyi Hu
- Centre for Eye Research Australia, Ophthalmology, University of Melbourne, Melbourne, VIC, Australia; Department of Surgery (Ophthalmology), University of Melbourne, Melbourne, VIC, Australia
| | - Xiayin Zhang
- Guangdong Eye Institute, Department of Ophthalmology, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Siegfried K Wagner
- NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, UK; Institute of Ophthalmology, University College London, London, UK
| | - Yujie Wang
- Centre for Eye Research Australia, Ophthalmology, University of Melbourne, Melbourne, VIC, Australia; Department of Surgery (Ophthalmology), University of Melbourne, Melbourne, VIC, Australia
| | - An Ran Ran
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China
| | - Joshua Ong
- Department of Ophthalmology and Visual Sciences, University of Michigan Kellogg Eye Center, Ann Arbor, USA
| | - Ethan Waisberg
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - Mouayad Masalkhi
- University College Dublin School of Medicine, Belfield, Dublin, Ireland
| | - Alex Suh
- Tulane University School of Medicine, New Orleans, LA, USA
| | - Yih Chung Tham
- Department of Ophthalmology and Centre for Innovation and Precision Eye Health, Yong Loo Lin School of Medicine, National University of Singapore, Singapore; Singapore Eye Research Institute, Singapore National Eye Centre, Singapore; Ophthalmology and Visual Sciences Academic Clinical Program, Duke-NUS Medical School, Singapore
| | - Carol Y Cheung
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China
| | - Xiaohong Yang
- Guangdong Eye Institute, Department of Ophthalmology, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Honghua Yu
- Guangdong Eye Institute, Department of Ophthalmology, Guangdong Provincial People's Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China
| | - Zongyuan Ge
- Monash e-Research Center, Faculty of Engineering, Airdoc Research, Nvidia AI Technology Research Center, Monash University, Melbourne, VIC, Australia
| | - Wei Wang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Bin Sheng
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Yun Liu
- Google Research, Mountain View, CA, USA
| | - Andrew G Lee
- Center for Space Medicine and the Department of Ophthalmology, Baylor College of Medicine, Houston, USA; Department of Ophthalmology, Blanton Eye Institute, Houston Methodist Hospital, Houston, USA; The Houston Methodist Research Institute, Houston Methodist Hospital, Houston, USA; Departments of Ophthalmology, Neurology, and Neurosurgery, Weill Cornell Medicine, New York, USA; Department of Ophthalmology, University of Texas Medical Branch, Galveston, USA; University of Texas MD Anderson Cancer Center, Houston, USA; Texas A&M College of Medicine, Bryan, USA; Department of Ophthalmology, The University of Iowa Hospitals and Clinics, Iowa City, USA
| | - Alastair K Denniston
- NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, UK; Institute of Ophthalmology, University College London, London, UK; National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre (BRC), University Hospital Birmingham and University of Birmingham, Birmingham, UK; University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK; Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK; Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK
| | - Peter van Wijngaarden
- Centre for Eye Research Australia, Ophthalmology, University of Melbourne, Melbourne, VIC, Australia; Department of Surgery (Ophthalmology), University of Melbourne, Melbourne, VIC, Australia; Florey Institute of Neuroscience and Mental Health, University of Melbourne, Parkville, VIC, Australia
| | - Pearse A Keane
- NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, UK; Institute of Ophthalmology, University College London, London, UK
| | - Ching-Yu Cheng
- Department of Ophthalmology and Centre for Innovation and Precision Eye Health, Yong Loo Lin School of Medicine, National University of Singapore, Singapore; Singapore Eye Research Institute, Singapore National Eye Centre, Singapore; Ophthalmology and Visual Sciences Academic Clinical Program, Duke-NUS Medical School, Singapore
| | - Mingguang He
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, Hong Kong, China; Research Centre for SHARP Vision (RCSV), The Hong Kong Polytechnic University, Kowloon, Hong Kong, China; Centre for Eye and Vision Research (CEVR), 17W Hong Kong Science Park, Hong Kong, China
| | - Tien Yin Wong
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore; School of Clinical Medicine, Beijing Tsinghua Changgung Hospital, Tsinghua Medicine, Tsinghua University, Beijing, China.
| |
Collapse
|
3
|
Khan Z, Gaidhane AM, Singh M, Ganesan S, Kaur M, Sharma GC, Rani P, Sharma R, Thapliyal S, Kushwaha M, Kumar H, Agarwal RK, Shabil M, Verma L, Sidhu A, Manan NBA, Bushi G, Mehta R, Sah S, Satapathy P, Samal SK. Diagnostic Accuracy of IDX-DR for Detecting Diabetic Retinopathy: A Systematic Review and Meta-Analysis. Am J Ophthalmol 2025; 273:192-204. [PMID: 39986640 DOI: 10.1016/j.ajo.2025.02.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2024] [Revised: 02/10/2025] [Accepted: 02/17/2025] [Indexed: 02/24/2025]
Abstract
PURPOSE Diabetic retinopathy (DR) is a leading cause of vision loss worldwide, making early detection critical to prevent blindness. IDX-DR, an FDA-approved autonomous artificial intelligence (AI) system, has emerged as an innovative solution to improve access to DR screening. This systematic review and meta-analysis aimed to evaluate the diagnostic accuracy of IDX-DR in detecting diabetic retinopathy. DESIGN Systematic review and meta-analysis. METHODS A comprehensive literature search was conducted across PubMed, Embase, Scopus and Web of Science, identifying studies published through October 5, 2024. Studies involving adult patients with Type 1 or Type 2 diabetes and reporting diagnostic metrics such as sensitivity and specificity were included. The primary outcomes were pooled sensitivity and specificity of IDX-DR. A bivariate random-effects model was used for meta-analysis, and summary receiver operating characteristic (SROC) curves were generated to assess diagnostic performance. Statistical analyses were performed using MetaDisc software version 2.0. RESULTS Thirteen studies involving 13,233 participants met the inclusion criteria. IDX-DR's pooled sensitivity was 0.95 (95% CI: 0.82-0.99), and its pooled specificity was 0.91 (95% CI: 0.84-0.95). The SROC curve confirmed IDX-DR's high diagnostic accuracy in detecting diabetic retinopathy across various clinical environments. The AUC value of 0.95 demonstrated high sensitivity and specificity, indicating a robust diagnostic performance for IDX-DR in detecting diabetic retinopathy. CONCLUSION IDX-DR is a highly effective diagnostic tool for diabetic retinopathy screening, with robust sensitivity and good specificity. Its integration into clinical practice, especially in resource-limited settings, can potentially improve early detection and reduce vision loss. However, careful implementation is needed to address challenges such as over-diagnosis and ensure the tool complements clinical judgment. Future studies should explore the long-term impacts of AI-based screening and address ethical considerations surrounding its use.
Collapse
Affiliation(s)
- Zaid Khan
- Evidence for Policy and Learning, Global Center for Evidence Synthesis (Z.K.), Chandigarh, Punjab, India
| | - Abhay M Gaidhane
- Jawaharlal Nehru Medical College, and Global Health Academy (A.M.G), School of Epidemiology and Public Health, Datta Meghe Institute of Higher Education, Wardha, Maharashtra, India
| | - Mahendra Singh
- Center for Global Health Research (M.S.), Saveetha Medical College and Hospital, Saveetha Institute of Medical and Technical Sciences, Saveetha University, Chennai, Tamil Nadu, India
| | - Subbulakshmi Ganesan
- Department of Chemistry and Biochemistry (S.G.), School of Sciences, JAIN (Deemed to be University), Bangalore, Karnataka, India
| | - Mandeep Kaur
- Department of Allied Healthcare and Sciences (M.K.), Vivekananda Global University, Jaipur, Rajasthan, India
| | | | - Pooja Rani
- Chandigarh Pharmacy College (P.R.), Chandigarh Group of College, Mohali, Punjab, India
| | - Rsk Sharma
- Department of Chemistry (R.S.), Raghu Engineering College, Visakhapatnam, Andhra Pradesh, India
| | - Shailendra Thapliyal
- Uttaranchal Institute of Technology (S.T.), Uttaranchal University, Uttarakhand, India
| | - Monam Kushwaha
- IES Institute of Pharmacy (M.K.), IES University, Bhopal, Madhya Pradesh, India
| | - Harish Kumar
- New Delhi Institute of Management (H.K.), Tughlakabad Institutional Area, New Delhi, India
| | - Rajat Kumar Agarwal
- Department of Microbiology (R.K.A.), Graphic Era (Deemed to be University), Dehradun, Uttarakhand, India
| | - Muhammed Shabil
- Noida Institute of Engineering and Technology (Pharmacy Institute) (M.S.), Greater Noida, Uttar Pradesh, India
| | - Lokesh Verma
- Centre of Research Impact and Outcome (L.V.), Chitkara University, Rajpura, Punjab, India
| | - Amritpal Sidhu
- Chitkara Centre for Research and Development (A.S.), Chitkara University, Himachal Pradesh, India
| | - Norhafizah Binti Ab Manan
- University of Cyberjaya, Persiaran Bestari (N.B.A.M.), Cyber 11, Cyberjaya, Selangor Darul Ehsan, Malaysia
| | - Ganesh Bushi
- School of Pharmaceutical Sciences (G.B.), Lovely Professional University, Phagwara, Punjab, India
| | - Rachana Mehta
- Clinical Microbiology (R.M.), RDC, Manav Rachna International Institute of Research and Studies, Faridabad, Haryana, India
| | - Sanjit Sah
- Department of Paediatrics (S.S.), Dr. D. Y. Patil Medical College, Hospital and Research Centre, Dr. D. Y. Patil Vidyapeeth, Pune, Maharashtra, India; Department of Public Health Dentistry (S.S.), Dr. D.Y. Patil Dental College and Hospital, Dr. D.Y. Patil Vidyapeeth, Pune, Maharashtra, India
| | - Prakasini Satapathy
- University Center for Research and Development (P.S.), Chandigarh University, Mohali, Punjab, India; Medical Laboratories Techniques Department (P.S.), AL-Mustaqbal University, Hillah, Babil, Iraq
| | - Shailesh Kumar Samal
- Evidence for Policy and Learning, Global Center for Evidence Synthesis (Z.K.), Chandigarh, Punjab, India; Unit of Immunology and Chronic Disease (S.K.S.), Institute of Environmental Medicine, Karolinska Institutet, Stockholm, Sweden.
| |
Collapse
|
4
|
Casazza M, Bolz M, Huemer J. Telemedicine in ophthalmology. Wien Med Wochenschr 2025; 175:153-161. [PMID: 40227513 DOI: 10.1007/s10354-025-01081-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Accepted: 02/20/2025] [Indexed: 04/15/2025]
Abstract
Since its beginnings in the 1970s, telemedicine has advanced extensively. Telemedicine is now more accessible and powerful than ever thanks to developments in medical imaging, Internet accessibility, advancements in telecommunications infrastructure, exponential growth in computing power, and related computer-aided diagnoses. This is especially true in the field of ophthalmology. With the COVID 19 pandemic serving as a catalyst for the widespread adoption and acceptance of teleophthalmology, new models of healthcare provision integrating telemedicine are needed to meet the challenges of the modern world. The demand for ophthalmic services is growing globally due to population growth, aging, and a shortage of ophthalmologists. In this review, we discuss the development and use of telemedicine in the field of ophthalmology and shed light on the benefits and drawbacks of teleophthalmology.
Collapse
Affiliation(s)
- Marina Casazza
- Department of Ophthalmology and Optometry, Kepler University Hospital, Johannes Kepler University, Linz, Austria
| | - Matthias Bolz
- Department of Ophthalmology and Optometry, Kepler University Hospital, Johannes Kepler University, Linz, Austria
| | - Josef Huemer
- Department of Ophthalmology and Optometry, Kepler University Hospital, Johannes Kepler University, Linz, Austria.
- Moorfields Eye Hospital NHS Foundation Trust, London, UK.
| |
Collapse
|
5
|
Deutsche Ophthalmologische Gesellschaft (DOG), Berufsverband der Augenärzte Deutschlands e. V. (BVA). [Ethical Aspects of the Development, Authorization, and Implementation of Applications in Ophthalmology Based on Artificial Intelligence - Statement of the German Ophthalmological Society (DOG) and the Professional Association of German Ophthalmologists (BVA), Developed by DOG-AG Ethics in Ophthalmology]. Klin Monbl Augenheilkd 2025; 242:605-613. [PMID: 40398425 DOI: 10.1055/a-2542-5742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/23/2025]
|
6
|
Deutsche Ophthalmologische Gesellschaft (DOG), Bechrakis NE, Bertram B, Bültmann S, Faber H, Gass P, Geerling G, Gronow T, Guthoff R, Heinz P, Hoerauf H, Lang S, Lemmen KD, Pleger D, Richter C, Schuster AK, Siebelmann S, Tost F, Wintergerst M, Berufsverband der Augenärzte Deutschlands e. V. (BVA). [Ethical aspects of the development, authorization and implementation of applications in ophthalmology based on artificial intelligence : Statement of the German Ophthalmological Society (DOG) and the Professional Association of German Ophthalmologists (BVA), developed by DOG-AG Ethics in Ophthalmology]. DIE OPHTHALMOLOGIE 2025; 122:365-373. [PMID: 39964395 DOI: 10.1007/s00347-025-02189-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 01/16/2025] [Indexed: 05/08/2025]
|
7
|
Irodi A, Zhu Z, Grzybowski A, Wu Y, Cheung CY, Li H, Tan G, Wong TY. The evolution of diabetic retinopathy screening. Eye (Lond) 2025; 39:1040-1046. [PMID: 39910282 PMCID: PMC11978858 DOI: 10.1038/s41433-025-03633-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2024] [Revised: 01/06/2025] [Accepted: 01/22/2025] [Indexed: 02/07/2025] Open
Abstract
Diabetic retinopathy (DR) is a leading cause of preventable blindness and has emerged as a global health challenge, necessitating the development of robust management strategies. As DR prevalence continues to rise, advancements in screening methods have become increasingly critical for timely detection and intervention. This review examines three key advancements in DR screening: a shift from specialist to generalist approach, the adoption of telemedicine strategies for expanded access and enhanced efficiency, and the integration of artificial intelligence (AI). In particular, AI offers unprecedented benefits in the form of sustainability and scalability for not only DR screening but other aspects of eye health and the medical field as a whole. Though there remain barriers to address, AI holds vast potential for reshaping DR screening and significantly improving patient outcomes globally.
Collapse
Affiliation(s)
- Anushka Irodi
- School of Clinical Medicine, University of Cambridge, Cambridge, United Kingdom
| | - Zhuoting Zhu
- Centre for Eye Research Australia, Ophthalmology, University of Melbourne, Melbourne, Australia
- Department of Surgery (Ophthalmology), The University of Melbourne, Melbourne, Australia
| | - Andrzej Grzybowski
- Department of Ophthalmology, University of Warmia and Mazury, Olsztyn, Poland
- Institute for Research in Ophthalmology, Foundation for Ophthalmology Development, Poznan, Poland
| | - Yilan Wu
- Tsinghua Medicine, Tsinghua University, Beijing, China
| | - Carol Y Cheung
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China
| | - Huating Li
- Department of Endocrinology and Metabolism, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai Diabetes Institute, Shanghai Clinical Centre for Diabetes, Shanghai International Joint Laboratory of Intelligent Prevention and Treatment for Metabolic Diseases, Shanghai, China
| | - Gavin Tan
- Singapore Eye Research Institute, Singapore National Eye Center, Singapore, Singapore
- Duke-NUS Medical School, National University of Singapore, Singapore, Singapore
| | - Tien Yin Wong
- Tsinghua Medicine, Tsinghua University, Beijing, China.
- Singapore Eye Research Institute, Singapore National Eye Center, Singapore, Singapore.
- Beijing Visual Science and Translational Eye Research Institute (BERI), School of Clinical Medicine, Beijing Tsinghua Changgung Hospital, Tsinghua Medicine, Tsinghua University, Beijing, China.
| |
Collapse
|
8
|
Zureik A, Couturier A, Delcourt C. Evolution of ophthalmological care in adult with diabetes in France between 2010 and 2022: a nationwide study. Graefes Arch Clin Exp Ophthalmol 2025:10.1007/s00417-025-06793-x. [PMID: 40097633 DOI: 10.1007/s00417-025-06793-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2024] [Revised: 02/03/2025] [Accepted: 03/05/2025] [Indexed: 03/19/2025] Open
Abstract
PURPOSE The aim of this study is to describe ophthalmological care of adults with diabetes in France and its evolution between 2010 and 2022. METHODS In this study, we used the ESND, a representative permanent random sample of 2/100th of the entire French population. Ophthalmological care was defined by the combination of ophthalmological procedures (fundus examination, color fundus photography, Optical Coherence Tomography..) and/or ophthalmological treatment (intravitreal injection or laser treatment) during the year. Changes in annual rates during the study period were assessed using linear regression models excluding 2020. RESULTS From 2010 to 2022, the number of adults treated for diabetes in the ENSD increased from 48 329 patients (mean age 65.3 ± 13.0, 46.3% women) to 68 397 patients (mean age 67.0 ± 13.2, 44.8% women). Among them, the annual rate of ophthalmological care was stable (46.5% in 2010 and 48.5% in 2022) and the difference was not significant (β = 0.10% per year, p = 0.11). The yearly ophthalmological treatment rate increased significantly (3.3% in 2010 and 5.3% in 2022, β = 0.2% per year, p < 0.0001). Rates were lower during the COVID-19 outbreak in 2020.Women, individuals aged between 66-80 years, those living in the least deprived areas and those treated with combined insulin and non-insulin treatment had higher yearly ophthalmological care rate. CONCLUSION In this large nationwide representative study with recent and updated data, although ophthalmological treatment rate has increased over the decade mainly due to intravitreal injections, less than half of the diabetic patients receive yearly ophthalmological care.
Collapse
Affiliation(s)
- Abir Zureik
- Ophthalmology Department, AP-HP, Hôpital Lariboisière, Université Paris Cité, 2 Rue Ambroise Paré, 75010, Paris, France.
- University Bordeaux, INSERM, BPH, U1219, F-33000, Bordeaux, France.
| | - Aude Couturier
- Ophthalmology Department, AP-HP, Hôpital Lariboisière, Université Paris Cité, 2 Rue Ambroise Paré, 75010, Paris, France
- Retina Department, Foundation Adolphe de Rothschild Hospital, 25-29 Rue Manin, 75019, Paris, France
| | - Cécile Delcourt
- University Bordeaux, INSERM, BPH, U1219, F-33000, Bordeaux, France
| |
Collapse
|
9
|
Krogh M, Hentze M, Jensen MSA, Jensen MB, Nielsen MG, Vorum H, Kolding Kristensen J. Valuable insights into general practice staff's experiences and perspectives on AI-assisted diabetic retinopathy screening-An interview study. Front Med (Lausanne) 2025; 12:1565532. [PMID: 40134918 PMCID: PMC11933039 DOI: 10.3389/fmed.2025.1565532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2025] [Accepted: 02/18/2025] [Indexed: 03/27/2025] Open
Abstract
Aim This study explores the hands-on experiences and perspectives of general practice staff regarding the feasibility of conducting artificial intelligence-assisted (AI-assisted) diabetic retinopathy screenings (DRS) in general practice settings. Method The screenings were tested in 12 general practices in the North Denmark Region and were conducted as part of daily care routines over ~4 weeks. Subsequently, 21 staff members involved in the DRS were interviewed. Results Thematic analysis generated four main themes: (1) Experiences with DRS in daily practice, (2) Effective DRS implementation in general practice in the future, (3) Trust and approval of AI-assisted DRS in general practice, and (4) Implications of DRS in general practice. The findings suggest that general practice staff recognise the potential for AI-assisted DRS to be integrated into their clinical workflows. However, they also emphasise the importance of addressing both practical and systemic factors to ensure successful implementation of DRS within the general practice setting. Conclusion Focusing on the practical experiences and perspectives of general practice staff, this study lays the groundwork for future research aimed at optimising the implementation of AI-assisted DRS in general practice settings, while recognising that the insights gained may also inform broader primary care contexts.
Collapse
Affiliation(s)
- Malene Krogh
- Center for General Practice at Aalborg University, Aalborg, Denmark
| | - Malene Hentze
- Department of Otorhinolaryngology, Head and Neck and Audiology, Aalborg University Hospital, Aalborg, Denmark
| | | | | | - Marie Germund Nielsen
- The Clinical Nursing Research Unit, Aalborg University Hospital, Aalborg, Denmark
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Henrik Vorum
- Department of Ophthalmology, Aalborg University Hospital, Aalborg, Denmark
| | | |
Collapse
|
10
|
Krogh M, Jensen MB, Sig Ager Jensen M, Hentze Hansen M, Germund Nielsen M, Vorum H, Kristensen JK. Exploring general practice staff perspectives on a teaching concept based on instruction videos for diabetic retinopathy screening - an interview study. Scand J Prim Health Care 2025; 43:75-84. [PMID: 39225788 PMCID: PMC11834787 DOI: 10.1080/02813432.2024.2396873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 08/20/2024] [Indexed: 09/04/2024] Open
Abstract
OBJECTIVE The aim of this study is to explore general practice staff perspectives regarding a teaching concept based on instructional videos for conducting DR screenings. Furthermore, this study aims to investigate the competencies acquired by the staff through this teaching concept. DESIGN AND SETTING Qualitative cross-sectional study conducted in general practice clinics in the North Denmark Region. METHOD A teaching concept was developed based on instruction videos to teach general practice staff to conduct diabetic retinopathy screenings with automated grading through artificial intelligence. Semi-structured interviews were performed with 16 staff members to investigate their perspectives on the concept and acquired competencies. RESULTS This study found no substantial resistance to the teaching concept from staff; however, participants' satisfaction with the methods employed in the instruction session, the progression of learning curves, screening competencies, and their acceptance of a known knowledge gap during screenings varied slightly among the participants. CONCLUSION This study showed that the teaching concept can be used to teach general practice staff to conduct diabetic retinopathy screenings. Staffs' perspectives on the teaching concept and acquired competencies varied, and this study suggest few adjustments to the concept to accommodate staff's preferences and establish more consistent competencies.
Collapse
Affiliation(s)
- Malene Krogh
- Center for General Practice, Aalborg University, Aalborg, Denmark
| | | | | | - Malene Hentze Hansen
- Department of Otorhinolaryngology, Head and Neck Surgery, Aalborg University Hospital, Aalborg, Denmark
| | - Marie Germund Nielsen
- The Clinical Nursing Research Unit, Aalborg University Hospital, Aalborg, Denmark
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Henrik Vorum
- Department of Ophthalmology, Aalborg University Hospital, Aalborg, Denmark
| | | |
Collapse
|
11
|
Maehara H, Ueno Y, Yamaguchi T, Kitaguchi Y, Miyazaki D, Nejima R, Inomata T, Kato N, Chikama TI, Ominato J, Yunoki T, Tsubota K, Oda M, Suzutani M, Sekiryu T, Oshika T. Artificial intelligence support improves diagnosis accuracy in anterior segment eye diseases. Sci Rep 2025; 15:5117. [PMID: 39934383 PMCID: PMC11814138 DOI: 10.1038/s41598-025-89768-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2024] [Accepted: 02/07/2025] [Indexed: 02/13/2025] Open
Abstract
CorneAI, a deep learning model designed for diagnosing cataracts and corneal diseases, was assessed for its impact on ophthalmologists' diagnostic accuracy. In the study, 40 ophthalmologists (20 specialists and 20 residents) classified 100 images, including iPhone 13 Pro photos (50 images) and diffuser slit-lamp photos (50 images), into nine categories (normal condition, infectious keratitis, immunological keratitis, corneal scar, corneal deposit, bullous keratopathy, ocular surface tumor, cataract/intraocular lens opacity, and primary angle-closure glaucoma). The iPhone and slit-lamp images represented the same cases. After initially answering without CorneAI, the same ophthalmologists responded to the same cases with CorneAI 2-4 weeks later. With CorneAI's support, the overall accuracy of ophthalmologists increased significantly from 79.2 to 88.8% (P < 0.001). Specialists' accuracy rose from 82.8 to 90.0%, and residents' from 75.6 to 86.2% (P < 0.001). Smartphone image accuracy improved from 78.7 to 85.5% and slit-lamp image accuracy from 81.2 to 90.6% (both, P < 0.001). In this study, CorneAI's own accuracy was 86%, but its support enhanced ophthalmologists' accuracy beyond the CorneAI's baseline. This study demonstrated that CorneAI, despite being trained on diffuser slit-lamp images, effectively improved diagnostic accuracy, even with smartphone images.
Collapse
Affiliation(s)
- Hiroki Maehara
- Department of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Yuta Ueno
- Departement of Ophthalmology, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba, Ibaraki, 305-8576, Japan.
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan.
| | - Takefumi Yamaguchi
- Department of Ophthalmology, Tokyo Dental College Ichikawa General Hospital, Chiba, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Yoshiyuki Kitaguchi
- Department of Ophthalmology, Osaka University Graduate School of Medicine, Osaka, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Dai Miyazaki
- Division of Ophthalmology and Visual Science, Faculty of Medicine, Tottori University, Tottori, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Ryohei Nejima
- Department of Ophthalmology, Miyata Eye Hospital, Miyazaki, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Takenori Inomata
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Naoko Kato
- Department of Ophthalmology, Tsukazaki Hospital, Hyogo, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Tai-Ichiro Chikama
- Division of Ophthalmology and Visual Science, Graduate School of Biomedical and Health Sciences, Hiroshima University, Hiroshima, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Jun Ominato
- Division of Ophthalmology and Visual Science, Graduate School of Medical and Dental Sciences, Niigata University, Niigata, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Tatsuya Yunoki
- Department of Ophthalmology, University of Toyama, Toyama, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Kinya Tsubota
- Department of Ophthalmology, Tokyo Medical University, Tokyo, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Masahiro Oda
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Manabu Suzutani
- Department of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan
| | - Tetsuju Sekiryu
- Department of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan
| | - Tetsuro Oshika
- Departement of Ophthalmology, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba, Ibaraki, 305-8576, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| |
Collapse
|
12
|
Maehara H, Ueno Y, Yamaguchi T, Kitaguchi Y, Miyazaki D, Nejima R, Inomata T, Kato N, Chikama TI, Ominato J, Yunoki T, Tsubota K, Oda M, Suzutani M, Sekiryu T, Oshika T. The importance of clinical experience in AI-assisted corneal diagnosis: verification using intentional AI misleading. Sci Rep 2025; 15:1462. [PMID: 39789113 PMCID: PMC11717947 DOI: 10.1038/s41598-025-85827-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Accepted: 01/06/2025] [Indexed: 01/12/2025] Open
Abstract
We developed an AI system capable of automatically classifying anterior eye images as either normal or indicative of corneal diseases. This study aims to investigate the influence of AI's misleading guidance on ophthalmologists' responses. This cross-sectional study included 30 cases each of infectious and immunological keratitis. Responses regarding the presence of infection were collected from 7 corneal specialists and 16 non-corneal-specialist ophthalmologists, first based on the images alone and then after presenting the AI's classification results. The AI's diagnoses were deliberately altered to present a correct classification in 70% of the cases and incorrect in 30%. The overall accuracy of the ophthalmologists did not significantly change after AI assistance was introduced [75.2 ± 8.1%, 75.9 ± 7.2%, respectively (P = 0.59)]. In cases where the AI presented incorrect diagnoses, the accuracy of corneal specialists before and after AI assistance was showing no significant change [60.3 ± 35.2% and 53.2 ± 30.9%, respectively (P = 0.11)]. In contrast, the accuracy for non-corneal specialists dropped significantly from 54.5 ± 27.8% to 31.6 ± 29.3% (P < 0.001), especially in cases where the AI presented incorrect options. Less experienced ophthalmologists were misled due to incorrect AI guidance, but corneal specialists were not. Even with the introduction of AI diagnostic support systems, the importance of ophthalmologist's experience remains crucial.
Collapse
Affiliation(s)
- Hiroki Maehara
- Department of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Yuta Ueno
- Department of Ophthalmology, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba, Ibaraki, Japan.
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan.
| | - Takefumi Yamaguchi
- Department of Ophthalmology, Tokyo Dental College Ichikawa General Hospital, Chiba, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Yoshiyuki Kitaguchi
- Department of Ophthalmology, Osaka University Graduate School of Medicine, Osaka, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Dai Miyazaki
- Division of Ophthalmology and Visual Science, Faculty of Medicine, Tottori University, Tottori, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Ryohei Nejima
- Department of Ophthalmology, Miyata Eye Hospital, Miyazaki, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Takenori Inomata
- Department of Ophthalmology, Juntendo University Graduate School of Medicine, Tokyo, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Naoko Kato
- Department of Ophthalmology, Tsukazaki Hospital, Hyogo, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Tai-Ichiro Chikama
- Division of Ophthalmology and Visual Science, Graduate School of Biomedical and Health Sciences, Hiroshima University, Hiroshima, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Jun Ominato
- Division of Ophthalmology and Visual Science, Graduate School of Medical and Dental Sciences, Niigata University, Niigata, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Tatsuya Yunoki
- Department of Ophthalmology, University of Toyama, Toyama, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Kinya Tsubota
- Department of Ophthalmology, Tokyo Medical University, Tokyo, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Masahiro Oda
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| | - Manabu Suzutani
- Department of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan
| | - Tetsuju Sekiryu
- Department of Ophthalmology, Fukushima Medical University School of Medicine, Fukushima, Japan
| | - Tetsuro Oshika
- Department of Ophthalmology, Faculty of Medicine, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba, Ibaraki, Japan
- Japan Anterior Segment Artificial Intelligence Research Group, Tsukuba, Japan
| |
Collapse
|
13
|
Wang VY, Lo MT, Chen TC, Huang CH, Huang A, Wang PC. A deep learning-based ADRPPA algorithm for the prediction of diabetic retinopathy progression. Sci Rep 2024; 14:31772. [PMID: 39738461 PMCID: PMC11686301 DOI: 10.1038/s41598-024-82884-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2024] [Accepted: 12/10/2024] [Indexed: 01/02/2025] Open
Abstract
As an alternative to assessments performed by human experts, artificial intelligence (AI) is currently being used for screening fundus images and monitoring diabetic retinopathy (DR). Although AI models can provide quasi-clinician diagnoses, they rarely offer new insights to assist clinicians in predicting disease prognosis and treatment response. Using longitudinal retinal imaging data, we developed and validated a predictive model for DR progression: AI-driven Diabetic Retinopathy Progression Prediction Algorithm (ADRPPA). In this retrospective study, we analyzed paired retinal fundus images of the same eye captured at ≥ 1-year intervals. The analysis was performed using the EyePACS dataset. By analyzing 12,768 images from 6384 eyes (2 images/eye, taken 733 ± 353 days apart), each annotated with DR severity grades, we trained the neural network ResNeXt to automatically determine DR severity. EyePACS data corresponding to 5108 (80%), 639 (10%), and 637 (10%) eyes were used for model training, validation, and testing, respectively. We further used an independent e-ophtha dataset comprising 148 images annotated with microaneurysms, 118 (75%) and 30 (25%) of which were used for training and validation, respectively. This dataset was used to train the neural network Mask Region-based Convolutional Neural Network (Mask-RCNN) for quantifying microaneurysms. The DR and microaneurysm scores from the first nonreferable DR (NRDR) image of each eye were used to predict progression to referable DR (RDR) in the second image. The area under the receiver operating characteristic curve values indicating our model's performance in diagnosing RDR were 0.963, 0.970, 0.968, and 0.971 for the trained ResNeXt models with input image resolutions of 256 × 256, 512 × 512, 768 × 768, and 1024 × 1024 pixels, respectively. In the validation of the Mask-RCNN model trained on the e-ophtha dataset resized to 1600 pixels in height, the recall, precision, and F1-score values for detecting individual microaneurysms were 0.786, 0.615, and 0.690, respectively. The best model combination for predicting NRDR-to-RDR progression included the 768-pixel ResNeXt and 1600-pixel Mask-RCNN models; this combination achieved recall, precision, and F1-scores of 0.338 (95% confidence interval [CI]: 0.228-0.451), 0.561 (95% CI: 0.405-0.714), and 0.422 (95% CI: 0.299-0.532), respectively. Thus, deep learning models can be trained on longitudinal retinal imaging data to predict NRDR-to-RDR progression. Furthermore, DR and microaneurysm scores generated from low- and high-resolution fundus images, respectively, can help identify patients at a high risk of NRDR, facilitating timely treatment.
Collapse
Affiliation(s)
- Victoria Y Wang
- Department of Ophthalmology, Keck School of Medicine, USC Roski Eye Institute, University of Southern California, Los Angeles, CA, USA
| | - Men-Tzung Lo
- Department of Biomedical Sciences and Engineering, National Central University, Research Center Building 3, Room 404, 300 Zhongda Rd, Zhong-Li, Taoyuan, Taiwan
| | - Ta-Ching Chen
- Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan
- Center of Frontier Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Chu-Hsuan Huang
- Department of Ophthalmology, Cathay General Hospital, Taipei, Taiwan
| | - Adam Huang
- Department of Biomedical Sciences and Engineering, National Central University, Research Center Building 3, Room 404, 300 Zhongda Rd, Zhong-Li, Taoyuan, Taiwan.
| | - Pa-Chun Wang
- Department of Medical Research, Cathay General Hospital, 280 Jen-Ai Rd. Sec.4 106, Taipei, Taiwan.
- Fu-Jen Catholic University School of Medicine, New Taipei City, Taiwan.
- Department of Medical Research, China Medical University Hospital, Taichung, Taiwan.
| |
Collapse
|
14
|
Kubin AM, Huhtinen P, Ohtonen P, Keskitalo A, Wirkkala J, Hautala N. Comparison of 21 artificial intelligence algorithms in automated diabetic retinopathy screening using handheld fundus camera. Ann Med 2024; 56:2352018. [PMID: 38738798 PMCID: PMC11095279 DOI: 10.1080/07853890.2024.2352018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Accepted: 04/21/2024] [Indexed: 05/14/2024] Open
Abstract
BACKGROUND Diabetic retinopathy (DR) is a common complication of diabetes and may lead to irreversible visual loss. Efficient screening and improved treatment of both diabetes and DR have amended visual prognosis for DR. The number of patients with diabetes is increasing and telemedicine, mobile handheld devices and automated solutions may alleviate the burden for healthcare. We compared the performance of 21 artificial intelligence (AI) algorithms for referable DR screening in datasets taken by handheld Optomed Aurora fundus camera in a real-world setting. PATIENTS AND METHODS Prospective study of 156 patients (312 eyes) attending DR screening and follow-up. Both papilla- and macula-centred 50° fundus images were taken from each eye. DR was graded by experienced ophthalmologists and 21 AI algorithms. RESULTS Most eyes, 183 out of 312 (58.7%), had no DR and mild NPDR was noted in 21 (6.7%) of the eyes. Moderate NPDR was detected in 66 (21.2%) of the eyes, severe NPDR in 1 (0.3%), and PDR in 41 (13.1%) composing a group of 34.6% of eyes with referable DR. The AI algorithms achieved a mean agreement of 79.4% for referable DR, but the results varied from 49.4% to 92.3%. The mean sensitivity for referable DR was 77.5% (95% CI 69.1-85.8) and specificity 80.6% (95% CI 72.1-89.2). The rate for images ungradable by AI varied from 0% to 28.2% (mean 1.9%). Nineteen out of 21 (90.5%) AI algorithms resulted in grading for DR at least in 98% of the images. CONCLUSIONS Fundus images captured with Optomed Aurora were suitable for DR screening. The performance of the AI algorithms varied considerably emphasizing the need for external validation of screening algorithms in real-world settings before their clinical application.
Collapse
Affiliation(s)
- Anna-Maria Kubin
- Department of Ophthalmology, Oulu University Hospital, Oulu, Finland
- Research Unit of Clinical Medicine, Oulu, Finland
- Medical Research Center, University of Oulu, Oulu, Finland
| | | | - Pasi Ohtonen
- Research Service Unit, Oulu, Finland
- The Research Unit of Surgery, Anesthesia and Intensive Care, Oulu University Hospital and University of Oulu, Oulu, Finland
| | - Antti Keskitalo
- Department of Ophthalmology, Oulu University Hospital, Oulu, Finland
| | - Joonas Wirkkala
- Department of Ophthalmology, Oulu University Hospital, Oulu, Finland
- Research Unit of Clinical Medicine, Oulu, Finland
- Medical Research Center, University of Oulu, Oulu, Finland
| | - Nina Hautala
- Department of Ophthalmology, Oulu University Hospital, Oulu, Finland
- Research Unit of Clinical Medicine, Oulu, Finland
- Medical Research Center, University of Oulu, Oulu, Finland
| |
Collapse
|
15
|
Larsen TJ, Pettersen MB, Nygaard Jensen H, Lynge Pedersen M, Lund-Andersen H, Jørgensen ME, Byberg S. The use of artificial intelligence to assess diabetic eye disease among the Greenlandic population. Int J Circumpolar Health 2024; 83:2314802. [PMID: 38359160 PMCID: PMC10877649 DOI: 10.1080/22423982.2024.2314802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 01/23/2024] [Accepted: 02/01/2024] [Indexed: 02/17/2024] Open
Abstract
Background: Retina fundus images conducted in Greenland are telemedically assessed for diabetic retinopathy by ophthalmological nurses in Denmark. Applying an AI grading solution, in a Greenlandic setting, could potentially improve the efficiency and cost-effectiveness of DR screening.Method: We developed an AI model using retina fundus photos, performed on persons registered with diabetes in Greenland and Denmark, using Optos® ultra wide-field scanning laser ophthalmoscope, graded according to ICDR.Using the ResNet50 network we compared the model's ability to distinguish between different images of ICDR severity levels in a confusion matrix.Results: Comparing images with ICDR level 0 to images of ICDR level 4 resulted in an accuracy of 0.9655, AUC of 0.9905, sensitivity and specificity of 96.6%.Comparing ICDR levels 0,1,2 with ICDR levels 3,4, we achieved a performance with an accuracy of 0.8077, an AUC of 0.8728, a sensitivity of 84.6% and a specificity of 78.8%. For the other comparisons, we achieved a modest performance.Conclusion: We developed an AI model using Greenlandic data, to automatically detect DR on Optos retina fundus images. The sensitivity and specificity were too low for our model to be applied directly in a clinical setting, thus optimising the model should be prioritised.
Collapse
Affiliation(s)
- Trine Jul Larsen
- Greenland Center of Health Research, Institute of Nursing and Health Science, University of Greenland, Nuuk, Greenland
| | | | | | - Michael Lynge Pedersen
- Greenland Center of Health Research, Institute of Nursing and Health Science, University of Greenland, Nuuk, Greenland
- Rigshospitalet-Glostrup University Hospital, Glostrup, Denmark
| | - Henrik Lund-Andersen
- Clinical Epidemiology, Steno Diabetes Center Copenhagen, Copenhagen, Denmark
- Rigshospitalet-Glostrup University Hospital, Glostrup, Denmark
| | | | - Stine Byberg
- Clinical Epidemiology, Steno Diabetes Center Copenhagen, Copenhagen, Denmark
| |
Collapse
|
16
|
Botha NN, Segbedzi CE, Dumahasi VK, Maneen S, Kodom RV, Tsedze IS, Akoto LA, Atsu FS, Lasim OU, Ansah EW. Artificial intelligence in healthcare: a scoping review of perceived threats to patient rights and safety. Arch Public Health 2024; 82:188. [PMID: 39444019 PMCID: PMC11515716 DOI: 10.1186/s13690-024-01414-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 10/01/2024] [Indexed: 10/25/2024] Open
Abstract
BACKGROUND The global health system remains determined to leverage on every workable opportunity, including artificial intelligence (AI) to provide care that is consistent with patients' needs. Unfortunately, while AI models generally return high accuracy within the trials in which they are trained, their ability to predict and recommend the best course of care for prospective patients is left to chance. PURPOSE This review maps evidence between January 1, 2010 to December 31, 2023, on the perceived threats posed by the usage of AI tools in healthcare on patients' rights and safety. METHODS We deployed the guidelines of Tricco et al. to conduct a comprehensive search of current literature from Nature, PubMed, Scopus, ScienceDirect, Dimensions AI, Web of Science, Ebsco Host, ProQuest, JStore, Semantic Scholar, Taylor & Francis, Emeralds, World Health Organisation, and Google Scholar. In all, 80 peer reviewed articles qualified and were included in this study. RESULTS We report that there is a real chance of unpredictable errors, inadequate policy and regulatory regime in the use of AI technologies in healthcare. Moreover, medical paternalism, increased healthcare cost and disparities in insurance coverage, data security and privacy concerns, and bias and discriminatory services are imminent in the use of AI tools in healthcare. CONCLUSIONS Our findings have some critical implications for achieving the Sustainable Development Goals (SDGs) 3.8, 11.7, and 16. We recommend that national governments should lead in the roll-out of AI tools in their healthcare systems. Also, other key actors in the healthcare industry should contribute to developing policies on the use of AI in healthcare systems.
Collapse
Affiliation(s)
- Nkosi Nkosi Botha
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana.
- Air Force Medical Centre, Armed Forces Medical Services, Air Force Base, Takoradi, Ghana.
| | - Cynthia E Segbedzi
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana
| | - Victor K Dumahasi
- Institute of Environmental and Sanitation Studies, Environmental Science, College of Basic and Applied Sciences, University of Ghana, Legon, Ghana
| | - Samuel Maneen
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana
| | - Ruby V Kodom
- Department of Health Services Management/Distance Education, University of Ghana, Legon, Ghana
| | - Ivy S Tsedze
- Department of Adult Health, School of Nursing and Midwifery, University of Cape Coast, Cape Coast, Ghana
| | - Lucy A Akoto
- Air Force Medical Centre, Armed Forces Medical Services, Air Force Base, Takoradi, Ghana
| | | | - Obed U Lasim
- Department of Health Information Management, School of Allied Health Sciences, University of Cape Coast, Cape Coast, Ghana
| | - Edward W Ansah
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana
| |
Collapse
|
17
|
Zhang Q, Zhang P, Chen N, Zhu Z, Li W, Wang Q. Trends and hotspots in the field of diabetic retinopathy imaging research from 2000-2023. Front Med (Lausanne) 2024; 11:1481088. [PMID: 39444814 PMCID: PMC11496202 DOI: 10.3389/fmed.2024.1481088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2024] [Accepted: 09/27/2024] [Indexed: 10/25/2024] Open
Abstract
Background Diabetic retinopathy (DR) poses a major threat to diabetic patients' vision and is a critical public health issue. Imaging applications for DR have grown since the 21st century, aiding diagnosis, grading, and screening. This study uses bibliometric analysis to assess the field's advancements and key areas of interest. Methods This study performed a bibliometric analysis of DR imaging articles collected from the Web of Science Core Collection database between January 1st, 2000, and December 31st, 2023. The literature information was then analyzed through CiteSpace. Results The United States and China led in the number of publications, with 719 and 609, respectively. The University of London topped the institution list with 139 papers. Tien Yin Wong was the most prolific researcher. Invest. Ophthalmol. Vis. Sci. published the most articles (105). Notable burst keywords were "deep learning," "artificial intelligence," et al. Conclusion The United States is at the forefront of DR research, with the University of London as the top institution and Invest. Ophthalmol. Vis. Sci. as the most published journal. Tien Yin Wong is the most influential researcher. Hotspots like "deep learning," and "artificial intelligence," have seen a significant rise, indicating artificial intelligence's growing role in DR imaging.
Collapse
Affiliation(s)
- Qing Zhang
- The Third Affiliated Hospital of Xinxiang Medical University, Xinxiang Medical University, Xinxiang, China
| | - Ping Zhang
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen, China
| | - Naimei Chen
- Department of Ophthalmology, Huaian Hospital of Huaian City, Huaian, China
| | - Zhentao Zhu
- Department of Ophthalmology, Huaian Hospital of Huaian City, Huaian, China
| | - Wangting Li
- Shenzhen Eye Institute, Shenzhen Eye Hospital, Jinan University, Shenzhen, China
| | - Qiang Wang
- Department of Ophthalmology, Third Affiliated Hospital, Wenzhou Medical University, Zhejiang, China
| |
Collapse
|
18
|
Baget-Bernaldiz M, Fontoba-Poveda B, Romero-Aroca P, Navarro-Gil R, Hernando-Comerma A, Bautista-Perez A, Llagostera-Serra M, Morente-Lorenzo C, Vizcarro M, Mira-Puerto A. Artificial Intelligence-Based Screening System for Diabetic Retinopathy in Primary Care. Diagnostics (Basel) 2024; 14:1992. [PMID: 39272776 PMCID: PMC11394635 DOI: 10.3390/diagnostics14171992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2024] [Revised: 09/01/2024] [Accepted: 09/06/2024] [Indexed: 09/15/2024] Open
Abstract
BACKGROUND This study aimed to test an artificial intelligence-based reading system (AIRS) capable of reading retinographies of type 2 diabetic (T2DM) patients and a predictive algorithm (DRPA) that predicts the risk of each patient with T2DM of developing diabetic retinopathy (DR). METHODS We tested the ability of the AIRS to read and classify 15,297 retinal photographs from our database of diabetics and 1200 retinal images taken with Messidor-2 into the different DR categories. We tested the DRPA in a sample of 40,129 T2DM patients. The results obtained by the AIRS and the DRPA were then compared with those provided by four retina specialists regarding sensitivity (S), specificity (SP), positive predictive value (PPV), negative predictive value (NPV), accuracy (ACC), and area under the curve (AUC). RESULTS The results of testing the AIRS for identifying referral DR (RDR) in our database were ACC = 98.6, S = 96.7, SP = 99.8, PPV = 99.0, NPV = 98.0, and AUC = 0.958, and in Messidor-2 were ACC = 96.78%, S = 94.64%, SP = 99.14%, PPV = 90.54%, NPV = 99.53%, and AUC = 0.918. The results of our DRPA when predicting the presence of any type of DR were ACC = 0.97, S = 0.89, SP = 0.98, PPV = 0.79, NPV = 0.98, and AUC = 0.92. CONCLUSIONS The AIRS performed well when reading and classifying the retinographies of T2DM patients with RDR. The DRPA performed well in predicting the absence of DR based on some clinical variables.
Collapse
Affiliation(s)
- Marc Baget-Bernaldiz
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Benilde Fontoba-Poveda
- Responsible for Diabetic Retinopathy Eye Screening Program in Primary Care in Baix Llobregat Barcelona (Spain), Institut d'Investigació Sanitaria Pere Virgili [IISPV], 43204 Reus, Spain
| | - Pedro Romero-Aroca
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Raul Navarro-Gil
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Adriana Hernando-Comerma
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Angel Bautista-Perez
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Monica Llagostera-Serra
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Cristian Morente-Lorenzo
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Montse Vizcarro
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| | - Alejandra Mira-Puerto
- Ophthalmology Service, Hospital Universitari Sant Joan, Institut d'Investigació Sanitària Pere Virgili [IISPV], Universitat Rovira i Virgili, 43204 Reus, Spain
| |
Collapse
|
19
|
Dos Reis MA, Künas CA, da Silva Araújo T, Schneiders J, de Azevedo PB, Nakayama LF, Rados DRV, Umpierre RN, Berwanger O, Lavinsky D, Malerbi FK, Navaux POA, Schaan BD. Advancing healthcare with artificial intelligence: diagnostic accuracy of machine learning algorithm in diagnosis of diabetic retinopathy in the Brazilian population. Diabetol Metab Syndr 2024; 16:209. [PMID: 39210394 PMCID: PMC11360296 DOI: 10.1186/s13098-024-01447-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Accepted: 08/12/2024] [Indexed: 09/04/2024] Open
Abstract
BACKGROUND In healthcare systems in general, access to diabetic retinopathy (DR) screening is limited. Artificial intelligence has the potential to increase care delivery. Therefore, we trained and evaluated the diagnostic accuracy of a machine learning algorithm for automated detection of DR. METHODS We included color fundus photographs from individuals from 4 databases (primary and specialized care settings), excluding uninterpretable images. The datasets consist of images from Brazilian patients, which differs from previous work. This modification allows for a more tailored application of the model to Brazilian patients, ensuring that the nuances and characteristics of this specific population are adequately captured. The sample was fractionated in training (70%) and testing (30%) samples. A convolutional neural network was trained for image classification. The reference test was the combined decision from three ophthalmologists. The sensitivity, specificity, and area under the ROC curve of the algorithm for detecting referable DR (moderate non-proliferative DR; severe non-proliferative DR; proliferative DR and/or clinically significant macular edema) were estimated. RESULTS A total of 15,816 images (4590 patients) were included. The overall prevalence of any degree of DR was 26.5%. Compared with human evaluators (manual method of diagnosing DR performed by an ophthalmologist), the deep learning algorithm achieved an area under the ROC curve of 0.98 (95% CI 0.97-0.98), with a specificity of 94.6% (95% CI 93.8-95.3) and a sensitivity of 93.5% (95% CI 92.2-94.9) at the point of greatest efficiency to detect referable DR. CONCLUSIONS A large database showed that this deep learning algorithm was accurate in detecting referable DR. This finding aids to universal healthcare systems like Brazil, optimizing screening processes and can serve as a tool for improving DR screening, making it more agile and expanding care access.
Collapse
Affiliation(s)
- Mateus A Dos Reis
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil.
- Universidade Feevale, Novo Hamburgo, RS, Brazil.
| | - Cristiano A Künas
- Institute of Informatics, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Thiago da Silva Araújo
- Institute of Informatics, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Josiane Schneiders
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | | | - Luis F Nakayama
- Department of Ophthalmology and Visual Sciences, Universidade Federal de São Paulo, São Paulo, Brazil
- Laboratory for Computational Physiology, Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Dimitris R V Rados
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- TelessaúdeRS Project, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Roberto N Umpierre
- TelessaúdeRS Project, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Department of Social Medicine, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | - Otávio Berwanger
- The George Institute for Global Health, Imperial College London, London, UK
| | - Daniel Lavinsky
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Department of Ophthalmology, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil
| | - Fernando K Malerbi
- Department of Ophthalmology and Visual Sciences, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Philippe O A Navaux
- Institute of Informatics, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Beatriz D Schaan
- Graduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Institute for Health Technology Assessment (IATS) - CNPq, Porto Alegre, Brazil
- Endocrinology Unit, Hospital de Clínicas de Porto Alegre, Porto Alegre, RS, Brazil
| |
Collapse
|
20
|
Riotto E, Gasser S, Potic J, Sherif M, Stappler T, Schlingemann R, Wolfensberger T, Konstantinidis L. Accuracy of Autonomous Artificial Intelligence-Based Diabetic Retinopathy Screening in Real-Life Clinical Practice. J Clin Med 2024; 13:4776. [PMID: 39200918 PMCID: PMC11355215 DOI: 10.3390/jcm13164776] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 07/24/2024] [Accepted: 08/08/2024] [Indexed: 09/02/2024] Open
Abstract
Background: In diabetic retinopathy, early detection and intervention are crucial in preventing vision loss and improving patient outcomes. In the era of artificial intelligence (AI) and machine learning, new promising diagnostic tools have emerged. The IDX-DR machine (Digital Diagnostics, Coralville, IA, USA) represents a diagnostic tool that combines advanced imaging techniques, AI algorithms, and deep learning methodologies to identify and classify diabetic retinopathy. Methods: All patients that participated in our AI-based DR screening were considered for this study. For this study, all retinal images were additionally reviewed retrospectively by two experienced retinal specialists. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy were calculated for the IDX-DR machine compared to the graders' responses. Results: We included a total of 2282 images from 1141 patients who were screened between January 2021 and January 2023 at the Jules Gonin Eye Hospital in Lausanne, Switzerland. Sensitivity was calculated to be 100% for 'no DR', 'mild DR', and 'moderate DR'. Specificity for no DR', 'mild DR', 'moderate DR', and 'severe DR' was calculated to be, respectively, 78.4%, 81.2%, 93.4%, and 97.6%. PPV was calculated to be, respectively, 36.7%, 24.6%, 1.4%, and 0%. NPV was calculated to be 100% for each category. Accuracy was calculated to be higher than 80% for 'no DR', 'mild DR', and 'moderate DR'. Conclusions: In this study, based in Jules Gonin Eye Hospital in Lausanne, we compared the autonomous diagnostic AI system of the IDX-DR machine detecting diabetic retinopathy to human gradings established by two experienced retinal specialists. Our results showed that the ID-x DR machine constantly overestimates the DR stages, thus permitting the clinicians to fully trust negative results delivered by the screening software. Nevertheless, all fundus images classified as 'mild DR' or greater should always be controlled by a specialist in order to assert whether the predicted stage is truly present.
Collapse
|
21
|
Huang JJ, Channa R, Wolf RM, Dong Y, Liang M, Wang J, Abramoff MD, Liu TYA. Autonomous artificial intelligence for diabetic eye disease increases access and health equity in underserved populations. NPJ Digit Med 2024; 7:196. [PMID: 39039218 PMCID: PMC11263546 DOI: 10.1038/s41746-024-01197-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Accepted: 07/12/2024] [Indexed: 07/24/2024] Open
Abstract
Diabetic eye disease (DED) is a leading cause of blindness in the world. Annual DED testing is recommended for adults with diabetes, but adherence to this guideline has historically been low. In 2020, Johns Hopkins Medicine (JHM) began deploying autonomous AI for DED testing. In this study, we aimed to determine whether autonomous AI implementation was associated with increased adherence to annual DED testing, and how this differed across patient populations. JHM primary care sites were categorized as "non-AI" (no autonomous AI deployment) or "AI-switched" (autonomous AI deployment by 2021). We conducted a propensity score weighting analysis to compare change in adherence rates from 2019 to 2021 between non-AI and AI-switched sites. Our study included all adult patients with diabetes (>17,000) managed within JHM and has three major findings. First, AI-switched sites experienced a 7.6 percentage point greater increase in DED testing than non-AI sites from 2019 to 2021 (p < 0.001). Second, the adherence rate for Black/African Americans increased by 12.2 percentage points within AI-switched sites but decreased by 0.6% points within non-AI sites (p < 0.001), suggesting that autonomous AI deployment improved access to retinal evaluation for historically disadvantaged populations. Third, autonomous AI is associated with improved health equity, e.g. the adherence rate gap between Asian Americans and Black/African Americans shrank from 15.6% in 2019 to 3.5% in 2021. In summary, our results from real-world deployment in a large integrated healthcare system suggest that autonomous AI is associated with improvement in overall DED testing adherence, patient access, and health equity.
Collapse
Affiliation(s)
- Jane J Huang
- Wilmer Eye Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Roomasa Channa
- University of Wisconsin-Madison School of Medicine and Public Health, Madison, WI, USA
| | - Risa M Wolf
- Johns Hopkins Pediatric Diabetes Center, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Yiwen Dong
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD, USA
| | - Mavis Liang
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD, USA
| | - Jiangxia Wang
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD, USA
| | - Michael D Abramoff
- Department of Ophthalmology and Visual Sciences, University of Iowa, Iowa City, IA, USA
- Department of Electrical and Computer Engineering, University of Iowa, Iowa City, IA, USA
| | - T Y Alvin Liu
- Wilmer Eye Institute, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
22
|
Romero-Aroca P, Garcia-Curto E, Pascual-Fontanilles J, Valls A, Moreno A, Baget-Bernaldiz M. Distribution of Microaneurysms and Hemorrhages in Accordance with the Grading of Diabetic Retinopathy in Type Diabetes Patients. Diagnostics (Basel) 2024; 14:1547. [PMID: 39061684 PMCID: PMC11275489 DOI: 10.3390/diagnostics14141547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Revised: 07/13/2024] [Accepted: 07/16/2024] [Indexed: 07/28/2024] Open
Abstract
(1) Underlying Diabetic Retinopathy (DR) is the primary cause of poor vision in young adults. There are automatic image reading systems that can aid screening for DR. (2) Methods: Using our automatic reading system we have counted the number of microaneurysms and hemorrhages in the four quadrants of the ETDRS grid and evaluated the differences between them according to the type of DR. The study was carried out using data from two different databases, MESSIDOR and MIRADATASET. (3) Results: The majority of microaneurysms and hemorrhages are found in the temporal and inferior quadrants of the ETDRS grid. Differences are significant with respect to the other two quadrants at p < 0.001. Differences between the type of DR show that severe-DR has a greater number of microaneurysms and hemorrhages in the temporal and inferior quadrant, being significant at p < 0.001. (4) Conclusions: The count of microaneurysms and hemorrhages is higher in the temporal and inferior quadrants in all types of DR, and those differences are more important in the case of severe-DR.
Collapse
Affiliation(s)
- Pedro Romero-Aroca
- Ophthalmology Service, Hospital Universitario Sant Joan, Universitat Rovira & Virgili, Institut de Investigacio Sanitaria Pere Virgili (IISPV), 43204 Reus, Spain; (E.G.-C.); (M.B.-B.)
| | - Eugeni Garcia-Curto
- Ophthalmology Service, Hospital Universitario Sant Joan, Universitat Rovira & Virgili, Institut de Investigacio Sanitaria Pere Virgili (IISPV), 43204 Reus, Spain; (E.G.-C.); (M.B.-B.)
| | - Jordi Pascual-Fontanilles
- ITAKA Research Group, Department of Computer Science and Mathematics, Universitat Rovira & Virgili, Institut d’Investigacions Sanitaries Pere Virgili (IISPV), 43007 Tarragona, Spain; (J.P.-F.); (A.V.); (A.M.)
| | - Aida Valls
- ITAKA Research Group, Department of Computer Science and Mathematics, Universitat Rovira & Virgili, Institut d’Investigacions Sanitaries Pere Virgili (IISPV), 43007 Tarragona, Spain; (J.P.-F.); (A.V.); (A.M.)
| | - Antonio Moreno
- ITAKA Research Group, Department of Computer Science and Mathematics, Universitat Rovira & Virgili, Institut d’Investigacions Sanitaries Pere Virgili (IISPV), 43007 Tarragona, Spain; (J.P.-F.); (A.V.); (A.M.)
| | - Marc Baget-Bernaldiz
- Ophthalmology Service, Hospital Universitario Sant Joan, Universitat Rovira & Virgili, Institut de Investigacio Sanitaria Pere Virgili (IISPV), 43204 Reus, Spain; (E.G.-C.); (M.B.-B.)
| |
Collapse
|
23
|
Abstract
Artificial intelligence (AI) systems have demonstrated impressive performance across a variety of clinical tasks. However, notoriously, sometimes these systems are "black boxes." The initial response in the literature was a demand for "explainable AI." However, recently, several authors have suggested that making AI more explainable or "interpretable" is likely to be at the cost of the accuracy of these systems and that prioritizing interpretability in medical AI may constitute a "lethal prejudice." In this paper, we defend the value of interpretability in the context of the use of AI in medicine. Clinicians may prefer interpretable systems over more accurate black boxes, which in turn is sufficient to give designers of AI reason to prefer more interpretable systems in order to ensure that AI is adopted and its benefits realized. Moreover, clinicians may be justified in this preference. Achieving the downstream benefits from AI is critically dependent on how the outputs of these systems are interpreted by physicians and patients. A preference for the use of highly accurate black box AI systems, over less accurate but more interpretable systems, may itself constitute a form of lethal prejudice that may diminish the benefits of AI to-and perhaps even harm-patients.
Collapse
Affiliation(s)
- Joshua Hatherley
- School of Philosophical, Historical, and International Studies, Monash University, Clayton, Victoria, Australia
| | - Robert Sparrow
- School of Philosophical, Historical, and International Studies, Monash University, Clayton, Victoria, Australia
| | - Mark Howard
- School of Philosophical, Historical, and International Studies, Monash University, Clayton, Victoria, Australia
| |
Collapse
|
24
|
Chen D, Geevarghese A, Lee S, Plovnick C, Elgin C, Zhou R, Oermann E, Aphinyonaphongs Y, Al-Aswad LA. Transparency in Artificial Intelligence Reporting in Ophthalmology-A Scoping Review. OPHTHALMOLOGY SCIENCE 2024; 4:100471. [PMID: 38591048 PMCID: PMC11000111 DOI: 10.1016/j.xops.2024.100471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 11/18/2023] [Accepted: 01/12/2024] [Indexed: 04/10/2024]
Abstract
Topic This scoping review summarizes artificial intelligence (AI) reporting in ophthalmology literature in respect to model development and validation. We characterize the state of transparency in reporting of studies prospectively validating models for disease classification. Clinical Relevance Understanding what elements authors currently describe regarding their AI models may aid in the future standardization of reporting. This review highlights the need for transparency to facilitate the critical appraisal of models prior to clinical implementation, to minimize bias and inappropriate use. Transparent reporting can improve effective and equitable use in clinical settings. Methods Eligible articles (as of January 2022) from PubMed, Embase, Web of Science, and CINAHL were independently screened by 2 reviewers. All observational and clinical trial studies evaluating the performance of an AI model for disease classification of ophthalmic conditions were included. Studies were evaluated for reporting of parameters derived from reporting guidelines (CONSORT-AI, MI-CLAIM) and our previously published editorial on model cards. The reporting of these factors, which included basic model and dataset details (source, demographics), and prospective validation outcomes, were summarized. Results Thirty-seven prospective validation studies were included in the scoping review. Eleven additional associated training and/or retrospective validation studies were included if this information could not be determined from the primary articles. These 37 studies validated 27 unique AI models; multiple studies evaluated the same algorithms (EyeArt, IDx-DR, and Medios AI). Details of model development were variably reported; 18 of 27 models described training dataset annotation and 10 of 27 studies reported training data distribution. Demographic information of training data was rarely reported; 7 of the 27 unique models reported age and gender and only 2 reported race and/or ethnicity. At the level of prospective clinical validation, age and gender of populations was more consistently reported (29 and 28 of 37 studies, respectively), but only 9 studies reported race and/or ethnicity data. Scope of use was difficult to discern for the majority of models. Fifteen studies did not state or imply primary users. Conclusion Our scoping review demonstrates variable reporting of information related to both model development and validation. The intention of our study was not to assess the quality of the factors we examined, but to characterize what information is, and is not, regularly reported. Our results suggest the need for greater transparency in the reporting of information necessary to determine the appropriateness and fairness of these tools prior to clinical use. Financial Disclosures Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Dinah Chen
- Department of Ophthalmology, NYU Langone Health, New York, New York
| | | | - Samuel Lee
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, New York
| | | | - Cansu Elgin
- Department of Ophthalmology, Istanbul University-Cerrahpasa, Istanbul, Turkey
| | - Raymond Zhou
- Department of Neurosurgery, Vanderbilt School of Medicine, Nashville, Tennessee
| | - Eric Oermann
- Department of Neurosurgery, NYU Grossman School of Medicine, New York, New York
- Department of Neurosurgery, NYU Langone Health, New York, New York
| | - Yindalon Aphinyonaphongs
- Department of Medicine, NYU Langone Health, New York, New York
- Department of Population Health, NYU Grossman School of Medicine, New York, New York
| | - Lama A. Al-Aswad
- Department of Ophthalmology, NYU Langone Health, New York, New York
- Department of Population Health, NYU Grossman School of Medicine, New York, New York
| |
Collapse
|
25
|
Van TN, Thi HLV. Effectiveness of artificial intelligence for diabetic retinopathy screening in community in Binh Dinh Province, Vietnam. Taiwan J Ophthalmol 2024; 14:394-402. [PMID: 39430352 PMCID: PMC11488799 DOI: 10.4103/tjo.tjo-d-23-00101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2023] [Accepted: 11/18/2023] [Indexed: 10/22/2024] Open
Abstract
PURPOSE The objective of this study is to evaluate the sensitivity, specificity, and accuracy of artificial intelligence (AI) for diabetic retinopathy (DR) screening in community in Binh Dinh Province in Vietnam. MATERIALS AND METHODS This retrospective, descriptive, cross-sectional study assessed the DR screening efficacy of EyeArt system v2.0 by analyzing 2332 nonmydriatic digital fundus pictures of 583 diabetic patients from hospitals and health centers in Binh Dinh province. First, we selected thirty patients with 120 digital fundus pictures to perform the Kappa index by two eye doctors who would be responsible for the DR clinical feature evaluation and DR severity scale classification. Second, all digital fundus pictures were coded and then sent to the two above-mentioned eye doctors for the evaluation and classifications according to the International Committee of Ophthalmology's guidelines. Finally, DR severity scales with EyeArt were compared with those by eye doctors as a reference standard for EyeArt's effectiveness. All the data were analyzed using the SPSS software version 20.0. Values (with confidence interval 95%) of sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were calculated according to DR state, referable or not and vision-threatening DR state or not. P < 0.05 was considered statistically significant. RESULTS The sensitivity and specificity of EyeArt for DR screening were 94.1% and 87.2%. The sensitivity and specificity for referable DR and vision-threatening DR were 96.6%, 90.1%, and 100.0%, 92.2%. Accuracy for DR screening, referable DR, and vision-threatening DR were 88.9%, 91.4%, and 93.0%, respectively. CONCLUSION EyeArt AI was effective for DR screening in community.
Collapse
Affiliation(s)
- Thanh Nguyen Van
- Department of Planning and Outreach, Binh Dinh Eye Hospital, Binh Dinh Province, Vietnam
| | - Hoang Lan Vo Thi
- Department of Ophthalmology, University of Medicine and Pharmacy at Ho Chi Minh City, Ho Chi Minh, Vietnam
| |
Collapse
|
26
|
Sorrentino FS, Gardini L, Fontana L, Musa M, Gabai A, Maniaci A, Lavalle S, D’Esposito F, Russo A, Longo A, Surico PL, Gagliano C, Zeppieri M. Novel Approaches for Early Detection of Retinal Diseases Using Artificial Intelligence. J Pers Med 2024; 14:690. [PMID: 39063944 PMCID: PMC11278069 DOI: 10.3390/jpm14070690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 06/24/2024] [Accepted: 06/25/2024] [Indexed: 07/28/2024] Open
Abstract
BACKGROUND An increasing amount of people are globally affected by retinal diseases, such as diabetes, vascular occlusions, maculopathy, alterations of systemic circulation, and metabolic syndrome. AIM This review will discuss novel technologies in and potential approaches to the detection and diagnosis of retinal diseases with the support of cutting-edge machines and artificial intelligence (AI). METHODS The demand for retinal diagnostic imaging exams has increased, but the number of eye physicians or technicians is too little to meet the request. Thus, algorithms based on AI have been used, representing valid support for early detection and helping doctors to give diagnoses and make differential diagnosis. AI helps patients living far from hub centers to have tests and quick initial diagnosis, allowing them not to waste time in movements and waiting time for medical reply. RESULTS Highly automated systems for screening, early diagnosis, grading and tailored therapy will facilitate the care of people, even in remote lands or countries. CONCLUSION A potential massive and extensive use of AI might optimize the automated detection of tiny retinal alterations, allowing eye doctors to perform their best clinical assistance and to set the best options for the treatment of retinal diseases.
Collapse
Affiliation(s)
| | - Lorenzo Gardini
- Unit of Ophthalmology, Department of Surgical Sciences, Ospedale Maggiore, 40100 Bologna, Italy; (F.S.S.)
| | - Luigi Fontana
- Ophthalmology Unit, Department of Surgical Sciences, Alma Mater Studiorum University of Bologna, IRCCS Azienda Ospedaliero-Universitaria Bologna, 40100 Bologna, Italy
| | - Mutali Musa
- Department of Optometry, University of Benin, Benin City 300238, Edo State, Nigeria
| | - Andrea Gabai
- Department of Ophthalmology, Humanitas-San Pio X, 20159 Milan, Italy
| | - Antonino Maniaci
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
| | - Salvatore Lavalle
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
| | - Fabiana D’Esposito
- Imperial College Ophthalmic Research Group (ICORG) Unit, Imperial College, 153-173 Marylebone Rd, London NW15QH, UK
- Department of Neurosciences, Reproductive Sciences and Dentistry, University of Naples Federico II, Via Pansini 5, 80131 Napoli, Italy
| | - Andrea Russo
- Department of Ophthalmology, University of Catania, 95123 Catania, Italy
| | - Antonio Longo
- Department of Ophthalmology, University of Catania, 95123 Catania, Italy
| | - Pier Luigi Surico
- Schepens Eye Research Institute of Mass Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
- Department of Ophthalmology, Campus Bio-Medico University, 00128 Rome, Italy
| | - Caterina Gagliano
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
- Eye Clinic, Catania University, San Marco Hospital, Viale Carlo Azeglio Ciampi, 95121 Catania, Italy
| | - Marco Zeppieri
- Department of Ophthalmology, University Hospital of Udine, 33100 Udine, Italy
| |
Collapse
|
27
|
Ahsen ME, Vogel R, Stolovitzky G. Optimal linear ensemble of binary classifiers. BIOINFORMATICS ADVANCES 2024; 4:vbae093. [PMID: 39011276 PMCID: PMC11249386 DOI: 10.1093/bioadv/vbae093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 05/03/2024] [Accepted: 06/13/2024] [Indexed: 07/17/2024]
Abstract
Motivation The integration of vast, complex biological data with computational models offers profound insights and predictive accuracy. Yet, such models face challenges: poor generalization and limited labeled data. Results To overcome these difficulties in binary classification tasks, we developed the Method for Optimal Classification by Aggregation (MOCA) algorithm, which addresses the problem of generalization by virtue of being an ensemble learning method and can be used in problems with limited or no labeled data. We developed both an unsupervised (uMOCA) and a supervised (sMOCA) variant of MOCA. For uMOCA, we show how to infer the MOCA weights in an unsupervised way, which are optimal under the assumption of class-conditioned independent classifier predictions. When it is possible to use labels, sMOCA uses empirically computed MOCA weights. We demonstrate the performance of uMOCA and sMOCA using simulated data as well as actual data previously used in Dialogue on Reverse Engineering and Methods (DREAM) challenges. We also propose an application of sMOCA for transfer learning where we use pre-trained computational models from a domain where labeled data are abundant and apply them to a different domain with less abundant labeled data. Availability and implementation GitHub repository, https://github.com/robert-vogel/moca.
Collapse
Affiliation(s)
- Mehmet Eren Ahsen
- Department of Business Administration, University of Illinois at Urbana-Champaign, Champaign, IL, 61820, United States
- Department of Biomedical and Translational Sciences, University of Illinois at Urbana-Champaign, Urbana, IL, 61801, United States
| | - Robert Vogel
- Thomas J. Watson Research Center, IBM, New York, NY 10598, United States
- Department of Integrated Structural and Computational Biology, Scripps Research, La Jolla, CA 92037, United States
| | | |
Collapse
|
28
|
Winder AJ, Stanley EA, Fiehler J, Forkert ND. Challenges and Potential of Artificial Intelligence in Neuroradiology. Clin Neuroradiol 2024; 34:293-305. [PMID: 38285239 DOI: 10.1007/s00062-024-01382-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 01/03/2024] [Indexed: 01/30/2024]
Abstract
PURPOSE Artificial intelligence (AI) has emerged as a transformative force in medical research and is garnering increased attention in the public consciousness. This represents a critical time period in which medical researchers, healthcare providers, insurers, regulatory agencies, and patients are all developing and shaping their beliefs and policies regarding the use of AI in the healthcare sector. The successful deployment of AI will require support from all these groups. This commentary proposes that widespread support for medical AI must be driven by clear and transparent scientific reporting, beginning at the earliest stages of scientific research. METHODS A review of relevant guidelines and literature describing how scientific reporting plays a central role at key stages in the life cycle of an AI software product was conducted. To contextualize this principle within a specific medical domain, we discuss the current state of predictive tissue outcome modeling in acute ischemic stroke and the unique challenges presented therein. RESULTS AND CONCLUSION Translating AI methods from the research to the clinical domain is complicated by challenges related to model design and validation studies, medical product regulations, and healthcare providers' reservations regarding AI's efficacy and affordability. However, each of these limitations is also an opportunity for high-impact research that will help to accelerate the clinical adoption of state-of-the-art medical AI. In all cases, establishing and adhering to appropriate reporting standards is an important responsibility that is shared by all of the parties involved in the life cycle of a prospective AI software product.
Collapse
Affiliation(s)
- Anthony J Winder
- Department of Radiology, University of Calgary, Calgary, Canada.
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada.
| | - Emma Am Stanley
- Department of Radiology, University of Calgary, Calgary, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
- Biomedical Engineering Graduate Program, University of Calgary, Calgary, Canada
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
| | - Jens Fiehler
- Department of Diagnostic and Interventional Neuroradiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Canada
- Alberta Children's Hospital Research Institute, University of Calgary, Calgary, Canada
- Department of Clinical Neuroscience, University of Calgary, Calgary, Canada
- Department of Electrical and Software Engineering, University of Calgary, Calgary, Canada
| |
Collapse
|
29
|
Assié G, Allassonnière S. Artificial Intelligence in Endocrinology: On Track Toward Great Opportunities. J Clin Endocrinol Metab 2024; 109:e1462-e1467. [PMID: 38466742 DOI: 10.1210/clinem/dgae154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 02/13/2024] [Accepted: 03/08/2024] [Indexed: 03/13/2024]
Abstract
In endocrinology, the types and quantity of digital data are increasing rapidly. Computing capabilities are also developing at an incredible rate, as illustrated by the recent expansion in the use of popular generative artificial intelligence (AI) applications. Numerous diagnostic and therapeutic devices using AI have already entered routine endocrine practice, and developments in this field are expected to continue to accelerate. Endocrinologists will need to be supported in managing AI applications. Beyond technological training, interdisciplinary vision is needed to encompass the ethical and legal aspects of AI, to manage the profound impact of AI on patient/provider relationships, and to maintain an optimal balance between human input and AI in endocrinology.
Collapse
Affiliation(s)
- Guillaume Assié
- Université Paris Cité, CNRS UMR8104, INSERM U1016, Institut Cochin, F-75014 Paris, France
- Service d'endocrinologie, Center for Rare Adrenal Diseases, Assistance Publique-Hôpitaux de Paris, Hôpital Cochin, 75014 Paris, France
| | - Stéphanie Allassonnière
- Université Paris Cité, UFR Medecine, 75006 Paris, France
- HeKA INSERM, INRIA Paris, Centre de Recherche des Cordeliers Paris, Université Paris Cité, 75006 Paris, France
| |
Collapse
|
30
|
Salongcay RP, Aquino LAC, Alog GP, Locaylocay KB, Saunar AV, Peto T, Silva PS. Accuracy of Integrated Artificial Intelligence Grading Using Handheld Retinal Imaging in a Community Diabetic Eye Screening Program. OPHTHALMOLOGY SCIENCE 2024; 4:100457. [PMID: 38317871 PMCID: PMC10838904 DOI: 10.1016/j.xops.2023.100457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 11/08/2023] [Accepted: 12/11/2023] [Indexed: 02/07/2024]
Abstract
Purpose To evaluate mydriatic handheld retinal imaging performance assessed by point-of-care (POC) artificial intelligence (AI) as compared with retinal image graders at a centralized reading center (RC) in identifying diabetic retinopathy (DR) and diabetic macular edema (DME). Design Prospective, comparative study. Subjects Five thousand five hundred eighty-five eyes from 2793 adult patients with diabetes. Methods Point-of-care AI assessment of disc and macular handheld retinal images was compared with RC evaluation of validated 5-field handheld retinal images (disc, macula, superior, inferior, and temporal) in identifying referable DR (refDR; defined as moderate nonproliferative DR [NPDR], or worse, or any level of DME) and vision-threatening DR (vtDR; defined as severe NPDR or worse, or any level of center-involving DME [ciDME]). Reading center evaluation of the 5-field images followed the international DR/DME classification. Sensitivity (SN) and specificity (SP) for ungradable images, refDR, and vtDR were calculated. Main Outcome Measures Agreement for DR and DME; SN and SP for refDR, vtDR, and ungradable images. Results Diabetic retinopathy severity by RC evaluation: no DR, 67.3%; mild NPDR, 9.7%; moderate NPDR, 8.6%; severe NPDR, 4.8%; proliferative DR, 3.8%; and ungradable, 5.8%. Diabetic macular edema severity by RC evaluation was as follows: no DME (80.4%), non-ciDME (7.7%), ciDME (4.4%), and ungradable (7.5%). Referable DR was present in 25.3% and vtDR was present in 17.5% of eyes. Images were ungradable for DR or DME in 7.5% by RC evaluation and 15.4% by AI. There was substantial agreement between AI and RC for refDR (κ = 0.66) and moderate agreement for vtDR (κ = 0.54). The SN/SP of AI grading compared with RC evaluation was 0.86/0.86 for refDR and 0.92/0.80 for vtDR. Conclusions This study demonstrates that POC AI following a defined handheld retinal imaging protocol at the time of imaging has SN and SP for refDR that meets the current United States Food and Drug Administration thresholds of 85% and 82.5%, but not for vtDR. Integrating AI at the POC could substantially reduce centralized RC burden and speed information delivery to the patient, allowing more prompt eye care referral. Financial Disclosures Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Recivall P. Salongcay
- Centre for Public Health, Queen’s University Belfast, Belfast, United Kingdom
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Lizzie Anne C. Aquino
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
| | - Glenn P. Alog
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Kaye B. Locaylocay
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Aileen V. Saunar
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
| | - Tunde Peto
- Centre for Public Health, Queen’s University Belfast, Belfast, United Kingdom
| | - Paolo S. Silva
- Philippine Eye Research Institute, University of the Philippines, Manila, Philippines
- Eye and Vision Institute, The Medical City, Metro Manila, Philippines
- Beetham Eye Institute, Joslin Diabetes Center, Boston, Massachusetts
- Department of Ophthalmology, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
31
|
Tomić M, Vrabec R, Ljubić S, Prkačin I, Bulum T. Patients with Type 2 Diabetes, Higher Blood Pressure, and Infrequent Fundus Examinations Have a Higher Risk of Sight-Threatening Retinopathy. J Clin Med 2024; 13:2496. [PMID: 38731024 PMCID: PMC11084692 DOI: 10.3390/jcm13092496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 03/28/2024] [Accepted: 04/21/2024] [Indexed: 05/13/2024] Open
Abstract
Background: Diabetic retinopathy (DR) is the most common cause of preventable blindness among working-age adults. This study aimed to evaluate the impact of the regularity of fundus examinations and risk factor control in patients with type 2 diabetes (T2DM) on the prevalence and severity of DR. Methods: One hundred and fifty-six T2DM patients were included in this cross-sectional study. Results: In this sample, the prevalence of DR was 46.2%. Patients with no DR mainly did not examine the fundus regularly, while most patients with mild/moderate nonproliferative DR (NPDR) underwent a fundus examination regularly. In 39.7% of patients, this was the first fundus examination due to diabetes, and 67% of them had sight-threatening DR (STDR). Diabetes duration (p = 0.007), poor glycemic control (HbA1c) (p = 0.006), higher systolic blood pressure (SBP) (p < 0.001), and diastolic blood pressure (DBP) (p = 0.002) were the main predictors of DR. However, the impact of SBP (AOR 1.07, p = 0.003) and DBP (AOR 1.13, p = 0.005) on DR development remained significant even after adjustment for diabetes duration and HbA1c. The DR prevalence was higher in patients with higher blood pressure (≥130/80 mmHg) than in those with target blood pressure (<130/80 mmHg) (p = 0.043). None of the patients with target blood pressure had STDR. The peaks in SBP and DBP were observed in T2DM with DR and the first fundus examination due to diabetes. Conclusions: In this T2DM sample, DR prevalence was very high and strongly related to blood pressure and a lack of regular fundus examinations. These results indicate the necessity of establishing systematic DR screening in routine diabetes care and targeting blood pressure levels according to T2DM guidelines.
Collapse
Affiliation(s)
- Martina Tomić
- Department of Ophthalmology, Vuk Vrhovac University Clinic for Diabetes, Endocrinology and Metabolic Diseases, Merkur University Hospital, 10000 Zagreb, Croatia
| | - Romano Vrabec
- Department of Ophthalmology, Vuk Vrhovac University Clinic for Diabetes, Endocrinology and Metabolic Diseases, Merkur University Hospital, 10000 Zagreb, Croatia
| | - Spomenka Ljubić
- Department of Diabetes and Endocrinology, Vuk Vrhovac University Clinic for Diabetes, Endocrinology and Metabolic Diseases, Merkur University Hospital, 10000 Zagreb, Croatia
- School of Medicine, University of Zagreb, Šalata 3, 10000 Zagreb, Croatia
| | - Ingrid Prkačin
- School of Medicine, University of Zagreb, Šalata 3, 10000 Zagreb, Croatia
- Department of Internal Medicine, Merkur University Hospital, 10000 Zagreb, Croatia
| | - Tomislav Bulum
- Department of Diabetes and Endocrinology, Vuk Vrhovac University Clinic for Diabetes, Endocrinology and Metabolic Diseases, Merkur University Hospital, 10000 Zagreb, Croatia
- School of Medicine, University of Zagreb, Šalata 3, 10000 Zagreb, Croatia
| |
Collapse
|
32
|
Liu TYA, Huang J, Channa R, Wolf R, Dong Y, Liang M, Wang J, Abramoff M. Autonomous Artificial Intelligence Increases Access and Health Equity in Underserved Populations with Diabetes. RESEARCH SQUARE 2024:rs.3.rs-3979992. [PMID: 38559222 PMCID: PMC10980149 DOI: 10.21203/rs.3.rs-3979992/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Diabetic eye disease (DED) is a leading cause of blindness in the world. Early detection and treatment of DED have been shown to be both sight-saving and cost-effective. As such, annual testing for DED is recommended for adults with diabetes and is a Healthcare Effectiveness Data and Information Set (HEDIS) measure. However, adherence to this guideline has historically been low, and access to this sight-saving intervention has particularly been limited for specific populations, such as Black or African American patients. In 2018, the US Food and Drug Agency (FDA) De Novo cleared autonomous artificial intelligence (AI) for diagnosing DED in a primary care setting. In 2020, Johns Hopkins Medicine (JHM), an integrated healthcare system with over 30 primary care sites, began deploying autonomous AI for DED testing in some of its primary care clinics. In this retrospective study, we aimed to determine whether autonomous AI implementation was associated with increased adherence to annual DED testing, and whether this was different for specific populations. JHM primary care sites were categorized as "non-AI" sites (sites with no autonomous AI deployment over the study period and where patients are referred to eyecare for DED testing) or "AI-switched" sites (sites that did not have autonomous AI testing in 2019 but did by 2021). We conducted a difference-in-difference analysis using a logistic regression model to compare change in adherence rates from 2019 to 2021 between non-AI and AI-switched sites. Our study included all adult patients with diabetes managed within our health system (17,674 patients for the 2019 cohort and 17,590 patients for the 2021 cohort) and has three major findings. First, after controlling for a wide range of potential confounders, our regression analysis demonstrated that the odds ratio of adherence at AI-switched sites was 36% higher than that of non-AI sites, suggesting that there was a higher increase in DED testing between 2019 and 2021 at AI-switched sites than at non-AI sites. Second, our data suggested autonomous AI improved access for historically disadvantaged populations. The adherence rate for Black/African Americans increased by 11.9% within AI-switched sites whereas it decreased by 1.2% within non-AI sites over the same time frame. Third, the data suggest that autonomous AI improved health equity by closing care gaps. For example, in 2019, a large adherence rate gap existed between Asian Americans and Black/African Americans (61.1% vs. 45.5%). This 15.6% gap shrank to 3.5% by 2021. In summary, our real-world deployment results in a large integrated healthcare system suggest that autonomous AI improves adherence to a HEDIS measure, patient access, and health equity for patients with diabetes - particularly in historically disadvantaged patient groups. While our findings are encouraging, they will need to be replicated and validated in a prospective manner across more diverse settings.
Collapse
Affiliation(s)
| | | | | | - Risa Wolf
- Johns Hopkins University School of Medicine
| | | | | | | | | |
Collapse
|
33
|
Shou BL, Venkatesh K, Chen C, Ghidey R, Lee JH, Wang J, Channa R, Wolf RM, Abramoff MD, Liu TYA. Risk Factors for Nondiagnostic Imaging in a Real-World Deployment of Artificial Intelligence Diabetic Retinal Examinations in an Integrated Healthcare System: Maximizing Workflow Efficiency Through Predictive Dilation. J Diabetes Sci Technol 2024; 18:302-308. [PMID: 37798955 PMCID: PMC10973867 DOI: 10.1177/19322968231201654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/07/2023]
Abstract
OBJECTIVE In the pivotal clinical trial that led to Food and Drug Administration De Novo "approval" of the first fully autonomous artificial intelligence (AI) diabetic retinal disease diagnostic system, a reflexive dilation protocol was used. Using real-world deployment data before implementation of reflexive dilation, we identified factors associated with nondiagnostic results. These factors allow a novel predictive dilation workflow, where patients most likely to benefit from pharmacologic dilation are dilated a priori to maximize efficiency and patient satisfaction. METHODS Retrospective review of patients who were assessed with autonomous AI at Johns Hopkins Medicine (8/2020 to 5/2021). We constructed a multivariable logistic regression model for nondiagnostic results to compare characteristics of patients with and without diagnostic results, using adjusted odds ratio (aOR). P < .05 was considered statistically significant. RESULTS Of 241 patients (59% female; median age = 59), 123 (51%) had nondiagnostic results. In multivariable analysis, type 1 diabetes (T1D, aOR = 5.82, 95% confidence interval [CI]: 1.45-23.40, P = .01), smoking (aOR = 2.86, 95% CI: 1.36-5.99, P = .005), and age (every 10-year increase, aOR = 2.12, 95% CI: 1.62-2.77, P < .001) were associated with nondiagnostic results. Following feature elimination, a predictive model was created using T1D, smoking, age, race, sex, and hypertension as inputs. The model showed an area under the receiver-operator characteristics curve of 0.76 in five-fold cross-validation. CONCLUSIONS We used factors associated with nondiagnostic results to design a novel, predictive dilation workflow, where patients most likely to benefit from pharmacologic dilation are dilated a priori. This new workflow has the potential to be more efficient than reflexive dilation, thus maximizing the number of at-risk patients receiving their diabetic retinal examinations.
Collapse
Affiliation(s)
- Benjamin L. Shou
- School of Medicine, The Johns Hopkins
University, Baltimore, MD, USA
| | - Kesavan Venkatesh
- Whiting School of Engineering, The
Johns Hopkins University, Baltimore, MD, USA
| | - Chang Chen
- Bloomberg School of Public Health, The
Johns Hopkins University, Baltimore, MD, USA
| | - Ronel Ghidey
- Bloomberg School of Public Health, The
Johns Hopkins University, Baltimore, MD, USA
| | - Jae Hyoung Lee
- Bloomberg School of Public Health, The
Johns Hopkins University, Baltimore, MD, USA
| | - Jiangxia Wang
- Bloomberg School of Public Health, The
Johns Hopkins University, Baltimore, MD, USA
| | - Roomasa Channa
- Department of Ophthalmology and Visual
Sciences, University of Wisconsin-Madison, Madison, WI, USA
| | - Risa M. Wolf
- Department of Pediatrics, Division of
Pediatric Endocrinology, The Johns Hopkins University, Baltimore, MD, USA
| | - Michael D. Abramoff
- Department of Ophthalmology and Visual
Sciences, The University of Iowa, Iowa City, IA, USA
| | - T. Y. Alvin Liu
- Wilmer Eye Institute, The Johns Hopkins
University, Baltimore, MD, USA
| |
Collapse
|
34
|
Brennan IG, Kelly SR, McBride E, Garrahy D, Acheson R, Harmon J, McMahon S, Keegan DJ, Kavanagh H, O’Toole L. Addressing Technical Failures in a Diabetic Retinopathy Screening Program. Clin Ophthalmol 2024; 18:431-440. [PMID: 38356695 PMCID: PMC10864767 DOI: 10.2147/opth.s442414] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 01/18/2024] [Indexed: 02/16/2024] Open
Abstract
Purpose Diabetic retinopathy (DR) is a preventable cause of blindness detectable through screening using retinal digital photography. The Irish National Diabetic Retina Screening (DRS) programme, Diabetic RetinaScreen, provides free screening services to patients with diabetes from aged 12 years and older. A technical failure (TF) occurs when digital retinal imaging is ungradable, resulting in delays in the diagnosis and treatment of sight-threatening disease. Despite their impact, the causes of TFs, and indeed the utility of interventions to prevent them, have not been extensively examined. Aim Primary analysis aimed to identify factors associated with TF. Secondary analysis examined a subset of cases, assessing patient data from five time points between 2019 and 2021 to identify photographer/patient factors associated with TF. Methods Patient data from the DRS database for one provider were extracted for analysis between 2018 and 2022. Information on patient demographics, screening results, and other factors previously associated with TF were analyzed. Primary analysis involved using mixed-effects logistic regression models with nested patient-eye random effects. Secondary analysis reviewed a subset of cases in detail, checking for causes of TF. Results The primary analysis included a total of 366,528 appointments from 104,407 patients over 5 years. Most patients had Type 2 diabetes (89.2%), and the overall TF rate was 4.9%. Diabetes type and duration, dilate pupil status, and the presence of lens artefacts on the camera were significantly associated with TF. The Secondary analysis identified the primary cause of TF was found to be optically dense cataracts, accounting for over half of the TFs. Conclusion This study provides insight into the causes of TF within the Irish DRS program, highlighting cataracts as the primary contributing factor. The identification of patient-level factors associated with TF facilitates appropriate interventions that can be put in place to improve patient outcomes and minimize delays in treatment and diagnosis.
Collapse
Affiliation(s)
- Ian Gerard Brennan
- Diabetic RetinaScreen, National Screening Service, Health Service Executive, Dublin, Ireland
| | - Stephen R Kelly
- Diabetic RetinaScreen, National Screening Service, Health Service Executive, Dublin, Ireland
| | - Edel McBride
- Diabetic Retinal Screening Service, NEC Care, Cork City, Co. Cork, Ireland
| | - Darragh Garrahy
- Diabetic RetinaScreen, National Screening Service, Health Service Executive, Dublin, Ireland
| | - Robert Acheson
- Diabetic Retinal Screening Service, NEC Care, Cork City, Co. Cork, Ireland
| | - Joanne Harmon
- Diabetic Retinal Screening Service, NEC Care, Cork City, Co. Cork, Ireland
| | - Shane McMahon
- Diabetic Retinal Screening Service, NEC Care, Cork City, Co. Cork, Ireland
| | - David J Keegan
- Diabetic RetinaScreen, National Screening Service, Health Service Executive, Dublin, Ireland
| | - Helen Kavanagh
- Diabetic RetinaScreen, National Screening Service, Health Service Executive, Dublin, Ireland
| | - Louise O’Toole
- Diabetic Retinal Screening Service, NEC Care, Cork City, Co. Cork, Ireland
| |
Collapse
|
35
|
Feng L, Zhang Y, Wei W, Qiu H, Shi M. Applying deep learning to recognize the properties of vitreous opacity in ophthalmic ultrasound images. Eye (Lond) 2024; 38:380-385. [PMID: 37596401 PMCID: PMC10810903 DOI: 10.1038/s41433-023-02705-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Revised: 07/20/2023] [Accepted: 08/09/2023] [Indexed: 08/20/2023] Open
Abstract
BACKGROUND To explore the feasibility of artificial intelligence technology based on deep learning to automatically recognize the properties of vitreous opacities in ophthalmic ultrasound images. METHODS A total of 2000 greyscale Doppler ultrasound images containing non-pathological eye and three typical vitreous opacities confirmed as physiological vitreous opacity (VO), asteroid hyalosis (AH), and vitreous haemorrhage (VH) were selected and labelled for each lesion type. Five residual networks (ResNet) and two GoogLeNet models were trained to recognize vitreous lesions. Seventy-five percent of the images were randomly selected as the training set, and the remaining 25% were selected as the test set. The accuracy and parameters were recorded and compared among these seven different deep learning (DL) models. The precision, recall, F1 score, and area under the receiver operating characteristic curve (AUC) values for recognizing vitreous lesions were calculated for the most accurate DL model. RESULTS These seven DL models had significant differences in terms of their accuracy and parameters. GoogLeNet Inception V1 achieved the highest accuracy (95.5%) and minor parameters (10315580) in vitreous lesion recognition. GoogLeNet Inception V1 achieved precision values of 0.94, 0.94, 0.96, and 0.96, recall values of 0.94, 0.93, 0.97 and 0.98, and F1 scores of 0.94, 0.93, 0.96 and 0.97 for normal, VO, AH, and VH recognition, respectively. The AUC values for these four vitreous lesion types were 0.99, 1.0, 0.99, and 0.99, respectively. CONCLUSIONS GoogLeNet Inception V1 has shown promising results in ophthalmic ultrasound image recognition. With increasing ultrasound image data, a wide variety of confidential information on eye diseases can be detected automatically by artificial intelligence technology based on deep learning.
Collapse
Affiliation(s)
- Li Feng
- Department of Ophthalmology, The Fourth Affiliated Hospital of China Medical University, Eye Hospital of China Medical University, The Key Laboratory of Lens in Liaoning Province, Shenyang, China
| | | | - Wei Wei
- Hebei Eye Hospital, Xingtai, China
| | - Hui Qiu
- Department of Ophthalmology, The Fourth Affiliated Hospital of China Medical University, Eye Hospital of China Medical University, The Key Laboratory of Lens in Liaoning Province, Shenyang, China
| | - Mingyu Shi
- Department of Ophthalmology, The Fourth Affiliated Hospital of China Medical University, Eye Hospital of China Medical University, The Key Laboratory of Lens in Liaoning Province, Shenyang, China.
| |
Collapse
|
36
|
Skevas C, de Olaguer NP, Lleó A, Thiwa D, Schroeter U, Lopes IV, Mautone L, Linke SJ, Spitzer MS, Yap D, Xiao D. Implementing and evaluating a fully functional AI-enabled model for chronic eye disease screening in a real clinical environment. BMC Ophthalmol 2024; 24:51. [PMID: 38302908 PMCID: PMC10832120 DOI: 10.1186/s12886-024-03306-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Accepted: 01/16/2024] [Indexed: 02/03/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI) has the potential to increase the affordability and accessibility of eye disease screening, especially with the recent approval of AI-based diabetic retinopathy (DR) screening programs in several countries. METHODS This study investigated the performance, feasibility, and user experience of a seamless hardware and software solution for screening chronic eye diseases in a real-world clinical environment in Germany. The solution integrated AI grading for DR, age-related macular degeneration (AMD), and glaucoma, along with specialist auditing and patient referral decision. The study comprised several components: (1) evaluating the entire system solution from recruitment to eye image capture and AI grading for DR, AMD, and glaucoma; (2) comparing specialist's grading results with AI grading results; (3) gathering user feedback on the solution. RESULTS A total of 231 patients were recruited, and their consent forms were obtained. The sensitivity, specificity, and area under the curve for DR grading were 100.00%, 80.10%, and 90.00%, respectively. For AMD grading, the values were 90.91%, 78.79%, and 85.00%, and for glaucoma grading, the values were 93.26%, 76.76%, and 85.00%. The analysis of all false positive cases across the three diseases and their comparison with the final referral decisions revealed that only 17 patients were falsely referred among the 231 patients. The efficacy analysis of the system demonstrated the effectiveness of the AI grading process in the study's testing environment. Clinical staff involved in using the system provided positive feedback on the disease screening process, particularly praising the seamless workflow from patient registration to image transmission and obtaining the final result. Results from a questionnaire completed by 12 participants indicated that most found the system easy, quick, and highly satisfactory. The study also revealed room for improvement in the AMD model, suggesting the need to enhance its training data. Furthermore, the performance of the glaucoma model grading could be improved by incorporating additional measures such as intraocular pressure. CONCLUSIONS The implementation of the AI-based approach for screening three chronic eye diseases proved effective in real-world settings, earning positive feedback on the usability of the integrated platform from both the screening staff and auditors. The auditing function has proven valuable for obtaining efficient second opinions from experts, pointing to its potential for enhancing remote screening capabilities. TRIAL REGISTRATION Institutional Review Board of the Hamburg Medical Chamber (Ethik-Kommission der Ärztekammer Hamburg): 2021-10574-BO-ff.
Collapse
Affiliation(s)
- Christos Skevas
- Department of Ophthalmology, University Medical Center Hamburg - Eppendorf, Martinistr. 52, 20249, Hamburg, Germany
| | | | - Albert Lleó
- TeleMedC GmbH, Raboisen 32, 20095, Hamburg, Germany
| | - David Thiwa
- Department of Otorhinolaryngology, University Medical Center Hamburg - Eppendorf, Martinistr. 52, 20249, Hamburg, Germany
| | - Ulrike Schroeter
- Department of Ophthalmology, University Medical Center Hamburg - Eppendorf, Martinistr. 52, 20249, Hamburg, Germany
| | - Inês Valente Lopes
- Department of Ophthalmology, University Medical Center Hamburg - Eppendorf, Martinistr. 52, 20249, Hamburg, Germany.
| | - Luca Mautone
- Department of Ophthalmology, University Medical Center Hamburg - Eppendorf, Martinistr. 52, 20249, Hamburg, Germany
| | - Stephan J Linke
- Zentrum Sehestaerke, Martinistraße 64, 20251, Hamburg, Germany
| | - Martin Stephan Spitzer
- Department of Ophthalmology, University Medical Center Hamburg - Eppendorf, Martinistr. 52, 20249, Hamburg, Germany
| | - Daniel Yap
- TeleMedC Pty Ltd, 61 Ubi Avenue 1, #06-11 UBPoint, Singapore, 40894, Singapore
| | - Di Xiao
- TeleMedC Pty Ltd, Brisbane Technology Park, Level 2, 1 Westlink Court, Darra, QLD 4076, Australia
| |
Collapse
|
37
|
Kawasaki R. How Can Artificial Intelligence Be Implemented Effectively in Diabetic Retinopathy Screening in Japan? MEDICINA (KAUNAS, LITHUANIA) 2024; 60:243. [PMID: 38399532 PMCID: PMC10890175 DOI: 10.3390/medicina60020243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/06/2024] [Revised: 01/26/2024] [Accepted: 01/29/2024] [Indexed: 02/25/2024]
Abstract
Diabetic retinopathy (DR) is a major microvascular complication of diabetes, affecting a substantial portion of diabetic patients worldwide. Timely intervention is pivotal in mitigating the risk of blindness associated with DR, yet early detection remains a challenge due to the absence of early symptoms. Screening programs have emerged as a strategy to address this burden, and this paper delves into the role of artificial intelligence (AI) in advancing DR screening in Japan. There are two pathways for DR screening in Japan: a health screening pathway and a clinical referral path from physicians to ophthalmologists. AI technologies that realize automated image classification by applying deep learning are emerging. These technologies have exhibited substantial promise, achieving sensitivity and specificity levels exceeding 90% in prospective studies. Moreover, we introduce the potential of Generative AI and large language models (LLMs) to transform healthcare delivery, particularly in patient engagement, medical records, and decision support. Considering the use of AI in DR screening in Japan, we propose to follow a seven-step framework for systematic screening and emphasize the importance of integrating AI into a well-designed screening program. Automated scoring systems with AI enhance screening quality, but their effectiveness depends on their integration into the broader screening ecosystem. LLMs emerge as an important tool to fill gaps in the screening process, from personalized invitations to reporting results, facilitating a seamless and efficient system. However, it is essential to address concerns surrounding technical accuracy and governance before full-scale integration into the healthcare system. In conclusion, this review highlights the challenges in the current screening pathway and the potential for AI, particularly LLM, to revolutionize DR screening in Japan. The future direction will depend on leadership from ophthalmologists and stakeholders to address long-standing challenges in DR screening so that all people have access to accessible and effective screening.
Collapse
Affiliation(s)
- Ryo Kawasaki
- Division of Public Health, Department of Social Medicine, Graduate School of Medicine, Osaka University, Suita 565-0871, Japan;
- Artificial Intelligence Center for Medical Research and Application, Osaka University Hospital, Suita 565-0871, Japan
| |
Collapse
|
38
|
Badge A, Chandankhede M, Gajbe U, Bankar NJ, Bandre GR. Employment of Small-Group Discussions to Ensure the Effective Delivery of Medical Education. Cureus 2024; 16:e52655. [PMID: 38380198 PMCID: PMC10877665 DOI: 10.7759/cureus.52655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Accepted: 01/21/2024] [Indexed: 02/22/2024] Open
Abstract
The changing landscape of medical education has made small-group discussions crucial components. These sessions, including problem-based learning (PBL), case-based learning (CBL), and team-based learning (TBL), revolutionize learning by fostering active participation, critical thinking, and practical skills application. They bridge theory with practice, preparing future healthcare professionals for the dynamic challenges of modern healthcare. Despite their transformative potential, there are challenges in faculty preparation, resource allocation, and effective evaluation. The best practices include aligning discussions with curriculum goals, skilled facilitation, promoting active participation, and robust assessment strategies. Looking ahead, adapting to emerging health trends, ongoing research, and evolving healthcare demands will ensure the continued relevance and effectiveness of small-group discussions, shaping competent and adaptable healthcare providers equipped for the ever-evolving healthcare landscape.
Collapse
Affiliation(s)
- Ankit Badge
- Microbiology, Datta Meghe Medical College, Datta Meghe Institute of Higher Education and Research, Nagpur, IND
| | - Manju Chandankhede
- Biochemistry, Datta Meghe Medical College, Datta Meghe Institute of Higher Education and Research, Nagpur, IND
| | - Ujwal Gajbe
- Anatomy, Datta Meghe Medical College, Datta Meghe Institute of Higher Education and Research, Nagpur, IND
| | - Nandkishor J Bankar
- Microbiology, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| | - Gulshan R Bandre
- Microbiology, Jawaharlal Nehru Medical College, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| |
Collapse
|
39
|
Talcott KE, Valentim CCS, Perkins SW, Ren H, Manivannan N, Zhang Q, Bagherinia H, Lee G, Yu S, D'Souza N, Jarugula H, Patel K, Singh RP. Automated Detection of Abnormal Optical Coherence Tomography B-scans Using a Deep Learning Artificial Intelligence Neural Network Platform. Int Ophthalmol Clin 2024; 64:115-127. [PMID: 38146885 DOI: 10.1097/iio.0000000000000519] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2023]
|
40
|
Than J, Sim PY, Muttuvelu D, Ferraz D, Koh V, Kang S, Huemer J. Teleophthalmology and retina: a review of current tools, pathways and services. Int J Retina Vitreous 2023; 9:76. [PMID: 38053188 PMCID: PMC10699065 DOI: 10.1186/s40942-023-00502-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Accepted: 10/02/2023] [Indexed: 12/07/2023] Open
Abstract
Telemedicine, the use of telecommunication and information technology to deliver healthcare remotely, has evolved beyond recognition since its inception in the 1970s. Advances in telecommunication infrastructure, the advent of the Internet, exponential growth in computing power and associated computer-aided diagnosis, and medical imaging developments have created an environment where telemedicine is more accessible and capable than ever before, particularly in the field of ophthalmology. Ever-increasing global demand for ophthalmic services due to population growth and ageing together with insufficient supply of ophthalmologists requires new models of healthcare provision integrating telemedicine to meet present day challenges, with the recent COVID-19 pandemic providing the catalyst for the widespread adoption and acceptance of teleophthalmology. In this review we discuss the history, present and future application of telemedicine within the field of ophthalmology, and specifically retinal disease. We consider the strengths and limitations of teleophthalmology, its role in screening, community and hospital management of retinal disease, patient and clinician attitudes, and barriers to its adoption.
Collapse
Affiliation(s)
- Jonathan Than
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK
| | - Peng Y Sim
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK
| | - Danson Muttuvelu
- Department of Ophthalmology, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
- MitØje ApS/Danske Speciallaeger Aps, Aarhus, Denmark
| | - Daniel Ferraz
- D'Or Institute for Research and Education (IDOR), São Paulo, Brazil
- Institute of Ophthalmology, University College London, London, UK
| | - Victor Koh
- Department of Ophthalmology, National University Hospital, Singapore, Singapore
| | - Swan Kang
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK
| | - Josef Huemer
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London, UK.
- Department of Ophthalmology and Optometry, Kepler University Hospital, Johannes Kepler University, Linz, Austria.
| |
Collapse
|
41
|
Chen JS, Lin MC, Yiu G, Thorne C, Kulasa K, Stewart J, Nudleman E, Freeby M, Han MA, Baxter SL. Barriers to Implementation of Teleretinal Diabetic Retinopathy Screening Programs Across the University of California. Telemed J E Health 2023; 29:1810-1818. [PMID: 37256712 PMCID: PMC10714257 DOI: 10.1089/tmj.2022.0489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 12/17/2022] [Accepted: 12/19/2022] [Indexed: 06/02/2023] Open
Abstract
Aim: To describe barriers to implementation of diabetic retinopathy (DR) teleretinal screening programs and artificial intelligence (AI) integration at the University of California (UC). Methods: Institutional representatives from UC Los Angeles, San Diego, San Francisco, Irvine, and Davis were surveyed for the year of their program's initiation, active status at the time of survey (December 2021), number of primary care clinics involved, screening image quality, types of eye providers, image interpretation turnaround time, and billing codes used. Representatives were asked to rate perceptions toward barriers to teleretinal DR screening and AI implementation using a 5-point Likert scale. Results: Four UC campuses had active DR teleretinal screening programs at the time of survey and screened between 246 and 2,123 patients at 1-6 clinics per campus. Sites reported variation between poor-quality photos (<5% to 15%) and average image interpretation time (1-5 days). Patient education, resource availability, and infrastructural support were identified as barriers to DR teleretinal screening. Cost and integration into existing technology infrastructures were identified as barriers to AI integration in DR screening. Conclusions: Despite the potential to increase access to care, there remain several barriers to widespread implementation of DR teleretinal screening. More research is needed to develop best practices to overcome these barriers.
Collapse
Affiliation(s)
- Jimmy S. Chen
- Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, California, USA
| | - Mark C. Lin
- Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, California, USA
| | - Glenn Yiu
- Department of Ophthalmology and Vision Science, University of California Davis Health, Sacramento, California, USA
| | - Christine Thorne
- Department of Family Medicine and Public Health, University of California San Diego, La Jolla, California, USA
| | - Kristen Kulasa
- Department of Endocrinology, University of California San Diego, La Jolla, California, USA
| | - Jay Stewart
- Department of Ophthalmology, University of California, San Francisco, San Francisco, California, USA
- Department of Ophthalmology, Zuckerberg San Francisco General Hospital and Trauma Center, San Francisco, California, USA
| | - Eric Nudleman
- Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, California, USA
| | - Matthew Freeby
- Department of Medicine, University of California Los Angeles, Los Angeles, California, USA
| | - Maria A. Han
- Department of Medicine, University of California Los Angeles, Los Angeles, California, USA
| | - Sally L. Baxter
- Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego, La Jolla, California, USA
- Health Department of Biomedical Informatics, University of California San Diego, La Jolla, California, USA
| |
Collapse
|
42
|
Dow ER, Khan NC, Chen KM, Mishra K, Perera C, Narala R, Basina M, Dang J, Kim M, Levine M, Phadke A, Tan M, Weng K, Do DV, Moshfeghi DM, Mahajan VB, Mruthyunjaya P, Leng T, Myung D. AI-Human Hybrid Workflow Enhances Teleophthalmology for the Detection of Diabetic Retinopathy. OPHTHALMOLOGY SCIENCE 2023; 3:100330. [PMID: 37449051 PMCID: PMC10336195 DOI: 10.1016/j.xops.2023.100330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Revised: 05/04/2023] [Accepted: 05/08/2023] [Indexed: 07/18/2023]
Abstract
Objective Detection of diabetic retinopathy (DR) outside of specialized eye care settings is an important means of access to vision-preserving health maintenance. Remote interpretation of fundus photographs acquired in a primary care or other nonophthalmic setting in a store-and-forward manner is a predominant paradigm of teleophthalmology screening programs. Artificial intelligence (AI)-based image interpretation offers an alternative means of DR detection. IDx-DR (Digital Diagnostics Inc) is a Food and Drug Administration-authorized autonomous testing device for DR. We evaluated the diagnostic performance of IDx-DR compared with human-based teleophthalmology over 2 and a half years. Additionally, we evaluated an AI-human hybrid workflow that combines AI-system evaluation with human expert-based assessment for referable cases. Design Prospective cohort study and retrospective analysis. Participants Diabetic patients ≥ 18 years old without a prior DR diagnosis or DR examination in the past year presenting for routine DR screening in a primary care clinic. Methods Macula-centered and optic nerve-centered fundus photographs were evaluated by an AI algorithm followed by consensus-based overreading by retina specialists at the Stanford Ophthalmic Reading Center. Detection of more-than-mild diabetic retinopathy (MTMDR) was compared with in-person examination by a retina specialist. Main Outcome Measures Sensitivity, specificity, accuracy, positive predictive value, and gradability achieved by the AI algorithm and retina specialists. Results The AI algorithm had higher sensitivity (95.5% sensitivity; 95% confidence interval [CI], 86.7%-100%) but lower specificity (60.3% specificity; 95% CI, 47.7%-72.9%) for detection of MTMDR compared with remote image interpretation by retina specialists (69.5% sensitivity; 95% CI, 50.7%-88.3%; 96.9% specificity; 95% CI, 93.5%-100%). Gradability of encounters was also lower for the AI algorithm (62.5%) compared with retina specialists (93.1%). A 2-step AI-human hybrid workflow in which the AI algorithm initially rendered an assessment followed by overread by a retina specialist of MTMDR-positive encounters resulted in a sensitivity of 95.5% (95% CI, 86.7%-100%) and a specificity of 98.2% (95% CI, 94.6%-100%). Similarly, a 2-step overread by retina specialists of AI-ungradable encounters improved gradability from 63.5% to 95.6% of encounters. Conclusions Implementation of an AI-human hybrid teleophthalmology workflow may both decrease reliance on human specialist effort and improve diagnostic accuracy. Financial Disclosures Proprietary or commercial disclosure may be found after the references.
Collapse
Affiliation(s)
- Eliot R. Dow
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
- Veterans Affairs Palo Alto Health Care System, Palo Alto, California
| | - Nergis C. Khan
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Karen M. Chen
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Kapil Mishra
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Chandrashan Perera
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Ramsudha Narala
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Marina Basina
- Stanford Healthcare, Stanford University, Palo Alto, California
| | - Jimmy Dang
- Stanford Healthcare, Stanford University, Palo Alto, California
| | - Michael Kim
- Stanford Healthcare, Stanford University, Palo Alto, California
| | - Marcie Levine
- Stanford Healthcare, Stanford University, Palo Alto, California
| | - Anuradha Phadke
- Stanford Healthcare, Stanford University, Palo Alto, California
| | - Marilyn Tan
- Stanford Healthcare, Stanford University, Palo Alto, California
| | - Kirsti Weng
- Stanford Healthcare, Stanford University, Palo Alto, California
| | - Diana V. Do
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Darius M. Moshfeghi
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Vinit B. Mahajan
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
- Veterans Affairs Palo Alto Health Care System, Palo Alto, California
| | - Prithvi Mruthyunjaya
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - Theodore Leng
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| | - David Myung
- Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California
| |
Collapse
|
43
|
Osborne D, Steele A, Evans M, Ellis H, Pancholi R, Harding T, Dee J, Leary R, Bradshaw J, O'Flynn E, Self JE. Children's visual acuity tests without professional supervision: a prospective repeated measures study. Eye (Lond) 2023; 37:3762-3767. [PMID: 37328509 PMCID: PMC10697985 DOI: 10.1038/s41433-023-02597-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 04/11/2023] [Accepted: 05/19/2023] [Indexed: 06/18/2023] Open
Abstract
BACKGROUND Home visual acuity tests could ease pressure on ophthalmic services by facilitating remote review of patients. Home tests may have further utility in giving service users frequent updates of vision outcomes during therapy, identifying vision problems in an asymptomatic population, and engaging stakeholders in therapy. METHODS Children attending outpatient clinics had visual acuity measured 3 times at the same appointment: Once by a registered orthoptist per clinical protocols, once by an orthoptist using a tablet-based visual acuity test (iSight Test Pro, Kay Pictures), and once by an unsupervised parent/carer using the tablet-based test. RESULTS In total, 42 children were recruited to the study. The mean age was 5.6 years (range 3.3 to 9.3 years). Median and interquartile ranges (IQR) for clinical standard, orthoptic-led and parent/carer-led iSight Test Pro visual acuity measurements were 0.155 (0.18 IQR), 0.180 (0.26 IQR), and 0.300 (0.33 IQR) logMAR respectively. The iSight Test Pro in the hands of parents/carers was significantly different from the standard of care measurements (P = 0.008). In the hands of orthoptists. There was no significant difference between orthoptists using the iSight Test Pro and standard of care (P = 0.289), nor between orthoptist iSight Test Pro and parents/carer iSight Test Pro measurements (P = 0.108). CONCLUSION This technique of unsupervised visual acuity measures for children is not comparable to clinical measures and is unlikely to be valuable to clinical decision making. Future work should focus on improving the accuracy of the test through better training, equipment/software or supervision/support.
Collapse
Affiliation(s)
- Daniel Osborne
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK.
- University of Southampton, Faculty of Medicine, Southampton, UK.
| | - Aimee Steele
- University of Southampton, Faculty of Medicine, Southampton, UK
| | - Megan Evans
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Helen Ellis
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Roshni Pancholi
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Tomos Harding
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Jessica Dee
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Rachel Leary
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Jeremy Bradshaw
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Elizabeth O'Flynn
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
| | - Jay E Self
- University Hospital Southampton NHS Foundation Trust, Department of Ophthalmology, Southampton, UK
- University of Southampton, Faculty of Medicine, Southampton, UK
| |
Collapse
|
44
|
Winkelman J, Nguyen D, vanSonnenberg E, Kirk A, Lieberman S. Artificial Intelligence (AI) in pediatric endocrinology. J Pediatr Endocrinol Metab 2023; 36:903-908. [PMID: 37589444 DOI: 10.1515/jpem-2023-0287] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Accepted: 08/03/2023] [Indexed: 08/18/2023]
Abstract
Artificial Intelligence (AI) is integrating itself throughout the medical community. AI's ability to analyze complex patterns and interpret large amounts of data will have considerable impact on all areas of medicine, including pediatric endocrinology. In this paper, we review and update the current studies of AI in pediatric endocrinology. Specific topics that are addressed include: diabetes management, bone growth, metabolism, obesity, and puberty. Becoming knowledgeable and comfortable with AI will assist pediatric endocrinologists, the goal of the paper.
Collapse
Affiliation(s)
| | - Diep Nguyen
- University of Arizona College of Medicine Phoenix, Phoenix, USA
| | - Eric vanSonnenberg
- University of Arizona College of Medicine Phoenix, Phoenix, USA
- From the Departments of Radiology, University of Arizona College of Medicine Phoenix, Phoenix, USA
- Student Affairs, University of Arizona College of Medicine Phoenix, Phoenix, USA
| | - Alison Kirk
- University of Arizona College of Medicine Phoenix, Phoenix, USA
- Student Affairs, University of Arizona College of Medicine Phoenix, Phoenix, USA
- Pediatrics, University of Arizona College of Medicine Phoenix, Phoenix, USA
| | - Steven Lieberman
- University of Arizona College of Medicine Phoenix, Phoenix, USA
- Internal Medicine (Division of Endocrinology), University of Arizona College of Medicine Phoenix, Phoenix, USA
| |
Collapse
|
45
|
Clark KK, Gutierrez J, Cody JR, Padilla BI. Implementation of Diabetic Retinopathy Screening in Adult Patients With Type 2 Diabetes in a Primary Care Setting. Clin Diabetes 2023; 42:223-231. [PMID: 38694241 PMCID: PMC11060615 DOI: 10.2337/cd23-0032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/04/2024]
Abstract
Diabetic retinopathy (DR) is a microvascular complication of type 2 diabetes and the leading cause of blindness globally. Although diabetes-related eye exams are widely recognized as an effective method for early detection of DR, which can help to prevent eventual vision loss, adherence to screening exams in the United States is suboptimal. This article describes a quality improvement project to increase DR screening rates and increase knowledge and awareness of DR in adults with type 2 diabetes in a primary care setting using mobile DR screening units. This project addressed gaps of care and demonstrated that primary care settings can increase access to DR screening through a patient-centered process and thereby help to prevent irreversible outcomes of DR and improve quality of life.
Collapse
|
46
|
van Breugel M, Fehrmann RSN, Bügel M, Rezwan FI, Holloway JW, Nawijn MC, Fontanella S, Custovic A, Koppelman GH. Current state and prospects of artificial intelligence in allergy. Allergy 2023; 78:2623-2643. [PMID: 37584170 DOI: 10.1111/all.15849] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 07/08/2023] [Accepted: 07/31/2023] [Indexed: 08/17/2023]
Abstract
The field of medicine is witnessing an exponential growth of interest in artificial intelligence (AI), which enables new research questions and the analysis of larger and new types of data. Nevertheless, applications that go beyond proof of concepts and deliver clinical value remain rare, especially in the field of allergy. This narrative review provides a fundamental understanding of the core concepts of AI and critically discusses its limitations and open challenges, such as data availability and bias, along with potential directions to surmount them. We provide a conceptual framework to structure AI applications within this field and discuss forefront case examples. Most of these applications of AI and machine learning in allergy concern supervised learning and unsupervised clustering, with a strong emphasis on diagnosis and subtyping. A perspective is shared on guidelines for good AI practice to guide readers in applying it effectively and safely, along with prospects of field advancement and initiatives to increase clinical impact. We anticipate that AI can further deepen our knowledge of disease mechanisms and contribute to precision medicine in allergy.
Collapse
Affiliation(s)
- Merlijn van Breugel
- Department of Pediatric Pulmonology and Pediatric Allergology, Beatrix Children's Hospital, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- Groningen Research Institute for Asthma and COPD (GRIAC), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- MIcompany, Amsterdam, the Netherlands
| | - Rudolf S N Fehrmann
- Department of Medical Oncology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | | | - Faisal I Rezwan
- Human Development and Health, Faculty of Medicine, University of Southampton, Southampton, UK
- Department of Computer Science, Aberystwyth University, Aberystwyth, UK
| | - John W Holloway
- Human Development and Health, Faculty of Medicine, University of Southampton, Southampton, UK
- National Institute for Health and Care Research Southampton Biomedical Research Centre, University Hospitals Southampton NHS Foundation Trust, Southampton, UK
| | - Martijn C Nawijn
- Groningen Research Institute for Asthma and COPD (GRIAC), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- Department of Pathology and Medical Biology, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Sara Fontanella
- National Heart and Lung Institute, Imperial College London, London, UK
- National Institute for Health and Care Research Imperial Biomedical Research Centre (BRC), London, UK
| | - Adnan Custovic
- National Heart and Lung Institute, Imperial College London, London, UK
- National Institute for Health and Care Research Imperial Biomedical Research Centre (BRC), London, UK
| | - Gerard H Koppelman
- Department of Pediatric Pulmonology and Pediatric Allergology, Beatrix Children's Hospital, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- Groningen Research Institute for Asthma and COPD (GRIAC), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| |
Collapse
|
47
|
Le JP, Shashikumar SP, Malhotra A, Nemati S, Wardi G. Making the Improbable Possible: Generalizing Models Designed for a Syndrome-Based, Heterogeneous Patient Landscape. Crit Care Clin 2023; 39:751-768. [PMID: 37704338 PMCID: PMC10758922 DOI: 10.1016/j.ccc.2023.02.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/15/2023]
Abstract
Syndromic conditions, such as sepsis, are commonly encountered in the intensive care unit. Although these conditions are easy for clinicians to grasp, these conditions may limit the performance of machine-learning algorithms. Individual hospital practice patterns may limit external generalizability. Data missingness is another barrier to optimal algorithm performance and various strategies exist to mitigate this. Recent advances in data science, such as transfer learning, conformal prediction, and continual learning, may improve generalizability of machine-learning algorithms in critically ill patients. Randomized trials with these approaches are indicated to demonstrate improvements in patient-centered outcomes at this point.
Collapse
Affiliation(s)
- Joshua Pei Le
- School of Medicine, University of Limerick, Castletroy, Co, Limerick V94 T9PX, Ireland
| | | | - Atul Malhotra
- Division of Pulmonary, Critical Care and Sleep Medicine, University of California San Diego, San Diego, CA, USA
| | - Shamim Nemati
- Division of Biomedical Informatics, University of California San Diego, San Diego, CA, USA
| | - Gabriel Wardi
- Division of Pulmonary, Critical Care and Sleep Medicine, University of California San Diego, San Diego, CA, USA; Department of Emergency Medicine, University of California San Diego, 200 W Arbor Drive, San Diego, CA 92103, USA.
| |
Collapse
|
48
|
Okita Y, Hirano T, Wang B, Nakashima Y, Minoda S, Nagahara H, Kumanogoh A. Automatic evaluation of atlantoaxial subluxation in rheumatoid arthritis by a deep learning model. Arthritis Res Ther 2023; 25:181. [PMID: 37749583 PMCID: PMC10518918 DOI: 10.1186/s13075-023-03172-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Accepted: 09/13/2023] [Indexed: 09/27/2023] Open
Abstract
BACKGROUND This work aims to develop a deep learning model, assessing atlantoaxial subluxation (AAS) in rheumatoid arthritis (RA), which can often be ambiguous in clinical practice. METHODS We collected 4691 X-ray images of the cervical spine of the 906 patients with RA. Among these images, 3480 were used for training the deep learning model, 803 were used for validating the model during the training process, and the remaining 408 were used for testing the performance of the trained model. The two-dimensional key points' detection model of Deep High-Resolution Representation Learning for Human Pose Estimation was adopted as the base convolutional neural network model. The model inferred four coordinates to calculate the atlantodental interval (ADI) and space available for the spinal cord (SAC). Finally, these values were compared with those by clinicians to evaluate the performance of the model. RESULTS Among the 408 cervical images for testing the performance, the trained model correctly identified the four coordinates in 99.5% of the dataset. The values of ADI and SAC were positively correlated among the model and two clinicians. The sensitivity of AAS diagnosis with ADI or SAC by the model was 0.86 and 0.97 respectively. The specificity of that was 0.57 and 0.5 respectively. CONCLUSIONS We present the development of a deep learning model for the evaluation of cervical lesions of patients with RA. The model was demonstrably shown to be useful for quantitative evaluation.
Collapse
Affiliation(s)
- Yasutaka Okita
- Department of Respiratory Medicine and Clinical Immunology, Osaka University Graduate School of Medicine, 2-2, Yamadaoka, Suita, Osaka, 565-0871, Japan.
| | - Toru Hirano
- Department of Rheumatology, Nishinomiya Municipal Central Hospital, Hyogo, Japan
| | - Bowen Wang
- Osaka University Institute for Datability Science (IDS), Suita, Osaka, Japan
| | - Yuta Nakashima
- Osaka University Institute for Datability Science (IDS), Suita, Osaka, Japan
| | - Saki Minoda
- Department of Respiratory Medicine and Clinical Immunology, Osaka University Graduate School of Medicine, 2-2, Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Hajime Nagahara
- Osaka University Institute for Datability Science (IDS), Suita, Osaka, Japan
| | - Atsushi Kumanogoh
- Department of Respiratory Medicine and Clinical Immunology, Osaka University Graduate School of Medicine, 2-2, Yamadaoka, Suita, Osaka, 565-0871, Japan
- Laboratory of Immunopathology, World Premier International Immunology Frontier Research Center, Osaka University, Suita, Osaka, Japan
- The Institute for Open and Transdisciplinary Research Initiatives (OTRI), Osaka, Japan
| |
Collapse
|
49
|
Zhelev Z, Peters J, Rogers M, Allen M, Kijauskaite G, Seedat F, Wilkinson E, Hyde C. Test accuracy of artificial intelligence-based grading of fundus images in diabetic retinopathy screening: A systematic review. J Med Screen 2023; 30:97-112. [PMID: 36617971 PMCID: PMC10399100 DOI: 10.1177/09691413221144382] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 11/14/2022] [Accepted: 11/18/2022] [Indexed: 01/10/2023]
Abstract
OBJECTIVES To systematically review the accuracy of artificial intelligence (AI)-based systems for grading of fundus images in diabetic retinopathy (DR) screening. METHODS We searched MEDLINE, EMBASE, the Cochrane Library and the ClinicalTrials.gov from 1st January 2000 to 27th August 2021. Accuracy studies published in English were included if they met the pre-specified inclusion criteria. Selection of studies for inclusion, data extraction and quality assessment were conducted by one author with a second reviewer independently screening and checking 20% of titles. Results were analysed narratively. RESULTS Forty-three studies evaluating 15 deep learning (DL) and 4 machine learning (ML) systems were included. Nine systems were evaluated in a single study each. Most studies were judged to be at high or unclear risk of bias in at least one QUADAS-2 domain. Sensitivity for referable DR and higher grades was ≥85% while specificity varied and was <80% for all ML systems and in 6/31 studies evaluating DL systems. Studies reported high accuracy for detection of ungradable images, but the latter were analysed and reported inconsistently. Seven studies reported that AI was more sensitive but less specific than human graders. CONCLUSIONS AI-based systems are more sensitive than human graders and could be safe to use in clinical practice but have variable specificity. However, for many systems evidence is limited, at high risk of bias and may not generalise across settings. Therefore, pre-implementation assessment in the target clinical pathway is essential to obtain reliable and applicable accuracy estimates.
Collapse
Affiliation(s)
- Zhivko Zhelev
- Exeter Test Group, University of Exeter Medical School, University of Exeter, Exeter, UK
| | - Jaime Peters
- Exeter Test Group, University of Exeter Medical School, University of Exeter, Exeter, UK
| | - Morwenna Rogers
- NIHR ARC South West Peninsula (PenARC), University of Exeter Medical School, University of Exeter, Exeter, UK
| | - Michael Allen
- University of Exeter Medical School, University of Exeter, Exeter, UK
| | | | | | | | - Christopher Hyde
- Exeter Test Group, University of Exeter Medical School, University of Exeter, Exeter, UK
| |
Collapse
|
50
|
Chou YB, Kale AU, Lanzetta P, Aslam T, Barratt J, Danese C, Eldem B, Eter N, Gale R, Korobelnik JF, Kozak I, Li X, Li X, Loewenstein A, Ruamviboonsuk P, Sakamoto T, Ting DS, van Wijngaarden P, Waldstein SM, Wong D, Wu L, Zapata MA, Zarranz-Ventura J. Current status and practical considerations of artificial intelligence use in screening and diagnosing retinal diseases: Vision Academy retinal expert consensus. Curr Opin Ophthalmol 2023; 34:403-413. [PMID: 37326222 PMCID: PMC10399944 DOI: 10.1097/icu.0000000000000979] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
PURPOSE OF REVIEW The application of artificial intelligence (AI) technologies in screening and diagnosing retinal diseases may play an important role in telemedicine and has potential to shape modern healthcare ecosystems, including within ophthalmology. RECENT FINDINGS In this article, we examine the latest publications relevant to AI in retinal disease and discuss the currently available algorithms. We summarize four key requirements underlining the successful application of AI algorithms in real-world practice: processing massive data; practicability of an AI model in ophthalmology; policy compliance and the regulatory environment; and balancing profit and cost when developing and maintaining AI models. SUMMARY The Vision Academy recognizes the advantages and disadvantages of AI-based technologies and gives insightful recommendations for future directions.
Collapse
Affiliation(s)
- Yu-Bai Chou
- Department of Ophthalmology, Taipei Veterans General Hospital
- School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Aditya U. Kale
- Academic Unit of Ophthalmology, Institute of Inflammation & Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Paolo Lanzetta
- Department of Medicine – Ophthalmology, University of Udine
- Istituto Europeo di Microchirurgia Oculare, Udine, Italy
| | - Tariq Aslam
- Division of Pharmacy and Optometry, Faculty of Biology, Medicine and Health, University of Manchester School of Health Sciences, Manchester, UK
| | - Jane Barratt
- International Federation on Ageing, Toronto, Canada
| | - Carla Danese
- Department of Medicine – Ophthalmology, University of Udine
- Department of Ophthalmology, AP-HP Hôpital Lariboisière, Université Paris Cité, Paris, France
| | - Bora Eldem
- Department of Ophthalmology, Hacettepe University, Ankara, Turkey
| | - Nicole Eter
- Department of Ophthalmology, University of Münster Medical Center, Münster, Germany
| | - Richard Gale
- Department of Ophthalmology, York Teaching Hospital NHS Foundation Trust, York, UK
| | - Jean-François Korobelnik
- Service d’ophtalmologie, CHU Bordeaux
- University of Bordeaux, INSERM, BPH, UMR1219, F-33000 Bordeaux, France
| | - Igor Kozak
- Moorfields Eye Hospital Centre, Abu Dhabi, UAE
| | - Xiaorong Li
- Tianjin Key Laboratory of Retinal Functions and Diseases, Tianjin Branch of National Clinical Research Center for Ocular Disease, Eye Institute and School of Optometry, Tianjin Medical University Eye Hospital, Tianjin
| | - Xiaoxin Li
- Xiamen Eye Center, Xiamen University, Xiamen, China
| | - Anat Loewenstein
- Division of Ophthalmology, Tel Aviv Sourasky Medical Center, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Paisan Ruamviboonsuk
- Department of Ophthalmology, College of Medicine, Rangsit University, Rajavithi Hospital, Bangkok, Thailand
| | - Taiji Sakamoto
- Department of Ophthalmology, Kagoshima University, Kagoshima, Japan
| | - Daniel S.W. Ting
- Singapore National Eye Center, Duke-NUS Medical School, Singapore
| | - Peter van Wijngaarden
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, Australia
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Victoria, Australia
| | | | - David Wong
- Unity Health Toronto – St. Michael's Hospital, University of Toronto, Toronto, Canada
| | - Lihteh Wu
- Macula, Vitreous and Retina Associates of Costa Rica, San José, Costa Rica
| | | | | |
Collapse
|