1
|
Badr S, Tahri M, Maanan M, Kašpar J, Yousfi N. An intelligent decision-making system for embryo transfer in reproductive technology: a machine learning-based approach. Syst Biol Reprod Med 2025; 71:13-28. [PMID: 39873464 DOI: 10.1080/19396368.2024.2445831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Revised: 11/04/2024] [Accepted: 12/15/2024] [Indexed: 01/30/2025]
Abstract
Infertility has emerged as a significant public health concern, with assisted reproductive technology (ART) is a last-resort treatment option. However, ART's efficacy is limited by significant financial cost and physical discomfort. The aim of this study is to build Machine learning (ML) decision-support models to predict the optimal range of embryo numbers to transfer, using data from infertile couples identified through literature reviews. Binary classification models were developed to classify cases into two groups: those transferring two or fewer embryos and those transferring three or four. Four popular ML algorithms were used, including random forest (RF), logistic regression (LR), support vector machine (SVM), and artificial neural network (ANN), considering seven criteria: the woman's age, sperm origin, the developmental qualities of four potential embryos, infertility duration, assessment of the woman, morphological qualities of the four best embryos on the day of transfer, and number of oocytes extracted. The stratified 3-fold cross-validation results show that the SVM model obtained the highest average accuracy (95.83%) and demonstrated the best overall performance, closely followed by the ANN and LR models with an average accuracy equal to 91.67%. The RF model achieved a slightly lower average accuracy (88.89%), which demonstrated the lowest variability. Testing on a new dataset revealed all models performed well, with ANN and SVM models classified all test set instances correctly, while the RF and LR models achieved 91.68% accuracy. These results highlight the superior generalization and effectiveness of the ANN and SVM models in guiding ART decisions.
Collapse
Affiliation(s)
- Sanaa Badr
- Department of Mathematics and Computer Science, Laboratory of Analysis, Modeling and Simulation, Faculty of Sciences Ben M'sik, Hassan II University of Casablanca, Casablanca, Morocco
| | - Meryem Tahri
- Faculty of Forestry and Wood Sciences, Czech University of Life Sciences Prague (CZU), Praha-Suchdol, Czech Republic
| | - Mohamed Maanan
- Laboratory of Littoral, Environment, Remote Sensing and Geomatic (LETG) - UMR6554, Universit´e de Nantes, Nantes, France
| | - Jan Kašpar
- Faculty of Forestry and Wood Sciences, Czech University of Life Sciences Prague (CZU), Praha-Suchdol, Czech Republic
| | - Noura Yousfi
- Department of Mathematics and Computer Science, Laboratory of Analysis, Modeling and Simulation, Faculty of Sciences Ben M'sik, Hassan II University of Casablanca, Casablanca, Morocco
| |
Collapse
|
2
|
Zecca F, Faa G, Sanfilippo R, Saba L. How to improve epidemiological trustworthiness concerning abdominal aortic aneurysms. Vascular 2025; 33:520-535. [PMID: 38842081 DOI: 10.1177/17085381241257747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2024]
Abstract
BackgroundResearch on degenerative abdominal aortic aneurysms (AAA) is hampered by complex pathophysiology, sub-optimal pre-clinical models, and lack of effective medical therapies. In addition, trustworthiness of existing epidemiological data is impaired by elements of ambiguity, inaccuracy, and inconsistency. Our aim is to foster debate concerning the trustworthiness of AAA epidemiological data and to discuss potential solutions.MethodsWe searched the literature from the last five decades for relevant epidemiological data concerning AAA development, rupture, and repair. We then discussed the main issues burdening existing AAA epidemiological figures and proposed suggestions potentially beneficial to AAA diagnosis, prognostication, and management.ResultsRecent data suggest a heterogeneous scenario concerning AAA epidemiology with rates markedly varying by country and study cohorts. Overall, AAA prevalence seems to be decreasing worldwide while mortality is apparently increasing regardless of recent improvements in aortic-repair techniques. Prevalence and mortality are decreasing in high-income countries, whereas low-income countries show an increase in both. However, several pieces of information are missing or outdated, thus systematic renewal is necessary. Current AAA definition and surgical criteria do not consider inter-individual variability of baseline aortic size, further decreasing their reliability.ConclusionsSwitching from flat aortic-size thresholds to relative aortic indices would improve epidemiological trustworthiness regarding AAAs. Aortometry standardization focusing on simplicity, univocity, and accuracy is crucial. A patient-tailored approach integrating clinical data, multi-adjusted indices, and imaging parameters is desirable. Several novel imaging modalities boast promising profiles for investigating the aortic wall. New contrast agents, computational analyses, and artificial intelligence-powered software could provide further improvements.
Collapse
Affiliation(s)
- Fabio Zecca
- Department of Radiology, University Hospital "D. Casula", Cagliari, Italy
| | - Gavino Faa
- Department of Pathology, University Hospital "D. Casula", Cagliari, Italy
| | - Roberto Sanfilippo
- Department of Vascular Surgery, University Hospital "D. Casula", Cagliari, Italy
| | - Luca Saba
- Department of Radiology, University Hospital "D. Casula", Cagliari, Italy
| |
Collapse
|
3
|
Roy S, Mincu D, Proleev L, Ghate C, Graves JS, Steiner DF, Hartsell FL, Heller K. Performance of machine learning models for predicting high-severity symptoms in multiple sclerosis. Sci Rep 2025; 15:18209. [PMID: 40414922 DOI: 10.1038/s41598-024-63888-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 06/03/2024] [Indexed: 05/27/2025] Open
Abstract
Current care in multiple sclerosis (MS) primarily relies on infrequently obtained data such as magnetic resonance imaging, clinical laboratory tests or clinical history, resulting in subtle changes that may occur between visits being missed. Mobile technology enables continual collection of data and can pave the path for predicting complex aspects of MS such as symptoms and disease courses. To this end, we conducted a first-of-its-kind observational study called MS Mosaic. First, we developed and publicly launched a mobile app for collecting longitudinal data from MS subjects in the United States. Second, we ran the study across 3 years in order to capture complex patterns for this slow progressing disease. Finally, we retrospectively developed three classical ML methods and two deep learning models to accurately and continually predict the incidence of five high-severity symptoms (fatigue, sensory disturbance, walking instability, depression or anxiety and cramps/spasms) three months in advance.
Collapse
Affiliation(s)
| | | | | | | | - Jennifer S Graves
- Department of Neurosciences, University of California, San Diego, San Diego, USA
| | | | | | | |
Collapse
|
4
|
Navasardyan V, Katz M, Goertz L, Zohranyan V, Navasardyan H, Shahzadi I, Kröger JR, Borggrefe J. Accuracy of segment anything model for classification of vascular stenosis in digital subtraction angiography. CVIR Endovasc 2025; 8:45. [PMID: 40388101 PMCID: PMC12089558 DOI: 10.1186/s42155-025-00560-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2025] [Accepted: 04/28/2025] [Indexed: 05/20/2025] Open
Abstract
BACKGROUND This retrospective study evaluates the diagnostic performance of an optimized comprehensive multi-stage framework based on the Segment Anything Model (SAM), which we named Dr-SAM, for detecting and grading vascular stenosis in the abdominal aorta and iliac arteries using digital subtraction angiography (DSA). MATERIALS AND METHODS A total of 100 DSA examinations were conducted on 100 patients. The infrarenal abdominal aorta (AAI), common iliac arteries (CIA), and external iliac arteries (EIA) were independently evaluated by two experienced radiologists using a standardized 5-point grading scale. Dr-SAM analyzed the same DSA images, and its assessments were compared with the average stenosis grading provided by the radiologists. Diagnostic accuracy was evaluated using Cohen's kappa, specificity, sensitivity, and Wilcoxon signed-rank tests. RESULTS Interobserver agreement between radiologists, which established the reference standard, was strong (Cohen's kappa: CIA right = 0.95, CIA left = 0.94, EIA right = 0.98, EIA left = 0.98, AAI = 0.79). Dr-SAM showed high agreement with radiologist consensus for CIA (κ = 0.93 right, 0.91 left), moderate agreement for EIA (κ = 0.79 right, 0.76 left), and fair agreement for AAI (κ = 0.70). Dr-SAM demonstrated excellent specificity (up to 1.0) and robust sensitivity (0.67-0.83). Wilcoxon tests revealed no significant differences between Dr-SAM and radiologist grading (p > 0.05). CONCLUSION Dr-SAM proved to be an accurate and efficient tool for vascular assessment, with the potential to streamline diagnostic workflows and reduce variability in stenosis grading. Its ability to deliver rapid and consistent evaluations may contribute to earlier detection of disease and the optimization of treatment strategies. Further studies are needed to confirm these findings in prospective settings and to enhance its capabilities, particularly in the detection of occlusions.
Collapse
Affiliation(s)
- Vagner Navasardyan
- Department of Radiology, Neuroradiology and Nuclear Medicine, Johannes Wesling University Hospital, Hans-Nolte-Straße 1, 32429, Minden, Germany.
- Ruhr University Bochum, Universitätsstraße 150, 44801, Bochum, Germany.
| | - Maria Katz
- Department of Radiology, Neuroradiology and Nuclear Medicine, Johannes Wesling University Hospital, Hans-Nolte-Straße 1, 32429, Minden, Germany
| | - Lukas Goertz
- Department of Diagnostic and Interventional Radiology, Uniklinik Köln, Kerpener Str. 62, 50937, Cologne, Germany
| | | | | | - Iram Shahzadi
- Department of Radiology, Neuroradiology and Nuclear Medicine, Johannes Wesling University Hospital, Hans-Nolte-Straße 1, 32429, Minden, Germany
| | - Jan Robert Kröger
- Department of Radiology, Neuroradiology and Nuclear Medicine, Johannes Wesling University Hospital, Hans-Nolte-Straße 1, 32429, Minden, Germany
| | - Jan Borggrefe
- Department of Radiology, Neuroradiology and Nuclear Medicine, Johannes Wesling University Hospital, Hans-Nolte-Straße 1, 32429, Minden, Germany
| |
Collapse
|
5
|
Wang M, Zhang Z, Xu Z, Chen H, Hua M, Zeng S, Yue X, Xu C. Constructing different machine learning models for identifying pelvic lipomatosis based on AI-assisted CT image feature recognition. Abdom Radiol (NY) 2025; 50:1811-1821. [PMID: 39406992 DOI: 10.1007/s00261-024-04641-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2024] [Revised: 10/08/2024] [Accepted: 10/10/2024] [Indexed: 03/27/2025]
Affiliation(s)
- Maoyu Wang
- Shanghai Changhai Hospital, Naval Medical University, Shanghai, China
| | - Zheran Zhang
- Sino-European School of Technology, Shanghai University, Shanghai, China
| | - Zhikang Xu
- School of Computer and Information Technology, Shanxi University, Shanxi, China
| | - Haihu Chen
- Shanghai Changhai Hospital, Naval Medical University, Shanghai, China
| | - Meimian Hua
- Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shuxiong Zeng
- Shanghai Changhai Hospital, Naval Medical University, Shanghai, China
| | - Xiaodong Yue
- Technology Institute of Artificial Intelligence,Shanghai University, Shanghai, China
| | - Chuanliang Xu
- Shanghai Changhai Hospital, Naval Medical University, Shanghai, China.
- Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| |
Collapse
|
6
|
Rhee W, Park SC, Kim H, Chang BS, Chang SY. Deep learning-based prediction of cervical canal stenosis from mid-sagittal T2-weighted MRI. Skeletal Radiol 2025:10.1007/s00256-025-04917-2. [PMID: 40152984 DOI: 10.1007/s00256-025-04917-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/13/2025] [Revised: 03/12/2025] [Accepted: 03/15/2025] [Indexed: 03/30/2025]
Abstract
OBJECTIVE This study aims to establish a large degenerative cervical myelopathy cohort and develop deep learning models for predicting cervical canal stenosis from sagittal T2-weighted MRI. MATERIALS AND METHODS Data was collected retrospectively from patients who underwent a cervical spine MRI from January 2007 to December 2022 at a single institution. Ground truth labels for cervical canal stenosis were obtained from sagittal T2-weighted MRI using Kang's grade, a four-level scoring system that classifies stenosis with the degree of subarachnoid space obliteration and cord indentation. ResNet50, VGG16, MobileNetV3, and EfficientNetV2 were trained using threefold cross-validation, and the models exhibiting the largest area under the receiver operating characteristic curve (AUC) were selected to produce the ensemble model. Gradient-weighted class activation mapping was adopted for qualitative assessment. Models that incorporate demographic features were trained, and their corresponding AUCs on the test set were evaluated. RESULTS Of 8676 patients, 7645 were eligible for developing deep learning models, where 6880 (mean age, 56.0 ± 14.3 years, 3480 men) were used for training while 765 (mean age, 56.5 ± 14.4 years, 386 men) were set aside for testing. The ensemble model exhibited the largest AUC of 0.95 (0.94-0.97). Accuracy was 0.875 (0.851-0.898), sensitivity was 0.885 (0.855-0.915), and specificity was 0.861 (0.824-0.898). Qualitative analyses demonstrated that the models accurately pinpoint radiologic findings suggestive of cervical canal stenosis and myelopathy. Incorporation of demographic features did not result in a gain of AUC. CONCLUSION We have developed deep learning models from a large degenerative cervical myelopathy cohort and thoroughly explored their robustness and explainability.
Collapse
Affiliation(s)
- Wounsuk Rhee
- Ministry of Health and Welfare, Government of the Republic of Korea, 13, Doum 4-Ro, Sejong, 30113, Republic of Korea
- Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign, 201 N. Goodwin Avenue, Champaign, IL, 61801, USA
- Healthcare AI Research Institute, Seoul National University Hospital, 101, Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
| | - Sung Cheol Park
- Department of Orthopedic Surgery, Bumin Hospital Seoul, 389, Gonghang-daero, Gangseo-gu, Seoul, 07590, Republic of Korea
- Department of Orthopedic Surgery, Seoul National University College of Medicine, 103, Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
| | - Hyoungmin Kim
- Healthcare AI Research Institute, Seoul National University Hospital, 101, Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea.
- Department of Orthopedic Surgery, Seoul National University College of Medicine, 103, Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea.
- Department of Orthopedic Surgery, Seoul National University Hospital, 101, Daehak-Ro, Jongno-Gu, 03080, Seoul, Republic of Korea.
| | - Bong-Soon Chang
- Department of Orthopedic Surgery, Seoul National University College of Medicine, 103, Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
- Department of Orthopedic Surgery, Seoul National University Hospital, 101, Daehak-Ro, Jongno-Gu, 03080, Seoul, Republic of Korea
| | - Sam Yeol Chang
- Department of Orthopedic Surgery, Seoul National University College of Medicine, 103, Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
- Department of Orthopedic Surgery, Seoul National University Hospital, 101, Daehak-Ro, Jongno-Gu, 03080, Seoul, Republic of Korea
| |
Collapse
|
7
|
Kumari V, Katiyar A, Bhagawati M, Maindarkar M, Gupta S, Paul S, Chhabra T, Boi A, Tiwari E, Rathore V, Singh IM, Al-Maini M, Anand V, Saba L, Suri JS. Transformer and Attention-Based Architectures for Segmentation of Coronary Arterial Walls in Intravascular Ultrasound: A Narrative Review. Diagnostics (Basel) 2025; 15:848. [PMID: 40218198 PMCID: PMC11988294 DOI: 10.3390/diagnostics15070848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2025] [Revised: 03/08/2025] [Accepted: 03/20/2025] [Indexed: 04/14/2025] Open
Abstract
Background: The leading global cause of death is coronary artery disease (CAD), necessitating early and precise diagnosis. Intravascular ultrasound (IVUS) is a sophisticated imaging technique that provides detailed visualization of coronary arteries. However, the methods for segmenting walls in the IVUS scan into internal wall structures and quantifying plaque are still evolving. This study explores the use of transformers and attention-based models to improve diagnostic accuracy for wall segmentation in IVUS scans. Thus, the objective is to explore the application of transformer models for wall segmentation in IVUS scans to assess their inherent biases in artificial intelligence systems for improving diagnostic accuracy. Methods: By employing the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework, we pinpointed and examined the top strategies for coronary wall segmentation using transformer-based techniques, assessing their traits, scientific soundness, and clinical relevancy. Coronary artery wall thickness is determined by using the boundaries (inner: lumen-intima and outer: media-adventitia) through cross-sectional IVUS scans. Additionally, it is the first to investigate biases in deep learning (DL) systems that are associated with IVUS scan wall segmentation. Finally, the study incorporates explainable AI (XAI) concepts into the DL structure for IVUS scan wall segmentation. Findings: Because of its capacity to automatically extract features at numerous scales in encoders, rebuild segmented pictures via decoders, and fuse variations through skip connections, the UNet and transformer-based model stands out as an efficient technique for segmenting coronary walls in IVUS scans. Conclusions: The investigation underscores a deficiency in incentives for embracing XAI and pruned AI (PAI) models, with no UNet systems attaining a bias-free configuration. Shifting from theoretical study to practical usage is crucial to bolstering clinical evaluation and deployment.
Collapse
Affiliation(s)
- Vandana Kumari
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (A.K.)
| | - Alok Katiyar
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (A.K.)
| | - Mrinalini Bhagawati
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.B.); (S.P.)
| | - Mahesh Maindarkar
- School of Bioengineering Research and Sciences, MIT Art, Design and Technology University, Pune 412021, India;
| | - Siddharth Gupta
- Department of Computer Science and Engineering, Bharati Vidyapeeth’s College of Engineering, New Delhi 110063, India;
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (V.R.); (I.M.S.); (V.A.)
| | - Sudip Paul
- Department of Biomedical Engineering, North Eastern Hill University, Shillong 793022, India; (M.B.); (S.P.)
| | - Tisha Chhabra
- Department of Information Technology, Bharati Vidyapeeth’s College of Engineering, New Delhi 110063, India;
| | - Alberto Boi
- Department of Cardiology, University of Cagliari, 09124 Cagliari, Italy; (A.B.); (L.S.)
| | - Ekta Tiwari
- Department of Computer Science, Visvesvaraya National Institute of Technology (VNIT), Nagpur 440010, India;
| | - Vijay Rathore
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (V.R.); (I.M.S.); (V.A.)
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (V.R.); (I.M.S.); (V.A.)
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON M5G 1N8, Canada;
| | - Vinod Anand
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (V.R.); (I.M.S.); (V.A.)
| | - Luca Saba
- Department of Cardiology, University of Cagliari, 09124 Cagliari, Italy; (A.B.); (L.S.)
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA; (V.R.); (I.M.S.); (V.A.)
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
- Department of Computer Engineering, Graphic Era Deemed to be University, Dehradun 248002, India
- Symbiosis Institute of Technology, Nagpur Campus, Symbiosis International (Deemed University), Pune 440008, India
- University Centre for Research & Development, Chandigarh University, Mohali 140413, India
| |
Collapse
|
8
|
Kumar D, Mehta MA, Kotecha K, Kulkarni A. Computer-aided cholelithiasis diagnosis using explainable convolutional neural network. Sci Rep 2025; 15:4249. [PMID: 39905177 PMCID: PMC11794719 DOI: 10.1038/s41598-025-85798-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2024] [Accepted: 01/06/2025] [Indexed: 02/06/2025] Open
Abstract
Accurate and precise identification of cholelithiasis is essential for saving the lives of millions of people worldwide. Although several computer-aided cholelithiasis diagnosis approaches have been introduced in the literature, their use is limited because Convolutional Neural Network (CNN) models are black box in nature. Therefore, a novel approach for cholelithiasis classification using custom CNN with post-hoc model explanation is proposed. This paper presents multiple contributions. First, a custom CNN architecture is proposed to classify and predict cholelithiasis from ultrasound image. Second, a modified deep convolutional generative adversarial network is proposed to produce synthetic ultrasound images for better model generalization. Third, a hybrid visual explanation method is proposed by combining gradient-weighted class activation with local interpretable model agnostic explanation to generate a visual explanation using a heatmap. Fourth, an exhaustive performance analysis of the proposed approach on ultrasound images collected from three different Indian hospitals is presented to showcase its efficacy for computer-aided cholelithiasis diagnosis. Fifth, a team of radiologists evaluates and validates the prediction and respective visual explanations made using the proposed approach. The results reveal that the proposed cholelithiasis classification approach beats the performance of state-of-the-art pre-trained CNN and Vision Transformer models. The heatmap generated through the proposed hybrid explanation method offers detailed visual explanations to enhance transparency and trustworthiness in the medical domain.
Collapse
Affiliation(s)
- Dheeraj Kumar
- Department of Computer/IT Engineering, Gujarat Technological University, Ahmedabad, India.
- IT Department, Parul Institute of Engineering & Technology, Parul University, Vadodara, India.
| | - Mayuri A Mehta
- Department of Computer Engineering, Sarvajanik College of Engineering and Technology, Surat, India
| | - Ketan Kotecha
- Symbiosis Centre for Applied Artificial Intelligence, Symbiosis Institute of Technology, Symbiosis International University, Pune, India
- People's Friendship University of Russia Named After Patrice Lumumba (RUDN University), Moscow, Russian Federation
| | - Ambarish Kulkarni
- Computer Aided Engineering, School of Engineering, Swinburne University of Technology, Melbourne, Australia
| |
Collapse
|
9
|
Wollek A, Haitzer P, Sedlmeyr T, Hyska S, Rueckel J, Sabel BO, Ingrisch M, Lasser T. Language model-based labeling of German thoracic radiology reports. ROFO-FORTSCHR RONTG 2025; 197:55-64. [PMID: 38663428 DOI: 10.1055/a-2287-5054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
Abstract
The aim of this study was to explore the potential of weak supervision in a deep learning-based label prediction model. The goal was to use this model to extract labels from German free-text thoracic radiology reports on chest X-ray images and for training chest X-ray classification models.The proposed label extraction model for German thoracic radiology reports uses a German BERT encoder as a backbone and classifies a report based on the CheXpert labels. For investigating the efficient use of manually annotated data, the model was trained using manual annotations, weak rule-based labels, and both. Rule-based labels were extracted from 66071 retrospectively collected radiology reports from 2017-2021 (DS 0), and 1091 reports from 2020-2021 (DS 1) were manually labeled according to the CheXpert classes. Label extraction performance was evaluated with respect to mention extraction, negation detection, and uncertainty detection by measuring F1 scores. The influence of the label extraction method on chest X-ray classification was evaluated on a pneumothorax data set (DS 2) containing 6434 chest radiographs with associated reports and expert diagnoses of pneumothorax. For this, DenseNet-121 models trained on manual annotations, rule-based and deep learning-based label predictions, and publicly available data were compared.The proposed deep learning-based labeler (DL) performed on average considerably stronger than the rule-based labeler (RB) for all three tasks on DS 1 with F1 scores of 0.938 vs. 0.844 for mention extraction, 0.891 vs. 0.821 for negation detection, and 0.624 vs. 0.518 for uncertainty detection. Pre-training on DS 0 and fine-tuning on DS 1 performed better than only training on either DS 0 or DS 1. Chest X-ray pneumothorax classification results (DS 2) were highest when trained with DL labels with an area under the receiver operating curve (AUC) of 0.939 compared to RB labels with an AUC of 0.858. Training with manual labels performed slightly worse than training with DL labels with an AUC of 0.934. In contrast, training with a public data set resulted in an AUC of 0.720.Our results show that leveraging a rule-based report labeler for weak supervision leads to improved labeling performance. The pneumothorax classification results demonstrate that our proposed deep learning-based labeler can serve as a substitute for manual labeling requiring only 1000 manually annotated reports for training. · The proposed deep learning-based label extraction model for German thoracic radiology reports performs better than the rule-based model.. · Training with limited supervision outperformed training with a small manually labeled data set.. · Using predicted labels for pneumothorax classification from chest radiographs performed equally to using manual annotations.. Wollek A, Haitzer P, Sedlmeyr T et al. Language modelbased labeling of German thoracic radiology reports. Fortschr Röntgenstr 2024; DOI 10.1055/a-2287-5054.
Collapse
Affiliation(s)
- Alessandro Wollek
- Munich Institute of Biomedical Engineering, Technical University of Munich, Garching near Munich, Germany
- School of Computation, Information and Technology, Technical University of Munich, Garching near Munich, Germany
| | - Philip Haitzer
- Munich Institute of Biomedical Engineering, Technical University of Munich, Garching near Munich, Germany
- School of Computation, Information and Technology, Technical University of Munich, Garching near Munich, Germany
| | - Thomas Sedlmeyr
- Munich Institute of Biomedical Engineering, Technical University of Munich, Garching near Munich, Germany
- School of Computation, Information and Technology, Technical University of Munich, Garching near Munich, Germany
| | - Sardi Hyska
- Department of Radiology, Ludwig-Maximilians-University Hospital Munich, Germany, Munich, Germany
| | - Johannes Rueckel
- Department of Radiology, Ludwig-Maximilians-University Hospital Munich, Germany, Munich, Germany
- Institute of Neuroradiology, Ludwig-Maximilians-University Hospital Munich, Munich, Germany
| | - Bastian O Sabel
- Department of Radiology, Ludwig-Maximilians-University Hospital Munich, Germany, Munich, Germany
| | - Michael Ingrisch
- Department of Radiology, Ludwig-Maximilians-University Hospital Munich, Germany, Munich, Germany
| | - Tobias Lasser
- Munich Institute of Biomedical Engineering, Technical University of Munich, Garching near Munich, Germany
- School of Computation, Information and Technology, Technical University of Munich, Garching near Munich, Germany
| |
Collapse
|
10
|
Rathika S, Mahendran K, Sudarsan H, Ananth SV. Novel neural network classification of maternal fetal ultrasound planes through optimized feature selection. BMC Med Imaging 2024; 24:337. [PMID: 39696025 DOI: 10.1186/s12880-024-01453-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 10/04/2024] [Indexed: 12/20/2024] Open
Abstract
Ultrasound (US) imaging is an essential diagnostic technique in prenatal care, enabling enhanced surveillance of fetal growth and development. Fetal ultrasonography standard planes are crucial for evaluating fetal development parameters and detecting abnormalities. Real-time imaging, low cost, non-invasiveness, and accessibility make US imaging indispensable in clinical practice. However, acquiring fetal US planes with correct fetal anatomical features is a difficult and time-consuming task, even for experienced sonographers. Medical imaging using AI shows promise for addressing current challenges. In response to this challenge, a Deep Learning (DL)-based automated categorization method for maternal fetal US planes are introduced to enhance detection efficiency and diagnosis accuracy. This paper presents a hybrid optimization technique for feature selection and introduces a novel Radial Basis Function Neural Network (RBFNN) for reliable maternal fetal US plane classification. A large dataset of maternal-fetal screening US images was collected from publicly available sources and categorized into six groups: the four fetal anatomical planes, the mother's cervix, and an additional category. Feature extraction is performed using Gray-Level Co-occurrence Matrix (GLCM), and optimization methods such as Particle Swarm Optimization (PSO), Grey Wolf Optimization (GWO), and a hybrid Particle Swarm Optimization and Grey Wolf Optimization (PSOGWO) approach are utilized to select the most relevant features. The optimized features from each algorithm are then input into both conventional and proposed DL models. Experimental results indicate that the proposed approach surpasses conventional DL models in performance. Furthermore, the proposed model is evaluated against previously published models, showcasing its superior classification accuracy. In conclusion, our proposed approach provides a solid foundation for automating the classification of fetal US planes, leveraging optimization and DL techniques to enhance prenatal diagnosis and care.
Collapse
Affiliation(s)
- S Rathika
- Prince Shri Venkateshwara Padmavathy Engineering College, Chennai, India
| | - K Mahendran
- Saveetha Engineering College, Chennai, India.
| | - H Sudarsan
- K. Ramakrishnan College of Engineering, Trichy, India
| | | |
Collapse
|
11
|
Talib MA, Moufti MA, Nasir Q, Kabbani Y, Aljaghber D, Afadar Y. Transfer Learning-Based Classifier to Automate the Extraction of False X-Ray Images From Hospital's Database. Int Dent J 2024; 74:1471-1482. [PMID: 39232939 PMCID: PMC11551570 DOI: 10.1016/j.identj.2024.08.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 07/11/2024] [Accepted: 08/02/2024] [Indexed: 09/06/2024] Open
Abstract
BACKGROUND During preclinical training, dental students take radiographs of acrylic (plastic) blocks containing extracted patient teeth. With the digitisation of medical records, a central archiving system was created to store and retrieve all x-ray images, regardless of whether they were images of teeth on acrylic blocks, or those from patients. In the early stage of the digitisation process, and due to the immaturity of the data management system, numerous images were mixed up and stored in random locations within a unified archiving system, including patient record files. Filtering out and expunging the undesired training images is imperative as manual searching for such images is problematic. Hence the aim of this stidy was to differentiate intraoral images from artificial images on acrylic blocks. METHODS An artificial intelligence (AI) solution to automatically differentiate between intraoral radiographs taken of patients and those taken of acrylic blocks was utilised in this study. The concept of transfer learning was applied to a dataset provided by a Dental Hospital. RESULTS An accuracy score, F1 score, and a recall score of 98.8%, 99.2%, and 100%, respectively, were achieved using a VGG16 pre-trained model. These results were more sensitive compared to those obtained initally using a baseline model with 96.5%, 97.5%, and 98.9% accuracy score, F1 score, and a recall score respectively. CONCLUSIONS The proposed system using transfer learning was able to accurately identify "fake" radiographs images and distinguish them from the real intraoral images.
Collapse
Affiliation(s)
- Manar Abu Talib
- Department of Computer Engineering, College of Computing and Informatics, University of Sharjah, Sharjah, United Arab Emirates
| | - Mohammad Adel Moufti
- Department of Restorative Dentistry, College of Dental Medicine, University of Sharjah, Sharjah, United Arab Emirates.
| | - Qassim Nasir
- Department of Computer Science, College of Computing and Informatics, University of Sharjah, Sharjah, United Arab Emirates
| | - Yousuf Kabbani
- Department of Computer Science, College of Computing and Informatics, University of Sharjah, Sharjah, United Arab Emirates
| | - Dana Aljaghber
- Department of Restorative Dentistry, College of Dental Medicine, University of Sharjah, Sharjah, United Arab Emirates
| | - Yaman Afadar
- Department of Computer Science, College of Computing and Informatics, University of Sharjah, Sharjah, United Arab Emirates
| |
Collapse
|
12
|
Takeshita WM, Silva TP, de Souza LLT, Tenorio JM. State of the art and prospects for artificial intelligence in orthognathic surgery: A systematic review with meta-analysis. JOURNAL OF STOMATOLOGY, ORAL AND MAXILLOFACIAL SURGERY 2024; 125:101787. [PMID: 38302057 DOI: 10.1016/j.jormas.2024.101787] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 01/19/2024] [Accepted: 01/25/2024] [Indexed: 02/03/2024]
Abstract
OBJECTIVE To present a systematic review of the state of the art regarding clinical applications, main features, and outcomes of artificial intelligence (AI) in orthognathic surgery. METHODS The PICOS strategy was performed on a systematic review (SR) to answer the following question: "What are the state of the art, characteristics and outcomes of applications with artificial intelligence for orthognathic surgery?" After registering in PROSPERO (CRD42021270789) a systematic search was performed in the databases: PubMed (including MedLine), Scopus, Embase, LILACS, MEDLINE EBSCOHOST and Cochrane Library. 195 studies were selected, after screening titles and abstracts, of which thirteen manuscripts were included in the qualitative analysis and six in the quantitative analysis. The treatment effects were plotted in a Forest-plot. JBI questionnaire for observational studies was used to asses the risk of bias. The quality of the SR evidence was assessed using the GRADE tool. RESULTS AI studies on 2D cephalometry for orthognathic surgery, the Tau2 = 0.00, Chi2 = 3.78, p = 1.00 and I² of 0 %, indicating low heterogeneity, AI did not differ statistically from control (p = 0.79). AI studies in the diagnosis of the decision of whether or not to perform orthognathic surgery showed heterogeneity, and therefore meta-analysis was not peformed. CONCLUSION The outcome of AI is similar to the control group, with a low degree of bias, highlighting its potential for use in various applications.
Collapse
Affiliation(s)
- Wilton Mitsunari Takeshita
- Department of Diagnosis and Surgery, São Paulo State University (Unesp), School of Dentistry, Araçatuba, 16015-050 Araçatuba, São Paulo, Brazil
| | - Thaísa Pinheiro Silva
- Department of Oral Diagnosis, Division of Oral Radiology, Piracicaba Dental School, University of Campinas (UNICAMP), 13414-903 Piracicaba, Sao Paulo, Brazil.
| | | | - Josceli Maria Tenorio
- Department of Information technology and health, Federal Institute of São Paulo, 01109-010 São Paulo, São Paulo, Brazil
| |
Collapse
|
13
|
Altmann S, Grauhan NF, Mercado MAA, Steinmetz S, Kronfeld A, Paul R, Benkert T, Uphaus T, Groppa S, Winter Y, Brockmann MA, Othman AE. Deep Learning Accelerated Brain Diffusion-Weighted MRI with Super Resolution Processing. Acad Radiol 2024; 31:4171-4182. [PMID: 38521612 DOI: 10.1016/j.acra.2024.02.049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 02/20/2024] [Accepted: 02/26/2024] [Indexed: 03/25/2024]
Abstract
OBJECTIVES To investigate the clinical feasibility and image quality of accelerated brain diffusion-weighted imaging (DWI) with deep learning image reconstruction and super resolution. METHODS 85 consecutive patients with clinically indicated MRI at a 3 T scanner were prospectively included. Conventional diffusion-weighted data (c-DWI) with four averages were obtained. Reconstructions of one and two averages, as well as deep learning diffusion-weighted imaging (DL-DWI), were accomplished. Three experienced readers evaluated the acquired data using a 5-point Likert scale regarding overall image quality, overall contrast, diagnostic confidence, occurrence of artefacts and evaluation of the central region, basal ganglia, brainstem, and cerebellum. To assess interrater agreement, Fleiss' kappa (ϰ) was determined. Signal intensity (SI) levels for basal ganglia and the central region were estimated via automated segmentation, and SI values of detected pathologies were measured. RESULTS Intracranial pathologies were identified in 35 patients. DL-DWI was significantly superior for all defined parameters, independently from applied averages (p-value <0.001). Optimum image quality was achieved with DL-DWI by utilizing a single average (p-value <0.001), demonstrating very good (80.9%) to excellent image quality (14.5%) in nearly all cases, compared to 12.5% with very good and 0% with excellent image quality for c-MRI (p-value <0.001). Comparable results could be shown for diagnostic confidence. Inter-rater Fleiss' Kappa demonstrated moderate to substantial agreement for virtually all defined parameters, with good accordance, particularly for the assessment of pathologies (p = 0.74). Regarding SI values, no significant difference was found. CONCLUSION Ultra-fast diffusion-weighted imaging with super resolution is feasible, resulting in highly accelerated brain imaging while increasing diagnostic image quality.
Collapse
Affiliation(s)
- Sebastian Altmann
- Department of Neuroradiology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany.
| | - Nils F Grauhan
- Department of Neuroradiology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| | - Mario Alberto Abello Mercado
- Department of Neuroradiology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| | - Sebastian Steinmetz
- Department of Neuroradiology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| | - Andrea Kronfeld
- Department of Neuroradiology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| | - Roman Paul
- Institute of Medical Biostatistics, Epidemiology and Informatics (IMBEI), University Medical Center Mainz, Johannes Gutenberg University, Rhabanusstr. 3/Tower A, 55118 Mainz, Germany
| | | | - Timo Uphaus
- Department of Neurology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| | - Sergiu Groppa
- Department of Neurology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| | - Yaroslav Winter
- Department of Neurology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany; Department of Neurology, Philipps-University Marburg, Baldingerstr, 35043 Marburg, Germany
| | - Marc A Brockmann
- Department of Neuroradiology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| | - Ahmed E Othman
- Department of Neuroradiology, University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr. 1, 55131 Mainz, Germany
| |
Collapse
|
14
|
Biswas M, Saba L, Kalra M, Singh R, Fernandes E Fernandes J, Viswanathan V, Laird JR, Mantella LE, Johri AM, Fouda MM, Suri JS. MultiNet 2.0: A lightweight attention-based deep learning network for stenosis measurement in carotid ultrasound scans and cardiovascular risk assessment. Comput Med Imaging Graph 2024; 117:102437. [PMID: 39378691 DOI: 10.1016/j.compmedimag.2024.102437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Revised: 09/17/2024] [Accepted: 09/17/2024] [Indexed: 10/10/2024]
Abstract
BACKGROUND Cardiovascular diseases (CVD) cause 19 million fatalities each year and cost nations billions of dollars. Surrogate biomarkers are established methods for CVD risk stratification; however, manual inspection is costly, cumbersome, and error-prone. The contemporary artificial intelligence (AI) tools for segmentation and risk prediction, including older deep learning (DL) networks employ simple merge connections which may result in semantic loss of information and hence low in accuracy. METHODOLOGY We hypothesize that DL networks enhanced with attention mechanisms can do better segmentation than older DL models. The attention mechanism can concentrate on relevant features aiding the model in better understanding and interpreting images. This study proposes MultiNet 2.0 (AtheroPoint, Roseville, CA, USA), two attention networks have been used to segment the lumen from common carotid artery (CCA) ultrasound images and predict CVD risks. RESULTS The database consisted of 407 ultrasound CCA images of both the left and right sides taken from 204 patients. Two experts were hired to delineate borders on the 407 images, generating two ground truths (GT1 and GT2). The results were far better than contemporary models. The lumen dimension (LD) error for GT1 and GT2 were 0.13±0.08 and 0.16±0.07 mm, respectively, the best in market. The AUC for low, moderate and high-risk patients' detection from stenosis data for GT1 were 0.88, 0.98, and 1.00 respectively. Similarly, for GT2, the AUC values for low, moderate, and high-risk patient detection were 0.93, 0.97, and 1.00, respectively. The system can be fully adopted for clinical practice in AtheroEdge™ model by AtheroPoint, Roseville, CA, USA.
Collapse
Affiliation(s)
- Mainak Biswas
- School of Computer Engineering, Kalinga Institute of Industrial Technology, Bhubaneswar, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria di Cagliari, Cagliari, Monserrato, Italy
| | - Mannudeep Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02115, USA
| | - Rajesh Singh
- Department of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, India
| | - J Fernandes E Fernandes
- Cardiovascular Institute and the Lisbon University Medical School, Hospital de SantaMaria, Lisbon 1600 190, Portugal
| | | | - John R Laird
- Cardiology Department, St. Helena Hospital, St. Helena, CA, USA
| | - Laura E Mantella
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Amer M Johri
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, ON, Canada
| | - Mostafa M Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
| | - Jasjit S Suri
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA; Department of CS, Graphics Era University, Dehradun, India; University Center for Research & Development, Chandigarh University, Mohali, India; Symbiosis Institute of Technology, Nagpur Campus, Symbiosis International (Deemed University), Pune, India; Stroke Monitoring Division, AtheroPoint™ LLC, Roseville, CA, USA.
| |
Collapse
|
15
|
Bhagawati M, Paul S, Mantella L, Johri AM, Gupta S, Laird JR, Singh IM, Khanna NN, Al-Maini M, Isenovic ER, Tiwari E, Singh R, Nicolaides A, Saba L, Anand V, Suri JS. Cardiovascular Disease Risk Stratification Using Hybrid Deep Learning Paradigm: First of Its Kind on Canadian Trial Data. Diagnostics (Basel) 2024; 14:1894. [PMID: 39272680 PMCID: PMC11393849 DOI: 10.3390/diagnostics14171894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Revised: 08/12/2024] [Accepted: 08/26/2024] [Indexed: 09/15/2024] Open
Abstract
BACKGROUND The risk of cardiovascular disease (CVD) has traditionally been predicted via the assessment of carotid plaques. In the proposed study, AtheroEdge™ 3.0HDL (AtheroPoint™, Roseville, CA, USA) was designed to demonstrate how well the features obtained from carotid plaques determine the risk of CVD. We hypothesize that hybrid deep learning (HDL) will outperform unidirectional deep learning, bidirectional deep learning, and machine learning (ML) paradigms. METHODOLOGY 500 people who had undergone targeted carotid B-mode ultrasonography and coronary angiography were included in the proposed study. ML feature selection was carried out using three different methods, namely principal component analysis (PCA) pooling, the chi-square test (CST), and the random forest regression (RFR) test. The unidirectional and bidirectional deep learning models were trained, and then six types of novel HDL-based models were designed for CVD risk stratification. The AtheroEdge™ 3.0HDL was scientifically validated using seen and unseen datasets while the reliability and statistical tests were conducted using CST along with p-value significance. The performance of AtheroEdge™ 3.0HDL was evaluated by measuring the p-value and area-under-the-curve for both seen and unseen data. RESULTS The HDL system showed an improvement of 30.20% (0.954 vs. 0.702) over the ML system using the seen datasets. The ML feature extraction analysis showed 70% of common features among all three methods. The generalization of AtheroEdge™ 3.0HDL showed less than 1% (p-value < 0.001) difference between seen and unseen data, complying with regulatory standards. CONCLUSIONS The hypothesis for AtheroEdge™ 3.0HDL was scientifically validated, and the model was tested for reliability and stability and is further adaptable clinically.
Collapse
Affiliation(s)
- Mrinalini Bhagawati
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong 793022, India
| | - Sudip Paul
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong 793022, India
| | - Laura Mantella
- Division of Cardiology, Department of Medicine, University of Toronto, Toronto, ON M5S 1A1, Canada
| | - Amer M Johri
- Division of Cardiology, Department of Medicine, Queen's University, Kingston, ON K7L 3N6, Canada
| | - Siddharth Gupta
- Department of Computer Science and Engineering, Bharati Vidyapeeth's College of Engineering, New Delhi 110063, India
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA
| | - Inder M Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
| | | | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON M5G 1N8, Canada
| | - Esma R Isenovic
- Department of Radiobiology and Molecular Genetics, National Institute of The Republic of Serbia, University of Belgrade, 11001 Belgrade, Serbia
| | - Ekta Tiwari
- Department of Computer Science, Visvesvaraya National Institute of Technology (VNIT), Nagpur 440010, India
| | - Rajesh Singh
- Division of Research and Innovation, UTI, Uttaranchal University, Dehradun 248007, India
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia, Nicosia 2417, Cyprus
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138 Cagliari, Italy
| | - Vinod Anand
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of CE, Graphic Era Deemed to be University, Dehradun 248002, India
- Department of ECE, Idaho State University, Pocatello, ID 83209, USA
- University Center for Research & Development, Chandigarh University, Mohali 140413, India
- Symbiosis Institute of Technology, Nagpur Campus, Symbiosis International (Deemed University), Pune 412115, India
| |
Collapse
|
16
|
Al-Obeidat F, Hafez W, Gador M, Ahmed N, Abdeljawad MM, Yadav A, Rashed A. Diagnostic performance of AI-based models versus physicians among patients with hepatocellular carcinoma: a systematic review and meta-analysis. Front Artif Intell 2024; 7:1398205. [PMID: 39224209 PMCID: PMC11368160 DOI: 10.3389/frai.2024.1398205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Accepted: 07/26/2024] [Indexed: 09/04/2024] Open
Abstract
Background Hepatocellular carcinoma (HCC) is a common primary liver cancer that requires early diagnosis due to its poor prognosis. Recent advances in artificial intelligence (AI) have facilitated hepatocellular carcinoma detection using multiple AI models; however, their performance is still uncertain. Aim This meta-analysis aimed to compare the diagnostic performance of different AI models with that of clinicians in the detection of hepatocellular carcinoma. Methods We searched the PubMed, Scopus, Cochrane Library, and Web of Science databases for eligible studies. The R package was used to synthesize the results. The outcomes of various studies were aggregated using fixed-effect and random-effects models. Statistical heterogeneity was evaluated using I-squared (I2) and chi-square statistics. Results We included seven studies in our meta-analysis;. Both physicians and AI-based models scored an average sensitivity of 93%. Great variation in sensitivity, accuracy, and specificity was observed depending on the model and diagnostic technique used. The region-based convolutional neural network (RCNN) model showed high sensitivity (96%). Physicians had the highest specificity in diagnosing hepatocellular carcinoma(100%); furthermore, models-based convolutional neural networks achieved high sensitivity. Models based on AI-assisted Contrast-enhanced ultrasound (CEUS) showed poor accuracy (69.9%) compared to physicians and other models. The leave-one-out sensitivity revealed high heterogeneity among studies, which represented true differences among the studies. Conclusion Models based on Faster R-CNN excel in image classification and data extraction, while both CNN-based models and models combining contrast-enhanced ultrasound (CEUS) with artificial intelligence (AI) had good sensitivity. Although AI models outperform physicians in diagnosing HCC, they should be utilized as supportive tools to help make more accurate and timely decisions.
Collapse
Affiliation(s)
- Feras Al-Obeidat
- College of Technological Innovation, Zayed University, Abu Dubai, United Arab Emirates
| | - Wael Hafez
- NMC Royal Hospital, Khalifa City, United Arab Emirates
- Internal Medicine Department, Medical Research and Clinical Studies Institute, The National Research Centre, Cairo, Egypt
| | - Muneir Gador
- Internal Medicine Department, Medical Research and Clinical Studies Institute, The National Research Centre, Cairo, Egypt
| | | | | | - Antesh Yadav
- NMC Royal Hospital, Khalifa City, United Arab Emirates
| | - Asrar Rashed
- NMC Royal Hospital, Khalifa City, United Arab Emirates
- Department of Computer Science, Edinburgh Napier University, Merchiston Campus, Edinburgh, United Kingdom
| |
Collapse
|
17
|
ZECCA F, MANNELLI L, FAA G, MUSCOGIURI G, SANFILIPPO R, SURI JS, SABA L. Abdominal aortic aneurysms: is it time for a diagnostic revolution? Evidence from the Cardiovascular Health Study. ITALIAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY 2024; 31. [DOI: 10.23736/s1824-4777.24.01655-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2025]
|
18
|
Lee JM, Bae JS. Enhancing diagnostic precision in liver lesion analysis using a deep learning-based system: opportunities and challenges. Nat Rev Clin Oncol 2024; 21:485-486. [PMID: 38519602 DOI: 10.1038/s41571-024-00887-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/25/2024]
Affiliation(s)
- Jeong Min Lee
- Department of Radiology, Seoul National University Hospital, Seoul, South Korea.
- Department of Radiology, Seoul National University College of Medicine, Seoul, South Korea.
- Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, South Korea.
| | - Jae Seok Bae
- Department of Radiology, Seoul National University Hospital, Seoul, South Korea
| |
Collapse
|
19
|
Singh M, Kumar A, Khanna NN, Laird JR, Nicolaides A, Faa G, Johri AM, Mantella LE, Fernandes JFE, Teji JS, Singh N, Fouda MM, Singh R, Sharma A, Kitas G, Rathore V, Singh IM, Tadepalli K, Al-Maini M, Isenovic ER, Chaturvedi S, Garg D, Paraskevas KI, Mikhailidis DP, Viswanathan V, Kalra MK, Ruzsa Z, Saba L, Laine AF, Bhatt DL, Suri JS. Artificial intelligence for cardiovascular disease risk assessment in personalised framework: a scoping review. EClinicalMedicine 2024; 73:102660. [PMID: 38846068 PMCID: PMC11154124 DOI: 10.1016/j.eclinm.2024.102660] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 04/25/2024] [Accepted: 05/08/2024] [Indexed: 06/09/2024] Open
Abstract
Background The field of precision medicine endeavors to transform the healthcare industry by advancing individualised strategies for diagnosis, treatment modalities, and predictive assessments. This is achieved by utilizing extensive multidimensional biological datasets encompassing diverse components, such as an individual's genetic makeup, functional attributes, and environmental influences. Artificial intelligence (AI) systems, namely machine learning (ML) and deep learning (DL), have exhibited remarkable efficacy in predicting the potential occurrence of specific cancers and cardiovascular diseases (CVD). Methods We conducted a comprehensive scoping review guided by the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) framework. Our search strategy involved combining key terms related to CVD and AI using the Boolean operator AND. In August 2023, we conducted an extensive search across reputable scholarly databases including Google Scholar, PubMed, IEEE Xplore, ScienceDirect, Web of Science, and arXiv to gather relevant academic literature on personalised medicine for CVD. Subsequently, in January 2024, we extended our search to include internet search engines such as Google and various CVD websites. These searches were further updated in March 2024. Additionally, we reviewed the reference lists of the final selected research articles to identify any additional relevant literature. Findings A total of 2307 records were identified during the process of conducting the study, consisting of 564 entries from external sites like arXiv and 1743 records found through database searching. After 430 duplicate articles were eliminated, 1877 items that remained were screened for relevancy. In this stage, 1241 articles remained for additional review after 158 irrelevant articles and 478 articles with insufficient data were removed. 355 articles were eliminated for being inaccessible, 726 for being written in a language other than English, and 281 for not having undergone peer review. Consequently, 121 studies were deemed suitable for inclusion in the qualitative synthesis. At the intersection of CVD, AI, and precision medicine, we found important scientific findings in our scoping review. Intricate pattern extraction from large, complicated genetic datasets is a skill that AI algorithms excel at, allowing for accurate disease diagnosis and CVD risk prediction. Furthermore, these investigations have uncovered unique genetic biomarkers linked to CVD, providing insight into the workings of the disease and possible treatment avenues. The construction of more precise predictive models and personalised treatment plans based on the genetic profiles of individual patients has been made possible by the revolutionary advancement of CVD risk assessment through the integration of AI and genomics. Interpretation The systematic methodology employed ensured the thorough examination of available literature and the inclusion of relevant studies, contributing to the robustness and reliability of the study's findings. Our analysis stresses a crucial point in terms of the adaptability and versatility of AI solutions. AI algorithms designed in non-CVD domains such as in oncology, often include ideas and tactics that might be modified to address cardiovascular problems. Funding No funding received.
Collapse
Affiliation(s)
- Manasvi Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
- Bennett University, 201310, Greater Noida, India
| | - Ashish Kumar
- Bennett University, 201310, Greater Noida, India
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi, 110001, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, 94574, USA
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Cyprus
| | - Gavino Faa
- Department of Pathology, University of Cagliari, Cagliari, Italy
| | - Amer M. Johri
- Department of Medicine, Division of Cardiology, Queen's University, Kingston, Canada
| | - Laura E. Mantella
- Department of Medicine, Division of Cardiology, University of Toronto, Toronto, Canada
| | | | - Jagjit S. Teji
- Ann and Robert H. Lurie Children's Hospital of Chicago, Chicago, IL, 60611, USA
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era Deemed to Be University, Dehradun, Uttarakhand, 248002, India
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
| | - Rajesh Singh
- Department of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun, 248007, India
| | - Aditya Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, 22901, VA, USA
| | - George Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, DY1, Dudley, UK
| | - Vijay Rathore
- Nephrology Department, Kaiser Permanente, Sacramento, CA, 95823, USA
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
| | | | - Mustafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON, L4Z 4C4, Canada
| | - Esma R. Isenovic
- Department of Radiobiology and Molecular Genetics, National Institute of The Republic of Serbia, University of Belgrade, 110010, Serbia
| | - Seemant Chaturvedi
- Department of Neurology & Stroke Program, University of Maryland, Baltimore, MD, USA
| | | | | | - Dimitri P. Mikhailidis
- Department of Clinical Biochemistry, Royal Free Hospital Campus, University College London Medical School, University College London (UCL), London, UK
| | | | | | - Zoltan Ruzsa
- Invasive Cardiology Division, University of Szeged, Szeged, Hungary
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138, Cagliari, Italy
| | - Andrew F. Laine
- Departments of Biomedical and Radiology, Columbia University, New York, NY, USA
| | | | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, 95661, USA
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID, 83209, USA
- Department of Computer Science, Graphic Era Deemed to Be University, Dehradun, Uttarakhand, 248002, India
| |
Collapse
|
20
|
Seoni S, Shahini A, Meiburger KM, Marzola F, Rotunno G, Acharya UR, Molinari F, Salvi M. All you need is data preparation: A systematic review of image harmonization techniques in Multi-center/device studies for medical support systems. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 250:108200. [PMID: 38677080 DOI: 10.1016/j.cmpb.2024.108200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Revised: 04/20/2024] [Accepted: 04/22/2024] [Indexed: 04/29/2024]
Abstract
BACKGROUND AND OBJECTIVES Artificial intelligence (AI) models trained on multi-centric and multi-device studies can provide more robust insights and research findings compared to single-center studies. However, variability in acquisition protocols and equipment can introduce inconsistencies that hamper the effective pooling of multi-source datasets. This systematic review evaluates strategies for image harmonization, which standardizes appearances to enable reliable AI analysis of multi-source medical imaging. METHODS A literature search using PRISMA guidelines was conducted to identify relevant papers published between 2013 and 2023 analyzing multi-centric and multi-device medical imaging studies that utilized image harmonization approaches. RESULTS Common image harmonization techniques included grayscale normalization (improving classification accuracy by up to 24.42 %), resampling (increasing the percentage of robust radiomics features from 59.5 % to 89.25 %), and color normalization (enhancing AUC by up to 0.25 in external test sets). Initially, mathematical and statistical methods dominated, but machine and deep learning adoption has risen recently. Color imaging modalities like digital pathology and dermatology have remained prominent application areas, though harmonization efforts have expanded to diverse fields including radiology, nuclear medicine, and ultrasound imaging. In all the modalities covered by this review, image harmonization improved AI performance, with increasing of up to 24.42 % in classification accuracy and 47 % in segmentation Dice scores. CONCLUSIONS Continued progress in image harmonization represents a promising strategy for advancing healthcare by enabling large-scale, reliable analysis of integrated multi-source datasets using AI. Standardizing imaging data across clinical settings can help realize personalized, evidence-based care supported by data-driven technologies while mitigating biases associated with specific populations or acquisition protocols.
Collapse
Affiliation(s)
- Silvia Seoni
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Alen Shahini
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Kristen M Meiburger
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Francesco Marzola
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Giulia Rotunno
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Centre for Health Research, University of Southern Queensland, Australia
| | - Filippo Molinari
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
| | - Massimo Salvi
- Biolab, PolitoBIOMedLab, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy.
| |
Collapse
|
21
|
Bhagawati M, Paul S, Mantella L, Johri AM, Laird JR, Singh IM, Singh R, Garg D, Fouda MM, Khanna NN, Cau R, Abraham A, Al-Maini M, Isenovic ER, Sharma AM, Fernandes JFE, Chaturvedi S, Karla MK, Nicolaides A, Saba L, Suri JS. Deep learning approach for cardiovascular disease risk stratification and survival analysis on a Canadian cohort. THE INTERNATIONAL JOURNAL OF CARDIOVASCULAR IMAGING 2024; 40:1283-1303. [PMID: 38678144 DOI: 10.1007/s10554-024-03100-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 04/02/2024] [Indexed: 04/29/2024]
Abstract
The quantification of carotid plaque has been routinely used to predict cardiovascular risk in cardiovascular disease (CVD) and coronary artery disease (CAD). To determine how well carotid plaque features predict the likelihood of CAD and cardiovascular (CV) events using deep learning (DL) and compare against the machine learning (ML) paradigm. The participants in this study consisted of 459 individuals who had undergone coronary angiography, contrast-enhanced ultrasonography, and focused carotid B-mode ultrasound. Each patient was tracked for thirty days. The measurements on these patients consisted of maximum plaque height (MPH), total plaque area (TPA), carotid intima-media thickness (cIMT), and intraplaque neovascularization (IPN). CAD risk and CV event stratification were performed by applying eight types of DL-based models. Univariate and multivariate analysis was also conducted to predict the most significant risk predictors. The DL's model effectiveness was evaluated by the area-under-the-curve measurement while the CV event prediction was evaluated using the Cox proportional hazard model (CPHM) and compared against the DL-based concordance index (c-index). IPN showed a substantial ability to predict CV events (p < 0.0001). The best DL system improved by 21% (0.929 vs. 0.762) over the best ML system. DL-based CV event prediction showed a ~ 17% increase in DL-based c-index compared to the CPHM (0.86 vs. 0.73). CAD and CV incidents were linked to IPN and carotid imaging characteristics. For survival analysis and CAD prediction, the DL-based system performs superior to ML-based models.
Collapse
Affiliation(s)
- Mrinalini Bhagawati
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong, India
| | - Sudip Paul
- Department of Biomedical Engineering, North-Eastern Hill University, Shillong, India
| | - Laura Mantella
- Division of Cardiology, Department of Medicine, University of Toronto, Toronto, Canada
| | - Amer M Johri
- Division of Cardiology, Department of Medicine, Queen's University, Kingston, Canada
| | - John R Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA, 94574, USA
| | - Inder M Singh
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, 95661, USA
| | - Rajesh Singh
- Division of Research and Innovation, UTI, Uttaranchal University, Dehradun, India
| | - Deepak Garg
- School of Cowereter Science and Artificial Intelligence, SR University, Warangal, Telangana, 506371, India
| | - Mostafa M Fouda
- Department of ECE, Idaho State University, Pocatello, ID, 83209, USA
| | | | - Riccardo Cau
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138, Cagliari, Italy
| | | | - Mostafa Al-Maini
- Allergy, Clinical Immunology and Rheumatology Institute, Toronto, ON, Canada
| | - Esma R Isenovic
- Department of Radiobiology and Molecular Genetics, National Institute of The Republic of Serbia, University of Belgrade, 11001, Belgrade, Serbia
| | - Aditya M Sharma
- Division of Cardiovascular Medicine, University of Virginia, Charlottesville, VA, 22904, USA
| | | | - Seemant Chaturvedi
- Department of Neurology & Stroke Program, University of Maryland, Baltimore, MD, USA
| | - Mannudeep K Karla
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre, University of Nicosia Medical School, Nicosia, Cyprus
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria, 40138, Cagliari, Italy
| | - Jasjit S Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA, 95661, USA.
- Department of ECE, Idaho State University, Pocatello, ID, 83209, USA.
- Department of CE, Graphic Era Deemed to be University, 248002, Dehradun, India.
| |
Collapse
|
22
|
Botnari A, Kadar M, Patrascu JM. A Comprehensive Evaluation of Deep Learning Models on Knee MRIs for the Diagnosis and Classification of Meniscal Tears: A Systematic Review and Meta-Analysis. Diagnostics (Basel) 2024; 14:1090. [PMID: 38893617 PMCID: PMC11172202 DOI: 10.3390/diagnostics14111090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 05/19/2024] [Accepted: 05/21/2024] [Indexed: 06/21/2024] Open
Abstract
OBJECTIVES This study delves into the cutting-edge field of deep learning techniques, particularly deep convolutional neural networks (DCNNs), which have demonstrated unprecedented potential in assisting radiologists and orthopedic surgeons in precisely identifying meniscal tears. This research aims to evaluate the effectiveness of deep learning models in recognizing, localizing, describing, and categorizing meniscal tears in magnetic resonance images (MRIs). MATERIALS AND METHODS This systematic review was rigorously conducted, strictly following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Extensive searches were conducted on MEDLINE (PubMed), Web of Science, Cochrane Library, and Google Scholar. All identified articles underwent a comprehensive risk of bias analysis. Predictive performance values were either extracted or calculated for quantitative analysis, including sensitivity and specificity. The meta-analysis was performed for all prediction models that identified the presence and location of meniscus tears. RESULTS This study's findings underscore that a range of deep learning models exhibit robust performance in detecting and classifying meniscal tears, in one case surpassing the expertise of musculoskeletal radiologists. Most studies in this review concentrated on identifying tears in the medial or lateral meniscus and even precisely locating tears-whether in the anterior or posterior horn-with exceptional accuracy, as demonstrated by AUC values ranging from 0.83 to 0.94. CONCLUSIONS Based on these findings, deep learning models have showcased significant potential in analyzing knee MR images by learning intricate details within images. They offer precise outcomes across diverse tasks, including segmenting specific anatomical structures and identifying pathological regions. Contributions: This study focused exclusively on DL models for identifying and localizing meniscus tears. It presents a meta-analysis that includes eight studies for detecting the presence of a torn meniscus and a meta-analysis of three studies with low heterogeneity that localize and classify the menisci. Another novelty is the analysis of arthroscopic surgery as ground truth. The quality of the studies was assessed against the CLAIM checklist, and the risk of bias was determined using the QUADAS-2 tool.
Collapse
Affiliation(s)
- Alexei Botnari
- Department of Orthopedics, Faculty of Medicine, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania
| | - Manuella Kadar
- Department of Computer Science, Faculty of Informatics and Engineering, “1 Decembrie 1918” University of Alba Iulia, 510009 Alba Iulia, Romania
| | - Jenel Marian Patrascu
- Department of Orthopedics-Traumatology, Faculty of Medicine, “Victor Babes” University of Medicine and Pharmacy, 300041 Timisoara, Romania;
| |
Collapse
|
23
|
Corrias G, Lai E, Ziranu P, Mariani S, Donisi C, Liscia N, Saba G, Pretta A, Persano M, Fanni D, Spanu D, Balconi F, Loi F, Deidda S, Restivo A, Pusceddu V, Puzzoni M, Solinas C, Massa E, Madeddu C, Gerosa C, Zorcolo L, Faa G, Saba L, Scartozzi M. Prediction of Response to Anti-Angiogenic Treatment for Advanced Colorectal Cancer Patients: From Biological Factors to Functional Imaging. Cancers (Basel) 2024; 16:1364. [PMID: 38611042 PMCID: PMC11011199 DOI: 10.3390/cancers16071364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Revised: 03/24/2024] [Accepted: 03/27/2024] [Indexed: 04/14/2024] Open
Abstract
Colorectal cancer (CRC) is a leading tumor worldwide. In CRC, the angiogenic pathway plays a crucial role in cancer development and the process of metastasis. Thus, anti-angiogenic drugs represent a milestone for metastatic CRC (mCRC) treatment and lead to significant improvement of clinical outcomes. Nevertheless, not all patients respond to treatment and some develop resistance. Therefore, the identification of predictive factors able to predict response to angiogenesis pathway blockade is required in order to identify the best candidates to receive these agents. Unfortunately, no predictive biomarkers have been prospectively validated to date. Over the years, research has focused on biologic factors such as genetic polymorphisms, circulating biomarkers, circulating tumor cells (CTCs), circulating tumor DNA (ctDNA), and microRNA. Moreover, research efforts have evaluated the potential correlation of molecular biomarkers with imaging techniques used for tumor assessment as well as the application of imaging tools in clinical practice. In addition to functional imaging, radiomics, a relatively newer technique, shows real promise in the setting of correlating molecular medicine to radiological phenotypes.
Collapse
Affiliation(s)
- Giuseppe Corrias
- Department of Radiology, University of Cagliari, 09042 Cagliari, Italy;
| | - Eleonora Lai
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Pina Ziranu
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Stefano Mariani
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Clelia Donisi
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Nicole Liscia
- Department of Medical Oncology, IRCCS San Raffaele Scientific Institute, Vita-Salute San Raffaele University, 20132 Milan, Italy;
| | - Giorgio Saba
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Andrea Pretta
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Mara Persano
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Daniela Fanni
- Division of Pathology, Department of Medical Sciences and Public Health, AOU Cagliari, University of Cagliari, 09124 Cagliari, Italy; (D.F.); (C.G.); (G.F.)
| | - Dario Spanu
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Francesca Balconi
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Francesco Loi
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Simona Deidda
- Colorectal Surgery Unit, A.O.U. Cagliari, Department of Surgical Science, University of Cagliari, 09042 Cagliari, Italy; (S.D.); (A.R.); (L.Z.)
| | - Angelo Restivo
- Colorectal Surgery Unit, A.O.U. Cagliari, Department of Surgical Science, University of Cagliari, 09042 Cagliari, Italy; (S.D.); (A.R.); (L.Z.)
| | - Valeria Pusceddu
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Marco Puzzoni
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Cinzia Solinas
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Elena Massa
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Clelia Madeddu
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| | - Clara Gerosa
- Division of Pathology, Department of Medical Sciences and Public Health, AOU Cagliari, University of Cagliari, 09124 Cagliari, Italy; (D.F.); (C.G.); (G.F.)
| | - Luigi Zorcolo
- Colorectal Surgery Unit, A.O.U. Cagliari, Department of Surgical Science, University of Cagliari, 09042 Cagliari, Italy; (S.D.); (A.R.); (L.Z.)
| | - Gavino Faa
- Division of Pathology, Department of Medical Sciences and Public Health, AOU Cagliari, University of Cagliari, 09124 Cagliari, Italy; (D.F.); (C.G.); (G.F.)
| | - Luca Saba
- Department of Radiology, University of Cagliari, 09042 Cagliari, Italy;
| | - Mario Scartozzi
- Medical Oncology Unit, University Hospital and University of Cagliari, 09042 Cagliari, Italy; (E.L.); (P.Z.); (S.M.); (C.D.); (G.S.); (A.P.); (M.P.); (D.S.); (F.B.); (F.L.); (V.P.); (M.P.); (C.S.); (E.M.); (C.M.); (M.S.)
| |
Collapse
|
24
|
Ullah MS, Khan MA, Almujally NA, Alhaisoni M, Akram T, Shabaz M. BrainNet: a fusion assisted novel optimal framework of residual blocks and stacked autoencoders for multimodal brain tumor classification. Sci Rep 2024; 14:5895. [PMID: 38467755 PMCID: PMC10928185 DOI: 10.1038/s41598-024-56657-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Accepted: 03/08/2024] [Indexed: 03/13/2024] Open
Abstract
A significant issue in computer-aided diagnosis (CAD) for medical applications is brain tumor classification. Radiologists could reliably detect tumors using machine learning algorithms without extensive surgery. However, a few important challenges arise, such as (i) the selection of the most important deep learning architecture for classification (ii) an expert in the field who can assess the output of deep learning models. These difficulties motivate us to propose an efficient and accurate system based on deep learning and evolutionary optimization for the classification of four types of brain modalities (t1 tumor, t1ce tumor, t2 tumor, and flair tumor) on a large-scale MRI database. Thus, a CNN architecture is modified based on domain knowledge and connected with an evolutionary optimization algorithm to select hyperparameters. In parallel, a Stack Encoder-Decoder network is designed with ten convolutional layers. The features of both models are extracted and optimized using an improved version of Grey Wolf with updated criteria of the Jaya algorithm. The improved version speeds up the learning process and improves the accuracy. Finally, the selected features are fused using a novel parallel pooling approach that is classified using machine learning and neural networks. Two datasets, BraTS2020 and BraTS2021, have been employed for the experimental tasks and obtained an improved average accuracy of 98% and a maximum single-classifier accuracy of 99%. Comparison is also conducted with several classifiers, techniques, and neural nets; the proposed method achieved improved performance.
Collapse
Affiliation(s)
| | - Muhammad Attique Khan
- Department of Computer Science and Mathematics, Lebanese American University, Beirut, Lebanon
- Department of Computer Science, HITEC University, Taxila, 47080, Pakistan
| | - Nouf Abdullah Almujally
- Department of Information Systems, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, PO Box 84428, 11671, Riyadh, Saudi Arabia
| | - Majed Alhaisoni
- Computer Sciences Department, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia
| | - Tallha Akram
- Department of ECE, COMSATS University Islamabad, Wah Campus, Rawalpindi, Pakistan
| | - Mohammad Shabaz
- Model Institute of Engineering and Technology, Jammu, J&K, India.
| |
Collapse
|
25
|
Santomartino SM, Kung J, Yi PH. Systematic review of artificial intelligence development and evaluation for MRI diagnosis of knee ligament or meniscus tears. Skeletal Radiol 2024; 53:445-454. [PMID: 37584757 DOI: 10.1007/s00256-023-04416-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 07/24/2023] [Accepted: 07/24/2023] [Indexed: 08/17/2023]
Abstract
OBJECTIVE The purpose of this systematic review was to summarize the results of original research studies evaluating the characteristics and performance of deep learning models for detection of knee ligament and meniscus tears on MRI. MATERIALS AND METHODS We searched PubMed for studies published as of February 2, 2022 for original studies evaluating development and evaluation of deep learning models for MRI diagnosis of knee ligament or meniscus tears. We summarized study details according to multiple criteria including baseline article details, model creation, deep learning details, and model evaluation. RESULTS 19 studies were included with radiology departments leading the publications in deep learning development and implementation for detecting knee injuries via MRI. Among the studies, there was a lack of standard reporting and inconsistently described development details. However, all included studies reported consistently high model performance that significantly supplemented human reader performance. CONCLUSION From our review, we found radiology departments have been leading deep learning development for injury detection on knee MRIs. Although studies inconsistently described DL model development details, all reported high model performance, indicating great promise for DL in knee MRI analysis.
Collapse
Affiliation(s)
- Samantha M Santomartino
- Drexel University College of Medicine, Philadelphia, PA, USA
- University of Maryland Medical Intelligent Imaging (UM2ii) Center, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland, University of Maryland School of Medicine, Baltimore, MD, USA
| | - Justin Kung
- Department of Orthopaedic Surgery, University of South Carolina, Columbia, SC, USA
| | - Paul H Yi
- University of Maryland Medical Intelligent Imaging (UM2ii) Center, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland, University of Maryland School of Medicine, Baltimore, MD, USA.
- Malone Center for Engineering in Healthcare, Johns Hopkins University, Baltimore Street First Floor Rm. 1172, Baltimore, MD, 21201, USA.
| |
Collapse
|
26
|
Chang M, Reicher JJ, Kalra A, Muelly M, Ahmad Y. Analysis of Validation Performance of a Machine Learning Classifier in Interstitial Lung Disease Cases Without Definite or Probable Usual Interstitial Pneumonia Pattern on CT Using Clinical and Pathology-Supported Diagnostic Labels. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:297-307. [PMID: 38343230 PMCID: PMC10976935 DOI: 10.1007/s10278-023-00914-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 07/17/2023] [Accepted: 08/10/2023] [Indexed: 03/02/2024]
Abstract
We previously validated Fibresolve, a machine learning classifier system that non-invasively predicts idiopathic pulmonary fibrosis (IPF) diagnosis. The system incorporates an automated deep learning algorithm that analyzes chest computed tomography (CT) imaging to assess for features associated with idiopathic pulmonary fibrosis. Here, we assess performance in assessment of patterns beyond those that are characteristic features of usual interstitial pneumonia (UIP) pattern. The machine learning classifier was previously developed and validated using standard training, validation, and test sets, with clinical plus pathologically determined ground truth. The multi-site 295-patient validation dataset was used for focused subgroup analysis in this investigation to evaluate the classifier's performance range in cases with and without radiologic UIP and probable UIP designations. Radiologic assessment of specific features for UIP including the presence and distribution of reticulation, ground glass, bronchiectasis, and honeycombing was used for assignment of radiologic pattern. Output from the classifier was assessed within various UIP subgroups. The machine learning classifier was able to classify cases not meeting the criteria for UIP or probable UIP as IPF with estimated sensitivity of 56-65% and estimated specificity of 92-94%. Example cases demonstrated non-basilar-predominant as well as ground glass patterns that were indeterminate for UIP by subjective imaging criteria but for which the classifier system was able to correctly identify the case as IPF as confirmed by multidisciplinary discussion generally inclusive of histopathology. The machine learning classifier Fibresolve may be helpful in the diagnosis of IPF in cases without radiological UIP and probable UIP patterns.
Collapse
Affiliation(s)
- Marcello Chang
- Stanford School of Medicine, 291 Campus Drive, Stanford, CA, USA
| | | | | | | | - Yousef Ahmad
- Department of Pulmonary and Critical Care, University of Cincinnati Medical Center, Cincinnati, USA
| |
Collapse
|
27
|
Altmann S, Grauhan NF, Brockstedt L, Kondova M, Schmidtmann I, Paul R, Clifford B, Feiweier T, Hosseini Z, Uphaus T, Groppa S, Brockmann MA, Othman AE. Ultrafast Brain MRI with Deep Learning Reconstruction for Suspected Acute Ischemic Stroke. Radiology 2024; 310:e231938. [PMID: 38376403 DOI: 10.1148/radiol.231938] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/21/2024]
Abstract
Background Deep learning (DL)-accelerated MRI can substantially reduce examination times. However, studies prospectively evaluating the diagnostic performance of DL-accelerated MRI reconstructions in acute suspected stroke are lacking. Purpose To investigate the interchangeability of DL-accelerated MRI with conventional MRI in patients with suspected acute ischemic stroke at 1.5 T. Materials and Methods In this prospective study, 211 participants with suspected acute stroke underwent clinically indicated MRI at 1.5 T between June 2022 and March 2023. For each participant, conventional MRI (including T1-weighted, T2-weighted, T2*-weighted, T2 fluid-attenuated inversion-recovery, and diffusion-weighted imaging; 14 minutes 18 seconds) and DL-accelerated MRI (same sequences; 3 minutes 4 seconds) were performed. The primary end point was the interchangeability between conventional and DL-accelerated MRI for acute ischemic infarction detection. Secondary end points were interchangeability regarding the affected vascular territory and clinically relevant secondary findings (eg, microbleeds, neoplasm). Three readers evaluated the overall occurrence of acute ischemic stroke, affected vascular territory, clinically relevant secondary findings, overall image quality, and diagnostic confidence. For acute ischemic lesions, size and signal intensities were assessed. The margin for interchangeability was chosen as 5%. For interrater agreement analysis and interrater reliability analysis, multirater Fleiss κ and the intraclass correlation coefficient, respectively, was determined. Results The study sample consisted of 211 participants (mean age, 65 years ± 16 [SD]); 123 male and 88 female). Acute ischemic stroke was confirmed in 79 participants. Interchangeability was demonstrated for all primary and secondary end points. No individual equivalence indexes (IEIs) exceeded the interchangeability margin of 5% (IEI, -0.002 [90% CI: -0.007, 0.004]). Almost perfect interrater agreement was observed (P > .91). DL-accelerated MRI provided higher overall image quality (P < .001) and diagnostic confidence (P < .001). The signal properties of acute ischemic infarctions were similar in both techniques and demonstrated good to excellent interrater reliability (intraclass correlation coefficient, ≥0.8). Conclusion Despite being four times faster, DL-accelerated brain MRI was interchangeable with conventional MRI for acute ischemic lesion detection. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Haller in this issue.
Collapse
Affiliation(s)
- Sebastian Altmann
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Nils F Grauhan
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Lavinia Brockstedt
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Mariya Kondova
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Irene Schmidtmann
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Roman Paul
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Bryan Clifford
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Thorsten Feiweier
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Zahra Hosseini
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Timo Uphaus
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Sergiu Groppa
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Marc A Brockmann
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| | - Ahmed E Othman
- From the Department of Neuroradiology (S.A., N.F.G., L.B., M.K., M.A.B., A.E.O.), Institute of Medical Biostatistics, Epidemiology and Informatics (I.S., R.P.), and Department of Neurology (T.U., S.G.), University Medical Center Mainz, Johannes Gutenberg University, Langenbeckstr 1, 55131 Mainz, Germany; Siemens Medical Solutions USA, Boston, Mass (B.C.); and Siemens Healthcare, Erlangen, Germany (T.F., Z.H.)
| |
Collapse
|
28
|
Rahman A, Debnath T, Kundu D, Khan MSI, Aishi AA, Sazzad S, Sayduzzaman M, Band SS. Machine learning and deep learning-based approach in smart healthcare: Recent advances, applications, challenges and opportunities. AIMS Public Health 2024; 11:58-109. [PMID: 38617415 PMCID: PMC11007421 DOI: 10.3934/publichealth.2024004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2023] [Accepted: 12/18/2023] [Indexed: 04/16/2024] Open
Abstract
In recent years, machine learning (ML) and deep learning (DL) have been the leading approaches to solving various challenges, such as disease predictions, drug discovery, medical image analysis, etc., in intelligent healthcare applications. Further, given the current progress in the fields of ML and DL, there exists the promising potential for both to provide support in the realm of healthcare. This study offered an exhaustive survey on ML and DL for the healthcare system, concentrating on vital state of the art features, integration benefits, applications, prospects and future guidelines. To conduct the research, we found the most prominent journal and conference databases using distinct keywords to discover scholarly consequences. First, we furnished the most current along with cutting-edge progress in ML-DL-based analysis in smart healthcare in a compendious manner. Next, we integrated the advancement of various services for ML and DL, including ML-healthcare, DL-healthcare, and ML-DL-healthcare. We then offered ML and DL-based applications in the healthcare industry. Eventually, we emphasized the research disputes and recommendations for further studies based on our observations.
Collapse
Affiliation(s)
- Anichur Rahman
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
- Department of CSE, Mawlana Bhashani Science and Technology University, Tangail, Bangladesh
| | - Tanoy Debnath
- Department of CSE, Mawlana Bhashani Science and Technology University, Tangail, Bangladesh
- Department of CSE, Green University of Bangladesh, 220/D, Begum Rokeya Sarani, Dhaka -1207, Bangladesh
| | - Dipanjali Kundu
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
| | - Md. Saikat Islam Khan
- Department of CSE, Mawlana Bhashani Science and Technology University, Tangail, Bangladesh
| | - Airin Afroj Aishi
- Department of Computing and Information System, Daffodil International University, Savar, Dhaka, Bangladesh
| | - Sadia Sazzad
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
| | - Mohammad Sayduzzaman
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
| | - Shahab S. Band
- Department of Information Management, International Graduate School of Artificial Intelligence, National Yunlin University of Science and Technology, Taiwan
| |
Collapse
|
29
|
Kumari V, Kumar N, Kumar K S, Kumar A, Skandha SS, Saxena S, Khanna NN, Laird JR, Singh N, Fouda MM, Saba L, Singh R, Suri JS. Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look. J Cardiovasc Dev Dis 2023; 10:485. [PMID: 38132653 PMCID: PMC10743870 DOI: 10.3390/jcdd10120485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 10/15/2023] [Accepted: 11/07/2023] [Indexed: 12/23/2023] Open
Abstract
BACKGROUND AND MOTIVATION Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias. METHODS Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework. FINDINGS AND CONCLUSIONS UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.
Collapse
Affiliation(s)
- Vandana Kumari
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Naresh Kumar
- Department of Applied Computational Science and Engineering, G L Bajaj Institute of Technology and Management, Greater Noida 201310, India
| | - Sampath Kumar K
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Ashish Kumar
- School of CSET, Bennett University, Greater Noida 201310, India;
| | - Sanagala S. Skandha
- Department of CSE, CMR College of Engineering and Technology, Hyderabad 501401, India;
| | - Sanjay Saxena
- Department of Computer Science and Engineering, IIT Bhubaneswar, Bhubaneswar 751003, India;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era, Deemed to be University, Dehradun 248002, India;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09100 Cagliari, Italy;
| | - Rajesh Singh
- Department of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, India;
| | - Jasjit S. Suri
- Stroke Diagnostics and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Computer Science & Engineering, Graphic Era, Deemed to be University, Dehradun 248002, India
- Monitoring and Diagnosis Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
30
|
Zhang J, Santos C, Park C, Mazurowski MA, Colglazier R. Improving Image Classification of Knee Radiographs: An Automated Image Labeling Approach. J Digit Imaging 2023; 36:2402-2410. [PMID: 37620710 PMCID: PMC10584746 DOI: 10.1007/s10278-023-00894-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 07/28/2023] [Accepted: 07/31/2023] [Indexed: 08/26/2023] Open
Abstract
Large numbers of radiographic images are available in musculoskeletal radiology practices which could be used for training of deep learning models for diagnosis of knee abnormalities. However, those images do not typically contain readily available labels due to limitations of human annotations. The purpose of our study was to develop an automated labeling approach that improves the image classification model to distinguish normal knee images from those with abnormalities or prior arthroplasty. The automated labeler was trained on a small set of labeled data to automatically label a much larger set of unlabeled data, further improving the image classification performance for knee radiographic diagnosis. We used BioBERT and EfficientNet as the feature extraction backbone of the labeler and imaging model, respectively. We developed our approach using 7382 patients and validated it on a separate set of 637 patients. The final image classification model, trained using both manually labeled and pseudo-labeled data, had the higher weighted average AUC (WA-AUC 0.903) value and higher AUC values among all classes (normal AUC 0.894; abnormal AUC 0.896, arthroplasty AUC 0.990) compared to the baseline model (WA-AUC = 0.857; normal AUC 0.842; abnormal AUC 0.848, arthroplasty AUC 0.987), trained using only manually labeled data. Statistical tests show that the improvement is significant on normal (p value < 0.002), abnormal (p value < 0.001), and WA-AUC (p value = 0.001). Our findings demonstrated that the proposed automated labeling approach significantly improves the performance of image classification for radiographic knee diagnosis, allowing for facilitating patient care and curation of large knee datasets.
Collapse
Affiliation(s)
- Jikai Zhang
- Department of Electrical and Computer Engineering, Duke University, Room 10070, 2424 Erwin Road, Durham, NC, 27705, USA.
| | - Carlos Santos
- Wake Forest University, Winston-Salem, NC, 27109, USA
| | - Christine Park
- Department of Radiology, Duke University Medical Center, Durham, NC, USA
| | - Maciej A Mazurowski
- Department of Radiology, Duke University Medical Center, Durham, NC, USA
- Department of Electrical and Computer Engineering, Department of Biostatistics and Bioinformatics, Department of Computer Science, Duke University, Durham, NC, USA
| | - Roy Colglazier
- Department of Radiology, Duke University Medical Center, Durham, NC, USA
| |
Collapse
|
31
|
Sadeghi MH, Sina S, Alavi M, Giammarile F. The OCDA-Net: a 3D convolutional neural network-based system for classification and staging of ovarian cancer patients using [ 18F]FDG PET/CT examinations. Ann Nucl Med 2023; 37:645-654. [PMID: 37768493 DOI: 10.1007/s12149-023-01867-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 09/11/2023] [Indexed: 09/29/2023]
Abstract
OBJECTIVE To create the 3D convolutional neural network (CNN)-based system that can use whole-body [18F]FDG PET for recurrence/post-therapy surveillance in ovarian cancer (OC). METHODS In this study, 1224 image sets from OC patients who underwent whole-body [18F]FDG PET/CT at Kowsar Hospital between April 2019 and May 2022 were investigated. For recurrence/post-therapy surveillance, diagnostic classification as cancerous, and non-cancerous and staging as stage III, and stage IV were determined by pathological diagnosis and specialists' interpretation. New deep neural network algorithms, the OCDAc-Net, and the OCDAs-Net were developed for diagnostic classification and staging of OC patients using [18F]FDG PET/CT images. Examinations were divided into independent training (75%), validation (10%), and testing (15%) subsets. RESULTS This study included 37 women (mean age 56.3 years; age range 36-83 years). Data augmentation techniques were applied to the images in two phases. There were 1224 image sets for diagnostic classification and staging. For the test set, 170 image sets were considered for diagnostic classification and staging. The OCDAc-Net areas under the receiver operating characteristic curve (AUCs) and overall accuracy for diagnostic classification were 0.990 and 0.92, respectively. The OCDAs-Net achieved areas under the receiver operating characteristic curve (AUCs) of 0.995 and overall accuracy of 0.94 for staging. CONCLUSIONS The proposed 3D CNN-based models provide potential tools for recurrence/post-therapy surveillance in OC. The OCDAc-Net and the OCDAs-Net model provide a new prognostic analysis method that can utilize PET images without pathological findings for diagnostic classification and staging.
Collapse
Affiliation(s)
- Mohammad Hossein Sadeghi
- Nuclear Engineering Department, School of Mechanical Engineering, Shiraz University, Shiraz, Iran
| | - Sedigheh Sina
- Nuclear Engineering Department, School of Mechanical Engineering, Shiraz University, Shiraz, Iran.
- Radiation Research Center, School of Mechanical Engineering, Shiraz University, Shiraz, Iran.
| | - Mehrosadat Alavi
- Department of Nuclear Medicine, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Francesco Giammarile
- Nuclear Medicine and Diagnostic Imaging Section, Division of Human Health, International Atomic Energy Agency, Vienna, Austria
| |
Collapse
|
32
|
Sabuncu Ö, Bilgehan B, Kneebone E, Mirzaei O. Effective deep learning classification for kidney stone using axial computed tomography (CT) images. BIOMED ENG-BIOMED TE 2023; 68:481-491. [PMID: 37129960 DOI: 10.1515/bmt-2022-0142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Accepted: 04/11/2023] [Indexed: 05/03/2023]
Abstract
INTRODUCTION Stone formation in the kidneys is a common disease, and the high rate of recurrence and morbidity of the disease worries all patients with kidney stones. There are many imaging options for diagnosing and managing kidney stone disease, and CT imaging is the preferred method. OBJECTIVES Radiologists need to manually analyse large numbers of CT slices to diagnose kidney stones, and this process is laborious and time-consuming. This study used deep automated learning (DL) algorithms to analyse kidney stones. The primary purpose of this study is to classify kidney stones accurately from CT scans using deep learning algorithms. METHODS The Inception-V3 model was selected as a reference in this study. Pre-trained with other CNN architectures were applied to a recorded dataset of abdominal CT scans of patients with kidney stones labelled by a radiologist. The minibatch size has been modified to 7, and the initial learning rate was 0.0085. RESULTS The performance of the eight models has been analysed with 8209 CT images recorded at the hospital for the first time. The training and test phases were processed with limited authentic recorded CT images. The outcome result of the test shows that the Inception-V3 model has a test accuracy of 98.52 % using CT images in detecting kidney stones. CONCLUSIONS The observation is that the Inception-V3 model is successful in detecting kidney stones of small size. The performance of the Inception-V3 Model is at a high level and can be used for clinical applications. The research helps the radiologist identify kidney stones with less computational cost and disregards the need for many experts for such applications.
Collapse
Affiliation(s)
- Özlem Sabuncu
- Department of Electrical and Electronic Engineering, Near East University, Nicosia, Mersin, Türkiye
| | - Bülent Bilgehan
- Department of Electrical and Electronic Engineering, Near East University, Nicosia, Mersin, Türkiye
| | - Enver Kneebone
- Vocational School of Health Services, European University of Lefke, Lefke, Mersin, Türkiye
| | - Omid Mirzaei
- Department of Biomedical Engineering, Near East University, Nicosia, Mersin, Türkiye
| |
Collapse
|
33
|
Allen TJ, Henze Bancroft LC, Unal O, Estkowski LD, Cashen TA, Korosec F, Strigel RM, Kelcz F, Fowler AM, Gegios A, Thai J, Lebel RM, Holmes JH. Evaluation of a Deep Learning Reconstruction for High-Quality T2-Weighted Breast Magnetic Resonance Imaging. Tomography 2023; 9:1949-1964. [PMID: 37888744 PMCID: PMC10611328 DOI: 10.3390/tomography9050152] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 10/16/2023] [Accepted: 10/16/2023] [Indexed: 10/28/2023] Open
Abstract
Deep learning (DL) reconstruction techniques to improve MR image quality are becoming commercially available with the hope that they will be applicable to multiple imaging application sites and acquisition protocols. However, before clinical implementation, these methods must be validated for specific use cases. In this work, the quality of standard-of-care (SOC) T2w and a high-spatial-resolution (HR) imaging of the breast were assessed both with and without prototype DL reconstruction. Studies were performed using data collected from phantoms, 20 retrospectively collected SOC patient exams, and 56 prospectively acquired SOC and HR patient exams. Image quality was quantitatively assessed via signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), and edge sharpness. Qualitatively, all in vivo images were scored by either two or four radiologist readers using 5-point Likert scales in the following categories: artifacts, perceived sharpness, perceived SNR, and overall quality. Differences in reader scores were tested for significance. Reader preference and perception of signal intensity changes were also assessed. Application of the DL resulted in higher average SNR (1.2-2.8 times), CNR (1.0-1.8 times), and image sharpness (1.2-1.7 times). Qualitatively, the SOC acquisition with DL resulted in significantly improved image quality scores in all categories compared to non-DL images. HR acquisition with DL significantly increased SNR, sharpness, and overall quality compared to both the non-DL SOC and the non-DL HR images. The acquisition time for the HR data only required a 20% increase compared to the SOC acquisition and readers typically preferred DL images over non-DL counterparts. Overall, the DL reconstruction demonstrated improved T2w image quality in clinical breast MRI.
Collapse
Affiliation(s)
- Timothy J. Allen
- Department of Medical Physics, University of Wisconsin-Madison, 1111 Highland Avenue, Madison, WI 53705, USA
| | - Leah C. Henze Bancroft
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | - Orhan Unal
- Department of Medical Physics, University of Wisconsin-Madison, 1111 Highland Avenue, Madison, WI 53705, USA
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | | | - Ty A. Cashen
- GE Healthcare, 3000 N Grandview Blvd, Waukesha, WI 53188, USA (R.M.L.)
| | - Frank Korosec
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | - Roberta M. Strigel
- Department of Medical Physics, University of Wisconsin-Madison, 1111 Highland Avenue, Madison, WI 53705, USA
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
- Carbone Cancer Center, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | - Frederick Kelcz
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | - Amy M. Fowler
- Department of Medical Physics, University of Wisconsin-Madison, 1111 Highland Avenue, Madison, WI 53705, USA
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
- Carbone Cancer Center, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | - Alison Gegios
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | - Janice Thai
- Department of Radiology, University of Wisconsin-Madison, 600 Highland Avenue, Madison, WI 53792, USA
| | - R. Marc Lebel
- GE Healthcare, 3000 N Grandview Blvd, Waukesha, WI 53188, USA (R.M.L.)
| | - James H. Holmes
- Department of Radiology, University of Iowa, 169 Newton Road, Iowa City, IA 52242, USA
- Department of Biomedical Engineering, University of Iowa, 3100 Seamans Center, Iowa City, IA 52242, USA
- Holden Comprehensive Cancer Center, University of Iowa, 200 Hawkins Drive, Iowa City, IA 52242, USA
| |
Collapse
|
34
|
López-Blanco R, Sorrentino Rodriguez A, Cubo E, Gabilondo Í, Ezpeleta D, Labrador-Espinosa MÁ, Sánchez-Ferro Á, Tejero C, Matarazzo M. Impact of new technologies on neurology in Spain. Review by the New Technologies Ad-Hoc Committee of the Spanish Society of Neurology. Neurologia 2023; 38:591-598. [PMID: 35842132 DOI: 10.1016/j.nrleng.2020.10.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 10/10/2020] [Indexed: 10/17/2022] Open
Abstract
INTRODUCTION New technologies are increasingly widespread in biomedicine. Using the consensus definition of new technologies established by the New Technologies Ad-Hoc Committee of the Spanish Society of Neurology (SEN), we evaluated the impact of these technologies on Spanish neurology, based on communications presented at Annual Meetings of the SEN. MATERIAL AND METHODS We defined the concept of new technology in neurology as a novel technology or novel application of an existing technology, characterised by a certain degree of coherence persisting over time, with the potential to have an impact on the present and/or future of neurology. We conducted a descriptive study of scientific communications presented at the SEN's annual meetings from 2012 to 2018, analysing the type of technology, the field of neurology, and the geographical provenance of the studies. RESULTS We identified 299 communications related with new technologies from a total of 8139 (3.7%), including 120 posters and 179 oral communications, ranging from 1.6% of all communications in 2012 to 6.8% in 2018. The technologies most commonly addressed were advanced neuroimaging (24.7%), biosensors (17.1%), electrophysiology and neurostimulation (14.7%), and telemedicine (13.7%). The neurological fields where new technologies were most widely employed were movement disorders (18.4%), cerebrovascular diseases (15.7%), and dementia (13.4%). Madrid was the region presenting the highest number of communications related to new technologies (32.8%), followed by Catalonia (26.8%) and Andalusia (9.0%). CONCLUSIONS The number of communications addressing new technologies follows an upward trend. The number of technologies used in neurology has increased in parallel with their availability. We found scientific communications in all neurological subspecialties, with a heterogeneous geographical distribution.
Collapse
Affiliation(s)
- R López-Blanco
- Servicio Integrado de Neurología, Hospital Universitario Rey Juan Carlos (Móstoles), Hospital General de Villalba, Hospital Universitario Infanta Elena (Valdemoro), Madrid, Spain
| | | | - E Cubo
- Hospital Universitario Burgos, Burgos, Spain
| | - Í Gabilondo
- Hospital Universitario de Cruces, Barakaldo, Spain
| | - D Ezpeleta
- Hospital Universitario Quirónsalud Madrid, Pozuelo de Alarcón, Madrid, Spain
| | - M Á Labrador-Espinosa
- Instituto de Biomedicina de Sevilla, Hospital Universitario Virgen del Rocío, Sevilla, Spain
| | - Á Sánchez-Ferro
- HM CINAC, Hospital Universitario HM Puerta del Sur, Móstoles, Madrid, Spain
| | - C Tejero
- Hospital Clinico Universitario Lozano Blesa, Zaragoza, Spain
| | - M Matarazzo
- HM CINAC, Hospital Universitario HM Puerta del Sur, Móstoles, Madrid, Spain; Pacific Parkinson's Research Centre, University of British Columbia, Vancouver, BC, Canada.
| |
Collapse
|
35
|
Li Z, Jiang Y, Lu M, Li R, Xia Y. Survival Prediction via Hierarchical Multimodal Co-Attention Transformer: A Computational Histology-Radiology Solution. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:2678-2689. [PMID: 37030860 DOI: 10.1109/tmi.2023.3263010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
The rapid advances in deep learning-based computational pathology and radiology have demonstrated the promise of using whole slide images (WSIs) and radiology images for survival prediction in cancer patients. However, most image-based survival prediction methods are limited to using either histology or radiology alone, leaving integrated approaches across histology and radiology relatively underdeveloped. There are two main challenges in integrating WSIs and radiology images: (1) the gigapixel nature of WSIs and (2) the vast difference in spatial scales between WSIs and radiology images. To address these challenges, in this work, we propose an interpretable, weakly-supervised, multimodal learning framework, called Hierarchical Multimodal Co-Attention Transformer (HMCAT), to integrate WSIs and radiology images for survival prediction. Our approach first uses hierarchical feature extractors to capture various information including cellular features, cellular organization, and tissue phenotypes in WSIs. Then the hierarchical radiology-guided co- attention (HRCA) in HMCAT characterizes the multimodal interactions between hierarchical histology-based visual concepts and radiology features and learns hierarchical co- attention mappings for two modalities. Finally, HMCAT combines their complementary information into a multimodal risk score and discovers prognostic features from two modalities by multimodal interpretability. We apply our approach to two cancer datasets (365 WSIs with matched magnetic resonance [MR] images and 213 WSIs with matched computed tomography [CT] images). Our results demonstrate that the proposed HMCAT consistently achieves superior performance over the unimodal approaches trained on either histology or radiology data alone, as well as other state-of-the-art methods.
Collapse
|
36
|
Gupta R, Kumari S, Senapati A, Ambasta RK, Kumar P. New era of artificial intelligence and machine learning-based detection, diagnosis, and therapeutics in Parkinson's disease. Ageing Res Rev 2023; 90:102013. [PMID: 37429545 DOI: 10.1016/j.arr.2023.102013] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 06/26/2023] [Accepted: 07/06/2023] [Indexed: 07/12/2023]
Abstract
Parkinson's disease (PD) is characterized by the loss of neuronal cells, which leads to synaptic dysfunction and cognitive defects. Despite the advancements in treatment strategies, the management of PD is still a challenging event. Early prediction and diagnosis of PD are of utmost importance for effective management of PD. In addition, the classification of patients with PD as compared to normal healthy individuals also imposes drawbacks in the early diagnosis of PD. To address these challenges, artificial intelligence (AI) and machine learning (ML) models have been implicated in the diagnosis, prediction, and treatment of PD. Recent times have also demonstrated the implication of AI and ML models in the classification of PD based on neuroimaging methods, speech recording, gait abnormalities, and others. Herein, we have briefly discussed the role of AI and ML in the diagnosis, treatment, and identification of novel biomarkers in the progression of PD. We have also highlighted the role of AI and ML in PD management through altered lipidomics and gut-brain axis. We briefly explain the role of early PD detection through AI and ML algorithms based on speech recordings, handwriting patterns, gait abnormalities, and neuroimaging techniques. Further, the review discuss the potential role of the metaverse, the Internet of Things, and electronic health records in the effective management of PD to improve the quality of life. Lastly, we also focused on the implementation of AI and ML-algorithms in neurosurgical process and drug discovery.
Collapse
Affiliation(s)
- Rohan Gupta
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA.
| | - Smita Kumari
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA
| | | | - Rashmi K Ambasta
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA
| | - Pravir Kumar
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA.
| |
Collapse
|
37
|
Singh J, Singh N, Fouda MM, Saba L, Suri JS. Attention-Enabled Ensemble Deep Learning Models and Their Validation for Depression Detection: A Domain Adoption Paradigm. Diagnostics (Basel) 2023; 13:2092. [PMID: 37370987 DOI: 10.3390/diagnostics13122092] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 06/08/2023] [Accepted: 06/12/2023] [Indexed: 06/29/2023] Open
Abstract
Depression is increasingly prevalent, leading to higher suicide risk. Depression detection and sentimental analysis of text inputs in cross-domain frameworks are challenging. Solo deep learning (SDL) and ensemble deep learning (EDL) models are not robust enough. Recently, attention mechanisms have been introduced in SDL. We hypothesize that attention-enabled EDL (aeEDL) architectures are superior compared to attention-not-enabled SDL (aneSDL) or aeSDL models. We designed EDL-based architectures with attention blocks to build eleven kinds of SDL model and five kinds of EDL model on four domain-specific datasets. We scientifically validated our models by comparing "seen" and "unseen" paradigms (SUP). We benchmarked our results against the SemEval (2016) sentimental dataset and established reliability tests. The mean increase in accuracy for EDL over their corresponding SDL components was 4.49%. Regarding the effect of attention block, the increase in the mean accuracy (AUC) of aeSDL over aneSDL was 2.58% (1.73%), and the increase in the mean accuracy (AUC) of aeEDL over aneEDL was 2.76% (2.80%). When comparing EDL vs. SDL for non-attention and attention, the mean aneEDL was greater than aneSDL by 4.82% (3.71%), and the mean aeEDL was greater than aeSDL by 5.06% (4.81%). For the benchmarking dataset (SemEval), the best-performing aeEDL model (ALBERT+BERT-BiLSTM) was superior to the best aeSDL (BERT-BiLSTM) model by 3.86%. Our scientific validation and robust design showed a difference of only 2.7% in SUP, thereby meeting the regulatory constraints. We validated all our hypotheses and further demonstrated that aeEDL is a very effective and generalized method for detecting symptoms of depression in cross-domain settings.
Collapse
Affiliation(s)
- Jaskaran Singh
- Department of Computer Science, Graphic Era, Deemed to be University, Dehradun 248002, India
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era, Deemed to be University, Dehradun 248002, India
| | - Mostafa M Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Luca Saba
- Department of Neurology, University of Cagliari, 09124 Cagliari, Italy
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 94203, USA
| |
Collapse
|
38
|
Xu M, Ouyang Y, Yuan Z. Deep Learning Aided Neuroimaging and Brain Regulation. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23114993. [PMID: 37299724 DOI: 10.3390/s23114993] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 05/15/2023] [Accepted: 05/22/2023] [Indexed: 06/12/2023]
Abstract
Currently, deep learning aided medical imaging is becoming the hot spot of AI frontier application and the future development trend of precision neuroscience. This review aimed to render comprehensive and informative insights into the recent progress of deep learning and its applications in medical imaging for brain monitoring and regulation. The article starts by providing an overview of the current methods for brain imaging, highlighting their limitations and introducing the potential benefits of using deep learning techniques to overcome these limitations. Then, we further delve into the details of deep learning, explaining the basic concepts and providing examples of how it can be used in medical imaging. One of the key strengths is its thorough discussion of the different types of deep learning models that can be used in medical imaging including convolutional neural networks (CNNs), recurrent neural networks (RNNs), and generative adversarial network (GAN) assisted magnetic resonance imaging (MRI), positron emission tomography (PET)/computed tomography (CT), electroencephalography (EEG)/magnetoencephalography (MEG), optical imaging, and other imaging modalities. Overall, our review on deep learning aided medical imaging for brain monitoring and regulation provides a referrable glance for the intersection of deep learning aided neuroimaging and brain regulation.
Collapse
Affiliation(s)
- Mengze Xu
- Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Zhuhai 519087, China
- Centre for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Macau SAR 999078, China
| | - Yuanyuan Ouyang
- Nanomicro Sino-Europe Technology Company Limited, Zhuhai 519031, China
- Jiangfeng China-Portugal Technology Co., Ltd., Macau SAR 999078, China
| | - Zhen Yuan
- Centre for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Macau SAR 999078, China
| |
Collapse
|
39
|
Adam CA, Marcu DTM, Mitu O, Roca M, Aursulesei Onofrei V, Zabara ML, Tribuș LC, Cumpăt C, Crișan Dabija R, Mitu F. Old and Novel Predictors for Cardiovascular Risk in Diabetic Foot Syndrome—A Narrative Review. APPLIED SCIENCES 2023; 13:5990. [DOI: 10.3390/app13105990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
Diabetic foot syndrome (DFS) is a complication associated with diabetes that has a strong negative impact, both medically and socio-economically. Recent epidemiological data show that one in six patients with diabetes will develop an ulcer in their lifetime. Vascular complications associated with diabetic foot have multiple prognostic implications in addition to limiting functional status and leading to decreased quality of life for these patients. We searched the electronic databases of PubMed, MEDLINE and EMBASE for studies that evaluated the role of DFS as a cardiovascular risk factor through the pathophysiological mechanisms involved, in particular the inflammatory ones and the associated metabolic changes. In the era of evidence-based medicine, the management of these cases in multidisciplinary teams of “cardio-diabetologists” prevents the occurrence of long-term disabling complications and has prognostic value for cardiovascular morbidity and mortality among diabetic patients. Identifying artificial-intelligence-based cardiovascular risk prediction models or conducting extensive clinical trials on gene therapy or potential therapeutic targets promoted by in vitro studies represent future research directions with a modulating role on the risk of morbidity and mortality in patients with DFS.
Collapse
Affiliation(s)
- Cristina Andreea Adam
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- Clinical Rehabilitation Hospital, Cardiovascular Rehabilitation Clinic, 700661 Iasi, Romania
| | - Dragos Traian Marius Marcu
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- Clinical Hospital of Pneumophthisiology Iași, 700115 Iasi, Romania
| | - Ovidiu Mitu
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- “St. Spiridon” Clinical Emergency Hospital, 700111 Iasi, Romania
| | - Mihai Roca
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- Clinical Rehabilitation Hospital, Cardiovascular Rehabilitation Clinic, 700661 Iasi, Romania
| | - Viviana Aursulesei Onofrei
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- “St. Spiridon” Clinical Emergency Hospital, 700111 Iasi, Romania
| | - Mihai Lucian Zabara
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
| | - Laura Carina Tribuș
- Department of Internal Medicine, Faculty of Dentistry, “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania
- Department of Internal Medicine, Ilfov County Emergency Hospital, 022104 Bucharest, Romania
| | - Carmen Cumpăt
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- Department of Management, “Alexandru Ioan Cuza” University, 700506 Iasi, Romania
| | - Radu Crișan Dabija
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- Clinical Hospital of Pneumophthisiology Iași, 700115 Iasi, Romania
| | - Florin Mitu
- Department of Medical Specialties I and III and Department of Surgical Specialties, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
- Clinical Hospital of Pneumophthisiology Iași, 700115 Iasi, Romania
- Academy of Medical Sciences, 030167 Bucharest, Romania
- Academy of Romanian Scientists, 700050 Iasi, Romania
| |
Collapse
|
40
|
Prediction of O-6-methylguanine-DNA methyltransferase and overall survival of the patients suffering from glioblastoma using MRI-based hybrid radiomics signatures in machine and deep learning framework. Neural Comput Appl 2023. [DOI: 10.1007/s00521-023-08405-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
|
41
|
Fu F, Shan Y, Yang G, Zheng C, Zhang M, Rong D, Wang X, Lu J. Deep Learning for Head and Neck CT Angiography: Stenosis and Plaque Classification. Radiology 2023; 307:e220996. [PMID: 36880944 DOI: 10.1148/radiol.220996] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/08/2023]
Abstract
Background Studies have rarely investigated stenosis detection from head and neck CT angiography scans because accurate interpretation is time consuming and labor intensive. Purpose To develop an automated convolutional neural network-based method for accurate stenosis detection and plaque classification in head and neck CT angiography images and compare its performance with that of radiologists. Materials and Methods A deep learning (DL) algorithm was constructed and trained with use of head and neck CT angiography images that were collected retrospectively from four tertiary hospitals between March 2020 and July 2021. CT scans were partitioned into training, validation, and independent test sets at a ratio of 7:2:1. An independent test set of CT angiography scans was collected prospectively between October 2021 and December 2021 in one of the four tertiary centers. Stenosis grade categories were as follows: mild stenosis (<50%), moderate stenosis (50%-69%), severe stenosis (70%-99%), and occlusion (100%). The stenosis diagnosis and plaque classification of the algorithm were compared with the ground truth of consensus by two radiologists (with more than 10 years of experience). The performance of the models was analyzed in terms of accuracy, sensitivity, specificity, and areas under the receiver operating characteristic curve. Results There were 3266 patients (mean age ± SD, 62 years ± 12; 2096 men) evaluated. The consistency between radiologists and the DL-assisted algorithm on plaque classification was 85.6% (320 of 374 cases [95% CI: 83.2, 88.6]) on a per-vessel basis. Moreover, the artificial intelligence model assisted in visual assessment, such as increasing confidence in the degree of stenosis. This reduced the time needed for diagnosis and report writing of radiologists from 28.8 minutes ± 5.6 to 12.4 minutes ± 2.0 (P < .001). Conclusion A deep learning algorithm for head and neck CT angiography interpretation accurately determined vessel stenosis and plaque classification and had equivalent diagnostic performance when compared with experienced radiologists. © RSNA, 2023 Supplemental material is available for this article.
Collapse
Affiliation(s)
- Fan Fu
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| | - Yi Shan
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| | - Guang Yang
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| | - Chao Zheng
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| | - Miao Zhang
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| | - Dongdong Rong
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| | - Ximing Wang
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| | - Jie Lu
- From the Department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University, No. 45 Changchun St, Xicheng District, Beijing 100053, China (F.F., Y.S., M.Z., D.R., J.L.); Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics, Beijing, China (F.F., Y.S., M.Z., D.R., J.L.); Department of Nuclear Medicine, Ruijin Hospital, Shanghai Jiaotong University, Shanghai, China (F.F.); Shukun (Beijing) Technology Co, Beijing, China (G.Y., C.Z.); and Department of Radiology, Shandong Provincial Hospital, Jinan, China (X.W.)
| |
Collapse
|
42
|
Saba L, Loewe C, Weikert T, Williams MC, Galea N, Budde RPJ, Vliegenthart R, Velthuis BK, Francone M, Bremerich J, Natale L, Nikolaou K, Dacher JN, Peebles C, Caobelli F, Redheuil A, Dewey M, Kreitner KF, Salgado R. State-of-the-art CT and MR imaging and assessment of atherosclerotic carotid artery disease: standardization of scanning protocols and measurements-a consensus document by the European Society of Cardiovascular Radiology (ESCR). Eur Radiol 2023; 33:1063-1087. [PMID: 36194267 PMCID: PMC9889495 DOI: 10.1007/s00330-022-09024-7] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Revised: 06/26/2022] [Accepted: 06/30/2022] [Indexed: 02/04/2023]
Abstract
The European Society of Cardiovascular Radiology (ESCR) is the European specialist society of cardiac and vascular imaging. This society's highest priority is the continuous improvement, development, and standardization of education, training, and best medical practice, based on experience and evidence. The present intra-society consensus is based on the existing scientific evidence and on the individual experience of the members of the ESCR writing group on carotid diseases, the members of the ESCR guidelines committee, and the members of the executive committee of the ESCR. The recommendations published herein reflect the evidence-based society opinion of ESCR. We have produced a twin-papers consensus, indicated through the documents as respectively "Part I" and "Part II." The first document (Part I) begins with a discussion of features, role, indications, and evidence for CT and MR imaging-based diagnosis of carotid artery disease for risk stratification and prediction of stroke (Section I). It then provides an extensive overview and insight into imaging-derived biomarkers and their potential use in risk stratification (Section II). Finally, detailed recommendations about optimized imaging technique and imaging strategies are summarized (Section III). The second part of this consensus paper (Part II) is focused on structured reporting of carotid imaging studies with CT/MR. KEY POINTS: • CT and MR imaging-based evaluation of carotid artery disease provides essential information for risk stratification and prediction of stroke. • Imaging-derived biomarkers and their potential use in risk stratification are evolving; their correct interpretation and use in clinical practice must be well-understood. • A correct imaging strategy and scan protocol will produce the best possible results for disease evaluation.
Collapse
Affiliation(s)
- Luca Saba
- Department of Radiology, University of Cagliari, Cagliari, Italy
| | - Christian Loewe
- Division of Cardiovascular and Interventional Radiology, Department of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, Vienna, Austria
| | - Thomas Weikert
- Department of Radiology, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Michelle C Williams
- BHF Centre for Cardiovascular Science, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh, EH164SB, UK
- Edinburgh Imaging Facility QMRI, University of Edinburgh, Edinburgh, UK
| | - Nicola Galea
- Policlinico Umberto I, Department of Radiological, Oncological and Pathological Sciences, Sapienza University of Rome, Rome, Italy
| | - Ricardo P J Budde
- Department of Radiology & Nuclear Medicine, Erasmus MC, Rotterdam, The Netherlands
| | - Rozemarijn Vliegenthart
- Department of Radiology, University of Groningen, University Medical Center Groningen, Hanzeplein 1, 9713 GZ, Groningen, The Netherlands
| | - Birgitta K Velthuis
- Department of Radiology, Utrecht University Medical Center, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands
| | - Marco Francone
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072, Milan, Italy
- IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, 20089, Milan, Italy
| | - Jens Bremerich
- Department of Radiology, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Luigi Natale
- Department of Radiological Sciences - Institute of Radiology, Catholic University of Rome, "A. Gemelli" University Hospital, Rome, Italy
| | - Konstantin Nikolaou
- Department of Diagnostic and Interventional Radiology, University of Tuebingen, Tübingen, Germany
| | - Jean-Nicolas Dacher
- Department of Radiology, Normandie University, UNIROUEN, INSERM U1096 - Rouen University Hospital, F 76000, Rouen, France
| | - Charles Peebles
- Department of Cardiothoracic Radiology, University Hospital Southampton, Southampton, UK
| | - Federico Caobelli
- University Clinic of Nuclear Medicine Inselspital Bern, University of Bern, Bern, Switzerland
| | - Alban Redheuil
- Institute of Cardiometabolism and Nutrition (ICAN), Paris, France
- Department of Cardiovascular and Thoracic, Imaging and Interventional Radiology, Institute of Cardiology, APHP, Pitié-Salpêtrière University Hospital, Paris, France
- Laboratoire d'Imagerie Biomédicale, Sorbonne Universités, UPMC Univ Paris 06, INSERM 1146, CNRS 7371, Paris, France
| | - Marc Dewey
- Department of Radiology, Charité - Universitätsmedizin Berlin, Charitéplatz 1, 10117, Berlin, Germany
| | - Karl-Friedrich Kreitner
- Department of Diagnostic and Interventional Radiology, University Medical Center, Mainz; Langenbeckstraße 1, 55131, Mainz, Germany
| | - Rodrigo Salgado
- Department of Radiology, Antwerp University Hospital & Antwerp University, Holy Heart Lier, Belgium.
| |
Collapse
|
43
|
Saxena S, Jena B, Mohapatra B, Gupta N, Kalra M, Scartozzi M, Saba L, Suri JS. Fused deep learning paradigm for the prediction of o6-methylguanine-DNA methyltransferase genotype in glioblastoma patients: A neuro-oncological investigation. Comput Biol Med 2023; 153:106492. [PMID: 36621191 DOI: 10.1016/j.compbiomed.2022.106492] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 11/29/2022] [Accepted: 12/27/2022] [Indexed: 01/06/2023]
Abstract
BACKGROUND The O6-methylguanine-DNA methyltransferase (MGMT) is a deoxyribonucleic acid (DNA) repairing enzyme that has been established as an essential clinical brain tumor biomarker for Glioblastoma Multiforme (GBM). Knowing the status of MGMT methylation biomarkers using multi-parametric MRI (mp-MRI) helps neuro-oncologists to analyze GBM and its treatment plan. METHOD The hand-crafted radiomics feature extraction of GBM's subregions, such as edema(ED), tumor core (TC), and enhancing tumor (ET) in the machine learning (ML) framework, was investigated using support vector machine(SVM), K-Nearest Neighbours (KNN), random forest (RF), LightGBM, and extreme gradient boosting (XGB). For tissue-level analysis of the promotor genes in GBM, we used the deep residual neural network (ResNet-18) with 3D architecture, followed by EfficientNet-based investigation for variants as B0 and B1. Lastly, we analyzed the fused deep learning (FDL) framework that combines ML and DL frameworks. RESULT Structural mp-MRI consisting of T1, T2, FLAIR, and T1GD having a size of 400 and 185 patients, respectively, for discovery and replication cohorts. Using the CV protocol in the ResNet-3D framework, MGMT methylation status prediction in mp-MRI gave the AUC of 0.753 (p < 0.0001) and 0.72 (p < 0.0001) for the discovery and replication cohort, respectively. We presented that the FDL is ∼7% superior to solo DL and ∼15% to solo ML. CONCLUSION The proposed study aims to provide solutions for building an efficient predictive model of MGMT for GBM patients using deep radiomics features obtained from mp-MRI with the end-to-end ResNet-18 3D and FDL imaging signatures.
Collapse
Affiliation(s)
- Sanjay Saxena
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Biswajit Jena
- Department of Computer Science & Engineering, Institute of Technical Education and Research, SOA Deemed to be University, Bhubaneswar, India
| | - Bibhabasu Mohapatra
- Department of Computer Science & Engineering, International Institute of Information Technology, Bhubaneswar, Odisha, India
| | - Neha Gupta
- Bharati Vidyapeeth's College of Engineering, Paschim Vihar, New Delhi, India
| | - Manudeep Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA, 02114, USA
| | - Mario Scartozzi
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Luca Saba
- Department of Radiology, A.O.U, di Cagliari-Polo di Monserrato s.s, 09124, Cagliari, Italy
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™ LLC, Roseville, CA, USA; Knowledge Engineering Centre, Global Biomedical Technologies, Inc, Roseville, CA, USA.
| |
Collapse
|
44
|
Role of Ensemble Deep Learning for Brain Tumor Classification in Multiple Magnetic Resonance Imaging Sequence Data. Diagnostics (Basel) 2023; 13:diagnostics13030481. [PMID: 36766587 PMCID: PMC9914433 DOI: 10.3390/diagnostics13030481] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 01/24/2023] [Accepted: 01/26/2023] [Indexed: 01/31/2023] Open
Abstract
The biopsy is a gold standard method for tumor grading. However, due to its invasive nature, it has sometimes proved fatal for brain tumor patients. As a result, a non-invasive computer-aided diagnosis (CAD) tool is required. Recently, many magnetic resonance imaging (MRI)-based CAD tools have been proposed for brain tumor grading. The MRI has several sequences, which can express tumor structure in different ways. However, a suitable MRI sequence for brain tumor classification is not yet known. The most common brain tumor is 'glioma', which is the most fatal form. Therefore, in the proposed study, to maximize the classification ability between low-grade versus high-grade glioma, three datasets were designed comprising three MRI sequences: T1-Weighted (T1W), T2-weighted (T2W), and fluid-attenuated inversion recovery (FLAIR). Further, five well-established convolutional neural networks, AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50 were adopted for tumor classification. An ensemble algorithm was proposed using the majority vote of above five deep learning (DL) models to produce more consistent and improved results than any individual model. Five-fold cross validation (K5-CV) protocol was adopted for training and testing. For the proposed ensembled classifier with K5-CV, the highest test accuracies of 98.88 ± 0.63%, 97.98 ± 0.86%, and 94.75 ± 0.61% were achieved for FLAIR, T2W, and T1W-MRI data, respectively. FLAIR-MRI data was found to be most significant for brain tumor classification, where it showed a 4.17% and 0.91% improvement in accuracy against the T1W-MRI and T2W-MRI sequence data, respectively. The proposed ensembled algorithm (MajVot) showed significant improvements in the average accuracy of three datasets of 3.60%, 2.84%, 1.64%, 4.27%, and 1.14%, respectively, against AlexNet, VGG16, ResNet18, GoogleNet, and ResNet50.
Collapse
|
45
|
Chang CY, Huber FA, Yeh KJ, Buckless C, Torriani M. Original research: utilization of a convolutional neural network for automated detection of lytic spinal lesions on body CTs. Skeletal Radiol 2023; 52:1377-1384. [PMID: 36651936 DOI: 10.1007/s00256-023-04283-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Revised: 01/11/2023] [Accepted: 01/11/2023] [Indexed: 01/19/2023]
Abstract
OBJECTIVE To develop, train, and test a convolutional neural network (CNN) for detection of spinal lytic lesions in chest, abdomen, and pelvis CT scans. MATERIALS AND METHODS Cases of malignant spinal lytic lesions in CT scans were identified. Images were manually segmented for the following classes: (i) lesion, (ii) normal bone, (iii) background. If more than one lesion was on a single slice, all lesions were segmented. Images were stored as 128×128 pixel grayscale, with 10% segregated for testing. The training pipeline of the dataset included histogram equalization and data augmentation. A model was trained on Keras/Tensorflow using an 80/20 training/validation split, based on U-Net architecture. Additional testing of the model was performed on 1106 images of healthy controls. Global sensitivity measured detection of any lesion on a single image. Local sensitivity and positive predictive value (PPV) measured detection of all lesions on an image. Global specificity measured false positive rate in non-pathologic bone. RESULTS Six hundred images were obtained for model creation. The training set consisted of 540 images, which was augmented to 20,000. The test set consisted of 60 images. Model training was performed in triplicate. Mean Dice scores were 0.61 for lytic lesion, 0.95 for normal bone, and 0.99 for background. Mean global sensitivity was 90.6%, local sensitivity was 74.0%, local PPV was 78.3%, and global specificity was 63.3%. At least one false positive lesion was noted in 28.8-44.9% of control images. CONCLUSION A task-trained CNN showed good sensitivity in detecting spinal lytic lesions in axial CT images.
Collapse
Affiliation(s)
- Connie Y Chang
- Division of Musculoskeletal Imaging and Intervention, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street - YAW 6 -, Boston, MA, 02114, USA.
| | - Florian A Huber
- Division of Musculoskeletal Imaging and Intervention, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street - YAW 6 -, Boston, MA, 02114, USA
- Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Faculty of Medicine, University of Zurich, Zurich, Switzerland
| | - Kaitlyn J Yeh
- Division of Musculoskeletal Imaging and Intervention, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street - YAW 6 -, Boston, MA, 02114, USA
| | - Colleen Buckless
- Division of Musculoskeletal Imaging and Intervention, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street - YAW 6 -, Boston, MA, 02114, USA
| | - Martin Torriani
- Division of Musculoskeletal Imaging and Intervention, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street - YAW 6 -, Boston, MA, 02114, USA
| |
Collapse
|
46
|
Gutiérrez-Mondragón MA, König C, Vellido A. Layer-Wise Relevance Analysis for Motif Recognition in the Activation Pathway of the β2- Adrenergic GPCR Receptor. Int J Mol Sci 2023; 24:ijms24021155. [PMID: 36674669 PMCID: PMC9865744 DOI: 10.3390/ijms24021155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Revised: 12/22/2022] [Accepted: 12/30/2022] [Indexed: 01/11/2023] Open
Abstract
G-protein-coupled receptors (GPCRs) are cell membrane proteins of relevance as therapeutic targets, and are associated to the development of treatments for illnesses such as diabetes, Alzheimer's, or even cancer. Therefore, comprehending the underlying mechanisms of the receptor functional properties is of particular interest in pharmacoproteomics and in disease therapy at large. Their interaction with ligands elicits multiple molecular rearrangements all along their structure, inducing activation pathways that distinctly influence the cell response. In this work, we studied GPCR signaling pathways from molecular dynamics simulations as they provide rich information about the dynamic nature of the receptors. We focused on studying the molecular properties of the receptors using deep-learning-based methods. In particular, we designed and trained a one-dimensional convolution neural network and illustrated its use in a classification of conformational states: active, intermediate, or inactive, of the β2-adrenergic receptor when bound to the full agonist BI-167107. Through a novel explainability-oriented investigation of the prediction results, we were able to identify and assess the contribution of individual motifs (residues) influencing a particular activation pathway. Consequently, we contribute a methodology that assists in the elucidation of the underlying mechanisms of receptor activation-deactivation.
Collapse
Affiliation(s)
- Mario A. Gutiérrez-Mondragón
- Computer Science Department, Universitat Politècnica de Catalunya—UPC BarcelonaTech, 08034 Barcelona, Spain
- Intelligent Data Science and Artificial Intelligence (IDEAI-UPC) Research Center, Universitat Politècnica de Catalunya—UPC BarcelonaTech, 08034 Barcelona, Spain
| | - Caroline König
- Computer Science Department, Universitat Politècnica de Catalunya—UPC BarcelonaTech, 08034 Barcelona, Spain
- Intelligent Data Science and Artificial Intelligence (IDEAI-UPC) Research Center, Universitat Politècnica de Catalunya—UPC BarcelonaTech, 08034 Barcelona, Spain
- Correspondence:
| | - Alfredo Vellido
- Computer Science Department, Universitat Politècnica de Catalunya—UPC BarcelonaTech, 08034 Barcelona, Spain
- Intelligent Data Science and Artificial Intelligence (IDEAI-UPC) Research Center, Universitat Politècnica de Catalunya—UPC BarcelonaTech, 08034 Barcelona, Spain
| |
Collapse
|
47
|
Xiong M, Xu Y, Zhao Y, He S, Zhu Q, Wu Y, Hu X, Liu L. Quantitative analysis of artificial intelligence on liver cancer: A bibliometric analysis. Front Oncol 2023; 13:990306. [PMID: 36874099 PMCID: PMC9978515 DOI: 10.3389/fonc.2023.990306] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Accepted: 02/03/2023] [Indexed: 02/18/2023] Open
Abstract
Objective To provide the current research progress, hotspots, and emerging trends for AI in liver cancer, we have compiled a relative comprehensive and quantitative report on the research of liver disease using artificial intelligence by employing bibliometrics in this study. Methods In this study, the Web of Science Core Collection (WoSCC) database was used to perform systematic searches using keywords and a manual screening strategy, VOSviewer was used to analyze the degree of cooperation between countries/regions and institutions, as well as the co-occurrence of cooperation between authors and cited authors. Citespace was applied to generate a dual map to analyze the relationship of citing journals and citied journals and conduct a strong citation bursts ranking analysis of references. Online SRplot was used for in-depth keyword analysis and Microsoft Excel 2019 was used to collect the targeted variables from retrieved articles. Results 1724 papers were collected in this study, including 1547 original articles and 177 reviews. The study of AI in liver cancer mostly began from 2003 and has developed rapidly from 2017. China has the largest number of publications, and the United States has the highest H-index and total citation counts. The top three most productive institutions are the League of European Research Universities, Sun Yat Sen University, and Zhejiang University. Jasjit S. Suri and Frontiers in Oncology are the most published author and journal, respectively. Keyword analysis showed that in addition to the research on liver cancer, research on liver cirrhosis, fatty liver disease, and liver fibrosis were also common. Computed tomography was the most used diagnostic tool, followed by ultrasound and magnetic resonance imaging. The diagnosis and differential diagnosis of liver cancer are currently the most widely adopted research goals, and comprehensive analyses of multi-type data and postoperative analysis of patients with advanced liver cancer are rare. The use of convolutional neural networks is the main technical method used in studies of AI on liver cancer. Conclusion AI has undergone rapid development and has a wide application in the diagnosis and treatment of liver diseases, especially in China. Imaging is an indispensable tool in this filed. Mmulti-type data fusion analysis and development of multimodal treatment plans for liver cancer could become the major trend of future research in AI in liver cancer.
Collapse
Affiliation(s)
- Ming Xiong
- Department of Digital Medicine, School of Biomedical Engineering and Medical Imaging, Third Military Medical University (Army Medical University), Chongqing, China
| | - Yaona Xu
- Department of Digital Medicine, School of Biomedical Engineering and Medical Imaging, Third Military Medical University (Army Medical University), Chongqing, China
| | - Yang Zhao
- Department of Digital Medicine, School of Biomedical Engineering and Medical Imaging, Third Military Medical University (Army Medical University), Chongqing, China
| | - Si He
- Department of Digital Medicine, School of Biomedical Engineering and Medical Imaging, Third Military Medical University (Army Medical University), Chongqing, China
| | - Qihan Zhu
- Department of Digital Medicine, School of Biomedical Engineering and Medical Imaging, Third Military Medical University (Army Medical University), Chongqing, China
| | - Yi Wu
- Department of Digital Medicine, School of Biomedical Engineering and Medical Imaging, Third Military Medical University (Army Medical University), Chongqing, China
| | - Xiaofei Hu
- Department of Nuclear Medicine, Southwest Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| | - Li Liu
- Department of Digital Medicine, School of Biomedical Engineering and Medical Imaging, Third Military Medical University (Army Medical University), Chongqing, China.,Department of Ultrasound, Southwest Hospital, Third Military Medical University (Army Medical University), Chongqing, China
| |
Collapse
|
48
|
Lv P, Yang J, Wang J, Guo Y, Tang Q, Magnier B, Lin J, Zhou J. Ischemic stroke prediction of patients with carotid atherosclerotic stenosis via multi-modality fused network. Front Neurosci 2023; 17:1118376. [PMID: 36908778 PMCID: PMC9998529 DOI: 10.3389/fnins.2023.1118376] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 02/06/2023] [Indexed: 03/14/2023] Open
Abstract
Carotid atherosclerotic stenosis of the carotid artery is an important cause of ischemic cerebrovascular disease. The aim of this study was to predict the presence or absence of clinical symptoms in unknown patients by studying the existence or lack of symptoms of patients with carotid atherosclerotic stenosis. First, a deep neural network prediction model based on brain MRI imaging data of patients with multiple modalities is constructed; it uses the multi-modality features extracted from the neural network as inputs and the incidence of diagnosis as output to train the model. Then, a machine learning-based classification algorithm is developed to utilize the clinical features for comparison and evaluation. The experimental results showed that the deep learning model using imaging data could better predict the clinical symptom classification of patients. As part of preventive medicine, this study could help patients with carotid atherosclerosis narrowing to prepare for stroke prevention based on the prediction results.
Collapse
Affiliation(s)
- Peng Lv
- Department of Radiology, Zhongshan Hospital, Fudan University and Shanghai Institute of Medical Imaging, Shanghai, China
| | - Jing Yang
- School of Medicine, Xiamen University, Xiamen, China
| | - Jiacheng Wang
- Department of Computer Science at School of Informatics, Xiamen University, Xiamen, China
| | - Yi Guo
- Department of Radiology, Zhongshan Hospital Xiamen, Fudan University, Xiamen, China.,Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China
| | - Qiying Tang
- Department of Radiology, Zhongshan Hospital Xiamen, Fudan University, Xiamen, China.,Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China
| | - Baptiste Magnier
- Euromov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Ales, France
| | - Jiang Lin
- Department of Radiology, Zhongshan Hospital, Fudan University and Shanghai Institute of Medical Imaging, Shanghai, China
| | - Jianjun Zhou
- Department of Radiology, Zhongshan Hospital Xiamen, Fudan University, Xiamen, China.,Xiamen Municipal Clinical Research Center for Medical Imaging, Xiamen, China
| |
Collapse
|
49
|
Zhang Z, Wang Y, Zhang H, Samusak A, Rao H, Xiao C, Abula M, Cao Q, Dai Q. Artificial intelligence-assisted diagnosis of ocular surface diseases. Front Cell Dev Biol 2023; 11:1133680. [PMID: 36875760 PMCID: PMC9981656 DOI: 10.3389/fcell.2023.1133680] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 02/08/2023] [Indexed: 02/19/2023] Open
Abstract
With the rapid development of computer technology, the application of artificial intelligence (AI) in ophthalmology research has gained prominence in modern medicine. Artificial intelligence-related research in ophthalmology previously focused on the screening and diagnosis of fundus diseases, particularly diabetic retinopathy, age-related macular degeneration, and glaucoma. Since fundus images are relatively fixed, their standards are easy to unify. Artificial intelligence research related to ocular surface diseases has also increased. The main issue with research on ocular surface diseases is that the images involved are complex, with many modalities. Therefore, this review aims to summarize current artificial intelligence research and technologies used to diagnose ocular surface diseases such as pterygium, keratoconus, infectious keratitis, and dry eye to identify mature artificial intelligence models that are suitable for research of ocular surface diseases and potential algorithms that may be used in the future.
Collapse
Affiliation(s)
- Zuhui Zhang
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China.,National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| | - Ying Wang
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China
| | - Hongzhen Zhang
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China
| | - Arzigul Samusak
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China
| | - Huimin Rao
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China
| | - Chun Xiao
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China
| | - Muhetaer Abula
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China
| | - Qixin Cao
- Huzhou Traditional Chinese Medicine Hospital Affiliated to Zhejiang University of Traditional Chinese Medicine, Huzhou, China
| | - Qi Dai
- The First People's Hospital of Aksu District in Xinjiang, Aksu City, China.,National Clinical Research Center for Ocular Diseases, Eye Hospital, Wenzhou Medical University, Wenzhou, China
| |
Collapse
|
50
|
Developing a machine learning model to predict patient need for computed tomography imaging in the emergency department. PLoS One 2022; 17:e0278229. [PMID: 36520785 PMCID: PMC9754219 DOI: 10.1371/journal.pone.0278229] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 11/13/2022] [Indexed: 12/23/2022] Open
Abstract
Overcrowding is a well-known problem in hospitals and emergency departments (ED) that can negatively impact patients and staff. This study aims to present a machine learning model to detect a patient's need for a Computed Tomography (CT) exam in the emergency department at the earliest possible time. The data for this work was collected from ED at Thunder Bay Regional Health Sciences Centre over one year (05/2016-05/2017) and contained administrative triage information. The target outcome was whether or not a patient required a CT exam. Multiple combinations of text embedding methods, machine learning algorithms, and data resampling methods were experimented with to find the optimal model for this task. The final model was trained with 81, 118 visits and tested on a hold-out test set with a size of 9, 013 visits. The best model achieved a ROC AUC score of 0.86 and had a sensitivity of 87.3% and specificity of 70.9%. The most important factors that led to a CT scan order were found to be chief complaint, treatment area, and triage acuity. The proposed model was able to successfully identify patients needing a CT using administrative triage data that is available at the initial stage of a patient's arrival. By determining that a CT scan is needed early in the patient's visit, the ED can allocate resources to ensure these investigations are completed quickly and patient flow is maintained to reduce overcrowding.
Collapse
|