1
|
Sait ARW, Nagaraj R. Diabetic Foot Ulcers Detection Model Using a Hybrid Convolutional Neural Networks-Vision Transformers. Diagnostics (Basel) 2025; 15:736. [PMID: 40150079 PMCID: PMC11941693 DOI: 10.3390/diagnostics15060736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2025] [Revised: 03/13/2025] [Accepted: 03/14/2025] [Indexed: 03/29/2025] Open
Abstract
Background: Diabetic foot ulcers (DFUs) are severe and common complications of diabetes. Early and accurate DFUs classification is essential for effective treatment and prevention of severe complications. The existing DFUs classification methods have certain limitations, including limited performance, poor generalization, and lack of interpretability, restricting their use in clinical settings. Objectives: To overcome these limitations, this study proposes an innovative model to achieve robust and interpretable DFUs classification. Methodology: The proposed DFUs classification integrates MobileNet V3-SWIN, LeViT-Peformer, Tensor-based feature fusion, and ensemble splines-based Kolmogorov-Arnold Networks (KANs) with Shapley Additive exPlanations (SHAP) values to classify DFUs severities into ischemia and infection classes. In order to train and generalize the proposed model, the authors utilized the DFUs challenge (DFUC) 2021 and 2020 datasets. Findings: The proposed model achieved state-of-the-art performance, outperforming the existing approaches by obtaining an average accuracy of 98.7%, precision of 97.3%, recall of 97.4%, and F1-score of 97.3% on DFUC 2021. On DFUC 2020, it maintained a robust generalization accuracy of 96.9%, demonstrating superiority over standalone and baseline models. The study findings have significant implications for research and clinical practice. The findings offer an effective platform for scalable and explainable automated DFUs treatment and management, improving patient outcomes and clinical practices.
Collapse
Affiliation(s)
- Abdul Rahaman Wahab Sait
- Department of Archives and Communication, Center of Documentation and Administrative Communication, King Faisal University, P.O. Box 400, Hofuf 31982, Al-Ahsa, Saudi Arabia
| | - Ramprasad Nagaraj
- Department of Biochemistry, S S Hospital, S S Institute of Medical Sciences & Research Centre, Rajiv Gandhi University of Health Sciences, Davangere 577005, Karnataka, India;
| |
Collapse
|
2
|
M G S, Venkatesan C. SwinDFU-Net: Deep learning transformer network for infection identification in diabetic foot ulcer. Technol Health Care 2025; 33:601-618. [PMID: 39269872 DOI: 10.3233/thc-241444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/15/2024]
Abstract
BACKGROUND The identification of infection in diabetic foot ulcers (DFUs) is challenging due to variability within classes, visual similarity between classes, reduced contrast with healthy skin, and presence of artifacts. Existing studies focus on visual characteristics and tissue classification rather than infection detection, critical for assessing DFUs and predicting amputation risk. OBJECTIVE To address these challenges, this study proposes a deep learning model using a hybrid CNN and Swin Transformer architecture for infection classification in DFU images. The aim is to leverage end-to-end mapping without prior knowledge, integrating local and global feature extraction to improve detection accuracy. METHODS The proposed model utilizes a hybrid CNN and Swin Transformer architecture. It employs the Grad CAM technique to visualize the decision-making process of the CNN and Transformer blocks. The DFUC Challenge dataset is used for training and evaluation, emphasizing the model's ability to accurately classify DFU images into infected and non-infected categories. RESULTS The model achieves high performance metrics: sensitivity (95.98%), specificity (97.08%), accuracy (96.52%), and Matthews Correlation Coefficient (0.93). These results indicate the model's effectiveness in quickly diagnosing DFU infections, highlighting its potential as a valuable tool for medical professionals. CONCLUSION The hybrid CNN and Swin Transformer architecture effectively combines strengths from both models, enabling accurate classification of DFU images as infected or non-infected, even in complex scenarios. The use of Grad CAM provides insights into the model's decision process, aiding in identifying infected regions within DFU images. This approach shows promise for enhancing clinical assessment and management of DFU infections.
Collapse
|
3
|
Anbarasi LJ, Jawahar M, Jayakumari RB, Narendra M, Ravi V, Neeraja R. An overview of current developments and methods for identifying diabetic foot ulcers: A survey. WIRES DATA MINING AND KNOWLEDGE DISCOVERY 2024; 14. [DOI: 10.1002/widm.1562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Accepted: 09/04/2024] [Indexed: 01/06/2025]
Abstract
AbstractDiabetic foot ulcers (DFUs) present a substantial health risk across diverse age groups, creating challenges for healthcare professionals in the accurate classification and grading. DFU plays a crucial role in automated health monitoring and diagnosis systems, where the integration of medical imaging, computer vision, statistical analysis, and gait information is essential for comprehensive understanding and effective management. Diagnosing DFU is imperative, as it plays a major role in the processes of diagnosis, treatment planning, and neuropathy research within automated health monitoring and diagnosis systems. To address this, various machine learning and deep learning‐based methodologies have emerged in the literature to support healthcare practitioners in achieving improved diagnostic analyses for DFU. This survey paper investigates various diagnostic methodologies for DFU, spanning traditional statistical approaches to cutting‐edge deep learning techniques. It systematically reviews key stages involved in diabetic foot ulcer classification (DFUC) methods, including preprocessing, feature extraction, and classification, explaining their benefits and drawbacks. The investigation extends to exploring state‐of‐the‐art convolutional neural network models tailored for DFUC, involving extensive experiments with data augmentation and transfer learning methods. The overview also outlines datasets commonly employed for evaluating DFUC methodologies. Recognizing that neuropathy and reduced blood flow in the lower limbs might be caused by atherosclerotic blood vessels, this paper provides recommendations to researchers and practitioners involved in routine medical therapy to prevent substantial complications. Apart from reviewing prior literature, this survey aims to influence the future of DFU diagnostics by outlining prospective research directions, particularly in the domains of personalized and intelligent healthcare. Finally, this overview is to contribute to the continual evolution of DFU diagnosis in order to provide more effective and customized medical care.This article is categorized under:
Application Areas > Health Care
Technologies > Machine Learning
Technologies > Artificial Intelligence
Collapse
Affiliation(s)
- L. Jani Anbarasi
- School of Computer Science and Engineering Vellore Institute of Technology Chennai India
| | - Malathy Jawahar
- Leather Process Technology Division CSIR‐Central Leather Research Institute Chennai India
| | | | - Modigari Narendra
- School of Computer Science and Engineering Vellore Institute of Technology Chennai India
| | - Vinayakumar Ravi
- Center for Artificial Intelligence Prince Mohammad Bin Fahd University Khobar Saudi Arabia
| | - R. Neeraja
- School of Computer Science and Engineering Vellore Institute of Technology Chennai India
| |
Collapse
|
4
|
Weatherall T, Avsar P, Nugent L, Moore Z, McDermott JH, Sreenan S, Wilson H, McEvoy NL, Derwin R, Chadwick P, Patton D. The impact of machine learning on the prediction of diabetic foot ulcers - A systematic review. J Tissue Viability 2024; 33:853-863. [PMID: 39019690 DOI: 10.1016/j.jtv.2024.07.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2024] [Revised: 06/24/2024] [Accepted: 07/10/2024] [Indexed: 07/19/2024]
Abstract
INTRODUCTION Globally, diabetes mellitus poses a significant health challenge as well as the associated complications of diabetes, such as diabetic foot ulcers (DFUs). The early detection of DFUs is important in the healing process and machine learning may be able to help inform clinical staff during the treatment process. METHODS A PRISMA-informed search of the literature was completed via the Cochrane Library and MEDLINE (OVID), EMBASE, CINAHL Plus and Scopus databases for reports published in English and in the last ten years. The primary outcome of interest was the impact of machine learning on the prediction of DFUs. The secondary outcome was the statistical performance measures reported. Data were extracted using a predesigned data extraction tool. Quality appraisal was undertaken using the evidence-based librarianship critical appraisal tool. RESULTS A total of 18 reports met the inclusion criteria. Nine reports proposed models to identify two classes, either healthy skin or a DFU. Nine reports proposed models to predict the progress of DFUs, for example, classing infection versus non-infection, or using wound characteristics to predict healing. A variety of machine learning techniques were proposed. Where reported, sensitivity = 74.53-98 %, accuracy = 64.6-99.32 %, precision = 62.9-99 %, and the F-measure = 52.05-99.0 %. CONCLUSIONS A variety of machine learning models were suggested to successfully classify DFUs from healthy skin, or to inform the prediction of DFUs. The proposed machine learning models may have the potential to inform the clinical practice of managing DFUs and may help to improve outcomes for individuals with DFUs. Future research may benefit from the development of a standard device and algorithm that detects, diagnoses and predicts the progress of DFUs.
Collapse
Affiliation(s)
- Teagan Weatherall
- Skin Wounds and Trauma (SWaT) Research Centre, RCSI University of Medicine and Health Sciences, Dublin, Ireland; School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland.
| | - Pinar Avsar
- Skin Wounds and Trauma (SWaT) Research Centre, RCSI University of Medicine and Health Sciences, Dublin, Ireland; School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland.
| | - Linda Nugent
- Skin Wounds and Trauma (SWaT) Research Centre, RCSI University of Medicine and Health Sciences, Dublin, Ireland; School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland; Fakeeh College of Medical Sciences, Jeddah, Saudi Arabia.
| | - Zena Moore
- Skin Wounds and Trauma (SWaT) Research Centre, RCSI University of Medicine and Health Sciences, Dublin, Ireland; School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland; Fakeeh College of Medical Sciences, Jeddah, Saudi Arabia; School of Nursing and Midwifery, Griffith University, Southport, Queensland, Australia; Lida Institute, Shanghai, China; Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, Victoria, Australia; Department of Public Health, Faculty of Medicine and Health Sciences, Ghent University, Ghent, Belgium; University of Wales, Cardiff, UK; National Health and Medical Research Council Centre of Research Excellence in Wiser Wound Care, Menzies Health Institute Queensland, Southport, Queensland, Australia.
| | - John H McDermott
- Department of Endocrinology, Royal College of Surgeons in Ireland, Connolly Hospital Blanchardstown, Dublin, Ireland.
| | - Seamus Sreenan
- Department of Endocrinology, Royal College of Surgeons in Ireland, Connolly Hospital Blanchardstown, Dublin, Ireland.
| | - Hannah Wilson
- Skin Wounds and Trauma (SWaT) Research Centre, RCSI University of Medicine and Health Sciences, Dublin, Ireland; School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland.
| | - Natalie L McEvoy
- School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland.
| | - Rosemarie Derwin
- School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland.
| | - Paul Chadwick
- Birmingham City University, Birmingham, UK; Spectral MD, London, UK.
| | - Declan Patton
- Skin Wounds and Trauma (SWaT) Research Centre, RCSI University of Medicine and Health Sciences, Dublin, Ireland; School of Nursing and Midwifery, RCSI University of Medicine and Health Sciences, Dublin, Ireland; Fakeeh College of Medical Sciences, Jeddah, Saudi Arabia; School of Nursing and Midwifery, Griffith University, Southport, Queensland, Australia; Faculty of Science, Medicine and Health, University of Wollongong, Wollongong, New South Wales, Australia.
| |
Collapse
|
5
|
Zhao W, Huang Z, Tang S, Li W, Gao Y, Hu Y, Fan W, Cheng C, Yang Y, Zheng H, Liang D, Hu Z. MMCA-NET: A Multimodal Cross Attention Transformer Network for Nasopharyngeal Carcinoma Tumor Segmentation Based on a Total-Body PET/CT System. IEEE J Biomed Health Inform 2024; 28:5447-5458. [PMID: 38805334 DOI: 10.1109/jbhi.2024.3405993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/30/2024]
Abstract
Nasopharyngeal carcinoma (NPC) is a malignant tumor primarily treated by radiotherapy. Accurate delineation of the target tumor is essential for improving the effectiveness of radiotherapy. However, the segmentation performance of current models is unsatisfactory due to poor boundaries, large-scale tumor volume variation, and the labor-intensive nature of manual delineation for radiotherapy. In this paper, MMCA-Net, a novel segmentation network for NPC using PET/CT images that incorporates an innovative multimodal cross attention transformer (MCA-Transformer) and a modified U-Net architecture, is introduced to enhance modal fusion by leveraging cross-attention mechanisms between CT and PET data. Our method, tested against ten algorithms via fivefold cross-validation on samples from Sun Yat-sen University Cancer Center and the public HECKTOR dataset, consistently topped all four evaluation metrics with average Dice similarity coefficients of 0.815 and 0.7944, respectively. Furthermore, ablation experiments were conducted to demonstrate the superiority of our method over multiple baseline and variant techniques. The proposed method has promising potential for application in other tasks.
Collapse
|
6
|
Almufadi N, Alhasson HF. Classification of Diabetic Foot Ulcers from Images Using Machine Learning Approach. Diagnostics (Basel) 2024; 14:1807. [PMID: 39202295 PMCID: PMC11353632 DOI: 10.3390/diagnostics14161807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2024] [Revised: 08/12/2024] [Accepted: 08/14/2024] [Indexed: 09/03/2024] Open
Abstract
Diabetic foot ulcers (DFUs) represent a significant and serious challenge associated with diabetes. It is estimated that approximately one third of individuals with diabetes will develop DFUs at some point in their lives. This common complication can lead to serious health issues if not properly managed. The early diagnosis and treatment of DFUs are crucial to prevent severe complications, including lower limb amputation. DFUs can be categorized into two states: ischemia and infection. Accurate classification is required to avoid misdiagnosis due to the similarities between these two states. Several convolutional neural network (CNN) models have been used and pre-trained through transfer learning. These models underwent evaluation with hyperparameter tuning for the binary classification of different states of DFUs, such as ischemia and infection. This study aimed to develop an effective classification system for DFUs using CNN models and machine learning classifiers utilizing various CNN models, such as EfficientNetB0, DenseNet121, ResNet101, VGG16, InceptionV3, MobileNetV2, and InceptionResNetV2, due to their excellent performance in diverse computer vision tasks. Additionally, the head model functions as the ultimate component for making decisions in the model, utilizing data collected from preceding layers to make precise predictions or classifications. The results of the CNN models with the suggested head model have been used in different machine learning classifiers to determine which ones are most effective for enhancing the performance of each CNN model. The most optimal outcome in categorizing ischemia is a 97% accuracy rate. This was accomplished by integrating the suggested head model with the EfficientNetB0 model and inputting the outcomes into the logistic regression classifier. The EfficientNetB0 model, with the proposed modifications and by feeding the outcomes to the AdaBoost classifier, attains an accuracy of 93% in classifying infections.
Collapse
Affiliation(s)
| | - Haifa F. Alhasson
- Department of Information Technology, College of Computer, Qassim University, Buraydah 51452, Saudi Arabia
| |
Collapse
|
7
|
Verma G. Leveraging smart image processing techniques for early detection of foot ulcers using a deep learning network. Pol J Radiol 2024; 89:e368-e377. [PMID: 39139256 PMCID: PMC11321030 DOI: 10.5114/pjr/189412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Accepted: 05/28/2024] [Indexed: 08/15/2024] Open
Abstract
Purpose To detect foot ulcers in diabetic patients by analysing thermal images of the foot using a deep learning model and estimate the effectiveness of the proposed model by comparing it with some existing studies. Material and methods Open-source thermal images were used for the study. The dataset consists of two types of images of the feet of diabetic patients: normal and abnormal foot images. The dataset contains 1055 total images; among these, 543 are normal foot images, and the others are images of abnormal feet of the patient. The study's dataset was converted into a new and pre-processed dataset by applying canny edge detection and watershed segmentation. This pre-processed dataset was then balanced and enlarged using data augmentation, and after that, for prediction, a deep learning model was applied for the diagnosis of an ulcer in the foot. After applying canny edge detection and segmentation, the pre-processed dataset can enhance the model's performance for correct predictions and reduce the computational cost. Results Our proposed model, utilizing ResNet50 and EfficientNetB0, was tested on both the original dataset and the pre-processed dataset after applying edge detection and segmentation. The results were highly promising, with ResNet50 achieving 89% and 89.1% accuracy for the two datasets, respectively, and EfficientNetB0 surpassing this with 96.1% and 99.4% accuracy for the two datasets, respectively. Conclusions Our study offers a practical solution for foot ulcer detection, particularly in situations where expert analysis is not readily available. The efficacy of our models was tested using real images, and they outperformed other available models, demonstrating their potential for real-world application.
Collapse
Affiliation(s)
- Garima Verma
- School of Computing, DIT University, Dehradun, India
| |
Collapse
|
8
|
Narang K, Gupta M, Kumar R, Obaid AJ. Channel Attention Based on ResNet-50 Model for Image Classification of DFUs Using CNN. 2024 5TH INTERNATIONAL CONFERENCE FOR EMERGING TECHNOLOGY (INCET) 2024:1-6. [DOI: 10.1109/incet61516.2024.10593169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
Affiliation(s)
- Kriti Narang
- Chandigarh University,Department of Computer Science and Engineering,Punjab,India
| | - Meenu Gupta
- Chandigarh University,Department of Computer Science and Engineering,Punjab,India
| | - Rakesh Kumar
- Chandigarh University,Department of Computer Science and Engineering,Punjab,India
| | - Ahmed J. Obaid
- University of Kufa, Najaf, Iraq National University of Science and Technology,Faculty of Computer Science and Mathematics,Dhi Qar,Iraq
| |
Collapse
|
9
|
Wang Z, Tan X, Xue Y, Xiao C, Yue K, Lin K, Wang C, Zhou Q, Zhang J. Smart diabetic foot ulcer scoring system. Sci Rep 2024; 14:11588. [PMID: 38773207 PMCID: PMC11109117 DOI: 10.1038/s41598-024-62076-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 05/13/2024] [Indexed: 05/23/2024] Open
Abstract
Current assessment methods for diabetic foot ulcers (DFUs) lack objectivity and consistency, posing a significant risk to diabetes patients, including the potential for amputations, highlighting the urgent need for improved diagnostic tools and care standards in the field. To address this issue, the objective of this study was to develop and evaluate the Smart Diabetic Foot Ulcer Scoring System, ScoreDFUNet, which incorporates artificial intelligence (AI) and image analysis techniques, aiming to enhance the precision and consistency of diabetic foot ulcer assessment. ScoreDFUNet demonstrates precise categorization of DFU images into "ulcer," "infection," "normal," and "gangrene" areas, achieving a noteworthy accuracy rate of 95.34% on the test set, with elevated levels of precision, recall, and F1 scores. Comparative evaluations with dermatologists affirm that our algorithm consistently surpasses the performance of junior and mid-level dermatologists, closely matching the assessments of senior dermatologists, and rigorous analyses including Bland-Altman plots and significance testing validate the robustness and reliability of our algorithm. This innovative AI system presents a valuable tool for healthcare professionals and can significantly improve the care standards in the field of diabetic foot ulcer assessment.
Collapse
Affiliation(s)
- Zheng Wang
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
- Department of Dermatology, Shenzhen People's Hospital, The Second Clinical Medical College, Jinan University, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, Guangdong, China
| | - Xinyu Tan
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Yang Xue
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Chen Xiao
- Department of Dermatology, Shenzhen People's Hospital, The Second Clinical Medical College, Jinan University, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, Guangdong, China
- Candidate Branch of National Clinical Research Center for Skin Diseases, Shenzhen, 518020, Guangdong, China
| | - Kejuan Yue
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Kaibin Lin
- School of Computer Science, Hunan First Normal University, Changsha, 410205, China
| | - Chong Wang
- Department of Dermatology, Shenzhen People's Hospital, The Second Clinical Medical College, Jinan University, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, Guangdong, China.
- Candidate Branch of National Clinical Research Center for Skin Diseases, Shenzhen, 518020, Guangdong, China.
| | - Qiuhong Zhou
- Department of Clinical Nursing, Xiangya Hospital, Central South University, Changsha, 410008, China.
- Foot Prevention and Treatment Center, Xiangya Hospital, Central South University, Changsha, 410008, China.
| | - Jianglin Zhang
- Department of Dermatology, Shenzhen People's Hospital, The Second Clinical Medical College, Jinan University, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, Guangdong, China.
- Candidate Branch of National Clinical Research Center for Skin Diseases, Shenzhen, 518020, Guangdong, China.
- Department of Geriatrics, Shenzhen People's Hospital, The Second Clinical Medical College, Jinan University, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, Guangdong, China.
| |
Collapse
|
10
|
Guan H, Wang Y, Niu P, Zhang Y, Zhang Y, Miao R, Fang X, Yin R, Zhao S, Liu J, Tian J. The role of machine learning in advancing diabetic foot: a review. Front Endocrinol (Lausanne) 2024; 15:1325434. [PMID: 38742201 PMCID: PMC11089132 DOI: 10.3389/fendo.2024.1325434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Accepted: 04/09/2024] [Indexed: 05/16/2024] Open
Abstract
Background Diabetic foot complications impose a significant strain on healthcare systems worldwide, acting as a principal cause of morbidity and mortality in individuals with diabetes mellitus. While traditional methods in diagnosing and treating these conditions have faced limitations, the emergence of Machine Learning (ML) technologies heralds a new era, offering the promise of revolutionizing diabetic foot care through enhanced precision and tailored treatment strategies. Objective This review aims to explore the transformative impact of ML on managing diabetic foot complications, highlighting its potential to advance diagnostic accuracy and therapeutic approaches by leveraging developments in medical imaging, biomarker detection, and clinical biomechanics. Methods A meticulous literature search was executed across PubMed, Scopus, and Google Scholar databases to identify pertinent articles published up to March 2024. The search strategy was carefully crafted, employing a combination of keywords such as "Machine Learning," "Diabetic Foot," "Diabetic Foot Ulcers," "Diabetic Foot Care," "Artificial Intelligence," and "Predictive Modeling." This review offers an in-depth analysis of the foundational principles and algorithms that constitute ML, placing a special emphasis on their relevance to the medical sciences, particularly within the specialized domain of diabetic foot pathology. Through the incorporation of illustrative case studies and schematic diagrams, the review endeavors to elucidate the intricate computational methodologies involved. Results ML has proven to be invaluable in deriving critical insights from complex datasets, enhancing both the diagnostic precision and therapeutic planning for diabetic foot management. This review highlights the efficacy of ML in clinical decision-making, underscored by comparative analyses of ML algorithms in prognostic assessments and diagnostic applications within diabetic foot care. Conclusion The review culminates in a prospective assessment of the trajectory of ML applications in the realm of diabetic foot care. We believe that despite challenges such as computational limitations and ethical considerations, ML remains at the forefront of revolutionizing treatment paradigms for the management of diabetic foot complications that are globally applicable and precision-oriented. This technological evolution heralds unprecedented possibilities for treatment and opportunities for enhancing patient care.
Collapse
Affiliation(s)
- Huifang Guan
- College of Traditional Chinese Medicine, Changchun University of Chinese Medicine, Changchun, China
| | - Ying Wang
- College of Traditional Chinese Medicine, Changchun University of Chinese Medicine, Changchun, China
| | - Ping Niu
- Department of Encephalopathy, The Affiliated Hospital of Changchun University of Chinese Medicine, Changchun, Jilin, China
| | - Yuxin Zhang
- Institute of Metabolic Diseases, Guang’anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Yanjiao Zhang
- Institute of Metabolic Diseases, Guang’anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Runyu Miao
- Institute of Metabolic Diseases, Guang’anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Xinyi Fang
- Institute of Metabolic Diseases, Guang’anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Ruiyang Yin
- Institute of Metabolic Diseases, Guang’anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Shuang Zhao
- College of Traditional Chinese Medicine, Changchun University of Chinese Medicine, Changchun, China
| | - Jun Liu
- Department of Hand Surgery, Second Hospital of Jilin University, Changchun, China
| | - Jiaxing Tian
- Institute of Metabolic Diseases, Guang’anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| |
Collapse
|
11
|
Sheela KS, Reethika R, Sakthi V. Visualizing Healing Image Analysis of Gangrene from DFU Progression. 2024 SECOND INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN INFORMATION TECHNOLOGY AND ENGINEERING (ICETITE) 2024:1-7. [DOI: 10.1109/ic-etite58242.2024.10493815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
Affiliation(s)
- K. Santha Sheela
- Velammal College of Engineering and Technology,Computer Science and Engineering,Madurai,India
| | - R. Reethika
- Velammal College of Engineering and Technology,Computer Science and Engineering,Madurai,India
| | - V. Sakthi
- Velammal College of Engineering and Technology,Computer Science and Engineering,Madurai,India
| |
Collapse
|
12
|
Guo X, Yi W, Dong L, Kong L, Liu M, Zhao Y, Hui M, Chu X. Multi-Class Wound Classification via High and Low-Frequency Guidance Network. Bioengineering (Basel) 2023; 10:1385. [PMID: 38135976 PMCID: PMC10740846 DOI: 10.3390/bioengineering10121385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 11/24/2023] [Accepted: 11/28/2023] [Indexed: 12/24/2023] Open
Abstract
Wound image classification is a crucial preprocessing step to many intelligent medical systems, e.g., online diagnosis and smart medical. Recently, Convolutional Neural Network (CNN) has been widely applied to the classification of wound images and obtained promising performance to some extent. Unfortunately, it is still challenging to classify multiple wound types due to the complexity and variety of wound images. Existing CNNs usually extract high- and low-frequency features at the same convolutional layer, which inevitably causes information loss and further affects the accuracy of classification. To this end, we propose a novel High and Low-frequency Guidance Network (HLG-Net) for multi-class wound classification. To be specific, HLG-Net contains two branches: High-Frequency Network (HF-Net) and Low-Frequency Network (LF-Net). We employ pre-trained models ResNet and Res2Net as the feature backbone of the HF-Net, which makes the network capture the high-frequency details and texture information of wound images. To extract much low-frequency information, we utilize a Multi-Stream Dilation Convolution Residual Block (MSDCRB) as the backbone of the LF-Net. Moreover, a fusion module is proposed to fully explore informative features at the end of these two separate feature extraction branches, and obtain the final classification result. Extensive experiments demonstrate that HLG-Net can achieve maximum accuracy of 98.00%, 92.11%, and 82.61% in two-class, three-class, and four-class wound image classifications, respectively, which outperforms the previous state-of-the-art methods.
Collapse
Affiliation(s)
- Xiuwen Guo
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
| | - Weichao Yi
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
| | - Liquan Dong
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314019, China
| | - Lingqin Kong
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314019, China
| | - Ming Liu
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314019, China
| | - Yuejin Zhao
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314019, China
| | - Mei Hui
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
| | - Xuhong Chu
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China; (X.G.); (W.Y.); (L.K.); (M.L.); (Y.Z.); (M.H.); (X.C.)
- Beijing Key Laboratory for Precision Optoelectronic Measurement Instrument and Technology, Beijing 100081, China
- Yangtze Delta Region Academy of Beijing Institute of Technology, Jiaxing 314019, China
| |
Collapse
|
13
|
Khalil M, Naeem A, Naqvi RA, Zahra K, Moqurrab SA, Lee SW. Deep Learning-Based Classification of Abrasion and Ischemic Diabetic Foot Sores Using Camera-Captured Images. MATHEMATICS 2023; 11:3793. [DOI: 10.3390/math11173793] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
Abstract
Diabetic foot sores (DFS) are serious diabetic complications. The patient’s weakened neurological system damages the tissues of the foot’s skin, which results in amputation. This study aims to validate and deploy a deep learning-based system for the automatic classification of abrasion foot sores (AFS) and ischemic diabetic foot sores (DFS). We proposed a novel model combining convolutional neural network (CNN) capabilities with Vgg-19. The proposed method utilized two benchmark datasets to classify AFS and DFS from the patient’s foot. A data augmentation technique was used to enhance the accuracy of the training. Moreover, image segmentation was performed using UNet++. We tested and evaluated the proposed model’s classification performance against two well-known pre-trained classifiers, Inceptionv3 and MobileNet. The proposed model classified AFS and ischemia DFS images with an accuracy of 99.05%, precision of 98.99%, recall of 99.01%, MCC of 0.9801, and f1 score of 99.04%. Furthermore, the results of statistical evaluations using ANOVA and Friedman tests revealed that the proposed model exhibited a remarkable performance. The proposed model achieved an excellent performance that assist medical professionals in identifying foot ulcers.
Collapse
Affiliation(s)
- Mudassir Khalil
- Department of Computer Engineering, Bahauddin Zakariya University, Multan 60000, Pakistan
| | - Ahmad Naeem
- Department of Computer Science, University of Management and Technology, Lahore 54000, Pakistan
| | - Rizwan Ali Naqvi
- Department of Intelligent Mechatronics Engineering, Sejong University, Seoul 05006, Republic of Korea
| | - Kiran Zahra
- Division of Oncology, Washington University, St. Louis, MO 63130, USA
| | - Syed Atif Moqurrab
- School of Computing, Gachon University, Seongnam 13120, Republic of Korea
| | - Seung-Won Lee
- School of Medicine, Sungkyunkwan University, Suwon 16419, Republic of Korea
| |
Collapse
|
14
|
Reyes-Luévano J, Guerrero-Viramontes J, Rubén Romo-Andrade J, Funes-Gallanzi M. DFU_VIRNet: A novel Visible-InfraRed CNN to improve diabetic foot ulcer classification and early detection of ulcer risk zones. Biomed Signal Process Control 2023; 86:105341. [DOI: 10.1016/j.bspc.2023.105341] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
|
15
|
Khosa I, Raza A, Anjum M, Ahmad W, Shahab S. Automatic Diabetic Foot Ulcer Recognition Using Multi-Level Thermographic Image Data. Diagnostics (Basel) 2023; 13:2637. [PMID: 37627896 PMCID: PMC10453276 DOI: 10.3390/diagnostics13162637] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 07/29/2023] [Accepted: 08/06/2023] [Indexed: 08/27/2023] Open
Abstract
Lower extremity diabetic foot ulcers (DFUs) are a severe consequence of diabetes mellitus (DM). It has been estimated that people with diabetes have a 15% to 25% lifetime risk of acquiring DFUs which leads to the risk of lower limb amputations up to 85% due to poor diagnosis and treatment. Diabetic foot develops planter ulcers where thermography is used to detect the changes in the planter temperature. In this study, publicly available thermographic image data including both control group and diabetic group patients are used. Thermograms at image level as well as patch level are utilized for DFU detection. For DFU recognition, several machine-learning-based classification approaches are employed with hand-crafted features. Moreover, a couple of convolutional neural network models including ResNet50 and DenseNet121 are evaluated for DFU recognition. Finally, a CNN-based custom-developed model is proposed for the recognition task. The results are produced using image-level data, patch-level data, and image-patch combination data. The proposed CNN-based model outperformed the utilized models as well as the state-of-the-art models in terms of the AUC and accuracy. Moreover, the recognition accuracy for both the machine-learning and deep-learning approaches was higher for the image-level thermogram data in comparison to the patch-level or combination of image-patch thermograms.
Collapse
Affiliation(s)
- Ikramullah Khosa
- Department of Electrical and Computer Engineering, COMSATS University Islamabad, Lahore Campus, Lahore 54000, Pakistan
| | - Awais Raza
- Department of Electrical and Computer Engineering, COMSATS University Islamabad, Lahore Campus, Lahore 54000, Pakistan
| | - Mohd Anjum
- Department of Computer Engineering, Aligarh Muslim University, Aligarh 202002, India
| | - Waseem Ahmad
- Department of Computer Science and Engineering, Meerut Institute of Engineering and Technology, Meerut 250005, India
| | - Sana Shahab
- Department of Business Administration, College of Business Administration, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| |
Collapse
|
16
|
Wu X, Xu P, Chen H, Yin J, Li K. Improving DFU Image Classification by an Adaptive Augmentation Pool and Voting with Expertise. 2023 11TH INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND COMPUTATIONAL BIOLOGY (ICBCB) 2023:196-202. [DOI: 10.1109/icbcb57893.2023.10246573] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
Affiliation(s)
- Xin Wu
- Dongguan University of Technology,School of Cyberspace Security,Dongguan,China
| | - Pin Xu
- Dongguan University of Technology,School of Cyberspace Security,Dongguan,China
| | - Haoyuan Chen
- Dongguan University of Technology,School of Cyberspace Security,Dongguan,China
| | - Jianping Yin
- Dongguan University of Technology,School of Cyberspace Security,Dongguan,China
| | - Kuan Li
- Dongguan University of Technology,School of Cyberspace Security,Dongguan,China
| |
Collapse
|
17
|
Kairys A, Pauliukiene R, Raudonis V, Ceponis J. Towards Home-Based Diabetic Foot Ulcer Monitoring: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:3618. [PMID: 37050678 PMCID: PMC10099334 DOI: 10.3390/s23073618] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 03/14/2023] [Accepted: 03/27/2023] [Indexed: 06/19/2023]
Abstract
It is considered that 1 in 10 adults worldwide have diabetes. Diabetic foot ulcers are some of the most common complications of diabetes, and they are associated with a high risk of lower-limb amputation and, as a result, reduced life expectancy. Timely detection and periodic ulcer monitoring can considerably decrease amputation rates. Recent research has demonstrated that computer vision can be used to identify foot ulcers and perform non-contact telemetry by using ulcer and tissue area segmentation. However, the applications are limited to controlled lighting conditions, and expert knowledge is required for dataset annotation. This paper reviews the latest publications on the use of artificial intelligence for ulcer area detection and segmentation. The PRISMA methodology was used to search for and select articles, and the selected articles were reviewed to collect quantitative and qualitative data. Qualitative data were used to describe the methodologies used in individual studies, while quantitative data were used for generalization in terms of dataset preparation and feature extraction. Publicly available datasets were accounted for, and methods for preprocessing, augmentation, and feature extraction were evaluated. It was concluded that public datasets can be used to form a bigger, more diverse datasets, and the prospects of wider image preprocessing and the adoption of augmentation require further research.
Collapse
Affiliation(s)
- Arturas Kairys
- Automation Department, Electrical and Electronics Faculty, Kaunas University of Technology, 51368 Kaunas, Lithuania
| | - Renata Pauliukiene
- Department of Endocrinology, Lithuanian University of Health Sciences, 50161 Kaunas, Lithuania
| | - Vidas Raudonis
- Automation Department, Electrical and Electronics Faculty, Kaunas University of Technology, 51368 Kaunas, Lithuania
| | - Jonas Ceponis
- Institute of Endocrinology, Lithuanian University of Health Sciences, 44307 Kaunas, Lithuania
| |
Collapse
|
18
|
Liu Z, Agu E, Pedersen P, Lindsay C, Tulu B, Strong D. Chronic Wound Image Augmentation and Assessment Using Semi-Supervised Progressive Multi-Granularity EfficientNet. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2023; 5:404-420. [PMID: 38899014 PMCID: PMC11186650 DOI: 10.1109/ojemb.2023.3248307] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 01/06/2023] [Accepted: 02/20/2023] [Indexed: 06/21/2024] Open
Abstract
Goal: Augment a small, imbalanced, wound dataset by using semi-supervised learning with a secondary dataset. Then utilize the augmented wound dataset for deep learning-based wound assessment. Methods: The clinically-validated Photographic Wound Assessment Tool (PWAT) scores eight wound attributes: Size, Depth, Necrotic Tissue Type, Necrotic Tissue Amount, Granulation Tissue type, Granulation Tissue Amount, Edges, Periulcer Skin Viability to comprehensively assess chronic wound images. A small corpus of 1639 wound images labeled with ground truth PWAT scores was used as reference. A Semi-Supervised learning and Progressive Multi-Granularity training mechanism were used to leverage a secondary corpus of 9870 unlabeled wound images. Wound scoring utilized the EfficientNet Convolutional Neural Network on the augmented wound corpus. Results: Our proposed Semi-Supervised PMG EfficientNet (SS-PMG-EfficientNet) approach estimated all 8 PWAT sub-scores with classification accuracies and F1 scores of about 90% on average, and outperformed a comprehensive list of baseline models and had a 7% improvement over the prior state-of-the-art (without data augmentation). We also demonstrate that synthetic wound image generation using Generative Adversarial Networks (GANs) did not improve wound assessment. Conclusions: Semi-supervised learning on unlabeled wound images in a secondary dataset achieved impressive performance for deep learning-based wound grading.
Collapse
Affiliation(s)
- Ziyang Liu
- Computer Science DepartmentWorcester Polytechnic InstituteWorcesterMA01609USA
| | - Emmanuel Agu
- Computer Science DepartmentWorcester Polytechnic InstituteWorcesterMA01609USA
| | - Peder Pedersen
- Electrical and Computer Engineering DepartmentWorcester Polytechnic InstituteWorcesterMA01609USA
| | - Clifford Lindsay
- Department of RadiologyUniversity of Massachusetts Medical SchoolWorcesterMA01609USA
| | - Bengisu Tulu
- Foisie Business SchoolWorcester Polytechnic InstituteWorcesterMA01609USA
| | - Diane Strong
- Foisie Business SchoolWorcester Polytechnic InstituteWorcesterMA01609USA
| |
Collapse
|
19
|
Hernandez-Guedes A, Arteaga-Marrero N, Villa E, Callico GM, Ruiz-Alzola J. Feature Ranking by Variational Dropout for Classification Using Thermograms from Diabetic Foot Ulcers. SENSORS (BASEL, SWITZERLAND) 2023; 23:757. [PMID: 36679552 PMCID: PMC9867159 DOI: 10.3390/s23020757] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 12/31/2022] [Accepted: 01/03/2023] [Indexed: 06/17/2023]
Abstract
Diabetes mellitus presents a high prevalence around the world. A common and long-term derived complication is diabetic foot ulcers (DFUs), which have a global prevalence of roughly 6.3%, and a lifetime incidence of up to 34%. Infrared thermograms, covering the entire plantar aspect of both feet, can be employed to monitor the risk of developing a foot ulcer, because diabetic patients exhibit an abnormal pattern that may indicate a foot disorder. In this study, the publicly available INAOE dataset composed of thermogram images of healthy and diabetic subjects was employed to extract relevant features aiming to establish a set of state-of-the-art features that efficiently classify DFU. This database was extended and balanced by fusing it with private local thermograms from healthy volunteers and generating synthetic data via synthetic minority oversampling technique (SMOTE). State-of-the-art features were extracted using two classical approaches, LASSO and random forest, as well as two variational deep learning (DL)-based ones: concrete and variational dropout. Then, the most relevant features were detected and ranked. Subsequently, the extracted features were employed to classify subjects at risk of developing an ulcer using as reference a support vector machine (SVM) classifier with a fixed hyperparameter configuration to evaluate the robustness of the selected features. The new set of features extracted considerably differed from those currently considered state-of-the-art but provided a fair performance. Among the implemented extraction approaches, the variational DL ones, particularly the concrete dropout, performed the best, reporting an F1 score of 90% using the aforementioned SVM classifier. In comparison with features previously considered as the state-of-the-art, approximately 15% better performance was achieved for classification.
Collapse
Affiliation(s)
- Abian Hernandez-Guedes
- Instituto Universitario de Investigaciones Biomédicas y Sanitarias (IUIBS), Universidad de Las Palmas de Gran Canaria, 35016 Las Palmas de Gran Canaria, Spain
- Instituto Universitario de Microelectrónica Aplicada (IUMA), Universidad de Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
| | - Natalia Arteaga-Marrero
- Grupo Tecnología Médica IACTEC, Instituto de Astrofísica de Canarias (IAC), 38205 San Cristóbal de La Laguna, Spain
| | - Enrique Villa
- Grupo Tecnología Médica IACTEC, Instituto de Astrofísica de Canarias (IAC), 38205 San Cristóbal de La Laguna, Spain
| | - Gustavo M. Callico
- Instituto Universitario de Microelectrónica Aplicada (IUMA), Universidad de Las Palmas de Gran Canaria, 35017 Las Palmas de Gran Canaria, Spain
| | - Juan Ruiz-Alzola
- Instituto Universitario de Investigaciones Biomédicas y Sanitarias (IUIBS), Universidad de Las Palmas de Gran Canaria, 35016 Las Palmas de Gran Canaria, Spain
- Grupo Tecnología Médica IACTEC, Instituto de Astrofísica de Canarias (IAC), 38205 San Cristóbal de La Laguna, Spain
- Departamento de Señales y Comunicaciones, Universidad de Las Palmas de Gran Canaria, 35016 Las Palmas de Gran Canaria, Spain
| |
Collapse
|
20
|
Ahsan M, Naz S, Ahmad R, Ehsan H, Sikandar A. A Deep Learning Approach for Diabetic Foot Ulcer Classification and Recognition. INFORMATION 2023; 14:36. [DOI: 10.3390/info14010036] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2025] Open
Abstract
Diabetic foot ulcer (DFU) is one of the major complications of diabetes and results in the amputation of lower limb if not treated timely and properly. Despite the traditional clinical approaches used in DFU classification, automatic methods based on a deep learning framework show promising results. In this paper, we present several end-to-end CNN-based deep learning architectures, i.e., AlexNet, VGG16/19, GoogLeNet, ResNet50.101, MobileNet, SqueezeNet, and DenseNet, for infection and ischemia categorization using the benchmark dataset DFU2020. We fine-tune the weight to overcome a lack of data and reduce the computational cost. Affine transform techniques are used for the augmentation of input data. The results indicate that the ResNet50 achieves the highest accuracy of 99.49% and 84.76% for Ischaemia and infection, respectively.
Collapse
Affiliation(s)
- Mehnoor Ahsan
- Computer Science Department, GGPGC No.1, Abbottabad 22020, Pakistan
| | - Saeeda Naz
- Computer Science Department, GGPGC No.1, Abbottabad 22020, Pakistan
| | - Riaz Ahmad
- Computer Science Department, Shaheed Benazir Bhutto University, Upper Dir 00384, Pakistan
| | - Haleema Ehsan
- Computer Science Department, GGPGC No.1, Abbottabad 22020, Pakistan
| | - Aisha Sikandar
- Computer Science Department, GGPGC No.1, Abbottabad 22020, Pakistan
| |
Collapse
|
21
|
Sun L, Tian H, Ge H, Tian J, Lin Y, Liang C, Liu T, Zhao Y. Cross-attention multi-branch CNN using DCE-MRI to classify breast cancer molecular subtypes. Front Oncol 2023; 13:1107850. [PMID: 36959806 PMCID: PMC10028183 DOI: 10.3389/fonc.2023.1107850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 02/20/2023] [Indexed: 03/09/2023] Open
Abstract
Purpose The aim of this study is to improve the accuracy of classifying luminal or non-luminal subtypes of breast cancer by using computer algorithms based on DCE-MRI, and to validate the diagnostic efficacy of the model by considering the patient's age of menarche and nodule size. Methods DCE-MRI images of patients with non-specific invasive breast cancer admitted to the Second Affiliated Hospital of Dalian Medical University were collected. There were 160 cases in total, with 84 cases of luminal type (luminal A and luminal B and 76 cases of non-luminal type (HER 2 overexpressing and triple negative). Patients were grouped according to thresholds of nodule sizes of 20 mm and age at menarche of 14 years. A cross-attention multi-branch net CAMBNET) was proposed based on the dataset to predict the molecular subtypes of breast cancer. Diagnostic performance was assessed by accuracy, sensitivity, specificity, F1 and area under the ROC curve (AUC). And the model is visualized with Grad-CAM. Results Several classical deep learning models were included for diagnostic performance comparison. Using 5-fold cross-validation on the test dataset, all the results of CAMBNET are significantly higher than the compared deep learning models. The average prediction recall, accuracy, precision, and AUC for luminal and non-luminal types of the dataset were 89.11%, 88.44%, 88.52%, and 96.10%, respectively. For patients with tumor size <20 mm, the CAMBNET had AUC of 83.45% and ACC of 90.29% for detecting triple-negative breast cancer. When classifying luminal from non-luminal subtypes for patients with age at menarche years, our CAMBNET model achieved an ACC of 92.37%, precision of 92.42%, recall of 93.33%, F1of 92.33%, and AUC of 99.95%. Conclusions The CAMBNET can be applied in molecular subtype classification of breasts. For patients with menarche at 14 years old, our model can yield more accurate results when classifying luminal and non-luminal subtypes. For patients with tumor sizes ≤20 mm, our model can yield more accurate result in detecting triple-negative breast cancer to improve patient prognosis and survival.
Collapse
Affiliation(s)
- Liang Sun
- The College of Computer Science and Technology, Dalian University of Technology, Dalian, Liaoning, China
| | - Haowen Tian
- The College of Computer Science and Technology, Dalian University of Technology, Dalian, Liaoning, China
| | - Hongwei Ge
- The College of Computer Science and Technology, Dalian University of Technology, Dalian, Liaoning, China
| | - Juan Tian
- Department of Radiology, The Second Affiliated Hospital of Dalian Medical University, Dalian, Liaoning, China
| | - Yuxin Lin
- Department of Radiology, The Second Affiliated Hospital of Dalian Medical University, Dalian, Liaoning, China
| | - Chang Liang
- Department of Radiology, The Second Affiliated Hospital of Dalian Medical University, Dalian, Liaoning, China
| | - Tang Liu
- Department of Radiology, The Second Affiliated Hospital of Dalian Medical University, Dalian, Liaoning, China
- *Correspondence: Tang Liu, ; Yiping Zhao,
| | - Yiping Zhao
- Department of Radiology, The Second Affiliated Hospital of Dalian Medical University, Dalian, Liaoning, China
- *Correspondence: Tang Liu, ; Yiping Zhao,
| |
Collapse
|
22
|
Nagaraju S, Kumar KV, Rani BP, Lydia EL, Ishak MK, Filali I, Karim FK, Mostafa SM. Automated Diabetic Foot Ulcer Detection and Classification Using Deep Learning. IEEE ACCESS 2023; 11:127578-127588. [DOI: 10.1109/access.2023.3332292] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
Affiliation(s)
- Sunnam Nagaraju
- Department of Mechanical Engineering, MLR Institute of Technology, Hyderabad, India
| | - Kollati Vijaya Kumar
- Department of Computer Science and Engineering, GITAM School of Technology, Vishakhapatnam Campus, GITAM (Deemed to be a University), Visakhapatnam, India
| | - B. Prameela Rani
- Department of CSE-AIML, Aditya College of Engineering, Surampalem, Andhra Pradesh, India
| | - E. Laxmi Lydia
- Department of Computer Science and Engineering, Vignan's Institute of Information Technology, Visakhapatnam, India
| | - Mohamad Khairi Ishak
- Department of Electrical and Computer Engineering, College of Engineering and Information Technology, Ajman University, Ajman, United Arab Emirates
| | - Imen Filali
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia
| | - Faten Khalid Karim
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia
| | - Samih M. Mostafa
- Computer Science Department, Faculty of Computers and Information, South Valley University, Qena, Egypt
| |
Collapse
|
23
|
Dipto IC, Cassidy B, Kendrick C, Reeves ND, Pappachan JM, Chandrabalan V, Yap MH. Quantifying the Effect of Image Similarity on Diabetic Foot Ulcer Classification. LECTURE NOTES IN COMPUTER SCIENCE 2023:1-18. [DOI: 10.1007/978-3-031-26354-5_1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
|
24
|
Early detection of diabetic foot ulcers from thermal images using the bag of features technique. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
25
|
Pappachan JM, Cassidy B, Fernandez CJ, Chandrabalan V, Yap MH. The role of artificial intelligence technology in the care of diabetic foot ulcers: the past, the present, and the future. World J Diabetes 2022; 13:1131-1139. [PMID: 36578875 PMCID: PMC9791570 DOI: 10.4239/wjd.v13.i12.1131] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Revised: 11/01/2022] [Accepted: 12/01/2022] [Indexed: 12/15/2022] Open
Abstract
Foot ulcers are common complications of diabetes mellitus and substantially increase the morbidity and mortality due to this disease. Wound care by regular monitoring of the progress of healing with clinical review of the ulcers, dressing changes, appropriate antibiotic therapy for infection and proper offloading of the ulcer are the cornerstones of the management of foot ulcers. Assessing the progress of foot ulcers can be a challenge for the clinician and patient due to logistic issues such as regular attendance in the clinic. Foot clinics are often busy and because of manpower issues, ulcer reviews can be delayed with detrimental effects on the healing as a result of a lack of appropriate and timely changes in management. Wound photographs have been historically useful to assess the progress of diabetic foot ulcers over the past few decades. Mobile phones with digital cameras have recently revolutionized the capture of foot ulcer images. Patients can send ulcer photographs to diabetes care professionals electronically for remote monitoring, largely avoiding the logistics of patient transport to clinics with a reduction on clinic pressures. Artificial intelligence-based technologies have been developed in recent years to improve this remote monitoring of diabetic foot ulcers with the use of mobile apps. This is expected to make a huge impact on diabetic foot ulcer care with further research and development of more accurate and scientific technologies in future. This clinical update review aims to compile evidence on this hot topic to empower clinicians with the latest developments in the field.
Collapse
Affiliation(s)
- Joseph M Pappachan
- Department of Endocrinology & Metabolism, Lancashire Teaching Hospitals NHS Trust, Preston PR2 9HT, United Kingdom
- Faculty of Science and Engineering, Manchester Metropolitan University, Manchester M15 6BH, United Kingdom
| | - Bill Cassidy
- Faculty of Science and Engineering, Manchester Metropolitan University, Manchester M15 6BH, United Kingdom
| | | | - Vishnu Chandrabalan
- Department of Data Science, Lancashire Teaching Hospitals NHS Trust, Preston PR2 9HT, United Kingdom
| | - Moi Hoon Yap
- Faculty of Science and Engineering, Manchester Metropolitan University, Manchester M15 6BH, United Kingdom
| |
Collapse
|
26
|
ACTNet: asymmetric convolutional transformer network for diabetic foot ulcers classification. Phys Eng Sci Med 2022; 45:1175-1181. [PMID: 36279078 DOI: 10.1007/s13246-022-01185-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 10/01/2022] [Indexed: 12/15/2022]
Abstract
Most existing image classification methods have achieved significant progress in the field of natural images. However, in the field of diabetic foot ulcer (DFU) where data is scarce and complex, the accurate classification of data is still a thorny problem. In this paper, we propose an Asymmetric Convolutional Transformer Network (ACTNet) for the multi-class (4-class) classification task of DFU. Specifically, in order to strengthen the expressive ability of the network, we design an asymmetric convolutional module in the front part of the network to model the relationship between local pixels, extract the underlying features of the image, and guide the network to focus on the central region in the image that contains more information. Furthermore, a novel pooling layer is added between the encoder and the classification head in the Transformer, which weights the data sequence generated by the encoder to better correlate the features between the input data. Finally, to fully exploit the performance of the model, we pretrained our model on ImageNet and fine-tune it on DFU images. The model is validated on the DFUC2021 test set, and the F1-score and AUC value are 0.593 and 0.824, respectively. The experiments show that our model has excellent performance even in the case of a small dataset.
Collapse
|
27
|
Liu Z, John J, Agu E. Diabetic Foot Ulcer Ischemia and Infection Classification Using EfficientNet Deep Learning Models. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2022; 3:189-201. [PMID: 36660100 PMCID: PMC9842228 DOI: 10.1109/ojemb.2022.3219725] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Revised: 07/05/2022] [Accepted: 10/23/2022] [Indexed: 11/23/2022] Open
Abstract
Motivation: Infection (bacteria in the wound) and ischemia (insufficient blood supply) in Diabetic Foot Ulcers (DFUs) increase the risk of limb amputation. Goal: To develop an image-based DFU infection and ischemia detection system that uses deep learning. Methods: The DFU dataset was augmented using geometric and color image operations, after which binary infection and ischemia classification was done using the EfficientNet deep learning model and a comprehensive set of baselines. Results: The EfficientNets model achieved 99% accuracy in ischemia classification and 98% in infection classification, outperforming ResNet and Inception (87% accuracy) and Ensemble CNN, the prior state of the art (Classification accuracy of 90% for ischemia 73% for infection). EfficientNets also classified test images in a fraction (10% to 50%) of the time taken by baseline models. Conclusions: This work demonstrates that EfficientNets is a viable deep learning model for infection and ischemia classification.
Collapse
Affiliation(s)
- Ziyang Liu
- Computer Science DepartmentWorcester Polytechnic InstituteWorcesterMA 01609USA
| | - Josvin John
- Computer Science DepartmentWorcester Polytechnic InstituteWorcesterMA 01609USA
| | - Emmanuel Agu
- Computer Science DepartmentWorcester Polytechnic InstituteWorcesterMA 01609USA
| |
Collapse
|
28
|
Chemello G, Salvatori B, Morettini M, Tura A. Artificial Intelligence Methodologies Applied to Technologies for Screening, Diagnosis and Care of the Diabetic Foot: A Narrative Review. BIOSENSORS 2022; 12:985. [PMID: 36354494 PMCID: PMC9688674 DOI: 10.3390/bios12110985] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 10/26/2022] [Accepted: 11/04/2022] [Indexed: 06/16/2023]
Abstract
Diabetic foot syndrome is a multifactorial pathology with at least three main etiological factors, i.e., peripheral neuropathy, peripheral arterial disease, and infection. In addition to complexity, another distinctive trait of diabetic foot syndrome is its insidiousness, due to a frequent lack of early symptoms. In recent years, it has become clear that the prevalence of diabetic foot syndrome is increasing, and it is among the diabetes complications with a stronger impact on patient's quality of life. Considering the complex nature of this syndrome, artificial intelligence (AI) methodologies appear adequate to address aspects such as timely screening for the identification of the risk for foot ulcers (or, even worse, for amputation), based on appropriate sensor technologies. In this review, we summarize the main findings of the pertinent studies in the field, paying attention to both the AI-based methodological aspects and the main physiological/clinical study outcomes. The analyzed studies show that AI application to data derived by different technologies provides promising results, but in our opinion future studies may benefit from inclusion of quantitative measures based on simple sensors, which are still scarcely exploited.
Collapse
Affiliation(s)
- Gaetano Chemello
- CNR Institute of Neuroscience, Corso Stati Uniti 4, 35127 Padova, Italy
| | | | - Micaela Morettini
- Department of Information Engineering, Università Politecnica delle Marche, Via Brecce Bianche, 12, 60131 Ancona, Italy
| | - Andrea Tura
- CNR Institute of Neuroscience, Corso Stati Uniti 4, 35127 Padova, Italy
| |
Collapse
|
29
|
Automatic non-destructive multiple lettuce traits prediction based on DeepLabV3 +. JOURNAL OF FOOD MEASUREMENT AND CHARACTERIZATION 2022. [DOI: 10.1007/s11694-022-01660-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
30
|
Ai L, Yang M, Xie Z. Improved Residual Connection Network for Diabetic Foot Ulcers Classification. THE 6TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING 2022:1-5. [DOI: 10.1145/3565387.3565433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
Affiliation(s)
- Lingmei Ai
- School of Computer Science, Shaanxi Normal University, China
| | - Mengyao Yang
- School of Computer Science, Shaanxi Normal University, China
| | - Zhuoyu Xie
- School of Computer Science, Shaanxi Normal University, China
| |
Collapse
|
31
|
Huang Z, Tang S, Chen Z, Wang G, Shen H, Zhou Y, Wang H, Fan W, Liang D, Hu Y, Hu Z. TG-Net: Combining transformer and GAN for nasopharyngeal carcinoma tumor segmentation based on total-body uEXPLORER PET/CT scanner. Comput Biol Med 2022; 148:105869. [PMID: 35905660 DOI: 10.1016/j.compbiomed.2022.105869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 06/20/2022] [Accepted: 07/09/2022] [Indexed: 11/17/2022]
Abstract
Nasopharyngeal carcinoma (NPC) is a malignant tumor, and the main treatment is radiotherapy. Accurate delineation of the target tumor is essential for radiotherapy of NPC. NPC tumors are small in size and vary widely in shape and structure, making it a time-consuming and laborious task for even experienced radiologists to manually outline tumors. However, the segmentation performance of current deep learning models is not satisfactory, mainly manifested by poor segmentation boundaries. To solve this problem, this paper proposes a segmentation method for nasopharyngeal carcinoma based on dynamic PET-CT image data, whose input data include CT, PET, and parametric images (Ki images). This method uses a generative adversarial network with a modified UNet integrated with a Transformer as the generator (TG-Net) to achieve automatic segmentation of NPC on combined CT-PET-Ki images. In the coding stage, TG-Net uses moving windows to replace traditional pooling operations to obtain patches of different sizes, which can reduce information loss in the coding process. Moreover, the introduction of Transformer can make the network learn more representative features and improve the discriminant ability of the model, especially for tumor boundaries. Finally, the results of fivefold cross validation with an average Dice similarity coefficient score of 0.9135 show that our method has good segmentation performance. Comparative experiments also show that our network structure is superior to the most advanced methods in the segmentation of NPC. In addition, this work is the first to use Ki images to assist tumor segmentation. We also demonstrated the usefulness of adding Ki images to aid in tumor segmentation.
Collapse
Affiliation(s)
- Zhengyong Huang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China; University of Chinese Academy of Sciences, Beijing, 101408, China
| | - Si Tang
- State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, 510060, China; Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, Guangzhou, 510060, China
| | - Zixiang Chen
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Guoshuai Wang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China; University of Chinese Academy of Sciences, Beijing, 101408, China
| | - Hao Shen
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China; University of Chinese Academy of Sciences, Beijing, 101408, China
| | - Yun Zhou
- Central Research Institute, United Imaging Healthcare Group, Shanghai, 201807, China
| | - Haining Wang
- Central Research Institute, United Imaging Healthcare Group, Shanghai, 201807, China
| | - Wei Fan
- State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, 510060, China; Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, Guangzhou, 510060, China
| | - Dong Liang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Yingying Hu
- State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, 510060, China; Department of Nuclear Medicine, Sun Yat-sen University Cancer Center, Guangzhou, 510060, China.
| | - Zhanli Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
| |
Collapse
|
32
|
Santos E, Santos F, Dallyson J, Aires K, Tavares JMRS, Veras R. Diabetic Foot Ulcers Classification using a fine-tuned CNNs Ensemble. 2022 IEEE 35TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS) 2022:282-287. [DOI: 10.1109/cbms55023.2022.00056] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
Affiliation(s)
- Elineide Santos
- Universidade Federal do Piauí,Departamento de Computação,Teresina,Brasil
| | - Francisco Santos
- Universidade Federal do Piauí,Departamento de Computação,Teresina,Brasil
| | - Joao Dallyson
- Universidade Federal do Maranhão,Departamento de Informática,São Luís,Brasil
| | - Kelson Aires
- Universidade Federal do Piauí,Departamento de Computação,Teresina,Brasil
| | - Joao Manuel R. S. Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Universidade do Porto,Faculdade de Engenharia,Departamento de Engenharia Mecánica,Porto,Portugal
| | - Rodrigo Veras
- Universidade Federal do Piauí,Departamento de Computação,Teresina,Brasil
| |
Collapse
|
33
|
Yap MH, Kendrick C, Reeves ND, Goyal M, Pappachan JM, Cassidy B. Development of Diabetic Foot Ulcer Datasets: An Overview. LECTURE NOTES IN COMPUTER SCIENCE 2022:1-18. [DOI: 10.1007/978-3-030-94907-5_1] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2025]
|