1
|
Çelik B, Baslak ME, Genç MZ, Çelik ME. Automated segmentation of dental restorations using deep learning: exploring data augmentation techniques. Oral Radiol 2025; 41:207-215. [PMID: 39652261 DOI: 10.1007/s11282-024-00794-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Accepted: 11/27/2024] [Indexed: 03/15/2025]
Abstract
OBJECTIVES Deep learning has revolutionized image analysis for dentistry. Automated segmentation of dental radiographs is of great importance towards digital dentistry. The performance of deep learning models heavily relies on the quality and diversity of the training data. Data augmentation is a widely used technique implemented in machine learning and deep learning to artificially increase the size and diversity of a training dataset by applying various transformations to the original data. METHODS This work aims to automatically segment implants, prostheses, and fillings in panoramic images using 9 different deep learning segmentation models. Later, it explores the effect of data augmentation methods on segmentation performance of the models. Eight different data augmentation techniques are examined. Performance is evaluated by well-accepted metrics such as intersection over union (IoU) and Dice coefficient. RESULTS While averaging the segmentation results for the three classes, IoU varies between 0.62 and 0.82 while Dice score is between 0.75 and 0.9 among deep learning models used. Augmentation techniques provided performance improvements of up to 3.37%, 5.75% and 8.75% for implant, prosthesis and filling classes, respectively. CONCLUSIONS Findings reveal that choosing optimal augmentation strategies depends on both model architecture and dental structure type.
Collapse
Affiliation(s)
- Berrin Çelik
- Department of Oral and Maxillofacial Radiology, Faculty of Dentistry, Ankara Yıldırım Beyazıt University, Ankara, Turkey.
| | - Muhammed Emin Baslak
- Department of Electrical Electronics Engineering, Gazi University, Ankara, Turkey
| | - Mehmet Zahid Genç
- Department of Electrical Electronics Engineering, Gazi University, Ankara, Turkey
| | - Mahmut Emin Çelik
- Department of Electrical Electronics Engineering, Gazi University, Ankara, Turkey
- Biomedical Calibration and Research Center (BIYOKAM), Gazi University, Ankara, Turkey
| |
Collapse
|
2
|
Nguyen KD, Hoang HT, Doan TPH, Dao KQ, Wang DH, Hsu ML. SegmentAnyTooth: An open-source deep learning framework for tooth enumeration and segmentation in intraoral photos. J Dent Sci 2025; 20:1110-1117. [PMID: 40224126 PMCID: PMC11993027 DOI: 10.1016/j.jds.2025.01.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2024] [Revised: 01/03/2025] [Indexed: 04/15/2025] Open
Abstract
Background/purpose Preventive dentistry is essential for maintaining public oral health, but inequalities in dental care, especially in underserved areas, remain a significant challenge. Image-based dental analysis, using intraoral photographs, offers a practical and scalable approach to bridge this gap. In this context, we developed SegmentAnyTooth, an open-source deep learning framework that solves the critical first step by enabling automated tooth enumeration and segmentation across five standard intraoral views: upper occlusal, lower occlusal, frontal, right lateral, and left lateral. This tool lays the groundwork for advanced applications, reducing reliance on limited professional resources and enhancing access to preventive dental care. Materials and methods A dataset of 5000 intraoral photos from 1000 sets (953 subjects) was annotated with tooth surfaces and FDI notations. You Only Look Once 11 (YOLO11) nano models were trained for tooth localization and enumeration, followed by Light Segment Anything in High Quality (Light HQ-SAM) for segmentation using an active learning approach. Results SegmentAnyTooth demonstrated high segmentation accuracy, with mean Dice similarity coefficients (DSC) of 0.983 ± 0.036 for upper occlusal, 0.973 ± 0.060 for lower occlusal, and 0.920 ± 0.063 for frontal views. Lateral view models also performed well, with mean DSCs of 0.939 ± 0.070 (right) and 0.945 ± 0.056 (left). Statistically significant improvements over baseline models such as U-Net, nnU-Net, and Mask R-CNN were observed (Wilcoxon signed-rank test, P < 0.01). Conclusion SegmentAnyTooth provides accurate, multi-view tooth segmentation to enhance dental care, early diagnosis, individualized care, and population-level research. Its open-source design supports integration into clinical and public health workflows, with ongoing improvements focused on generalizability.
Collapse
Affiliation(s)
- Khoa Dang Nguyen
- College of Dentistry, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Hung Trong Hoang
- Faculty of Odonto-Stomatology, University of Medicine and Pharmacy at Ho Chi Minh City, Viet Nam
| | | | - Khai Quang Dao
- Faculty of Odonto-Stomatology, University of Medicine and Pharmacy at Ho Chi Minh City, Viet Nam
| | - Ding-Han Wang
- College of Dentistry, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Ming-Lun Hsu
- College of Dentistry, National Yang Ming Chiao Tung University, Taipei, Taiwan
| |
Collapse
|
3
|
Wu Z, Chen Y, Yu X, Wang F, Shi H, Qu F, Shen Y, Chen X, Xu C. Prediction of pink esthetic score using deep learning: A proof of concept. J Dent 2025; 155:105601. [PMID: 39892738 DOI: 10.1016/j.jdent.2025.105601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Revised: 01/28/2025] [Accepted: 01/30/2025] [Indexed: 02/04/2025] Open
Abstract
OBJECTIVES This study aimed to develop a deep learning (DL) model for the predictive esthetic evaluation of single-implant treatments in the esthetic zone. METHODS A total of 226 samples, each comprising three intraoral photographs and 12 clinical features, were collected for proof of concept. Labels were determined by a prosthodontic specialist using the pink esthetic score (PES). A DL model was developed to predict PES based on input images and clinical data. The performance was assessed and compared with that of two other models. RESULTS The DL model achieved an average mean absolute error (MAE) of 1.3597, average root mean squared error (MSE) of 1.8324, a Pearson correlation of 0.6326, and accuracies of 65.93 % and 85.84 % for differences between predicted and ground truth values no larger than 1 and 2, respectively. An ablation study demonstrated that incorporating all input features yielded the best performance, with the proposed model outperforming comparison models. CONCLUSIONS DL demonstrates potential for providing acceptable preoperative PES predictions for single implant-supported prostheses in the esthetic zone. Ongoing efforts to collect additional samples and clinical features aim to further enhance the model's performance. CLINICAL SIGNIFICANCE The DL model supports dentists in predicting esthetic outcomes and making informed treatment decisions before implant placement. It offers a valuable reference for inexperienced and general dentists to identify esthetic risk factors, thereby improving implant treatment outcomes.
Collapse
Affiliation(s)
- Ziang Wu
- Department of Prosthodontics, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China; College of Stomatology, Shanghai Jiao Tong University, Shanghai, China; National Center for Stomatology and National Clinical Research Center for Oral Diseases, Shanghai, China; Shanghai Key Laboratory of Stomatology and Shanghai Research Institute of Stomatology, Shanghai, China; Shanghai Engineering Research Center of Advanced Dental Technology and Materials, Shanghai, China
| | - Yizhou Chen
- Department of Nuclear Medicine, University of Bern, Bern, Switzerland
| | - Xinbo Yu
- College of Stomatology, Shanghai Jiao Tong University, Shanghai, China; National Center for Stomatology and National Clinical Research Center for Oral Diseases, Shanghai, China; Shanghai Key Laboratory of Stomatology and Shanghai Research Institute of Stomatology, Shanghai, China; Second Dental Center, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Feng Wang
- Division of Oral and Maxillofacial Surgery, Faculty of Dentistry, The University of Hong Kong, 34 Hospital Road, Sai Ying Pun, Hong Kong SAR, China
| | - Haochen Shi
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Fang Qu
- Department of Prosthodontics, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China; College of Stomatology, Shanghai Jiao Tong University, Shanghai, China; National Center for Stomatology and National Clinical Research Center for Oral Diseases, Shanghai, China; Shanghai Key Laboratory of Stomatology and Shanghai Research Institute of Stomatology, Shanghai, China; Shanghai Engineering Research Center of Advanced Dental Technology and Materials, Shanghai, China
| | - Yingyi Shen
- Department of Prosthodontics, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China; College of Stomatology, Shanghai Jiao Tong University, Shanghai, China; National Center for Stomatology and National Clinical Research Center for Oral Diseases, Shanghai, China; Shanghai Key Laboratory of Stomatology and Shanghai Research Institute of Stomatology, Shanghai, China; Shanghai Engineering Research Center of Advanced Dental Technology and Materials, Shanghai, China
| | - Xiaojun Chen
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
| | - Chun Xu
- Department of Prosthodontics, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200011, China; College of Stomatology, Shanghai Jiao Tong University, Shanghai, China; National Center for Stomatology and National Clinical Research Center for Oral Diseases, Shanghai, China; Shanghai Key Laboratory of Stomatology and Shanghai Research Institute of Stomatology, Shanghai, China; Shanghai Engineering Research Center of Advanced Dental Technology and Materials, Shanghai, China.
| |
Collapse
|
4
|
Ghorbani Z, Mirebeigi-Jamasbi SS, Hassannia Dargah M, Nahvi M, Hosseinikhah Manshadi SA, Akbarzadeh Fathabadi Z. A novel deep learning-based model for automated tooth detection and numbering in mixed and permanent dentition in occlusal photographs. BMC Oral Health 2025; 25:455. [PMID: 40158107 PMCID: PMC11955110 DOI: 10.1186/s12903-025-05803-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2025] [Accepted: 03/14/2025] [Indexed: 04/01/2025] Open
Abstract
BACKGROUND While artificial intelligence-driven approaches have shown great promise in dental diagnosis and treatment planning, most research focuses on dental radiographs. Only three studies have explored automated tooth numbering in oral photographs, all focusing on permanent dentition. Our study aimed to introduce an automated system for detection and numbering of teeth across mixed and permanent dentitions in occlusal photographs. METHODS A total of 3215 occlusal view images of maxilla and mandible were included. Five senior dental students, trained under the guidance of an associate professor in dental public health, annotated the dataset. Samples were distributed across the training, validation, and test sets using a ratio of 7:1.5:1.5, respectively. We employed two separate convolutional neural network (CNN) models working in conjunction. The first model detected tooth presence and position, generating bounding boxes, while the second model localized these boxes, conducted classification, and assigned tooth numbers. Python and YOLOv8 were utilized in model development. Overall performance was assessed using sensitivity, precision, and F1 score. RESULTS The model demonstrated a sensitivity of 99.89% and an overall precision of 95.72% across all tooth types, with an F1 score of 97.76%. Misclassifications were primarily observed in underrepresented teeth, including primary incisors and permanent third molars. Among primary teeth, maxillary molars showed the highest performance, with precisions above 94%, 100% sensitivities, and F1 scores exceeding 97%. The mandibular primary canine showed the lowest results, with a precision of 88.52% and an F1 score of 93.91%. CONCLUSION Our study advances dental diagnostics by developing a highly precise artificial intelligence model for detecting and numbering primary and permanent teeth on occlusal photographs. The model's performance, highlights its potential for real-world applications, including tele-dentistry and epidemiological studies in underserved areas. The model could be integrated with other systems to identify dental problems such as caries and orthodontic issues.
Collapse
Affiliation(s)
- Zahra Ghorbani
- Department of Community Oral Health, School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Seyed Sepehr Mirebeigi-Jamasbi
- Research Committee, School of Dentistry, Shahid Beheshti University of Medical Sciences, Daneshju Blvd., Velenjak St., Chamran Highway, Tehran, 1983963113, Iran.
| | - Mohammad Hassannia Dargah
- Research Committee, School of Dentistry, Shahid Beheshti University of Medical Sciences, Daneshju Blvd., Velenjak St., Chamran Highway, Tehran, 1983963113, Iran.
- Bachelor of science, Electrical engineering, Shahid Beheshti University, Tehran, Iran.
| | - Mohammad Nahvi
- Research Committee, School of Dentistry, Shahid Beheshti University of Medical Sciences, Daneshju Blvd., Velenjak St., Chamran Highway, Tehran, 1983963113, Iran
| | - Sara Alsadat Hosseinikhah Manshadi
- Research Committee, School of Dentistry, Shahid Beheshti University of Medical Sciences, Daneshju Blvd., Velenjak St., Chamran Highway, Tehran, 1983963113, Iran
| | - Zeinab Akbarzadeh Fathabadi
- Research Committee, School of Dentistry, Shahid Beheshti University of Medical Sciences, Daneshju Blvd., Velenjak St., Chamran Highway, Tehran, 1983963113, Iran
| |
Collapse
|
5
|
Oguzhan A, Peskersoy C, Devrimci EE, Kemaloglu H, Onder TK. Implementation of machine learning models as a quantitative evaluation tool for preclinical studies in dental education. J Dent Educ 2025; 89:383-397. [PMID: 39327675 DOI: 10.1002/jdd.13722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 08/02/2024] [Accepted: 09/04/2024] [Indexed: 09/28/2024]
Abstract
PURPOSE AND OBJECTIVE Objective, valid, and reliable evaluations are needed in order to develop haptic skills in dental education. The aim of this study is to investigate the validity and reliability of the machine learning method in evaluating the haptic skills of dentistry students. MATERIALS AND METHODS One-hundred fifty 6th semester dental students have performed Class II amalgam (C2A) and composite resin restorations (C2CR), in which all stages were evaluated with Direct Observation Practical Skills forms. The final phase was graded by three trainers and supervisors separately. Standard photographs of the restorations in the final stage were taken from different angles in a special setup and transferred to the Python program which utilized the Structural Similarity algorithm to calculate both the quantitative (numerical) and qualitative (visual) differences of each restoration. The validity and reliability analyses of inter-examiner evaluation were tested by Cronbach's Alpha and Kappa statistics (p = 0.05). RESULTS The intra-examiner reliability between Structural Similarity Index (SSIM) and examiners was found highly reliable in both C2A (α = 0.961) and C2CR (α = 0.856). The compatibility of final grades given by SSIM (53.07) and examiners (56.85) was statistically insignificant (p > 0.05). A significant difference was found between the examiners and SSIM when grading the occlusal surfaces in C2A and on the palatal surfaces of C2CR (p < 0.05). The concordance of observer assessments was found almost perfect in C2A (κ = 0.806), and acceptable in C2CR (κ = 0.769). CONCLUSION Although deep machine learning is a promising tool in the evaluation of haptic skills, further improvement and alignments are required for fully objective and reliable validation in all cases of dental training in restorative dentistry.
Collapse
Affiliation(s)
- Aybeniz Oguzhan
- Department of Restorative Dentistry, Faculty of Dentistry, Ege University, Izmir, Turkey
| | - Cem Peskersoy
- Department of Restorative Dentistry, Faculty of Dentistry, Ege University, Izmir, Turkey
| | - Elif Ercan Devrimci
- Department of Restorative Dentistry, Faculty of Dentistry, Ege University, Izmir, Turkey
| | - Hande Kemaloglu
- Department of Restorative Dentistry, Faculty of Dentistry, Ege University, Izmir, Turkey
| | - Tolga Kagan Onder
- Department of Mechanical Engineering, ARQUQ Project Partnership, Izmir, Turkey
| |
Collapse
|
6
|
Noor Uddin A, Ali SA, Lal A, Adnan N, Ahmed SMF, Umer F. Applications of AI-based deep learning models for detecting dental caries on intraoral images - a systematic review. Evid Based Dent 2025; 26:71-72. [PMID: 39609513 DOI: 10.1038/s41432-024-01089-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2024] [Accepted: 10/25/2024] [Indexed: 11/30/2024]
Abstract
OBJECTIVES This systematic review aimed to assess the effectiveness of Artificial Intelligence (AI)-based Deep Learning (DL) models in the detection of dental caries on intraoral images. METHODS This systematic review adhered to PRISMA 2020 guidelines conducting an electronic search on PubMed, Scopus, and CENTRAL databases for retrospective, prospective, and cross-sectional studies published till 1st June 2024. Methodological and performance metrics of clinical studies utilizing DL models were assessed. A modified QUADAS risk of bias tool was used for quality assessment. RESULTS Out of 273 studies identified, a total of 23 were included with 19 studies having a low risk and 4 studies having a high risk of bias. Overall accuracy ranged from 56% to 99.1%, sensitivity ranged from 23% to 98% and specificity ranged from 65.7% to 100%. Only 3 studies utilized explainable AI (XAI) techniques for caries detection. A total of 4 studies exhibited a level 4 deployment status by developing mobile or web-based applications. CONCLUSION AI-based DL models have demonstrated promising prospects in enhancing the detection of dental caries, especially in terms of low-resource settings. However, there is a need for future deployed studies to enhance the AI models to improve their real-world applications.
Collapse
Affiliation(s)
- Ayesha Noor Uddin
- Section of Dentistry, Department of Surgery, The Aga Khan University, Karachi, Pakistan
| | - Syed Ahmed Ali
- Section of Dentistry, Department of Surgery, The Aga Khan University, Karachi, Pakistan
| | - Abhishek Lal
- Section of Gastroenterology, Department of Medicine. The Aga Khan University, Karachi, Pakistan
| | - Niha Adnan
- Section of Dentistry, Department of Surgery, The Aga Khan University, Karachi, Pakistan
- MeDenTec, Karachi, Pakistan
| | | | - Fahad Umer
- Section of Dentistry, Department of Surgery, The Aga Khan University, Karachi, Pakistan.
- MeDenTec, Karachi, Pakistan.
| |
Collapse
|
7
|
Lu W, Yu X, Li Y, Cao Y, Chen Y, Hua F. Artificial Intelligence-Related Dental Research: Bibliometric and Altmetric Analysis. Int Dent J 2025; 75:166-175. [PMID: 39266401 PMCID: PMC11806303 DOI: 10.1016/j.identj.2024.08.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Revised: 07/09/2024] [Accepted: 08/02/2024] [Indexed: 09/14/2024] Open
Abstract
BACKGROUND Recent years have witnessed an explosive surge in dental research related to artificial intelligence (AI). These applications have optimised dental workflows, demonstrating significant clinical importance. Understanding the current landscape and trends of this topic is crucial for both clinicians and researchers to utilise and advance this technology. However, a comprehensive scientometric study regarding this field had yet to be performed. METHODS A literature search was conducted in the Web of Science Core Collection database to identify eligible "research articles" and "reviews." Literature screening and exclusion were performed by 2 investigators. Thereafter, VOSviewer was utilised in co-occurrence analysis and CiteSpace in co-citation analysis. R package Bibliometrix was employed to automatically calculate scientific impacts, determining the core authors and journals. Altmetric data were described narratively and supplemented with Spearman correlation analysis. RESULTS A total of 1558 research publications were included. During the past 5 years, AI-related dental publications drastically increased in number, from 36 to 581. Diagnostics and Scientific Reports published the most articles, whereas Journal of Dental Research received the highest number of citations per article. China, the US, and South Korea emerged as the most prolific countries, whilst Germany received the highest number of citations per article (23.29). Charité Universitätsmedizin Berlin was the institution with the highest number of publications and citations per article (29.16). Altmetric Attention Score was correlated with News Mentions (P < .001), and significant associations were observed amongst Dimension Citations, Mendeley Readers, and Web of Science Citations (P < .001). CONCLUSIONS The publication numbers regarding AI-related dental research have been rising rapidly and may continue their upwards trend. China, the US, South Korea, and Germany had promoted the progress of AI-related dental research. Disease diagnosis, orthodontic applications, and morphology segmentation were current hotspots. Attention mechanism, explainable AI, multimodal data fusion, and AI-generated text assistants necessitate future research and exploration.
Collapse
Affiliation(s)
- Wei Lu
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Key Laboratory of Oral Biomedicine Ministry of Education, Hubei Key Laboratory of Stomatology, School & Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Xueqian Yu
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Key Laboratory of Oral Biomedicine Ministry of Education, Hubei Key Laboratory of Stomatology, School & Hospital of Stomatology, Wuhan University, Wuhan, China; Library, School & Hospital of Stomatology, Wuhan University, Wuhan, China
| | - Yueyang Li
- Wuhan Children's Hospital (Wuhan Maternal and Child Healthcare Hospital), Tongji Medical College, Huazhong University of Science & Technology, Wuhan, China
| | - Yi Cao
- School of Electronic Information, Wuhan University, Wuhan, China
| | - Yanning Chen
- Restorative Dental Sciences, Faculty of Dentistry, The University of Hong Kong, Hong Kong SAR, China.
| | - Fang Hua
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Key Laboratory of Oral Biomedicine Ministry of Education, Hubei Key Laboratory of Stomatology, School & Hospital of Stomatology, Wuhan University, Wuhan, China; Center for Evidence-Based Stomatology, School & Hospital of Stomatology, Wuhan University, Wuhan, China; Center for Orthodontics and Pediatric Dentistry at Optics Valley Branch, School & Hospital of Stomatology, Wuhan University, Wuhan, China; Division of Dentistry, School of Medical Sciences, Faculty of Biology, Medicine and Health, The University of Manchester, Manchester, UK.
| |
Collapse
|
8
|
Chen W, Dhawan M, Liu J, Ing D, Mehta K, Tran D, Lawrence D, Ganhewa M, Cirillo N. Mapping the Use of Artificial Intelligence-Based Image Analysis for Clinical Decision-Making in Dentistry: A Scoping Review. Clin Exp Dent Res 2024; 10:e70035. [PMID: 39600121 PMCID: PMC11599430 DOI: 10.1002/cre2.70035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Revised: 09/19/2024] [Accepted: 10/20/2024] [Indexed: 11/29/2024] Open
Abstract
OBJECTIVES Artificial intelligence (AI) is an emerging field in dentistry. AI is gradually being integrated into dentistry to improve clinical dental practice. The aims of this scoping review were to investigate the application of AI in image analysis for decision-making in clinical dentistry and identify trends and research gaps in the current literature. MATERIAL AND METHODS This review followed the guidelines provided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR). An electronic literature search was performed through PubMed and Scopus. After removing duplicates, a preliminary screening based on titles and abstracts was performed. A full-text review and analysis were performed according to predefined inclusion criteria, and data were extracted from eligible articles. RESULTS Of the 1334 articles returned, 276 met the inclusion criteria (consisting of 601,122 images in total) and were included in the qualitative synthesis. Most of the included studies utilized convolutional neural networks (CNNs) on dental radiographs such as orthopantomograms (OPGs) and intraoral radiographs (bitewings and periapicals). AI was applied across all fields of dentistry - particularly oral medicine, oral surgery, and orthodontics - for direct clinical inference and segmentation. AI-based image analysis was use in several components of the clinical decision-making process, including diagnosis, detection or classification, prediction, and management. CONCLUSIONS A variety of machine learning and deep learning techniques are being used for dental image analysis to assist clinicians in making accurate diagnoses and choosing appropriate interventions in a timely manner.
Collapse
Affiliation(s)
- Wei Chen
- Melbourne Dental SchoolThe University of MelbourneCarltonVictoriaAustralia
| | - Monisha Dhawan
- Melbourne Dental SchoolThe University of MelbourneCarltonVictoriaAustralia
| | - Jonathan Liu
- Melbourne Dental SchoolThe University of MelbourneCarltonVictoriaAustralia
| | - Damie Ing
- Melbourne Dental SchoolThe University of MelbourneCarltonVictoriaAustralia
| | - Kruti Mehta
- Melbourne Dental SchoolThe University of MelbourneCarltonVictoriaAustralia
| | - Daniel Tran
- Melbourne Dental SchoolThe University of MelbourneCarltonVictoriaAustralia
| | | | - Max Ganhewa
- CoTreatAI, CoTreat Pty Ltd.MelbourneVictoriaAustralia
| | - Nicola Cirillo
- Melbourne Dental SchoolThe University of MelbourneCarltonVictoriaAustralia
- CoTreatAI, CoTreat Pty Ltd.MelbourneVictoriaAustralia
| |
Collapse
|
9
|
Huang Y, Liu W, Yao C, Miao X, Guan X, Lu X, Liang X, Ma L, Tang S, Zhang Z, Zhan J. A multimodal dental dataset facilitating machine learning research and clinic services. Sci Data 2024; 11:1291. [PMID: 39604495 PMCID: PMC11603170 DOI: 10.1038/s41597-024-04130-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 11/13/2024] [Indexed: 11/29/2024] Open
Abstract
Oral diseases affect nearly 3.5 billion people, and medical resources are limited, which makes access to oral health services nontrivial. Imaging-based machine learning technology is one of the most promising technologies to improve oral medical services and reduce patient costs. The development of machine learning technology requires publicly accessible datasets. However, previous public dental datasets have several limitations: a small volume of computed tomography (CT) images, a lack of multimodal data, and a lack of complexity and diversity of data. These issues are detrimental to the development of the field of dentistry. Thus, to solve these problems, this paper introduces a new dental dataset that contains 169 patients, three commonly used dental image modalities, and images of various health conditions of the oral cavity. The proposed dataset has good potential to facilitate research on oral medical services, such as reconstructing the 3D structure of assisting clinicians in diagnosis and treatment, image translation, and image segmentation.
Collapse
Affiliation(s)
- Yunyou Huang
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
- The International Open Benchmark Council, 19801, Delaware, USA
| | - Wenjing Liu
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
- Guilin Medical University, Guilin, 541199, China
| | - Caiqin Yao
- The Second Nanning People's Hospital, Nanning, 530031, China
| | - Xiuxia Miao
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Xianglong Guan
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Xiangjiang Lu
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Xiaoshuang Liang
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Li Ma
- Guilin Medical University, Guilin, 541199, China.
| | - Suqin Tang
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China.
| | - Zhifei Zhang
- Department of Physiology and Pathophysiology, Capital Medical University, Beijing, 100069, China.
| | - Jianfeng Zhan
- The International Open Benchmark Council, 19801, Delaware, USA.
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100086, China.
- University of Chinese Academy of Sciences, Beijing, 100086, China.
| |
Collapse
|
10
|
Alharbi SS, Alhasson HF. Exploring the Applications of Artificial Intelligence in Dental Image Detection: A Systematic Review. Diagnostics (Basel) 2024; 14:2442. [PMID: 39518408 PMCID: PMC11545562 DOI: 10.3390/diagnostics14212442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2024] [Revised: 10/10/2024] [Accepted: 10/12/2024] [Indexed: 11/16/2024] Open
Abstract
BACKGROUND Dental care has been transformed by neural networks, introducing advanced methods for improving patient outcomes. By leveraging technological innovation, dental informatics aims to enhance treatment and diagnostic processes. Early diagnosis of dental problems is crucial, as it can substantially reduce dental disease incidence by ensuring timely and appropriate treatment. The use of artificial intelligence (AI) within dental informatics is a pivotal tool that has applications across all dental specialties. This systematic literature review aims to comprehensively summarize existing research on AI implementation in dentistry. It explores various techniques used for detecting oral features such as teeth, fillings, caries, prostheses, crowns, implants, and endodontic treatments. AI plays a vital role in the diagnosis of dental diseases by enabling precise and quick identification of issues that may be difficult to detect through traditional methods. Its ability to analyze large volumes of data enhances diagnostic accuracy and efficiency, leading to better patient outcomes. METHODS An extensive search was conducted across a number of databases, including Science Direct, PubMed (MEDLINE), arXiv.org, MDPI, Nature, Web of Science, Google Scholar, Scopus, and Wiley Online Library. RESULTS The studies included in this review employed a wide range of neural networks, showcasing their versatility in detecting the dental categories mentioned above. Additionally, the use of diverse datasets underscores the adaptability of these AI models to different clinical scenarios. This study highlights the compatibility, robustness, and heterogeneity among the reviewed studies. This indicates that AI technologies can be effectively integrated into current dental practices. The review also discusses potential challenges and future directions for AI in dentistry. It emphasizes the need for further research to optimize these technologies for broader clinical applications. CONCLUSIONS By providing a detailed overview of AI's role in dentistry, this review aims to inform practitioners and researchers about the current capabilities and future potential of AI-driven dental care, ultimately contributing to improved patient outcomes and more efficient dental practices.
Collapse
Affiliation(s)
- Shuaa S. Alharbi
- Department of Information Technology, College of Computer, Qassim University, Buraydah 52571, Saudi Arabia;
| | | |
Collapse
|
11
|
Frenkel E, Neumayr J, Schwarzmaier J, Kessler A, Ammar N, Schwendicke F, Kühnisch J, Dujic H. Caries Detection and Classification in Photographs Using an Artificial Intelligence-Based Model-An External Validation Study. Diagnostics (Basel) 2024; 14:2281. [PMID: 39451605 PMCID: PMC11507311 DOI: 10.3390/diagnostics14202281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2024] [Accepted: 10/12/2024] [Indexed: 10/26/2024] Open
Abstract
OBJECTIVE This ex vivo diagnostic study aimed to externally validate a freely accessible AI-based model for caries detection, classification, localisation and segmentation using an independent image dataset. It was hypothesised that there would be no difference in diagnostic performance compared to previously published internal validation data. METHODS For the independent dataset, 718 dental images representing different stages of carious (n = 535) and noncarious teeth (n = 183) were retrieved from the internet. All photographs were evaluated by the dental team (reference standard) and the AI-based model (test method). Diagnostic performance was statistically determined using cross-tabulations to calculate accuracy (ACC), sensitivity (SE), specificity (SP) and area under the curve (AUC). RESULTS An overall ACC of 92.0% was achieved for caries detection, with an ACC of 85.5-95.6%, SE of 42.9-93.3%, SP of 82.1-99.4% and AUC of 0.702-0.909 for the classification of caries. Furthermore, 97.0% of the cases were accurately localised. Fully and partially correct segmentation was achieved in 52.9% and 44.1% of the cases, respectively. CONCLUSIONS The validated AI-based model showed promising diagnostic performance in detecting and classifying caries using an independent image dataset. Future studies are needed to investigate the validity, reliability and practicability of AI-based models using dental photographs from different image sources and/or patient groups.
Collapse
Affiliation(s)
- Elisabeth Frenkel
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
| | - Julia Neumayr
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
| | - Julia Schwarzmaier
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
| | - Andreas Kessler
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
- Department of Prosthetic Dentistry, Faculty of Medicine, Center for Dental Medicine, Medical Center-University of Freiburg, University of Freiburg, 79106 Freiburg, Germany
| | - Nour Ammar
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
| | - Falk Schwendicke
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
| | - Helena Dujic
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany; (E.F.); (J.N.); (J.S.); (A.K.); (N.A.); (F.S.); (H.D.)
| |
Collapse
|
12
|
Chaudhary S, Shah P, Paygude P, Chiwhane S, Mahajan P, Chavan P, Kasar M. Varying views of maxillary and mandibular aspects of teeth: A dataset. Data Brief 2024; 56:110772. [PMID: 39170734 PMCID: PMC11334821 DOI: 10.1016/j.dib.2024.110772] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 06/30/2024] [Accepted: 07/18/2024] [Indexed: 08/23/2024] Open
Abstract
Real teeth or dental image datasets are a valuable resource that is transforming the field of dentistry by enabling automation, improving diagnostics and accelerating research and development.This article presents a comprehensive dataset containing 9,562 images of healthy teeth (noncarious) from children aged 1 to 14 years. The images capture different views of the teeth, including maxillary (upper) and mandibular (lower) arches, front, right, left, and occlusal (biting surface) views. These images are stored under eight subcategories in the Mendeley repository, a platform for research data. The potential application of this dataset involves using machine learning to analyze the dental condition. This could provide a faster analysis and facilitate remote assessment of dental conditions in underserved areas. Overall, this dataset seems like a promising tool for advancing dental care through the power of machine learning.
Collapse
Affiliation(s)
- Shweta Chaudhary
- Bharati Vidyapeeth Deemed to be University Dental College and Hospital, Katraj, Pune, India
| | - Preetam Shah
- Bharati Vidyapeeth Deemed to be University Dental College and Hospital, Katraj, Pune, India
| | - Priyanka Paygude
- Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India
| | - Shwetambari Chiwhane
- Symbiosis Institute of Technology, Symbiosis International University, Pune, India
| | - Pratibha Mahajan
- Department of Artificial Intelligence, Vishwakarma University, Pune, India
| | - Prashant Chavan
- Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India
| | - Manisha Kasar
- Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India
| |
Collapse
|
13
|
Vilcapoma P, Parra Meléndez D, Fernández A, Vásconez IN, Hillmann NC, Gatica G, Vásconez JP. Comparison of Faster R-CNN, YOLO, and SSD for Third Molar Angle Detection in Dental Panoramic X-rays. SENSORS (BASEL, SWITZERLAND) 2024; 24:6053. [PMID: 39338799 PMCID: PMC11435645 DOI: 10.3390/s24186053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2024] [Revised: 09/05/2024] [Accepted: 09/14/2024] [Indexed: 09/30/2024]
Abstract
The use of artificial intelligence algorithms (AI) has gained importance for dental applications in recent years. Analyzing AI information from different sensor data such as images or panoramic radiographs (panoramic X-rays) can help to improve medical decisions and achieve early diagnosis of different dental pathologies. In particular, the use of deep learning (DL) techniques based on convolutional neural networks (CNNs) has obtained promising results in dental applications based on images, in which approaches based on classification, detection, and segmentation are being studied with growing interest. However, there are still several challenges to be tackled, such as the data quality and quantity, the variability among categories, and the analysis of the possible bias and variance associated with each dataset distribution. This study aims to compare the performance of three deep learning object detection models-Faster R-CNN, YOLO V2, and SSD-using different ResNet architectures (ResNet-18, ResNet-50, and ResNet-101) as feature extractors for detecting and classifying third molar angles in panoramic X-rays according to Winter's classification criterion. Each object detection architecture was trained, calibrated, validated, and tested with three different feature extraction CNNs which are ResNet-18, ResNet-50, and ResNet-101, which were the networks that best fit our dataset distribution. Based on such detection networks, we detect four different categories of angles in third molars using panoramic X-rays by using Winter's classification criterion. This criterion characterizes the third molar's position relative to the second molar's longitudinal axis. The detected categories for the third molars are distoangular, vertical, mesioangular, and horizontal. For training, we used a total of 644 panoramic X-rays. The results obtained in the testing dataset reached up to 99% mean average accuracy performance, demonstrating the YOLOV2 obtained higher effectiveness in solving the third molar angle detection problem. These results demonstrate that the use of CNNs for object detection in panoramic radiographs represents a promising solution in dental applications.
Collapse
Affiliation(s)
- Piero Vilcapoma
- Faculty of Engineering, Universidad Andres Bello, Santiago 7500735, Chile
| | | | - Alejandra Fernández
- Laboratorio de Odontología Traslacional, Facultad de Odontología, UNAB, Santiago 7591538, Chile
| | - Ingrid Nicole Vásconez
- Centro de Biotecnología Daniel Alkalay Lowitt, Universidad Técnica Federico Santa María, Valparaiso 2390136, Chile
| | - Nicolás Corona Hillmann
- Laboratorio de Odontología Traslacional, Facultad de Odontología, UNAB, Santiago 7591538, Chile
| | - Gustavo Gatica
- Faculty of Engineering, Universidad Andres Bello, Santiago 7500735, Chile
| | - Juan Pablo Vásconez
- Energy Transformation Center, Faculty of Engineering, Universidad Andres Bello, Santiago 7500971, Chile
| |
Collapse
|
14
|
Al-Khalifa KS, Ahmed WM, Azhari AA, Qaw M, Alsheikh R, Alqudaihi F, Alfaraj A. The Use of Artificial Intelligence in Caries Detection: A Review. Bioengineering (Basel) 2024; 11:936. [PMID: 39329679 PMCID: PMC11428802 DOI: 10.3390/bioengineering11090936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2024] [Revised: 08/20/2024] [Accepted: 09/11/2024] [Indexed: 09/28/2024] Open
Abstract
Advancements in artificial intelligence (AI) have significantly impacted the field of dentistry, particularly in diagnostic imaging for caries detection. This review critically examines the current state of AI applications in caries detection, focusing on the performance and accuracy of various AI techniques. We evaluated 40 studies from the past 23 years, carefully selected for their relevance and quality. Our analysis highlights the potential of AI, especially convolutional neural networks (CNNs), to improve diagnostic accuracy and efficiency in detecting dental caries. The findings underscore the transformative potential of AI in clinical dental practice.
Collapse
Affiliation(s)
- Khalifa S. Al-Khalifa
- Department of Preventive Dental Sciences, College of Dentistry, Imam Abdulrahman Bin Faisal University, Dammam 31441, Saudi Arabia
| | - Walaa Magdy Ahmed
- Department of Restorative Dentistry, Faculty of Dentistry, King Abdulaziz University, Jeddah 21589, Saudi Arabia; (W.M.A.); (A.A.A.)
| | - Amr Ahmed Azhari
- Department of Restorative Dentistry, Faculty of Dentistry, King Abdulaziz University, Jeddah 21589, Saudi Arabia; (W.M.A.); (A.A.A.)
| | - Masoumah Qaw
- Department of Restorative Dental Sciences, College of Dentistry, Imam Abdulrahman Bin Faisal University, Dammam 31441, Saudi Arabia; (M.Q.); (R.A.)
| | - Rasha Alsheikh
- Department of Restorative Dental Sciences, College of Dentistry, Imam Abdulrahman Bin Faisal University, Dammam 31441, Saudi Arabia; (M.Q.); (R.A.)
| | - Fatema Alqudaihi
- Department of Restorative Dentistry, Khobar Dental Complex, Eastern Health Cluster, Dammam 32253, Saudi Arabia;
| | - Amal Alfaraj
- Department of Prosthodontics and Dental Implantology, College of Dentistry, King Faisal University, Al-Ahsa 31982, Saudi Arabia;
| |
Collapse
|
15
|
Kang S, Shon B, Park EY, Jeong S, Kim EK. Diagnostic accuracy of dental caries detection using ensemble techniques in deep learning with intraoral camera images. PLoS One 2024; 19:e0310004. [PMID: 39241044 PMCID: PMC11379315 DOI: 10.1371/journal.pone.0310004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 08/22/2024] [Indexed: 09/08/2024] Open
Abstract
Camera image-based deep learning (DL) techniques have achieved promising results in dental caries screening. To apply the intraoral camera image-based DL technique for dental caries detection and assess its diagnostic performance, we employed the ensemble technique in the image classification task. 2,682 intraoral camera images were used as the dataset for image classification according to dental caries presence and caries-lesion localization using DL models such as ResNet-50, Inception-v3, Inception-ResNet-v2, and Faster R-convolutional neural network according to diagnostic study design. 534 participants whose mean age [SD] was 47.67 [±13.94] years were enrolled. The dataset was divided into training (56.0%), validation (14.0%), and test subset (30.0%) annotated by one experienced dentist as a reference standard about dental caries detection and lesion location. The confusion matrix, area under the receiver operating characteristic curve (AUROC), and average precision (AP) were evaluated for performance analysis. In the end-to-end dental caries image classification, the ensemble DL models had consistently improved performance, in which as the best results, the ensemble model of Inception-ResNet-v2 achieved 0.94 of AUROC and 0.97 of AP. On the other hand, the explainable model achieved 0.91 of AUROC and 0.96 of AP after the ensemble application. For dental caries classification using intraoral camera images, the application of ensemble techniques exhibited consistently improved performance regardless of the DL models. Furthermore, the trial to create an explainable DL model based on carious lesion detection yielded favorable results.
Collapse
Affiliation(s)
- Sohee Kang
- Department of Dentistry, College of Medicine, Yeungnam University, Daegu, South Korea
| | - Byungeun Shon
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, South Korea
- Department of Medical Informatics, School of Medicine, Kyungpook National University, Daegu, South Korea
| | - Eun Young Park
- Department of Dentistry, College of Medicine, Yeungnam University, Daegu, South Korea
| | - Sungmoon Jeong
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, South Korea
- Department of Medical Informatics, School of Medicine, Kyungpook National University, Daegu, South Korea
| | - Eun-Kyong Kim
- Department of Dental Hygiene, College of Science and Technology, Kyungpook National University, Sangju, South Korea
| |
Collapse
|
16
|
Schwarzmaier J, Frenkel E, Neumayr J, Ammar N, Kessler A, Schwendicke F, Kühnisch J, Dujic H. Validation of an Artificial Intelligence-Based Model for Early Childhood Caries Detection in Dental Photographs. J Clin Med 2024; 13:5215. [PMID: 39274428 PMCID: PMC11396146 DOI: 10.3390/jcm13175215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2024] [Revised: 08/22/2024] [Accepted: 08/30/2024] [Indexed: 09/16/2024] Open
Abstract
Background/Objectives: Early childhood caries (ECC) is a widespread and severe oral health problem that potentially affects the general health of children. Visual-tactile examination remains the diagnostic method of choice to diagnose ECC, although visual examination could be automated by artificial intelligence (AI) tools in the future. The aim of this study was the external validation of a recently published and freely accessible AI-based model for detecting ECC and classifying carious lesions in dental photographs. Methods: A total of 143 anonymised photographs of anterior deciduous teeth (ECC = 107, controls = 36) were visually evaluated by the dental study group (reference test) and analysed using the AI-based model (test method). Diagnostic performance was determined statistically. Results: ECC detection accuracy was 97.2%. Diagnostic performance varied between carious lesion classes (noncavitated lesions, greyish translucency/microcavity, cavitation, destructed tooth), with accuracies ranging from 88.9% to 98.1%, sensitivities ranging from 68.8% to 98.5% and specificities ranging from 86.1% to 99.4%. The area under the curve ranged from 0.834 to 0.964. Conclusions: The performance of the AI-based model is similar to that reported for the internal dataset used by developers. Further studies with independent image samples are required to comprehensively gauge the performance of the model.
Collapse
Affiliation(s)
- Julia Schwarzmaier
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
| | - Elisabeth Frenkel
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
| | - Julia Neumayr
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
| | - Nour Ammar
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
| | - Andreas Kessler
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
- Department of Prosthetic Dentistry, Center for Dental Medicine, University Hospital Freiburg, 79106 Freiburg, Germany
| | - Falk Schwendicke
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
| | - Helena Dujic
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University of Munich, 80336 Munich, Germany
| |
Collapse
|
17
|
Wu W, Chen S, Chen P, Chen M, Yang Y, Gao Y, Hu J, Ma J. Identification of Root Canal Morphology in Fused-rooted Mandibular Second Molars From X-ray Images Based on Deep Learning. J Endod 2024; 50:1289-1297.e1. [PMID: 38821263 DOI: 10.1016/j.joen.2024.05.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 04/26/2024] [Accepted: 05/22/2024] [Indexed: 06/02/2024]
Abstract
INTRODUCTION Understanding the intricate anatomical morphology of fused-rooted mandibular second molars (MSMs) is essential for root canal treatment. The present study utilized a deep learning approach to identify the three-dimensional root canal morphology of MSMs from two-dimensional X-ray images. METHODS A total of 271 fused-rooted MSMs were included in the study. Micro-computed tomography reconstruction images and two-dimensional X-ray projection images were obtained. The ground truth of three-dimensional root canal morphology was determined through micro-computed tomography images, which were classified into merging, symmetrical, and asymmetrical types. To amplify the X-ray image dataset, traditional augmentation techniques from the python package Augmentor and a multiangle projection method were employed. Identification of root canal morphology was conducted using the pretrained VGG19, ResNet18, ResNet50, and EfficientNet-b5 on X-ray images. The classification results from convolutional neural networks (CNNs) were then compared with those performed by endodontic residents. RESULTS The multiangle projection augmentation method outperformed the traditional approach in all CNNs except for EfficientNet-b5. ResNet18 combined with the multiangle projection method outperformed all other combinations, with an overall accuracy of 79.25%. In specific classifications, accuracies of 81.13%, 86.79%, and 90.57% were achieved for merging, symmetrical, and asymmetrical types, respectively. Notably, CNNs surpassed endodontic residents in classification performance; the average accuracy for endodontic residents was only 60.38% (P < .05). CONCLUSIONS CNNs were more effective than endodontic residents in identifying the three-dimensional root canal morphology of MSMs. The result indicates that CNNs possess the capacity to employ two-dimensional images effectively in aiding three-dimensional diagnoses.
Collapse
Affiliation(s)
- Weiwei Wu
- Department of Stomatology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Surong Chen
- Department of Stomatology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Pan Chen
- Department of Stomatology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Min Chen
- State Key Laboratory of Oral Diseases & National Center for Stomatology & National Clinical Research Center for Oral Diseases, Department of Cariology and Endodontics, West China Hospital of Stomatology, Sichuan University, Chengdu, Sichuan, China
| | - Yan Yang
- Department of Stomatology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yuan Gao
- State Key Laboratory of Oral Diseases & National Center for Stomatology & National Clinical Research Center for Oral Diseases, Department of Cariology and Endodontics, West China Hospital of Stomatology, Sichuan University, Chengdu, Sichuan, China
| | - Jingyu Hu
- Department of Stomatology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China.
| | - Jingzhi Ma
- Department of Stomatology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China; School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China.
| |
Collapse
|
18
|
Kong HJ, Kim YL. Application of artificial intelligence in dental crown prosthesis: a scoping review. BMC Oral Health 2024; 24:937. [PMID: 39138474 PMCID: PMC11321175 DOI: 10.1186/s12903-024-04657-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Accepted: 07/23/2024] [Indexed: 08/15/2024] Open
Abstract
BACKGROUND In recent years, artificial intelligence (AI) has made remarkable advancements and achieved significant accomplishments across the entire field of dentistry. Notably, efforts to apply AI in prosthodontics are continually progressing. This scoping review aims to present the applications and performance of AI in dental crown prostheses and related topics. METHODS We conducted a literature search of PubMed, Scopus, Web of Science, Google Scholar, and IEEE Xplore databases from January 2010 to January 2024. The included articles addressed the application of AI in various aspects of dental crown treatment, including fabrication, assessment, and prognosis. RESULTS The initial electronic literature search yielded 393 records, which were reduced to 315 after eliminating duplicate references. The application of inclusion criteria led to analysis of 12 eligible publications in the qualitative review. The AI-based applications included in this review were related to detection of dental crown finish line, evaluation of AI-based color matching, evaluation of crown preparation, evaluation of dental crown designed by AI, identification of a dental crown in an intraoral photo, and prediction of debonding probability. CONCLUSIONS AI has the potential to increase efficiency in processes such as fabricating and evaluating dental crowns, with a high level of accuracy reported in most of the analyzed studies. However, a significant number of studies focused on designing crowns using AI-based software, and these studies had a small number of patients and did not always present their algorithms. Standardized protocols for reporting and evaluating AI studies are needed to increase the evidence and effectiveness.
Collapse
Affiliation(s)
- Hyun-Jun Kong
- Department of Prosthodontics and Wonkwang Dental Research Institute, School of Dentistry, Wonkwang University, Iksan, Republic of Korea.
| | - Yu-Lee Kim
- Department of Prosthodontics, School of Dentistry, Wonkwang University, Iksan, Republic of Korea
| |
Collapse
|
19
|
Ali IE, Sumita Y, Wakabayashi N. Advancing maxillofacial prosthodontics by using pre-trained convolutional neural networks: Image-based classification of the maxilla. J Prosthodont 2024; 33:645-654. [PMID: 38566564 DOI: 10.1111/jopr.13853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 03/15/2024] [Indexed: 04/04/2024] Open
Abstract
PURPOSE The study aimed to compare the performance of four pre-trained convolutional neural networks in recognizing seven distinct prosthodontic scenarios involving the maxilla, as a preliminary step in developing an artificial intelligence (AI)-powered prosthesis design system. MATERIALS AND METHODS Seven distinct classes, including cleft palate, dentulous maxillectomy, edentulous maxillectomy, reconstructed maxillectomy, completely dentulous, partially edentulous, and completely edentulous, were considered for recognition. Utilizing transfer learning and fine-tuned hyperparameters, four AI models (VGG16, Inception-ResNet-V2, DenseNet-201, and Xception) were employed. The dataset, consisting of 3541 preprocessed intraoral occlusal images, was divided into training, validation, and test sets. Model performance metrics encompassed accuracy, precision, recall, F1 score, area under the receiver operating characteristic curve (AUC), and confusion matrix. RESULTS VGG16, Inception-ResNet-V2, DenseNet-201, and Xception demonstrated comparable performance, with maximum test accuracies of 0.92, 0.90, 0.94, and 0.95, respectively. Xception and DenseNet-201 slightly outperformed the other models, particularly compared with InceptionResNet-V2. Precision, recall, and F1 scores exceeded 90% for most classes in Xception and DenseNet-201 and the average AUC values for all models ranged between 0.98 and 1.00. CONCLUSIONS While DenseNet-201 and Xception demonstrated superior performance, all models consistently achieved diagnostic accuracy exceeding 90%, highlighting their potential in dental image analysis. This AI application could help work assignments based on difficulty levels and enable the development of an automated diagnosis system at patient admission. It also facilitates prosthesis designing by integrating necessary prosthesis morphology, oral function, and treatment difficulty. Furthermore, it tackles dataset size challenges in model optimization, providing valuable insights for future research.
Collapse
Affiliation(s)
- Islam E Ali
- Department of Advanced Prosthodontics, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
- Department of Prosthodontics, Faculty of Dentistry, Mansoura University, Mansoura, Egypt
| | - Yuka Sumita
- Division of General Dentistry 4, The Nippon Dental University Hospital, Tokyo, Japan
- Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
| | - Noriyuki Wakabayashi
- Department of Advanced Prosthodontics, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
| |
Collapse
|
20
|
Aykol-Sahin G, Yucel O, Eraydin N, Keles GC, Unlu U, Baser U. Efficiency of oral keratinized gingiva detection and measurement based on convolutional neural network. J Periodontol 2024. [PMID: 39007745 DOI: 10.1002/jper.24-0151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 06/11/2024] [Accepted: 06/12/2024] [Indexed: 07/16/2024]
Abstract
BACKGROUND With recent advances in artificial intelligence, the use of this technology has begun to facilitate comprehensive tissue evaluation and planning of interventions. This study aimed to assess different convolutional neural networks (CNN) in deep learning algorithms to detect keratinized gingiva based on intraoral photos and evaluate the ability of networks to measure keratinized gingiva width. METHODS Six hundred of 1200 photographs taken before and after applying a disclosing agent were used to compare the neural networks in segmenting the keratinized gingiva. Segmentation performances of networks were evaluated using accuracy, intersection over union, and F1 score. Keratinized gingiva width from a reference point was measured from ground truth images and compared with the measurements of clinicians and the DeepLab image that was generated from the ResNet50 model. The effect of measurement operators, phenotype, and jaw on differences in measurements was evaluated by three-factor mixed-design analysis of variance (ANOVA). RESULTS Among the compared networks, ResNet50 distinguished keratinized gingiva at the highest accuracy rate of 91.4%. The measurements between deep learning and clinicians were in excellent agreement according to jaw and phenotype. When analyzing the influence of the measurement operators, phenotype, and jaw on the measurements performed according to the ground truth, there were statistically significant differences in measurement operators and jaw (p < 0.05). CONCLUSIONS Automated keratinized gingiva segmentation with the ResNet50 model might be a feasible method for assisting professionals. The measurement results promise a potentially high performance of the model as it requires less time and experience. PLAIN LANGUAGE SUMMARY With recent advances in artificial intelligence (AI), it is now possible to use this technology to evaluate tissues and plan medical procedures thoroughly. This study focused on testing different AI models, specifically CNN, to identify and measure a specific type of gum tissue called keratinized gingiva using photos taken inside the mouth. Out of 1200 photos, 600 were used in the study to compare the performance of different CNN in identifying gingival tissue. The accuracy and effectiveness of these models were measured and compared to human clinician ratings. The study found that the ResNet50 model was the most accurate, correctly identifying gingival tissue 91.4% of the time. When the AI model and clinicians' measurements of gum tissue width were compared, the results were very similar, especially when accounting for different jaws and gum structures. The study also analyzed the effect of various factors on the measurements and found significant differences based on who took the measurements and jaw type. In conclusion, using the ResNet50 model to identify and measure gum tissue automatically could be a practical tool for dental professionals, saving time and requiring less expertise.
Collapse
Affiliation(s)
- Gokce Aykol-Sahin
- Istanbul Okan University, Faculty of Dentistry, Department of Periodontology, Istanbul, Turkey
| | - Ozgun Yucel
- Gebze Technical University, Department of Chemical Engineering, Kocaeli, Turkey
| | - Nihal Eraydin
- Istanbul Okan University, Faculty of Dentistry, Department of Periodontology, Istanbul, Turkey
| | - Gonca Cayir Keles
- Istanbul Okan University, Faculty of Dentistry, Department of Periodontology, Istanbul, Turkey
| | - Umran Unlu
- Gebze Technical University, Department of Chemical Engineering, Kocaeli, Turkey
| | - Ulku Baser
- Istanbul University, Faculty of Dentistry, Department of Periodontology, Istanbul, Turkey
| |
Collapse
|
21
|
Xiong Y, Zhang H, Zhou S, Lu M, Huang J, Huang Q, Huang B, Ding J. Simultaneous detection of dental caries and fissure sealant in intraoral photos by deep learning: a pilot study. BMC Oral Health 2024; 24:553. [PMID: 38735954 PMCID: PMC11089789 DOI: 10.1186/s12903-024-04254-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2023] [Accepted: 04/11/2024] [Indexed: 05/14/2024] Open
Abstract
BACKGROUND Deep learning, as an artificial intelligence method has been proved to be powerful in analyzing images. The purpose of this study is to construct a deep learning-based model (ToothNet) for the simultaneous detection of dental caries and fissure sealants in intraoral photos. METHODS A total of 1020 intraoral photos were collected from 762 volunteers. Teeth, caries and sealants were annotated by two endodontists using the LabelMe tool. ToothNet was developed by modifying the YOLOX framework for simultaneous detection of caries and fissure sealants. The area under curve (AUC) in the receiver operating characteristic curve (ROC) and free-response ROC (FROC) curves were used to evaluate model performance in the following aspects: (i) classification accuracy of detecting dental caries and fissure sealants from a photograph (image-level); and (ii) localization accuracy of the locations of predicted dental caries and fissure sealants (tooth-level). The performance of ToothNet and dentist with 1year of experience (1-year dentist) were compared at tooth-level and image-level using Wilcoxon test and DeLong test. RESULTS At the image level, ToothNet achieved an AUC of 0.925 (95% CI, 0.880-0.958) for caries detection and 0.902 (95% CI, 0.853-0.940) for sealant detection. At the tooth level, with a confidence threshold of 0.5, the sensitivity, precision, and F1-score for caries detection were 0.807, 0.814, and 0.810, respectively. For fissure sealant detection, the values were 0.714, 0.750, and 0.731. Compared with ToothNet, the 1-year dentist had a lower F1 value (0.599, p < 0.0001) and AUC (0.749, p < 0.0001) in caries detection, and a lower F1 value (0.727, p = 0.023) and similar AUC (0.829, p = 0.154) in sealant detection. CONCLUSIONS The proposed deep learning model achieved multi-task simultaneous detection in intraoral photos and showed good performance in the detection of dental caries and fissure sealants. Compared with 1-year dentist, the model has advantages in caries detection and is equivalent in fissure sealants detection.
Collapse
Affiliation(s)
- Yanshan Xiong
- Department of Endodontics, Shenzhen Stomatology Hospital, Shenzhen, Guangdong, China
| | - Hongyuan Zhang
- Medical AI Lab, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, Guangdong, China
| | - Shiyong Zhou
- Department of Endodontics, Shenzhen Stomatology Hospital, Shenzhen, Guangdong, China
| | - Minhua Lu
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, Guangdong, China
| | - Jiahui Huang
- Medical AI Lab, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, Guangdong, China
| | - Qiangtai Huang
- Medical AI Lab, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, Guangdong, China
| | - Bingsheng Huang
- Medical AI Lab, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, Guangdong, China.
| | - Jiangfeng Ding
- Department of Endodontics, Shenzhen Stomatology Hospital, Shenzhen, Guangdong, China.
- Department of Pediatric Stomatology, Shenzhen Stomatology Hospital, Shenzhen, Guangdong, China.
| |
Collapse
|
22
|
Moharrami M, Farmer J, Singhal S, Watson E, Glogauer M, Johnson AEW, Schwendicke F, Quinonez C. Detecting dental caries on oral photographs using artificial intelligence: A systematic review. Oral Dis 2024; 30:1765-1783. [PMID: 37392423 DOI: 10.1111/odi.14659] [Citation(s) in RCA: 16] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 05/19/2023] [Accepted: 06/15/2023] [Indexed: 07/03/2023]
Abstract
OBJECTIVES This systematic review aimed at evaluating the performance of artificial intelligence (AI) models in detecting dental caries on oral photographs. METHODS Methodological characteristics and performance metrics of clinical studies reporting on deep learning and other machine learning algorithms were assessed. The risk of bias was evaluated using the quality assessment of diagnostic accuracy studies 2 (QUADAS-2) tool. A systematic search was conducted in EMBASE, Medline, and Scopus. RESULTS Out of 3410 identified records, 19 studies were included with six and seven studies having low risk of biases and applicability concerns for all the domains, respectively. Metrics varied widely and were assessed on multiple levels. F1-scores for classification and detection tasks were 68.3%-94.3% and 42.8%-95.4%, respectively. Irrespective of the task, F1-scores were 68.3%-95.4% for professional cameras, 78.8%-87.6%, for intraoral cameras, and 42.8%-80% for smartphone cameras. Limited studies allowed assessing AI performance for lesions of different severity. CONCLUSION Automatic detection of dental caries using AI may provide objective verification of clinicians' diagnoses and facilitate patient-clinician communication and teledentistry. Future studies should consider more robust study designs, employ comparable and standardized metrics, and focus on the severity of caries lesions.
Collapse
Affiliation(s)
- Mohammad Moharrami
- Faculty of Dentistry, University of Toronto, Toronto, Ontario, Canada
- Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus Group AI on Health, Geneva, Switzerland
| | - Julie Farmer
- Faculty of Dentistry, University of Toronto, Toronto, Ontario, Canada
| | - Sonica Singhal
- Faculty of Dentistry, University of Toronto, Toronto, Ontario, Canada
- Health Promotion, Chronic Disease and Injury Prevention Department, Public Health Ontario, Toronto, Canada
| | - Erin Watson
- Faculty of Dentistry, University of Toronto, Toronto, Ontario, Canada
- Department of Dental Oncology, Princess Margaret Cancer Centre, Toronto, Ontario, Canada
| | - Michael Glogauer
- Faculty of Dentistry, University of Toronto, Toronto, Ontario, Canada
- Department of Dental Oncology, Princess Margaret Cancer Centre, Toronto, Ontario, Canada
- Department of Dentistry, Centre for Advanced Dental Research and Care, Mount Sinai Hospital, Toronto, Ontario, Canada
| | - Alistair E W Johnson
- Program in Child Health Evaluative Sciences, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Falk Schwendicke
- Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus Group AI on Health, Geneva, Switzerland
- Oral Diagnostics, Digital Health and Health Services Research, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | - Carlos Quinonez
- Faculty of Dentistry, University of Toronto, Toronto, Ontario, Canada
- Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada
| |
Collapse
|
23
|
Ying S, Huang F, Shen X, Liu W, He F. Performance comparison of multifarious deep networks on caries detection with tooth X-ray images. J Dent 2024; 144:104970. [PMID: 38556194 DOI: 10.1016/j.jdent.2024.104970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2023] [Revised: 03/11/2024] [Accepted: 03/24/2024] [Indexed: 04/02/2024] Open
Abstract
OBJECTIVES Deep networks have been preliminarily studied in caries diagnosis based on clinical X-ray images. However, the performance of different deep networks on caries detection is still unclear. This study aims to comprehensively compare the caries detection performances of recent multifarious deep networks with clinical dentist level as a bridge. METHODS Based on the self-collected periapical radiograph dataset in clinic, four most popular deep networks in two types, namely YOLOv5 and DETR object detection networks, and UNet and Trans-UNet segmentation networks, were included in the comparison study. Five dentists carried out the caries detection on the same testing dataset for reference. Key tooth-level metrics, including precision, sensitivity, specificity, F1-score and Youden index, were obtained, based on which statistical analysis was conducted. RESULTS The F1-score order of deep networks is YOLOv5 (0.87), Trans-UNet (0.86), DETR (0.82) and UNet (0.80) in caries detection. A same ranking order is found using the Youden index combining sensitivity and specificity, which are 0.76, 0.73, 0.69 and 0.64 respectively. A moderate level of concordance was observed between all networks and the gold standard. No significant difference (p > 0.05) was found between deep networks and between the well-trained network and dentists in caries detection. CONCLUSIONS Among investigated deep networks, YOLOv5 is recommended to be priority for caries detection in terms of its high metrics. The well-trained deep network could be used as a good assistance for dentists to detect and diagnose caries. CLINICAL SIGNIFICANCE The well-trained deep network shows a promising potential clinical application prospect. It can provide valuable support to healthcare professionals in facilitating detection and diagnosis of dental caries.
Collapse
Affiliation(s)
- Shunv Ying
- Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Clinical Research Center for Oral Diseases of Zhejiang Province, Key Laboratory of Oral Biomedical Research of Zhejiang Province, Cancer Center of Zhejiang University, Hangzhou, 310006, China
| | - Feng Huang
- School of Mechanical & Energy Engineering, Zhejiang University of Science & Technology, Hangzhou, 310023, China.
| | - Xiaoting Shen
- Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Clinical Research Center for Oral Diseases of Zhejiang Province, Key Laboratory of Oral Biomedical Research of Zhejiang Province, Cancer Center of Zhejiang University, Hangzhou, 310006, China
| | - Wei Liu
- Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Clinical Research Center for Oral Diseases of Zhejiang Province, Key Laboratory of Oral Biomedical Research of Zhejiang Province, Cancer Center of Zhejiang University, Hangzhou, 310006, China
| | - Fuming He
- Stomatology Hospital, School of Stomatology, Zhejiang University School of Medicine, Clinical Research Center for Oral Diseases of Zhejiang Province, Key Laboratory of Oral Biomedical Research of Zhejiang Province, Cancer Center of Zhejiang University, Hangzhou, 310006, China.
| |
Collapse
|
24
|
Naeimi SM, Darvish S, Salman BN, Luchian I. Artificial Intelligence in Adult and Pediatric Dentistry: A Narrative Review. Bioengineering (Basel) 2024; 11:431. [PMID: 38790300 PMCID: PMC11118054 DOI: 10.3390/bioengineering11050431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 04/21/2024] [Accepted: 04/24/2024] [Indexed: 05/26/2024] Open
Abstract
Artificial intelligence (AI) has been recently introduced into clinical dentistry, and it has assisted professionals in analyzing medical data with unprecedented speed and an accuracy level comparable to humans. With the help of AI, meaningful information can be extracted from dental databases, especially dental radiographs, to devise machine learning (a subset of AI) models. This study focuses on models that can diagnose and assist with clinical conditions such as oral cancers, early childhood caries, deciduous teeth numbering, periodontal bone loss, cysts, peri-implantitis, osteoporosis, locating minor apical foramen, orthodontic landmark identification, temporomandibular joint disorders, and more. The aim of the authors was to outline by means of a review the state-of-the-art applications of AI technologies in several dental subfields and to discuss the efficacy of machine learning algorithms, especially convolutional neural networks (CNNs), among different types of patients, such as pediatric cases, that were neglected by previous reviews. They performed an electronic search in PubMed, Google Scholar, Scopus, and Medline to locate relevant articles. They concluded that even though clinicians encounter challenges in implementing AI technologies, such as data management, limited processing capabilities, and biased outcomes, they have observed positive results, such as decreased diagnosis costs and time, as well as early cancer detection. Thus, further research and development should be considered to address the existing complications.
Collapse
Affiliation(s)
| | - Shayan Darvish
- School of Dentistry, University of Michigan, Ann Arbor, MI 48104, USA;
| | - Bahareh Nazemi Salman
- Department of Pediatric Dentistry, School of Dentistry, Zanjan University of Medical Sciences, Zanjan 4513956184, Iran
| | - Ionut Luchian
- Department of Periodontology, Faculty of Dental Medicine, “Grigore T. Popa” University of Medicine and Pharmacy, 700115 Iasi, Romania
| |
Collapse
|
25
|
Chen X, Ma N, Xu T, Xu C. Deep learning-based tooth segmentation methods in medical imaging: A review. Proc Inst Mech Eng H 2024; 238:115-131. [PMID: 38314788 DOI: 10.1177/09544119231217603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Deep learning approaches for tooth segmentation employ convolutional neural networks (CNNs) or Transformers to derive tooth feature maps from extensive training datasets. Tooth segmentation serves as a critical prerequisite for clinical dental analysis and surgical procedures, enabling dentists to comprehensively assess oral conditions and subsequently diagnose pathologies. Over the past decade, deep learning has experienced significant advancements, with researchers introducing efficient models such as U-Net, Mask R-CNN, and Segmentation Transformer (SETR). Building upon these frameworks, scholars have proposed numerous enhancement and optimization modules to attain superior tooth segmentation performance. This paper discusses the deep learning methods of tooth segmentation on dental panoramic radiographs (DPRs), cone-beam computed tomography (CBCT) images, intro oral scan (IOS) models, and others. Finally, we outline performance-enhancing techniques and suggest potential avenues for ongoing research. Numerous challenges remain, including data annotation and model generalization limitations. This paper offers insights for future tooth segmentation studies, potentially facilitating broader clinical adoption.
Collapse
Affiliation(s)
- Xiaokang Chen
- Beijing Key Laboratory of Information Service Engineering, Beijing Union University, Beijing, China
| | - Nan Ma
- Faculty of Information and Technology, Beijing University of Technology, Beijing, China
- Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing University of Technology, Beijing, China
| | - Tongkai Xu
- Department of General Dentistry II, Peking University School and Hospital of Stomatology, Beijing, China
| | - Cheng Xu
- Beijing Key Laboratory of Information Service Engineering, Beijing Union University, Beijing, China
| |
Collapse
|
26
|
Kurt-Bayrakdar S, Bayrakdar İŞ, Yavuz MB, Sali N, Çelik Ö, Köse O, Uzun Saylan BC, Kuleli B, Jagtap R, Orhan K. Detection of periodontal bone loss patterns and furcation defects from panoramic radiographs using deep learning algorithm: a retrospective study. BMC Oral Health 2024; 24:155. [PMID: 38297288 PMCID: PMC10832206 DOI: 10.1186/s12903-024-03896-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Accepted: 01/15/2024] [Indexed: 02/02/2024] Open
Abstract
BACKGROUND This retrospective study aimed to develop a deep learning algorithm for the interpretation of panoramic radiographs and to examine the performance of this algorithm in the detection of periodontal bone losses and bone loss patterns. METHODS A total of 1121 panoramic radiographs were used in this study. Bone losses in the maxilla and mandibula (total alveolar bone loss) (n = 2251), interdental bone losses (n = 25303), and furcation defects (n = 2815) were labeled using the segmentation method. In addition, interdental bone losses were divided into horizontal (n = 21839) and vertical (n = 3464) bone losses according to the defect patterns. A Convolutional Neural Network (CNN)-based artificial intelligence (AI) system was developed using U-Net architecture. The performance of the deep learning algorithm was statistically evaluated by the confusion matrix and ROC curve analysis. RESULTS The system showed the highest diagnostic performance in the detection of total alveolar bone losses (AUC = 0.951) and the lowest in the detection of vertical bone losses (AUC = 0.733). The sensitivity, precision, F1 score, accuracy, and AUC values were found as 1, 0.995, 0.997, 0.994, 0.951 for total alveolar bone loss; found as 0.947, 0.939, 0.943, 0.892, 0.910 for horizontal bone losses; found as 0.558, 0.846, 0.673, 0.506, 0.733 for vertical bone losses and found as 0.892, 0.933, 0.912, 0.837, 0.868 for furcation defects (respectively). CONCLUSIONS AI systems offer promising results in determining periodontal bone loss patterns and furcation defects from dental radiographs. This suggests that CNN algorithms can also be used to provide more detailed information such as automatic determination of periodontal disease severity and treatment planning in various dental radiographs.
Collapse
Affiliation(s)
- Sevda Kurt-Bayrakdar
- Faculty of Dentistry, Department of Periodontology, Eskisehir Osmangazi University, Eskisehir, 26240, Turkey.
- Division of Oral and Maxillofacial Radiology, Department of Care Planning and Restorative Sciences, University of Mississippi Medical Center School of Dentistry, Jackson, MS, USA.
| | - İbrahim Şevki Bayrakdar
- Division of Oral and Maxillofacial Radiology, Department of Care Planning and Restorative Sciences, University of Mississippi Medical Center School of Dentistry, Jackson, MS, USA
- Faculty of Dentistry, Department of Oral and Maxillofacial Radiology, Eskisehir Osmangazi University, Eskisehir, Turkey
| | - Muhammet Burak Yavuz
- Faculty of Dentistry, Department of Periodontology, Eskisehir Osmangazi University, Eskisehir, 26240, Turkey
| | - Nichal Sali
- Faculty of Dentistry, Department of Periodontology, Eskisehir Osmangazi University, Eskisehir, 26240, Turkey
| | - Özer Çelik
- Faculty of Science, Department of Mathematics and Computer Science, Eskisehir Osmangazi University, Eskisehir, Turkey
| | - Oğuz Köse
- Faculty of Dentistry, Department of Periodontology, Recep Tayyip Erdogan University, Rize, Turkey
| | | | - Batuhan Kuleli
- Faculty of Dentistry, Department of Orthodontics, Eskisehir Osmangazi University, Eskisehir, Turkey
| | - Rohan Jagtap
- Division of Oral and Maxillofacial Radiology, Department of Care Planning and Restorative Sciences, University of Mississippi Medical Center School of Dentistry, Jackson, MS, USA
| | - Kaan Orhan
- Faculty of Dentistry, Department of Oral and Maxillofacial Radiology, Ankara University, Ankara, Turkey
| |
Collapse
|
27
|
Lee J, Ahn S, Kim H, An J, Sim J. A robust model training strategy using hard negative mining in a weakly labeled dataset for lymphatic invasion in gastric cancer. J Pathol Clin Res 2024; 10:e355. [PMID: 38116763 PMCID: PMC10766063 DOI: 10.1002/cjp2.355] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Revised: 10/23/2023] [Accepted: 11/22/2023] [Indexed: 12/21/2023]
Abstract
Gastric cancer is a significant public health concern, emphasizing the need for accurate evaluation of lymphatic invasion (LI) for determining prognosis and treatment options. However, this task is time-consuming, labor-intensive, and prone to intra- and interobserver variability. Furthermore, the scarcity of annotated data presents a challenge, particularly in the field of digital pathology. Therefore, there is a demand for an accurate and objective method to detect LI using a small dataset, benefiting pathologists. In this study, we trained convolutional neural networks to classify LI using a four-step training process: (1) weak model training, (2) identification of false positives, (3) hard negative mining in a weakly labeled dataset, and (4) strong model training. To overcome the lack of annotated datasets, we applied a hard negative mining approach in a weakly labeled dataset, which contained only final diagnostic information, resembling the typical data found in hospital databases, and improved classification performance. Ablation studies were performed to simulate the lack of datasets and severely unbalanced datasets, further confirming the effectiveness of our proposed approach. Notably, our results demonstrated that, despite the small number of annotated datasets, efficient training was achievable, with the potential to extend to other image classification approaches used in medicine.
Collapse
Affiliation(s)
- Jonghyun Lee
- Department of Medical and Digital EngineeringHanyang University College of EngineeringSeoulRepublic of Korea
- Department of PathologyKorea University Anam Hospital, Korea University College of MedicineSeoulRepublic of Korea
| | - Sangjeong Ahn
- Department of PathologyKorea University Anam Hospital, Korea University College of MedicineSeoulRepublic of Korea
| | - Hyun‐Soo Kim
- Department of Pathology and Translational GenomicsSamsung Medical Center, Sungkyunkwan University School of MedicineSeoulRepublic of Korea
| | - Jungsuk An
- Department of PathologyKorea University Anam Hospital, Korea University College of MedicineSeoulRepublic of Korea
| | - Jongmin Sim
- Department of PathologyKorea University Anam Hospital, Korea University College of MedicineSeoulRepublic of Korea
| |
Collapse
|
28
|
Chato L, Regentova E. Survey of Transfer Learning Approaches in the Machine Learning of Digital Health Sensing Data. J Pers Med 2023; 13:1703. [PMID: 38138930 PMCID: PMC10744730 DOI: 10.3390/jpm13121703] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 12/01/2023] [Accepted: 12/08/2023] [Indexed: 12/24/2023] Open
Abstract
Machine learning and digital health sensing data have led to numerous research achievements aimed at improving digital health technology. However, using machine learning in digital health poses challenges related to data availability, such as incomplete, unstructured, and fragmented data, as well as issues related to data privacy, security, and data format standardization. Furthermore, there is a risk of bias and discrimination in machine learning models. Thus, developing an accurate prediction model from scratch can be an expensive and complicated task that often requires extensive experiments and complex computations. Transfer learning methods have emerged as a feasible solution to address these issues by transferring knowledge from a previously trained task to develop high-performance prediction models for a new task. This survey paper provides a comprehensive study of the effectiveness of transfer learning for digital health applications to enhance the accuracy and efficiency of diagnoses and prognoses, as well as to improve healthcare services. The first part of this survey paper presents and discusses the most common digital health sensing technologies as valuable data resources for machine learning applications, including transfer learning. The second part discusses the meaning of transfer learning, clarifying the categories and types of knowledge transfer. It also explains transfer learning methods and strategies, and their role in addressing the challenges in developing accurate machine learning models, specifically on digital health sensing data. These methods include feature extraction, fine-tuning, domain adaptation, multitask learning, federated learning, and few-/single-/zero-shot learning. This survey paper highlights the key features of each transfer learning method and strategy, and discusses the limitations and challenges of using transfer learning for digital health applications. Overall, this paper is a comprehensive survey of transfer learning methods on digital health sensing data which aims to inspire researchers to gain knowledge of transfer learning approaches and their applications in digital health, enhance the current transfer learning approaches in digital health, develop new transfer learning strategies to overcome the current limitations, and apply them to a variety of digital health technologies.
Collapse
Affiliation(s)
- Lina Chato
- Department of Electrical and Computer Engineering, University of Nevada, Las Vegas, NV 89154, USA;
| | | |
Collapse
|
29
|
Park EY, Jeong S, Kang S, Cho J, Cho JY, Kim EK. Tooth caries classification with quantitative light-induced fluorescence (QLF) images using convolutional neural network for permanent teeth in vivo. BMC Oral Health 2023; 23:981. [PMID: 38066624 PMCID: PMC10709920 DOI: 10.1186/s12903-023-03669-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 11/14/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND Owing to the remarkable advancements of artificial intelligence (AI) applications, AI-based detection of dental caries is continuously improving. We evaluated the efficacy of the detection of dental caries with quantitative light-induced fluorescence (QLF) images using a convolutional neural network (CNN) model. METHODS Overall, 2814 QLF intraoral images were obtained from 606 participants at a dental clinic using Qraypen C® (QC, AIOBIO, Seoul, Republic of Korea) from October 2020 to October 2022. These images included all the types of permanent teeth of which surfaces were smooth or occlusal. Dataset were randomly assigned to the training (56.0%), validation (14.0%), and test (30.0%) subsets of the dataset for caries classification. Moreover, masked images for teeth area were manually prepared to evaluate the segmentation efficacy. To compare diagnostic performance for caries classification according to the types of teeth, the dataset was further classified into the premolar (1,143 images) and molar (1,441 images) groups. As the CNN model, Xception was applied. RESULTS Using the original QLF images, the performance of the classification algorithm was relatively good showing 83.2% of accuracy, 85.6% of precision, and 86.9% of sensitivity. After applying the segmentation process for the tooth area, all the performance indics including 85.6% of accuracy, 88.9% of precision, and 86.9% of sensitivity were improved. However, the performance indices of each type of teeth (both premolar and molar) were similar to those for all teeth. CONCLUSION The application of AI to QLF images for caries classification demonstrated a good performance regardless of teeth type among posterior teeth. Additionally, tooth area segmentation through background elimination from QLF images exhibited a better performance.
Collapse
Affiliation(s)
- Eun Young Park
- Department of Dentistry, College of Medicine, Yeungnam University, Daegu, South Korea
| | - Sungmoon Jeong
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, South Korea
- Department of Medical Informatics, School of Medicine, Kyungpook National University, Daegu, South Korea
| | - Sohee Kang
- Department of Dentistry, College of Medicine, Yeungnam University, Daegu, South Korea
| | - Jungrae Cho
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, South Korea
| | - Ju-Yeon Cho
- Department of Dentistry, Dongsan Hospital, Keimyung University School of Medicine, Daegu, South Korea
| | - Eun-Kyong Kim
- Department of Dental Hygiene, College of Science and Technology, Kyungpook National University, Sangju, South Korea.
- , 2559 Gyeongsangde-ro, Sangju, Gyeongsangbuk-do, South Korea.
| |
Collapse
|
30
|
Portella PD, de Oliveira LF, Ferreira MFDC, Dias BC, de Souza JF, Assunção LRDS. Improving accuracy of early dental carious lesions detection using deep learning-based automated method. Clin Oral Investig 2023; 27:7663-7670. [PMID: 37906303 DOI: 10.1007/s00784-023-05355-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Accepted: 10/18/2023] [Indexed: 11/02/2023]
Abstract
OBJECTIVE To investigate the effectiveness of a convolutional neural network (CNN) in detecting healthy teeth and early carious lesions on occlusal surfaces and to assess the applicability of this deep learning algorithm as an auxiliary aid. MATERIALS AND METHODS A total of 2,481 posterior teeth (2,459 permanent and 22 deciduous teeth) with varying stages of carious lesions were classified according to the International Caries Detection and Assessment System (ICDAS). After clinical evaluation, ICDAS 0 and 2 occlusal surfaces were photographed with a professional digital camera. VGG-19 was chosen as the CNN and the findings were compared with those of a reference examiner to evaluate its detection efficiency. To verify the effectiveness of the CNN as an auxiliary detection aid, three examiners (an undergraduate student (US), a newly graduated dental surgeon (ND), and a specialist in pediatric dentistry (SP) assessed the acquired images (Phase I). In Phase II, the examiners reassessed the same images using the CNN-generated algorithms. RESULTS The training dataset consisted of 8,749 images, whereas the test dataset included 140 images. VGG-19 achieved an accuracy of 0.879, positive agreement of 0.827, precision of 0.949, negative agreement 0.800, and an F1-score of 0.887. In Phase I, the accuracy rates for examiners US, ND, and SP were 0.543, 0.771, and 0.807, respectively. In Phase II, the accuracy rates improved to 0.679, 0.886, and 0.857 for the respective examiners. The number of correct answers was significantly higher in Phase II than in Phase I for all examiners (McNemar test;P<0.05). CONCLUSIONS VGG-19 demonstrated satisfactory performance in the detection of early carious lesions, as well as an auxiliary detection aid. CLINICAL RELEVANCE Automated detection using deep learning algorithms is an important aid in detecting early caries lesions and improves the accuracy of the disease detection, enabling quicker and more reliable clinical decision-making.
Collapse
Affiliation(s)
- Paula Dresch Portella
- Stomatology Department, Universidade Federal do Paraná, Avenida Prefeito Lothário Meissner, 632, Jardim Botânico, Curitiba, PR, 80210-170, Brazil.
| | | | | | - Bruna Cristine Dias
- Stomatology Department, Universidade Federal do Paraná, Avenida Prefeito Lothário Meissner, 632, Jardim Botânico, Curitiba, PR, 80210-170, Brazil
| | - Juliana Feltrin de Souza
- Stomatology Department, Universidade Federal do Paraná, Avenida Prefeito Lothário Meissner, 632, Jardim Botânico, Curitiba, PR, 80210-170, Brazil
| | - Luciana Reichert da Silva Assunção
- Stomatology Department, Universidade Federal do Paraná, Avenida Prefeito Lothário Meissner, 632, Jardim Botânico, Curitiba, PR, 80210-170, Brazil
| |
Collapse
|
31
|
Dujic H, Meyer O, Hoss P, Wölfle UC, Wülk A, Meusburger T, Meier L, Gruhn V, Hesenius M, Hickel R, Kühnisch J. Automatized Detection of Periodontal Bone Loss on Periapical Radiographs by Vision Transformer Networks. Diagnostics (Basel) 2023; 13:3562. [PMID: 38066803 PMCID: PMC10706472 DOI: 10.3390/diagnostics13233562] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/18/2023] [Accepted: 11/27/2023] [Indexed: 07/25/2024] Open
Abstract
Several artificial intelligence-based models have been presented for the detection of periodontal bone loss (PBL), mostly using convolutional neural networks, which are the state of the art in deep learning. Given the emerging breakthrough of transformer networks in computer vision, we aimed to evaluate various models for automatized PBL detection. An image data set of 21,819 anonymized periapical radiographs from the upper/lower and anterior/posterior regions was assessed by calibrated dentists according to PBL. Five vision transformer networks (ViT-base/ViT-large from Google, BEiT-base/BEiT-large from Microsoft, DeiT-base from Facebook/Meta) were utilized and evaluated. Accuracy (ACC), sensitivity (SE), specificity (SP), positive/negative predictive value (PPV/NPV) and area under the ROC curve (AUC) were statistically determined. The overall diagnostic ACC and AUC values ranged from 83.4 to 85.2% and 0.899 to 0.918 for all evaluated transformer networks, respectively. Differences in diagnostic performance were evident for lower (ACC 94.1-96.7%; AUC 0.944-0.970) and upper anterior (86.7-90.2%; 0.948-0.958) and lower (85.6-87.2%; 0.913-0.937) and upper posterior teeth (78.1-81.0%; 0.851-0.875). In this study, only minor differences among the tested networks were detected for PBL detection. To increase the diagnostic performance and to support the clinical use of such networks, further optimisations with larger and manually annotated image data sets are needed.
Collapse
Affiliation(s)
- Helena Dujic
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Ole Meyer
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Patrick Hoss
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Uta Christine Wölfle
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Annika Wülk
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Theresa Meusburger
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Leon Meier
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Volker Gruhn
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Marc Hesenius
- Institute for Software Engineering, University of Duisburg-Essen, 45127 Essen, Germany; (O.M.); (V.G.); (M.H.)
| | - Reinhard Hickel
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, LMU University Hospital, LMU Munich, 80336 Munich, Germany; (P.H.); (U.C.W.); (A.W.); (T.M.); (L.M.); (R.H.)
| |
Collapse
|
32
|
Heboyan A, Yazdanie N, Ahmed N. Glimpse into the future of prosthodontics: The synergy of artificial intelligence. World J Clin Cases 2023; 11:7940-7942. [PMID: 38075567 PMCID: PMC10698409 DOI: 10.12998/wjcc.v11.i33.7940] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 10/26/2023] [Accepted: 11/17/2023] [Indexed: 11/24/2023] Open
Abstract
Prosthodontics, deals in the restoration and replacement of missing and structurally compromised teeth, this field has been remarkably transformed in the last two decades. Through the integration of digital imaging and three-dimensional printing, prosthodontics has evolved to provide more durable, precise, and patient-centric outcome. However, as we stand at the convergence of technology and healthcare, a new era is emerging, one that holds immense promise for the field and that is artificial intelligence (AI). In this paper, we explored the fascinating challenges and prospects associated with the future of prosthodontics in the era of AI.
Collapse
Affiliation(s)
- Artak Heboyan
- Department of Prosthodontics, Yerevan State Medical University after Mkhitar Heratsi, Yerevan 0025, Armenia
| | - Nazia Yazdanie
- Department of Prosthodontics, FMH College of Medicine and Dentistry, Lahore 54000, Pakistan
| | - Naseer Ahmed
- Department of Prosthodontics, Altammash Institute of Dental Medicine, Karachi 75500, Pakistan
| |
Collapse
|
33
|
Ahmed H, Zhang Q, Wong F, Donnan R, Alomainy A. Lesion Detection in Optical Coherence Tomography with Transformer-Enhanced Detector. J Imaging 2023; 9:244. [PMID: 37998091 PMCID: PMC10671998 DOI: 10.3390/jimaging9110244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 10/10/2023] [Accepted: 10/11/2023] [Indexed: 11/25/2023] Open
Abstract
Optical coherence tomography (OCT) is an emerging imaging tool in healthcare with common applications in ophthalmology for the detection of retinal diseases and in dentistry for the early detection of tooth decay. Speckle noise is ubiquitous in OCT images, which can hinder diagnosis by clinicians. In this paper, a region-based, deep learning framework for the detection of anomalies is proposed for OCT-acquired images. The core of the framework is Transformer-Enhanced Detection (TED), which includes attention gates (AGs) to ensure focus is placed on the foreground while identifying and removing noise artifacts as anomalies. TED was designed to detect the different types of anomalies commonly present in OCT images for diagnostic purposes and thus aid clinical interpretation. Extensive quantitative evaluations were performed to measure the performance of TED against current, widely known, deep learning detection algorithms. Three different datasets were tested: two dental and one CT (hosting scans of lung nodules, livers, etc.). The results showed that the approach verifiably detected tooth decay and numerous lesions across two modalities, achieving superior performance compared to several well-known algorithms. The proposed method improved the accuracy of detection by 16-22% and the Intersection over Union (IOU) by 10% for both dentistry datasets. For the CT dataset, the performance metrics were similarly improved by 9% and 20%, respectively.
Collapse
Affiliation(s)
- Hanya Ahmed
- Department of Electronic Engineering and Computer Science, Queen Mary University of London—QMUL, London E1 4NS, UK (R.D.); (A.A.)
| | - Qianni Zhang
- Department of Electronic Engineering and Computer Science, Queen Mary University of London—QMUL, London E1 4NS, UK (R.D.); (A.A.)
| | - Ferranti Wong
- Institute of Dentistry at Barts Health, Queen Mary University of London—QMUL, London E1 4NS, UK
| | - Robert Donnan
- Department of Electronic Engineering and Computer Science, Queen Mary University of London—QMUL, London E1 4NS, UK (R.D.); (A.A.)
| | - Akram Alomainy
- Department of Electronic Engineering and Computer Science, Queen Mary University of London—QMUL, London E1 4NS, UK (R.D.); (A.A.)
| |
Collapse
|
34
|
Felsch M, Meyer O, Schlickenrieder A, Engels P, Schönewolf J, Zöllner F, Heinrich-Weltzien R, Hesenius M, Hickel R, Gruhn V, Kühnisch J. Detection and localization of caries and hypomineralization on dental photographs with a vision transformer model. NPJ Digit Med 2023; 6:198. [PMID: 37880375 PMCID: PMC10600213 DOI: 10.1038/s41746-023-00944-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 10/13/2023] [Indexed: 10/27/2023] Open
Abstract
Caries and molar-incisor hypomineralization (MIH) are among the most prevalent diseases worldwide and need to be reliably diagnosed. The use of dental photographs and artificial intelligence (AI) methods may potentially contribute to realizing accurate and automated diagnostic visual examinations in the future. Therefore, the present study aimed to develop an AI-based algorithm that can detect, classify and localize caries and MIH. This study included an image set of 18,179 anonymous photographs. Pixelwise image labeling was achieved by trained and calibrated annotators using the Computer Vision Annotation Tool (CVAT). All annotations were made according to standard methods and were independently checked by an experienced dentist. The entire image set was divided into training (N = 16,679), validation (N = 500) and test sets (N = 1000). The AI-based algorithm was trained and finetuned over 250 epochs by using image augmentation and adapting a vision transformer network (SegFormer-B5). Statistics included the determination of the intersection over union (IoU), average precision (AP) and accuracy (ACC). The overall diagnostic performance in terms of IoU, AP and ACC were 0.959, 0.977 and 0.978 for the finetuned model, respectively. The corresponding data for the most relevant caries classes of non-cavitations (0.630, 0.813 and 0.990) and dentin cavities (0.692, 0.830, and 0.997) were found to be high. MIH-related demarcated opacity (0.672, 0.827, and 0.993) and atypical restoration (0.829, 0.902, and 0.999) showed similar results. Here, we report that the model achieves excellent precision for pixelwise detection and localization of caries and MIH. Nevertheless, the model needs to be further improved and externally validated.
Collapse
Affiliation(s)
- Marco Felsch
- Department of Conservative Dentistry and Periodontology, School of Dentistry, Ludwig-Maximilians University of Munich, Munich, Germany
| | - Ole Meyer
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Anne Schlickenrieder
- Department of Conservative Dentistry and Periodontology, School of Dentistry, Ludwig-Maximilians University of Munich, Munich, Germany
| | - Paula Engels
- Department of Conservative Dentistry and Periodontology, School of Dentistry, Ludwig-Maximilians University of Munich, Munich, Germany
| | - Jule Schönewolf
- Department of Conservative Dentistry and Periodontology, School of Dentistry, Ludwig-Maximilians University of Munich, Munich, Germany
| | - Felicitas Zöllner
- Department of Conservative Dentistry and Periodontology, School of Dentistry, Ludwig-Maximilians University of Munich, Munich, Germany
| | - Roswitha Heinrich-Weltzien
- Department of Orthodontics, Section of Preventive and Paediatric Dentistry, University Hospital Jena, Jena, Germany
| | - Marc Hesenius
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Reinhard Hickel
- Department of Conservative Dentistry and Periodontology, School of Dentistry, Ludwig-Maximilians University of Munich, Munich, Germany
| | - Volker Gruhn
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, School of Dentistry, Ludwig-Maximilians University of Munich, Munich, Germany.
| |
Collapse
|
35
|
Radha RC, Raghavendra BS, Subhash BV, Rajan J, Narasimhadhan AV. Machine learning techniques for periodontitis and dental caries detection: A narrative review. Int J Med Inform 2023; 178:105170. [PMID: 37595373 DOI: 10.1016/j.ijmedinf.2023.105170] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 07/07/2023] [Accepted: 07/31/2023] [Indexed: 08/20/2023]
Abstract
OBJECTIVES In recent years, periodontitis, and dental caries have become common in humans and need to be diagnosed in the early stage to prevent severe complications and tooth loss. These dental issues are diagnosed by visual inspection, measuring pocket probing depth, and radiographs findings from experienced dentists. Though a glut of machine learning (ML) algorithms has been proposed for the automated detection of periodontitis, and dental caries, determining which ML techniques are suitable for clinical practice remains under debate. This review aims to identify the research challenges by analyzing the limitations of current methods and how to address these to obtain robust systems suitable for clinical use or point-of-care testing. METHODS An extensive search of the literature published from 2015 to 2022 written in English, related to the subject of study was sought by searching the electronic databases: PubMed, Institute of Electrical and Electronics Engineers (IEEE) Xplore, and ScienceDirect. RESULTS The initial electronic search yielded 1743 titles, and 55 studies were eventually included based on the selection criteria adopted in this review. Studies selected were on ML applications for the automatic detection of periodontitis and dental caries and related dental issues: Apical lessons, Periodontal bone loss, and Vertical root fracture. CONCLUSION While most of the ML-based studies use radiograph images for the detection of periodontitis and dental caries, few pieces of the literature revealed that good diagnostic accuracy could be achieved by training the ML model even with mobile photos representing the images of dental issues. Nowadays smartphones are used in every sector for different applications. Training the ML model with as many images of dental issues captured by the smartphone can achieve good accuracy, reduce the cost of clinical diagnosis, and provide user interaction.
Collapse
Affiliation(s)
- R C Radha
- Department of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, India.
| | - B S Raghavendra
- Department of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, India
| | - B V Subhash
- Department of Oral Medicine and Radiology, DAPM R V Dental College, Bengaluru, India
| | - Jeny Rajan
- Department of Computer Science and Engineering, National Institute of Technology Karnataka, Surathkal, India
| | - A V Narasimhadhan
- Department of Electronics and Communication Engineering, National Institute of Technology Karnataka, Surathkal, India
| |
Collapse
|
36
|
Achararit P, Manaspon C, Jongwannasiri C, Phattarataratip E, Osathanon T, Sappayatosok K. Artificial Intelligence-Based Diagnosis of Oral Lichen Planus Using Deep Convolutional Neural Networks. Eur J Dent 2023; 17:1275-1282. [PMID: 36669652 PMCID: PMC10756816 DOI: 10.1055/s-0042-1760300] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
OBJECTIVE The aim of this study was to employ artificial intelligence (AI) via convolutional neural network (CNN) for the separation of oral lichen planus (OLP) and non-OLP in biopsy-proven clinical cases of OLP and non-OLP. MATERIALS AND METHODS Data comprised of clinical photographs of 609 OLP and 480 non-OLP which diagnosis has been confirmed histopathologically. Fifty-five photographs from the OLP and non-OLP groups were randomly selected for use as the test dataset, while the remaining were used as training and validation datasets. Data augmentation was performed on the training dataset to increase the number and variation of photographs. Performance metrics for the CNN model performance included accuracy, positive predictive value, negative predictive value, sensitivity, specificity, and F1-score. Gradient-weighted class activation mapping was also used to visualize the important regions associated with discriminative clinical features on which the model relies. RESULTS All the selected CNN models were able to diagnose OLP and non-OLP lesions using photographs. The performance of the Xception model was significantly higher than that of the other models in terms of overall accuracy and F1-score. CONCLUSIONS Our demonstration shows that CNN models can achieve an accuracy of 82 to 88%. Xception model performed the best in terms of both accuracy and F1-score.
Collapse
Affiliation(s)
- Paniti Achararit
- Princess Srisavangavadhana College of Medicine, Chulabhorn Royal Academy, Bangkok, Thailand
| | - Chawan Manaspon
- Biomedical Engineering Institute, Chiang Mai University, Chiang Mai, Thailand
| | - Chavin Jongwannasiri
- Princess Srisavangavadhana College of Medicine, Chulabhorn Royal Academy, Bangkok, Thailand
| | - Ekarat Phattarataratip
- Department of Oral Pathology, Faculty of Dentistry, Chulalongkorn University, Bangkok, Thailand
| | - Thanaphum Osathanon
- Dental Stem Cell Biology Research Unit, Department of Anatomy, Faculty of Dentistry, Chulalongkorn University, Bangkok, Thailand
| | | |
Collapse
|
37
|
Tabatabaian F, Vora SR, Mirabbasi S. Applications, functions, and accuracy of artificial intelligence in restorative dentistry: A literature review. J ESTHET RESTOR DENT 2023; 35:842-859. [PMID: 37522291 DOI: 10.1111/jerd.13079] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 06/18/2023] [Accepted: 06/19/2023] [Indexed: 08/01/2023]
Abstract
OBJECTIVE The applications of artificial intelligence (AI) are increasing in restorative dentistry; however, the AI performance is unclear for dental professionals. The purpose of this narrative review was to evaluate the applications, functions, and accuracy of AI in diverse aspects of restorative dentistry including caries detection, tooth preparation margin detection, tooth restoration design, metal structure casting, dental restoration/implant detection, removable partial denture design, and tooth shade determination. OVERVIEW An electronic search was performed on Medline/PubMed, Embase, Web of Science, Cochrane, Scopus, and Google Scholar databases. English-language articles, published from January 1, 2000, to March 1, 2022, relevant to the aforementioned aspects were selected using the key terms of artificial intelligence, machine learning, deep learning, artificial neural networks, convolutional neural networks, clustering, soft computing, automated planning, computational learning, computer vision, and automated reasoning as inclusion criteria. A manual search was also performed. Therefore, 157 articles were included, reviewed, and discussed. CONCLUSIONS Based on the current literature, the AI models have shown promising performance in the mentioned aspects when being compared with traditional approaches in terms of accuracy; however, as these models are still in development, more studies are required to validate their accuracy and apply them to routine clinical practice. CLINICAL SIGNIFICANCE AI with its specific functions has shown successful applications with acceptable accuracy in diverse aspects of restorative dentistry. The understanding of these functions may lead to novel applications with optimal accuracy for AI in restorative dentistry.
Collapse
Affiliation(s)
- Farhad Tabatabaian
- Department of Oral Health Sciences, Faculty of Dentistry, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Siddharth R Vora
- Department of Oral Health Sciences, Faculty of Dentistry, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Shahriar Mirabbasi
- Department of Electrical and Computer Engineering, Faculty of Applied Science, The University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
38
|
Sivari E, Senirkentli GB, Bostanci E, Guzel MS, Acici K, Asuroglu T. Deep Learning in Diagnosis of Dental Anomalies and Diseases: A Systematic Review. Diagnostics (Basel) 2023; 13:2512. [PMID: 37568875 PMCID: PMC10416832 DOI: 10.3390/diagnostics13152512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 07/21/2023] [Accepted: 07/25/2023] [Indexed: 08/13/2023] Open
Abstract
Deep learning and diagnostic applications in oral and dental health have received significant attention recently. In this review, studies applying deep learning to diagnose anomalies and diseases in dental image material were systematically compiled, and their datasets, methodologies, test processes, explainable artificial intelligence methods, and findings were analyzed. Tests and results in studies involving human-artificial intelligence comparisons are discussed in detail to draw attention to the clinical importance of deep learning. In addition, the review critically evaluates the literature to guide and further develop future studies in this field. An extensive literature search was conducted for the 2019-May 2023 range using the Medline (PubMed) and Google Scholar databases to identify eligible articles, and 101 studies were shortlisted, including applications for diagnosing dental anomalies (n = 22) and diseases (n = 79) using deep learning for classification, object detection, and segmentation tasks. According to the results, the most commonly used task type was classification (n = 51), the most commonly used dental image material was panoramic radiographs (n = 55), and the most frequently used performance metric was sensitivity/recall/true positive rate (n = 87) and accuracy (n = 69). Dataset sizes ranged from 60 to 12,179 images. Although deep learning algorithms are used as individual or at least individualized architectures, standardized architectures such as pre-trained CNNs, Faster R-CNN, YOLO, and U-Net have been used in most studies. Few studies have used the explainable AI method (n = 22) and applied tests comparing human and artificial intelligence (n = 21). Deep learning is promising for better diagnosis and treatment planning in dentistry based on the high-performance results reported by the studies. For all that, their safety should be demonstrated using a more reproducible and comparable methodology, including tests with information about their clinical applicability, by defining a standard set of tests and performance metrics.
Collapse
Affiliation(s)
- Esra Sivari
- Department of Computer Engineering, Cankiri Karatekin University, Cankiri 18100, Turkey
| | | | - Erkan Bostanci
- Department of Computer Engineering, Ankara University, Ankara 06830, Turkey
| | | | - Koray Acici
- Department of Artificial Intelligence and Data Engineering, Ankara University, Ankara 06830, Turkey
| | - Tunc Asuroglu
- Faculty of Medicine and Health Technology, Tampere University, 33720 Tampere, Finland
| |
Collapse
|
39
|
Anil S, Porwal P, Porwal A. Transforming Dental Caries Diagnosis Through Artificial Intelligence-Based Techniques. Cureus 2023; 15:e41694. [PMID: 37575741 PMCID: PMC10413921 DOI: 10.7759/cureus.41694] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/11/2023] [Indexed: 08/15/2023] Open
Abstract
Diagnosing dental caries plays a pivotal role in preventing and treating tooth decay. However, traditional methods of diagnosing caries often fall short in accuracy and efficiency. Despite the endorsement of radiography as a diagnostic tool, the identification of dental caries through radiographic images can be influenced by individual interpretation. Incorporating artificial intelligence (AI) into diagnosing dental caries holds significant promise, potentially enhancing the precision and efficiency of diagnoses. This review introduces the fundamental concepts of AI, including machine learning and deep learning algorithms, and emphasizes their relevance and potential contributions to the diagnosis of dental caries. It further explains the process of gathering and pre-processing radiography data for AI examination. Additionally, AI techniques for dental caries diagnosis are explored, focusing on image processing, analysis, and classification models for predicting caries risk and severity. Deep learning applications in dental caries diagnosis using convolutional neural networks are presented. Furthermore, the integration of AI systems into dental practice is discussed, including the challenges and considerations for implementation as well as ethical and legal aspects. The breadth of AI technologies and their prospective utility in clinical scenarios for diagnosing dental caries from dental radiographs is presented. This review outlines the advancements of AI and its potential in revolutionizing dental caries diagnosis, encouraging further research and development in this rapidly evolving field.
Collapse
Affiliation(s)
| | - Priyanka Porwal
- Dentistry, Pushpagiri Institute of Medical Sciences and Research Centre, Tiruvalla, IND
| | - Amit Porwal
- Prosthetic Dental Sciences, College of Dentistry, Jazan University, Jazan, SAU
| |
Collapse
|
40
|
Kang IA, Njimbouom SN, Kim JD. Optimal Feature Selection-Based Dental Caries Prediction Model Using Machine Learning for Decision Support System. Bioengineering (Basel) 2023; 10:bioengineering10020245. [PMID: 36829739 PMCID: PMC9952690 DOI: 10.3390/bioengineering10020245] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 02/07/2023] [Accepted: 02/08/2023] [Indexed: 02/16/2023] Open
Abstract
The high frequency of dental caries is a major public health concern worldwide. The condition is common, particularly in developing countries. Because there are no evident early-stage signs, dental caries frequently goes untreated. Meanwhile, early detection and timely clinical intervention are required to slow disease development. Machine learning (ML) models can benefit clinicians in the early detection of dental cavities through efficient and cost-effective computer-aided diagnoses. This study proposed a more effective method for diagnosing dental caries by integrating the GINI and mRMR algorithms with the GBDT classifier. Because just a few clinical test features are required for the diagnosis, this strategy could save time and money when screening for dental caries. The proposed method was compared to recently proposed dental procedures. Among these classifiers, the suggested GBDT trained with a reduced feature set achieved the best classification performance, with accuracy, F1-score, precision, and recall values of 95%, 93%, 99%, and 88%, respectively. Furthermore, the experimental results suggest that feature selection improved the performance of the various classifiers. The suggested method yielded a good predictive model for dental caries diagnosis, which might be used in more imbalanced medical datasets to identify disease more effectively.
Collapse
Affiliation(s)
- In-Ae Kang
- Department of Computer and Electronics Convergence Engineering, Sun Moon University, Asan-si 31460, Republic of Korea
| | - Soualihou Ngnamsie Njimbouom
- Department of Computer and Electronics Convergence Engineering, Sun Moon University, Asan-si 31460, Republic of Korea
| | - Jeong-Dong Kim
- Department of Computer and Electronics Convergence Engineering, Sun Moon University, Asan-si 31460, Republic of Korea
- Department of Computer Science and Engineering, Sun Moon University, Asan-si 31460, Republic of Korea
- Genome-Based BioIT Convergence Institute, Sun Moon University, Asan-si 31460, Republic of Korea
- Correspondence:
| |
Collapse
|
41
|
Arsiwala-Scheppach LT, Chaurasia A, Müller A, Krois J, Schwendicke F. Machine Learning in Dentistry: A Scoping Review. J Clin Med 2023; 12:937. [PMID: 36769585 PMCID: PMC9918184 DOI: 10.3390/jcm12030937] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 01/06/2023] [Accepted: 01/23/2023] [Indexed: 01/27/2023] Open
Abstract
Machine learning (ML) is being increasingly employed in dental research and application. We aimed to systematically compile studies using ML in dentistry and assess their methodological quality, including the risk of bias and reporting standards. We evaluated studies employing ML in dentistry published from 1 January 2015 to 31 May 2021 on MEDLINE, IEEE Xplore, and arXiv. We assessed publication trends and the distribution of ML tasks (classification, object detection, semantic segmentation, instance segmentation, and generation) in different clinical fields. We appraised the risk of bias and adherence to reporting standards, using the QUADAS-2 and TRIPOD checklists, respectively. Out of 183 identified studies, 168 were included, focusing on various ML tasks and employing a broad range of ML models, input data, data sources, strategies to generate reference tests, and performance metrics. Classification tasks were most common. Forty-two different metrics were used to evaluate model performances, with accuracy, sensitivity, precision, and intersection-over-union being the most common. We observed considerable risk of bias and moderate adherence to reporting standards which hampers replication of results. A minimum (core) set of outcome and outcome metrics is necessary to facilitate comparisons across studies.
Collapse
Affiliation(s)
- Lubaina T. Arsiwala-Scheppach
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, 14197 Berlin, Germany
- ITU/WHO Focus Group AI on Health, Topic Group Dental Diagnostics and Digital Dentistry, CH-1211 Geneva 20, Switzerland
| | - Akhilanand Chaurasia
- ITU/WHO Focus Group AI on Health, Topic Group Dental Diagnostics and Digital Dentistry, CH-1211 Geneva 20, Switzerland
- Department of Oral Medicine and Radiology, King George’s Medical University, Lucknow 226003, India
| | - Anne Müller
- Pharmacovigilance Institute (Pharmakovigilanz- und Beratungszentrum, PVZ) for Embryotoxicology, Institute of Clinical Pharmacology and Toxicology, Charité—Universitätsmedizin Berlin, 13353 Berlin, Germany
| | - Joachim Krois
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, 14197 Berlin, Germany
- ITU/WHO Focus Group AI on Health, Topic Group Dental Diagnostics and Digital Dentistry, CH-1211 Geneva 20, Switzerland
| | - Falk Schwendicke
- Department of Oral Diagnostics, Digital Health and Health Services Research, Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, 14197 Berlin, Germany
- ITU/WHO Focus Group AI on Health, Topic Group Dental Diagnostics and Digital Dentistry, CH-1211 Geneva 20, Switzerland
| |
Collapse
|
42
|
Qayyum A, Tahir A, Butt MA, Luke A, Abbas HT, Qadir J, Arshad K, Assaleh K, Imran MA, Abbasi QH. Dental caries detection using a semi-supervised learning approach. Sci Rep 2023; 13:749. [PMID: 36639724 PMCID: PMC9839770 DOI: 10.1038/s41598-023-27808-9] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Accepted: 01/09/2023] [Indexed: 01/15/2023] Open
Abstract
Early diagnosis of dental caries progression can prevent invasive treatment and enable preventive treatment. In this regard, dental radiography is a widely used tool to capture dental visuals that are used for the detection and diagnosis of caries. Different deep learning (DL) techniques have been used to automatically analyse dental images for caries detection. However, most of these techniques require large-scale annotated data to train DL models. On the other hand, in clinical settings, such medical images are scarcely available and annotations are costly and time-consuming. To this end, we present an efficient self-training-based method for caries detection and segmentation that leverages a small set of labelled images for training the teacher model and a large collection of unlabelled images for training the student model. We also propose to use centroid cropped images of the caries region and different augmentation techniques for the training of self-supervised models that provide computational and performance gains as compared to fully supervised learning and standard self-supervised learning methods. We present a fully labelled dental radiographic dataset of 141 images that are used for the evaluation of baseline and proposed models. Our proposed self-supervised learning strategy has provided performance improvement of approximately 6% and 3% in terms of average pixel accuracy and mean intersection over union, respectively as compared to standard self-supervised learning. Data and code will be made available to facilitate future research.
Collapse
Affiliation(s)
- Adnan Qayyum
- James Watt School of Engineering, University of Glasgow, Glasgow, UK
- Information Technology University of the Punjab, Lahore, Pakistan
| | - Ahsen Tahir
- James Watt School of Engineering, University of Glasgow, Glasgow, UK
- Department of Electrical Engineering, University of Engineering and Technology, Lahore, Pakistan
| | | | - Alexander Luke
- Department of Clinical Sciences, College of Dentistry, Ajman University, Ajman, UAE
- Centre of Medical and Bio-allied Health Sciences Research, Ajman University, Ajman, UAE
| | - Hasan Tahir Abbas
- James Watt School of Engineering, University of Glasgow, Glasgow, UK
| | - Junaid Qadir
- Department of Computer Science and Engineering, College of Engineering, Qatar University, Doha, Qatar
| | - Kamran Arshad
- Artificial Intelligence Research Center (AIRC), College of Engineering and Information Technology, Ajman University, Ajman, UAE
| | - Khaled Assaleh
- Artificial Intelligence Research Center (AIRC), College of Engineering and Information Technology, Ajman University, Ajman, UAE
| | - Muhammad Ali Imran
- James Watt School of Engineering, University of Glasgow, Glasgow, UK
- Artificial Intelligence Research Center (AIRC), College of Engineering and Information Technology, Ajman University, Ajman, UAE
| | - Qammer H Abbasi
- James Watt School of Engineering, University of Glasgow, Glasgow, UK.
| |
Collapse
|
43
|
Park EY, Cho H, Kang S, Jeong S, Kim EK. Caries detection with tooth surface segmentation on intraoral photographic images using deep learning. BMC Oral Health 2022; 22:573. [PMID: 36476359 PMCID: PMC9730679 DOI: 10.1186/s12903-022-02589-1] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 11/14/2022] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Intraoral photographic images are helpful in the clinical diagnosis of caries. Moreover, the application of artificial intelligence to these images has been attempted consistently. This study aimed to evaluate a deep learning algorithm for caries detection through the segmentation of the tooth surface using these images. METHODS In this prospective study, 2348 in-house intraoral photographic images were collected from 445 participants using a professional intraoral camera at a dental clinic in a university medical centre from October 2020 to December 2021. Images were randomly assigned to training (1638), validation (410), and test (300) datasets. For image segmentation of the tooth surface, classification, and localisation of caries, convolutional neural networks (CNN), namely U-Net, ResNet-18, and Faster R-CNN, were applied. RESULTS For the classification algorithm for caries images, the accuracy and area under the receiver operating characteristic curve were improved to 0.813 and 0.837 from 0.758 to 0.731, respectively, through segmentation of the tooth surface using CNN. Localisation algorithm for carious lesions after segmentation of the tooth area also showed improved performance. For example, sensitivity and average precision improved from 0.890 to 0.889 to 0.865 and 0.868, respectively. CONCLUSION The deep learning model with segmentation of the tooth surface is promising for caries detection on photographic images from an intraoral camera. This may be an aided diagnostic method for caries with the advantages of being time and cost-saving.
Collapse
Affiliation(s)
- Eun Young Park
- Department of Dentistry, College of Medicine, Yeungnam University, Daegu, South Korea
| | - Hyeonrae Cho
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, South Korea
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, Daegu, South Korea
| | - Sohee Kang
- Department of Dentistry, College of Medicine, Yeungnam University, Daegu, South Korea
| | - Sungmoon Jeong
- Research Center for Artificial Intelligence in Medicine, Kyungpook National University Hospital, Daegu, South Korea
- Department of Medical Informatics, School of Medicine, Kyungpook National University, Daegu, South Korea
| | - Eun-Kyong Kim
- Department of Dental Hygiene, College of Science and Technology, Kyungpook National University, 2559 Gyeongsangde-ro, Sangju, Gyeongsangbuk-do, South Korea.
| |
Collapse
|
44
|
Jayaweera M, Amarasinghe H, Johnson NW. Reshaping dental practice in the face of the COVID-19 pandemic: Leapfrogging to Dentronics. Oral Dis 2022; 28 Suppl 2:2556-2558. [PMID: 34676947 PMCID: PMC8661861 DOI: 10.1111/odi.14043] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 10/02/2021] [Accepted: 10/04/2021] [Indexed: 11/26/2022]
Affiliation(s)
- Mahesh Jayaweera
- Department of Civil EngineeringUniversity of MoratuwaMoratuwaSri Lanka
| | - Hemantha Amarasinghe
- Training unitInstitute of Oral HealthMaharagamaSri Lanka
- Menzies Heath Institute QueenslandGriffith UniversityGold CoastQueenslandAustralia
| | - Newell W Johnson
- Menzies Heath Institute QueenslandGriffith UniversityGold CoastQueenslandAustralia
- Faculty of Dentistry and Craniofacial SciencesKing’s College LondonLondonUK
| |
Collapse
|
45
|
Analysis of Deep Learning Techniques for Dental Informatics: A Systematic Literature Review. Healthcare (Basel) 2022; 10:healthcare10101892. [PMID: 36292339 PMCID: PMC9602147 DOI: 10.3390/healthcare10101892] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Revised: 08/30/2022] [Accepted: 08/31/2022] [Indexed: 12/04/2022] Open
Abstract
Within the ever-growing healthcare industry, dental informatics is a burgeoning field of study. One of the major obstacles to the health care system’s transformation is obtaining knowledge and insightful data from complex, high-dimensional, and diverse sources. Modern biomedical research, for instance, has seen an increase in the use of complex, heterogeneous, poorly documented, and generally unstructured electronic health records, imaging, sensor data, and text. There were still certain restrictions even after many current techniques were used to extract more robust and useful elements from the data for analysis. New effective paradigms for building end-to-end learning models from complex data are provided by the most recent deep learning technology breakthroughs. Therefore, the current study aims to examine the most recent research on the use of deep learning techniques for dental informatics problems and recommend creating comprehensive and meaningful interpretable structures that might benefit the healthcare industry. We also draw attention to some drawbacks and the need for better technique development and provide new perspectives about this exciting new development in the field.
Collapse
|
46
|
Bansal K, Bathla RK, Kumar Y. Deep transfer learning techniques with hybrid optimization in early prediction and diagnosis of different types of oral cancer. Soft comput 2022. [DOI: 10.1007/s00500-022-07246-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
47
|
Ngnamsie Njimbouom S, Lee K, Kim JD. MMDCP: Multi-Modal Dental Caries Prediction for Decision Support System Using Deep Learning. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:10928. [PMID: 36078635 PMCID: PMC9518085 DOI: 10.3390/ijerph191710928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/25/2022] [Accepted: 08/29/2022] [Indexed: 06/15/2023]
Abstract
In recent years, healthcare has gained unprecedented attention from researchers in the field of Human health science and technology. Oral health, a subdomain of healthcare described as being very complex, is threatened by diseases like dental caries, gum disease, oral cancer, etc. The critical point is to propose an identification mechanism to prevent the population from being affected by these diseases. The large amount of online data allows scholars to perform tremendous research on health conditions, specifically oral health. Regardless of the high-performing dental consultation tools available in current healthcare, computer-based technology has shown the ability to complete some tasks in less time and cost less than when using similar healthcare tools to perform the same type of work. Machine learning has displayed a wide variety of advantages in oral healthcare, such as predicting dental caries in the population. Compared to the standard dental caries prediction previously proposed, this work emphasizes the importance of using multiple data sources, referred to as multi-modality, to extract more features and obtain accurate performances. The proposed prediction model constructed using multi-modal data demonstrated promising performances with an accuracy of 90%, F1-score of 89%, a recall of 90%, and a precision of 89%.
Collapse
Affiliation(s)
| | - Kwonwoo Lee
- Department of Computer and Electronics Convergence Engineering, Sun Moon University, Asan 31460, Korea
| | - Jeong-Dong Kim
- Department of Computer and Electronics Convergence Engineering, Sun Moon University, Asan 31460, Korea
- Genome-Based BioIT Convergence Institute, Sun Moon University, Asan 31460, Korea
| |
Collapse
|
48
|
Schönewolf J, Meyer O, Engels P, Schlickenrieder A, Hickel R, Gruhn V, Hesenius M, Kühnisch J. Artificial intelligence-based diagnostics of molar-incisor-hypomineralization (MIH) on intraoral photographs. Clin Oral Investig 2022; 26:5923-5930. [PMID: 35608684 PMCID: PMC9474479 DOI: 10.1007/s00784-022-04552-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Accepted: 05/13/2022] [Indexed: 11/09/2022]
Abstract
OBJECTIVE The aim of this study was to develop and validate a deep learning-based convolutional neural network (CNN) for the automated detection and categorization of teeth affected by molar-incisor-hypomineralization (MIH) on intraoral photographs. MATERIALS AND METHODS The data set consisted of 3241 intraoral images (767 teeth with no MIH/no intervention, 76 with no MIH/atypical restoration, 742 with no MIH/sealant, 815 with demarcated opacity/no intervention, 158 with demarcated opacity/atypical restoration, 181 with demarcated opacity/sealant, 290 with enamel breakdown/no intervention, 169 with enamel breakdown/atypical restoration, and 43 with enamel breakdown/sealant). These images were divided into a training (N = 2596) and a test sample (N = 649). All images were evaluated by an expert group, and each diagnosis served as a reference standard for cyclic training and evaluation of the CNN (ResNeXt-101-32 × 8d). Statistical analysis included the calculation of contingency tables, areas under the receiver operating characteristic curve (AUCs) and saliency maps. RESULTS The developed CNN was able to categorize teeth with MIH correctly with an overall diagnostic accuracy of 95.2%. The overall SE and SP amounted to 78.6% and 97.3%, respectively, which indicate that the CNN performed better in healthy teeth compared to those with MIH. The AUC values ranging from 0.873 (enamel breakdown/sealant) to 0.994 (atypical restoration/no MIH). CONCLUSION It was possible to categorize the majority of clinical photographs automatically by using a trained deep learning-based CNN with an acceptably high diagnostic accuracy. CLINICAL RELEVANCE Artificial intelligence-based dental diagnostics may support dental diagnostics in the future regardless of the need to improve accuracy.
Collapse
Affiliation(s)
- Jule Schönewolf
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Goethestraße 70, 80336, Munich, Germany
| | - Ole Meyer
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Paula Engels
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Goethestraße 70, 80336, Munich, Germany
| | - Anne Schlickenrieder
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Goethestraße 70, 80336, Munich, Germany
| | - Reinhard Hickel
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Goethestraße 70, 80336, Munich, Germany
| | - Volker Gruhn
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Marc Hesenius
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Goethestraße 70, 80336, Munich, Germany.
| |
Collapse
|
49
|
Application and Performance of Artificial Intelligence Technology in Detection, Diagnosis and Prediction of Dental Caries (DC)—A Systematic Review. Diagnostics (Basel) 2022; 12:diagnostics12051083. [PMID: 35626239 PMCID: PMC9139989 DOI: 10.3390/diagnostics12051083] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Revised: 04/12/2022] [Accepted: 04/25/2022] [Indexed: 01/27/2023] Open
Abstract
Evolution in the fields of science and technology has led to the development of newer applications based on Artificial Intelligence (AI) technology that have been widely used in medical sciences. AI-technology has been employed in a wide range of applications related to the diagnosis of oral diseases that have demonstrated phenomenal precision and accuracy in their performance. The aim of this systematic review is to report on the diagnostic accuracy and performance of AI-based models designed for detection, diagnosis, and prediction of dental caries (DC). Eminent electronic databases (PubMed, Google scholar, Scopus, Web of science, Embase, Cochrane, Saudi Digital Library) were searched for relevant articles that were published from January 2000 until February 2022. A total of 34 articles that met the selection criteria were critically analyzed based on QUADAS-2 guidelines. The certainty of the evidence of the included studies was assessed using the GRADE approach. AI has been widely applied for prediction of DC, for detection and diagnosis of DC and for classification of DC. These models have demonstrated excellent performance and can be used in clinical practice for enhancing the diagnostic performance, treatment quality and patient outcome and can also be applied to identify patients with a higher risk of developing DC.
Collapse
|
50
|
Engels P, Meyer O, Schönewolf J, Schlickenrieder A, Hickel R, Hesenius M, Gruhn V, Kühnisch J. Automated detection of posterior restorations in permanent teeth using artificial intelligence on intraoral photographs. J Dent 2022; 121:104124. [PMID: 35395346 DOI: 10.1016/j.jdent.2022.104124] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 03/31/2022] [Indexed: 10/18/2022] Open
Abstract
OBJECTIVES Intraoral photographs might be considered the machine-readable equivalent of a clinical-based visual examination and can potentially be used to detect and categorize dental restorations. The first objective of this study was to develop a deep learning-based convolutional neural network (CNN) for automated detection and categorization of posterior composite, cement, amalgam, gold and ceramic restorations on clinical photographs. Second, this study aimed to determine the diagnostic accuracy for the developed CNN (test method) compared to that of an expert evaluation (reference standard). METHODS The whole image set of 1,761 images (483 of unrestored teeth, 570 of composite restorations, 213 of cements, 278 of amalgam restorations, 125 of gold restorations and 92 of ceramic restorations) was divided into a training set (N=1,407, 401, 447, 66, 231, 93, and 169, respectively) and a test set (N=354, 82, 123, 26, 47, 32, and 44). The expert diagnoses served as a reference standard for cyclic training and repeated evaluation of the CNN (ResNeXt-101-32x8d), which was trained by using image augmentation and transfer learning. Statistical analysis included the calculation of contingency tables, areas under the receiver operating characteristic curve and saliency maps. RESULTS After training was complete, the CNN was able to categorize restorations correctly with the following diagnostic accuracy values: 94.9% for unrestored teeth, 92.9% for composites, 98.3% for cements, 99.2% for amalgam restorations, 99.4% for gold restorations and 97.8% for ceramic restorations. CONCLUSIONS It was possible to categorize different types of posterior restorations on intraoral photographs automatically with a good diagnostic accuracy. CLINICAL SIGNIFICANCE Dental diagnostics might be supported by artificial intelligence-based algorithms in the future. However, further improvements are needed to increase accuracy and practicability.
Collapse
Affiliation(s)
- Paula Engels
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Germany
| | - Ole Meyer
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Jule Schönewolf
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Germany
| | - Anne Schlickenrieder
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Germany
| | - Reinhard Hickel
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Germany
| | - Marc Hesenius
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Volker Gruhn
- Institute for Software Engineering, University of Duisburg-Essen, Essen, Germany
| | - Jan Kühnisch
- Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, Germany.
| |
Collapse
|