1
|
Ren X, Zhou W, Yuan N, Li F, Ruan Y, Zhou H. Prompt-based polyp segmentation during endoscopy. Med Image Anal 2025; 102:103510. [PMID: 40073580 DOI: 10.1016/j.media.2025.103510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 12/26/2024] [Accepted: 02/15/2025] [Indexed: 03/14/2025]
Abstract
Accurate judgment and identification of polyp size is crucial in endoscopic diagnosis. However, the indistinct boundaries of polyps lead to missegmentation and missed cancer diagnoses. In this paper, a prompt-based polyp segmentation method (PPSM) is proposed to assist in early-stage cancer diagnosis during endoscopy. It combines endoscopists' experience and artificial intelligence technology. Firstly, a prompt-based polyp segmentation network (PPSN) is presented, which contains the prompt encoding module (PEM), the feature extraction encoding module (FEEM), and the mask decoding module (MDM). The PEM encodes prompts to guide the FEEM for feature extracting and the MDM for mask generating. So that PPSN can segment polyps efficiently. Secondly, endoscopists' ocular attention data (gazes) are used as prompts, which can enhance PPSN's accuracy for segmenting polyps and obtain prompt data effectively in real-world. To reinforce the PPSN's stability, non-uniform dot matrix prompts are generated to compensate for frame loss during the eye-tracking. Moreover, a data augmentation method based on the segment anything model (SAM) is introduced to enrich the prompt dataset and improve the PPSN's adaptability. Experiments demonstrate the PPSM's accuracy and real-time capability. The results from cross-training and cross-testing on four datasets show the PPSM's generalization. Based on the research results, a disposable electronic endoscope with the real-time auxiliary diagnosis function for early cancer and an image processor have been developed. Part of the code and the method for generating the prompts dataset are available at https://github.com/XinZhenRen/PPSM.
Collapse
Affiliation(s)
- Xinzhen Ren
- Shanghai Key Laboratory of Power Station Automation Technology, School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, CO 200444, China
| | - Wenju Zhou
- Shanghai Key Laboratory of Power Station Automation Technology, School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, CO 200444, China.
| | - Naitong Yuan
- Shanghai Key Laboratory of Power Station Automation Technology, School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, CO 200444, China
| | - Fang Li
- Department of Obstetrics and Gynecology, Shanghai East Hospital, School of Medicine, Tongji University, Shanghai, CO 200120, China.
| | - Yetian Ruan
- Department of Obstetrics and Gynecology, Shanghai East Hospital, School of Medicine, Tongji University, Shanghai, CO 200120, China
| | - Huiyu Zhou
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
| |
Collapse
|
2
|
Tawheed A, Ismail A, Amer MS, Elnahas O, Mowafy T. Capsule endoscopy: Do we still need it after 24 years of clinical use? World J Gastroenterol 2025; 31:102692. [PMID: 39926220 PMCID: PMC11718605 DOI: 10.3748/wjg.v31.i5.102692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Revised: 11/20/2024] [Accepted: 12/02/2024] [Indexed: 12/30/2024] Open
Abstract
In this letter, we comment on a recent article published in the World Journal of Gastroenterology by Xiao et al, where the authors aimed to use a deep learning model to automatically detect gastrointestinal lesions during capsule endoscopy (CE). CE was first presented in 2000 and was approved by the Food and Drug Administration in 2001. The indications of CE overlap with those of regular diagnostic endoscopy. However, in clinical practice, CE is usually used to detect lesions in areas inaccessible to standard endoscopies or in cases of bleeding that might be missed during conventional endoscopy. Since the emergence of CE, many physiological and technical challenges have been faced and addressed. In this letter, we summarize the current challenges and briefly mention the proposed methods to overcome these challenges to answer a central question: Do we still need CE?
Collapse
Affiliation(s)
- Ahmed Tawheed
- Department of Endemic Medicine, Faculty of Medicine, Helwan University, Cairo 11795, Egypt
| | - Alaa Ismail
- Faculty of Medicine, Helwan University, Cairo 11795, Egypt
| | - Mohab S Amer
- Faculty of Medicine, Helwan University, Cairo 11795, Egypt
- Department of Research, SMART Company for Research Services, Cairo 11795, Egypt
| | - Osama Elnahas
- Faculty of Medicine, Helwan University, Cairo 11795, Egypt
| | - Tawhid Mowafy
- Department of Internal Medicine, Gardenia Medical Center, Doha 0000, Qatar
| |
Collapse
|
3
|
Kang D, Min GJ, Kim TY, Jeon YW, Cho Y, Park JM, O JH, Choi BO, Park G, Cho SG. The Role of Small Bowel Capsule Endoscopy in Determining the Treatment Strategy for Duodenal Follicular Lymphoma: A Single-Center Retrospective Study. Diagnostics (Basel) 2025; 15:193. [PMID: 39857077 PMCID: PMC11765495 DOI: 10.3390/diagnostics15020193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2024] [Revised: 01/04/2025] [Accepted: 01/13/2025] [Indexed: 01/27/2025] Open
Abstract
Objectives: In this single-center retrospective study, we aimed to verify the extent of duodenal follicular lymphoma (DFL) and investigate the role and clinical significance of video capsule endoscopy (VCE) in the treatment process. Methods: We analyzed the clinical and imaging data of 40 patients diagnosed with DFL. Results: Imaging workup and bone marrow biopsies revealed DFL only in the gastrointestinal tract (stage I) in 22 patients and in local lymph nodes (stage II1), distant lymph nodes (stage II2), pancreas (stage II2Epancreas), and extranodal regions (stage IV) in 1, 3, 1, and 13 patients, respectively. Fifteen of the 23 patients with localized (stages I and II1) DFL underwent VCE for comprehensive small bowel evaluation, which revealed lesion extension beyond the duodenum in 10 patients (66.7%). A watch-and-wait strategy was implemented for one patient and systemic chemotherapy was administered to the remaining nine. Of the eight patients without VCE, seven and one received radiotherapy and observation, respectively. Nine of the 23 patients (39.1%) received systemic treatment based on positive VCE results. Only one of the 17 patients with advanced-stage DFL (stages II2 and IV) accepted radiotherapy; 16 underwent systemic chemotherapy. During follow-up (median, 48.4 months), two relapse events occurred in the advanced stage, with no lymphoma-associated deaths. DFL tends to be indolent and has favorable outcomes. Conclusions: Proactive VCE for diagnosing DFL is recommended to determine small bowel involvement, which may influence subsequent treatment decisions.
Collapse
Affiliation(s)
- Donghoon Kang
- Department of Gastroenterology and Hepatology, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea; (D.K.); (Y.C.); (J.M.P.)
| | - Gi-June Min
- Department of Hematology, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea;
| | - Tong Yoon Kim
- Department of Hematology, Catholic University Lymphoma Group, Yeouido St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, 10 63-ro, Yeongdeungpo-gu, Seoul 07345, Republic of Korea; (T.Y.K.); (Y.-W.J.)
| | - Young-Woo Jeon
- Department of Hematology, Catholic University Lymphoma Group, Yeouido St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, 10 63-ro, Yeongdeungpo-gu, Seoul 07345, Republic of Korea; (T.Y.K.); (Y.-W.J.)
| | - Yukyung Cho
- Department of Gastroenterology and Hepatology, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea; (D.K.); (Y.C.); (J.M.P.)
| | - Jae Myung Park
- Department of Gastroenterology and Hepatology, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea; (D.K.); (Y.C.); (J.M.P.)
| | - Joo Hyun O
- Department of Nuclear Medicine, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea;
| | - Byung-Ock Choi
- Department of Radiation Oncology, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea;
| | - Gyeongsin Park
- Department of Hospital Pathology, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea;
| | - Seok-Goo Cho
- Department of Hematology, Catholic University Lymphoma Group, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Banpo-daero 222, Seocho-Gu, Seoul 06591, Republic of Korea;
| |
Collapse
|
4
|
Li S, Xu M, Meng Y, Sun H, Zhang T, Yang H, Li Y, Ma X. The application of the combination between artificial intelligence and endoscopy in gastrointestinal tumors. MEDCOMM – ONCOLOGY 2024; 3. [DOI: 10.1002/mog2.91] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 09/03/2024] [Indexed: 01/04/2025]
Abstract
AbstractGastrointestinal (GI) tumors have always been a major type of malignant tumor and a leading cause of tumor‐related deaths worldwide. The main principles of modern medicine for GI tumors are early prevention, early diagnosis, and early treatment, with early diagnosis being the most effective measure. Endoscopy, due to its ability to visualize lesions, has been one of the primary modalities for screening, diagnosing, and treating GI tumors. However, a qualified endoscopist often requires long training and extensive experience, which to some extent limits the wider use of endoscopy. With advances in data science, artificial intelligence (AI) has brought a new development direction for the endoscopy of GI tumors. AI can quickly process large quantities of data and images and improve diagnostic accuracy with some training, greatly reducing the workload of endoscopists and assisting them in early diagnosis. Therefore, this review focuses on the combined application of endoscopy and AI in GI tumors in recent years, describing the latest research progress on the main types of tumors and their performance in clinical trials, the application of multimodal AI in endoscopy, the development of endoscopy, and the potential applications of AI within it, with the aim of providing a reference for subsequent research.
Collapse
Affiliation(s)
- Shen Li
- Department of Biotherapy Cancer Center, West China Hospital, West China Medical School Sichuan University Chengdu China
| | - Maosen Xu
- Laboratory of Aging Research and Cancer Drug Target, State Key Laboratory of Biotherapy, West China Hospital, National Clinical Research, Sichuan University Chengdu Sichuan China
| | - Yuanling Meng
- West China School of Stomatology Sichuan University Chengdu Sichuan China
| | - Haozhen Sun
- College of Life Sciences Sichuan University Chengdu Sichuan China
| | - Tao Zhang
- Department of Biotherapy Cancer Center, West China Hospital, West China Medical School Sichuan University Chengdu China
| | - Hanle Yang
- Department of Biotherapy Cancer Center, West China Hospital, West China Medical School Sichuan University Chengdu China
| | - Yueyi Li
- Department of Biotherapy Cancer Center, West China Hospital, West China Medical School Sichuan University Chengdu China
| | - Xuelei Ma
- Department of Biotherapy Cancer Center, West China Hospital, West China Medical School Sichuan University Chengdu China
| |
Collapse
|
5
|
Wei X, Xi P, Chen M, Wen Y, Wu H, Wang L, Zhu Y, Ren Y, Gu Z. Capsule robots for the monitoring, diagnosis, and treatment of intestinal diseases. Mater Today Bio 2024; 29:101294. [PMID: 39483392 PMCID: PMC11525164 DOI: 10.1016/j.mtbio.2024.101294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 09/21/2024] [Accepted: 10/06/2024] [Indexed: 11/03/2024] Open
Abstract
Current evidence suggests that the intestine as the new frontier for human health directly impacts both our physical and mental health. Therefore, it is highly desirable to develop the intelligent tool for the enhanced diagnosis and treatment of intestinal diseases. During the past 20 years, capsule robots have opened new avenues for research and clinical applications, potentially revolutionizing human health monitor, disease diagnosis and treatment. In this review, we summarize the research progress of edible multifunctional capsule robots in intestinal diseases. To begin, we introduce the correlation between the intestinal microbiome, intestinal gas and human diseases. After that, we focus on the technical structure of edible multifunctional robots. Subsequently, the biomedical applications in the monitoring, diagnosis and treatment of intestinal diseases are discussed in detail. Last but not least, the main challenges of multifunctional capsule robots during the development process are summarized, followed by a vision for future development opportunities.
Collapse
Affiliation(s)
- Xiangyu Wei
- Department of Rheumatology, Research Center of Immunology, Affiliated Hospital of Nantong University, Nantong University, Nantong, 226001, China
- Department of Rheumatology, Affiliated Municipal Hospital of Xuzhou Medical University, Xuzhou, 221100, China
- Suzhou Medical College, Soochow University, Suzhou, 215123, China
| | - Peipei Xi
- Department of Emergency, Affiliated Hospital of Nantong University, Nantong University, Nantong, 226001, China
- Suzhou Medical College, Soochow University, Suzhou, 215123, China
| | - Minjie Chen
- Research Center of Clinical Medicine, Affiliated Hospital of Nantong University, Nantong, 226001, China
| | - Ya Wen
- Research Center of Clinical Medicine, Affiliated Hospital of Nantong University, Nantong, 226001, China
| | - Hao Wu
- Department of Otolaryngology, Affiliated Hospital of Nantong University, Nantong University, Nantong, 226001, China
| | - Li Wang
- Institutes of Biomedical Sciences and the Shanghai Key Laboratory of Medical Epigenetics, Shanghai Medical College, Fudan University, Shanghai, 200032, China
| | - Yujuan Zhu
- Research Center of Clinical Medicine, Affiliated Hospital of Nantong University, Nantong, 226001, China
| | - Yile Ren
- Department of Rheumatology, Affiliated Municipal Hospital of Xuzhou Medical University, Xuzhou, 221100, China
| | - Zhifeng Gu
- Department of Rheumatology, Research Center of Immunology, Affiliated Hospital of Nantong University, Nantong University, Nantong, 226001, China
| |
Collapse
|
6
|
Cao Q, Deng R, Pan Y, Liu R, Chen Y, Gong G, Zou J, Yang H, Han D. Robotic wireless capsule endoscopy: recent advances and upcoming technologies. Nat Commun 2024; 15:4597. [PMID: 38816464 PMCID: PMC11139981 DOI: 10.1038/s41467-024-49019-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 05/21/2024] [Indexed: 06/01/2024] Open
Abstract
Wireless capsule endoscopy (WCE) offers a non-invasive evaluation of the digestive system, eliminating the need for sedation and the risks associated with conventional endoscopic procedures. Its significance lies in diagnosing gastrointestinal tissue irregularities, especially in the small intestine. However, existing commercial WCE devices face limitations, such as the absence of autonomous lesion detection and treatment capabilities. Recent advancements in micro-electromechanical fabrication and computational methods have led to extensive research in sophisticated technology integration into commercial capsule endoscopes, intending to supersede wired endoscopes. This Review discusses the future requirements for intelligent capsule robots, providing a comparative evaluation of various methods' merits and disadvantages, and highlighting recent developments in six technologies relevant to WCE. These include near-field wireless power transmission, magnetic field active drive, ultra-wideband/intrabody communication, hybrid localization, AI-based autonomous lesion detection, and magnetic-controlled diagnosis and treatment. Moreover, we explore the feasibility for future "capsule surgeons".
Collapse
Affiliation(s)
- Qing Cao
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Runyi Deng
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Yue Pan
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Ruijie Liu
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Yicheng Chen
- Sir Run-Run Shaw Hospital, College of Medicine, Zhejiang University, Hangzhou, 310016, China
| | - Guofang Gong
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Jun Zou
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Huayong Yang
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Dong Han
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China.
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China.
| |
Collapse
|
7
|
George AA, Tan JL, Kovoor JG, Lee A, Stretton B, Gupta AK, Bacchi S, George B, Singh R. Artificial intelligence in capsule endoscopy: development status and future expectations. MINI-INVASIVE SURGERY 2024. [DOI: 10.20517/2574-1225.2023.102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2025]
Abstract
In this review, we aim to illustrate the state-of-the-art artificial intelligence (AI) applications in the field of capsule endoscopy. AI has made significant strides in gastrointestinal imaging, particularly in capsule endoscopy - a non-invasive procedure for capturing gastrointestinal tract images. However, manual analysis of capsule endoscopy videos is labour-intensive and error-prone, prompting the development of automated computational algorithms and AI models. While currently serving as a supplementary observer, AI has the capacity to evolve into an autonomous, integrated reading system, potentially significantly reducing capsule reading time while surpassing human accuracy. We searched Embase, Pubmed, Medline, and Cochrane databases from inception to 06 Jul 2023 for studies investigating the use of AI for capsule endoscopy and screened retrieved records for eligibility. Quantitative and qualitative data were extracted and synthesised to identify current themes. In the search, 824 articles were collected, and 291 duplicates and 31 abstracts were deleted. After a double-screening process and full-text review, 106 publications were included in the review. Themes pertaining to AI for capsule endoscopy included active gastrointestinal bleeding, erosions and ulcers, vascular lesions and angiodysplasias, polyps and tumours, inflammatory bowel disease, coeliac disease, hookworms, bowel prep assessment, and multiple lesion detection. This review provides current insights into the impact of AI on capsule endoscopy as of 2023. AI holds the potential for faster and precise readings and the prospect of autonomous image analysis. However, careful consideration of diagnostic requirements and potential challenges is crucial. The untapped potential within vision transformer technology hints at further evolution and even greater patient benefit.
Collapse
|
8
|
Bordbar M, Helfroush MS, Danyali H, Ejtehadi F. Wireless capsule endoscopy multiclass classification using three-dimensional deep convolutional neural network model. Biomed Eng Online 2023; 22:124. [PMID: 38098015 PMCID: PMC10722702 DOI: 10.1186/s12938-023-01186-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 11/29/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND Wireless capsule endoscopy (WCE) is a patient-friendly and non-invasive technology that scans the whole of the gastrointestinal tract, including difficult-to-access regions like the small bowel. Major drawback of this technology is that the visual inspection of a large number of video frames produced during each examination makes the physician diagnosis process tedious and prone to error. Several computer-aided diagnosis (CAD) systems, such as deep network models, have been developed for the automatic recognition of abnormalities in WCE frames. Nevertheless, most of these studies have only focused on spatial information within individual WCE frames, missing the crucial temporal data within consecutive frames. METHODS In this article, an automatic multiclass classification system based on a three-dimensional deep convolutional neural network (3D-CNN) is proposed, which utilizes the spatiotemporal information to facilitate the WCE diagnosis process. The 3D-CNN model fed with a series of sequential WCE frames in contrast to the two-dimensional (2D) model, which exploits frames as independent ones. Moreover, the proposed 3D deep model is compared with some pre-trained networks. The proposed models are trained and evaluated with 29 subject WCE videos (14,691 frames before augmentation). The performance advantages of 3D-CNN over 2D-CNN and pre-trained networks are verified in terms of sensitivity, specificity, and accuracy. RESULTS 3D-CNN outperforms the 2D technique in all evaluation metrics (sensitivity: 98.92 vs. 98.05, specificity: 99.50 vs. 86.94, accuracy: 99.20 vs. 92.60). In conclusion, a novel 3D-CNN model for lesion detection in WCE frames is proposed in this study. CONCLUSION The results indicate the performance of 3D-CNN over 2D-CNN and some well-known pre-trained classifier networks. The proposed 3D-CNN model uses the rich temporal information in adjacent frames as well as spatial data to develop an accurate and efficient model.
Collapse
Affiliation(s)
- Mehrdokht Bordbar
- Department of Electrical Engineering, Shiraz University of Technology, Shiraz, Iran
| | | | - Habibollah Danyali
- Department of Electrical Engineering, Shiraz University of Technology, Shiraz, Iran
| | - Fardad Ejtehadi
- Department of Internal Medicine, Gastroenterohepatology Research Center, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran
| |
Collapse
|
9
|
Lin Y, Zhang C, Liu C, Ma X, Yang Q, Guan B, Liu Z. Imaging-Navigated Surgery. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2023; 1199:87-106. [PMID: 37460728 DOI: 10.1007/978-981-32-9902-3_5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/20/2023]
Abstract
It is vitally important to guide or navigate therapeutic proceedings with a direct and visual approach in order to carefully undertake precision medical manipulations and efficiently evaluate the treatments. Imaging-navigated surgery is one of the common and prevailing technologies to realize this target, and more importantly it merges visualized medicine into next-generation theranostic paradigms in modern medicine. Endoscopes, surgical robots, and nanorobots are three major domains in terms of imaging-navigated surgery. The history of endoscopy has seen upgraded developments since the early 1800s. In contrast, surgical robots have been widely used and investigated in recent years, and they came into clinical uses only in the past decades. Nanorobots which closely depend on innovated and multifunctional biomaterials are still in their infancy. All these imaging-navigated technologies show similar and apparent advantages such as minimal invasiveness, minimized pain, positive prognosis, and relatively expected recovery, which have greatly improved surgery efficiency and patients' life quality. Therefore, the imaging-navigated surgery will be discussed in this chapter, and advanced clinical and preclinical medical applications will also be demonstrated for a diverse readers and comprehensive understanding.
Collapse
Affiliation(s)
- Yandai Lin
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Chen Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Chenxi Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Xinyong Ma
- Division of Academic & Cultural Activities, Academic Divisions of the Chinese Academy of Sciences, Beijing, China
| | - Qiang Yang
- Tianjin Hospital, Tianjin University, Tianjin, China
| | - Binggang Guan
- Tianjin Hospital, Tianjin University, Tianjin, China
| | - Zhe Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China.
| |
Collapse
|
10
|
Galati JS, Duve RJ, O'Mara M, Gross SA. Artificial intelligence in gastroenterology: A narrative review. Artif Intell Gastroenterol 2022; 3:117-141. [DOI: 10.35712/aig.v3.i5.117] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 11/21/2022] [Accepted: 12/21/2022] [Indexed: 12/28/2022] Open
Abstract
Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.
Collapse
Affiliation(s)
- Jonathan S Galati
- Department of Medicine, NYU Langone Health, New York, NY 10016, United States
| | - Robert J Duve
- Department of Internal Medicine, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY 14203, United States
| | - Matthew O'Mara
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| | - Seth A Gross
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| |
Collapse
|
11
|
Minchenberg SB, Walradt T, Glissen Brown JR. Scoping out the future: The application of artificial intelligence to gastrointestinal endoscopy. World J Gastrointest Oncol 2022; 14:989-1001. [PMID: 35646286 PMCID: PMC9124983 DOI: 10.4251/wjgo.v14.i5.989] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 06/21/2021] [Accepted: 04/21/2022] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) is a quickly expanding field in gastrointestinal endoscopy. Although there are a myriad of applications of AI ranging from identification of bleeding to predicting outcomes in patients with inflammatory bowel disease, a great deal of research has focused on the identification and classification of gastrointestinal malignancies. Several of the initial randomized, prospective trials utilizing AI in clinical medicine have centered on polyp detection during screening colonoscopy. In addition to work focused on colorectal cancer, AI systems have also been applied to gastric, esophageal, pancreatic, and liver cancers. Despite promising results in initial studies, the generalizability of most of these AI systems have not yet been evaluated. In this article we review recent developments in the field of AI applied to gastrointestinal oncology.
Collapse
Affiliation(s)
- Scott B Minchenberg
- Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, MA 02130, United States
| | - Trent Walradt
- Department of Internal Medicine, Beth Israel Deaconess Medical Center, Boston, MA 02130, United States
| | - Jeremy R Glissen Brown
- Division of Gastroenterology, Beth Israel Deaconess Medical Center, Boston, MA 02130, United States
| |
Collapse
|
12
|
Abstract
Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.
Collapse
Affiliation(s)
- Yutaka Okagawa
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.,Department of Gastroenterology, Tonan Hospital, Sapporo, Japan
| | - Seiichiro Abe
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
| | - Masayoshi Yamada
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Ichiro Oda
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Yutaka Saito
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| |
Collapse
|
13
|
Proposing Novel Data Analytics Method for Anatomical Landmark Identification from Endoscopic Video Frames. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:8151177. [PMID: 35251578 PMCID: PMC8890842 DOI: 10.1155/2022/8151177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 12/20/2021] [Accepted: 01/07/2022] [Indexed: 11/18/2022]
Abstract
Background The anatomical landmarks contain the characteristics that are used to guide the gastroenterologists during the endoscopy. The expert can also ensure the completion of examination with the help of the anatomical landmarks. Automatic detection of anatomical landmarks in endoscopic video frames can be helpful for guiding the physicians during screening the gastrointestinal tract (GI). Method This study presents an automatic novel method for anatomical landmark detection of GI tract from endoscopic video frames based on semisupervised deep convolutional neural network (CNN) and compares the results with supervised CNN model. We consider the anatomical landmarks from Kvasir dataset that includes 500 images for each class of Z-line, pylorus, and cecum. The resolution of these images varies from 750 × 576 up to 1920 × 1072 pixels. Result Experimental results show that the supervised CNN has highly desirable performance with accuracy of 100%. Also, our proposed semisupervised CNN can compete with a slight difference similar to the CNN model. Our proposed semisupervised model trained using 1, 5, 10, and 20 percent of training data records as labeled training dataset has the average accuracy of 83%, 98%, 99%, and 99%, respectively. Conclusion The main advantage of our proposed method is achieving the high accuracy with small amount of labeled data without spending time for labeling more data. The strength of our proposed method saves the required labor, cost, and time for data labeling.
Collapse
|
14
|
Kröner PT, Engels MML, Glicksberg BS, Johnson KW, Mzaik O, van Hooft JE, Wallace MB, El-Serag HB, Krittanawong C. Artificial intelligence in gastroenterology: A state-of-the-art review. World J Gastroenterol 2021; 27:6794-6824. [PMID: 34790008 PMCID: PMC8567482 DOI: 10.3748/wjg.v27.i40.6794] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 06/15/2021] [Accepted: 09/16/2021] [Indexed: 02/06/2023] Open
Abstract
The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.
Collapse
Affiliation(s)
- Paul T Kröner
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Megan ML Engels
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Cancer Center Amsterdam, Department of Gastroenterology and Hepatology, Amsterdam UMC, Location AMC, Amsterdam 1105, The Netherlands
| | - Benjamin S Glicksberg
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Kipp W Johnson
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Obaie Mzaik
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Jeanin E van Hooft
- Department of Gastroenterology and Hepatology, Leiden University Medical Center, Amsterdam 2300, The Netherlands
| | - Michael B Wallace
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Division of Gastroenterology and Hepatology, Sheikh Shakhbout Medical City, Abu Dhabi 11001, United Arab Emirates
| | - Hashem B El-Serag
- Section of Gastroenterology and Hepatology, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
| | - Chayakrit Krittanawong
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Cardiology, Michael E. DeBakey VA Medical Center, Houston, TX 77030, United States
| |
Collapse
|
15
|
Geropoulos G, Aquilina J, Kakos C, Anestiadou E, Giannis D. Magnetically Controlled Capsule Endoscopy Versus Conventional Gastroscopy: A Systematic Review and Meta-Analysis. J Clin Gastroenterol 2021; 55:577-585. [PMID: 33883514 DOI: 10.1097/mcg.0000000000001540] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
BACKGROUND The introduction of magnetically controlled capsule endoscopy overcame the restriction of passive capsule endoscopy movement, thus allowing an improved visualization of the gastrointestinal lumen, where other imaging studies seem to be unhelpful. The aim of this study is to systematically review the performance of magnetically controlled capsule endoscopy and evaluate its potential as a less invasive diagnostic method in the detection of gastric lesions. METHODS A systematic search was performed in PubMed (Medline), EMBASE, Google Scholar, Scopus, Who Global Health Library (GHL), Virtual Health Library (VHL), Clinicaltrials.gov, Cochrane Library, and ISI Web of Science databases. Proportion meta-analyses were performed to estimate the pooled sensitivity of magnetically controlled capsuled endoscopy in the detection of gastrointestinal lesions. RESULTS Among the 3026 studies that were initially assessed, 7 studies were finally included, with a total of 916 patients and 745 gastric lesions. The mean capsule endoscopy examination time was 21.92±8.87 minutes. The pooled overall sensitivity of magnetically controlled capsule endoscopy was 87% [95% confidence interval (CI), 84%-89%]. Subgroup analysis showed that the sensitivity of identifying gastric ulcers was 82% (95% CI: 71%-89%), gastric polyps was 82% (95% CI: 76%-87%), and gastric erosions was 95% (95% CI: 86%-98%). In general, magnetically controlled capsule endoscopy was well tolerated by the participants with minimal adverse events. CONCLUSION The magnetically controlled capsule endoscopy demonstrated an acceptable sensitivity of identifying gastric lesions. Further prospective comparative studies are needed to identify the risks and benefits of this new technique, as well as to determine its role as a replacement for conventional gastroscopy.
Collapse
Affiliation(s)
| | - Julian Aquilina
- University College London Hospitals, NHS Foundation Trust, London
| | - Christos Kakos
- Department of General Surgery, Ulster Hospital Dundonald, Belfast, UK
| | - Elisavet Anestiadou
- Fourth Surgical Department, Aristotle University of Thessaloniki, General Hospital "G. Papanikolaou", Thessaloniki, Greece
| | - Dimitrios Giannis
- Institute of Health Innovations and Outcomes Research, The Feinstein Institute for Medical Research, Manhasset, NY, 11030
| |
Collapse
|
16
|
Yang Y, Li YX, Yao RQ, Du XH, Ren C. Artificial intelligence in small intestinal diseases: Application and prospects. World J Gastroenterol 2021; 27:3734-3747. [PMID: 34321840 PMCID: PMC8291013 DOI: 10.3748/wjg.v27.i25.3734] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 04/09/2021] [Accepted: 05/08/2021] [Indexed: 02/06/2023] Open
Abstract
The small intestine is located in the middle of the gastrointestinal tract, so small intestinal diseases are more difficult to diagnose than other gastrointestinal diseases. However, with the extensive application of artificial intelligence in the field of small intestinal diseases, with its efficient learning capacities and computational power, artificial intelligence plays an important role in the auxiliary diagnosis and prognosis prediction based on the capsule endoscopy and other examination methods, which improves the accuracy of diagnosis and prediction and reduces the workload of doctors. In this review, a comprehensive retrieval was performed on articles published up to October 2020 from PubMed and other databases. Thereby the application status of artificial intelligence in small intestinal diseases was systematically introduced, and the challenges and prospects in this field were also analyzed.
Collapse
Affiliation(s)
- Yu Yang
- Department of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Yu-Xuan Li
- Department of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Ren-Qi Yao
- Trauma Research Center, The Fourth Medical Center and Medical Innovation Research Division of the Chinese People‘s Liberation Army General Hospital, Beijing 100048, China
- Department of Burn Surgery, Changhai Hospital, Naval Medical University, Shanghai 200433, China
| | - Xiao-Hui Du
- Department of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Chao Ren
- Trauma Research Center, The Fourth Medical Center and Medical Innovation Research Division of the Chinese People‘s Liberation Army General Hospital, Beijing 100048, China
| |
Collapse
|
17
|
Naz J, Sharif M, Yasmin M, Raza M, Khan MA. Detection and Classification of Gastrointestinal Diseases using Machine Learning. Curr Med Imaging 2021; 17:479-490. [PMID: 32988355 DOI: 10.2174/1573405616666200928144626] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2020] [Revised: 07/07/2020] [Accepted: 07/23/2020] [Indexed: 12/22/2022]
Abstract
BACKGROUND Traditional endoscopy is an invasive and painful method of examining the gastrointestinal tract (GIT) not supported by physicians and patients. To handle this issue, video endoscopy (VE) or wireless capsule endoscopy (WCE) is recommended and utilized for GIT examination. Furthermore, manual assessment of captured images is not possible for an expert physician because it's a time taking task to analyze thousands of images thoroughly. Hence, there comes the need for a Computer-Aided-Diagnosis (CAD) method to help doctors analyze images. Many researchers have proposed techniques for automated recognition and classification of abnormality in captured images. METHODS In this article, existing methods for automated classification, segmentation and detection of several GI diseases are discussed. Paper gives a comprehensive detail about these state-of-theart methods. Furthermore, literature is divided into several subsections based on preprocessing techniques, segmentation techniques, handcrafted features based techniques and deep learning based techniques. Finally, issues, challenges and limitations are also undertaken. RESULTS A comparative analysis of different approaches for the detection and classification of GI infections. CONCLUSION This comprehensive review article combines information related to a number of GI diseases diagnosis methods at one place. This article will facilitate the researchers to develop new algorithms and approaches for early detection of GI diseases detection with more promising results as compared to the existing ones of literature.
Collapse
Affiliation(s)
- Javeria Naz
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Mussarat Yasmin
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | - Mudassar Raza
- Department of Computer Science, COMSATS University Islamabad, Wah Campus, Pakistan
| | | |
Collapse
|
18
|
Wang S, Cong Y, Zhu H, Chen X, Qu L, Fan H, Zhang Q, Liu M. Multi-Scale Context-Guided Deep Network for Automated Lesion Segmentation With Endoscopy Images of Gastrointestinal Tract. IEEE J Biomed Health Inform 2021; 25:514-525. [PMID: 32750912 DOI: 10.1109/jbhi.2020.2997760] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Accurate lesion segmentation based on endoscopy images is a fundamental task for the automated diagnosis of gastrointestinal tract (GI Tract) diseases. Previous studies usually use hand-crafted features for representing endoscopy images, while feature definition and lesion segmentation are treated as two standalone tasks. Due to the possible heterogeneity between features and segmentation models, these methods often result in sub-optimal performance. Several fully convolutional networks have been recently developed to jointly perform feature learning and model training for GI Tract disease diagnosis. However, they generally ignore local spatial details of endoscopy images, as down-sampling operations (e.g., pooling and convolutional striding) may result in irreversible loss of image spatial information. To this end, we propose a multi-scale context-guided deep network (MCNet) for end-to-end lesion segmentation of endoscopy images in GI Tract, where both global and local contexts are captured as guidance for model training. Specifically, one global subnetwork is designed to extract the global structure and high-level semantic context of each input image. Then we further design two cascaded local subnetworks based on output feature maps of the global subnetwork, aiming to capture both local appearance information and relatively high-level semantic information in a multi-scale manner. Those feature maps learned by three subnetworks are further fused for the subsequent task of lesion segmentation. We have evaluated the proposed MCNet on 1,310 endoscopy images from the public EndoVis-Ab and CVC-ClinicDB datasets for abnormal segmentation and polyp segmentation, respectively. Experimental results demonstrate that MCNet achieves [Formula: see text] and [Formula: see text] mean intersection over union (mIoU) on two datasets, respectively, outperforming several state-of-the-art approaches in automated lesion segmentation with endoscopy images of GI Tract.
Collapse
|
19
|
Liaqat A, Khan MA, Sharif M, Mittal M, Saba T, Manic KS, Al Attar FNH. Gastric Tract Infections Detection and Classification from Wireless Capsule Endoscopy using Computer Vision Techniques: A Review. Curr Med Imaging 2021; 16:1229-1242. [PMID: 32334504 DOI: 10.2174/1573405616666200425220513] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2019] [Revised: 01/14/2020] [Accepted: 01/30/2020] [Indexed: 11/22/2022]
Abstract
Recent facts and figures published in various studies in the US show that approximately
27,510 new cases of gastric infections are diagnosed. Furthermore, it has also been reported that
the mortality rate is quite high in diagnosed cases. The early detection of these infections can save
precious human lives. As the manual process of these infections is time-consuming and expensive,
therefore automated Computer-Aided Diagnosis (CAD) systems are required which helps the endoscopy
specialists in their clinics. Generally, an automated method of gastric infection detections
using Wireless Capsule Endoscopy (WCE) is comprised of the following steps such as contrast preprocessing,
feature extraction, segmentation of infected regions, and classification into their relevant
categories. These steps consist of various challenges that reduce the detection and recognition
accuracy as well as increase the computation time. In this review, authors have focused on the importance
of WCE in medical imaging, the role of endoscopy for bleeding-related infections, and
the scope of endoscopy. Further, the general steps and highlighting the importance of each step
have been presented. A detailed discussion and future directions have been provided at the end.
Collapse
Affiliation(s)
- Amna Liaqat
- Department of Computer Science, COMSATS University Islamabad, Wah Cantt, Pakistan
| | | | - Muhammad Sharif
- Department of Computer Science, COMSATS University Islamabad, Wah Cantt, Pakistan
| | - Mamta Mittal
- Department of Computer Science & Engineering, G.B. Pant Govt. Engineering College, New Delhi, India
| | - Tanzila Saba
- Department of Computer and Information Sciences, Prince Sultan University, Riyadh, Saudi Arabia
| | - K. Suresh Manic
- Department of Electrical & Computer Engineering, National University of Science & Technology, Muscat, Oman
| | | |
Collapse
|
20
|
Naz J, Attique Khan M, Alhaisoni M, Song OY, Tariq U, Kadry S. Segmentation and Classification of Stomach Abnormalities Using Deep Learning. COMPUTERS, MATERIALS & CONTINUA 2021; 69:607-625. [DOI: 10.32604/cmc.2021.017101] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Accepted: 02/21/2021] [Indexed: 08/25/2024]
|
21
|
Meher D, Gogoi M, Bharali P, Anirvan P, Singh SP. Artificial Intelligence in Small Bowel Endoscopy: Current Perspectives and Future Directions. JOURNAL OF DIGESTIVE ENDOSCOPY 2020. [DOI: 10.1055/s-0040-1717824] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
AbstractArtificial intelligence (AI) is a computer system that is able to perform tasks which normally require human intelligence. The role of AI in the field of gastroenterology has been gradually evolving since its inception in the 1950s. Discovery of wireless capsule endoscopy (WCE) and balloon enteroscopy (BE) has revolutionized small gut imaging. While WCE is a relatively patient-friendly and noninvasive mode to examine the nonobstructed small gut, it is limited by a lengthy examination time and the need for expertise in reading images acquired by the capsule. Similarly, BE, despite having the advantage of therapeutic intervention, is costly, invasive, and requires general sedation. Incorporation of concepts like machine learning and deep learning has been used to handle large amounts of data and images in gastroenterology. Interestingly, in small gut imaging, the application of AI has been limited to WCE only. This review was planned to examine and summarize available published data on various AI-based approaches applied to small bowel disease.
We conducted an extensive literature search using Google search engine, Google Scholar, and PubMed database for published literature in English on the application of different AI techniques in small bowel endoscopy, and have summarized the outcome and benefits of these applications of AI in small bowel endoscopy. Incorporation of AI in WCE has resulted in significant advancements in the detection of various lesions starting from dysplastic mucosa, inflammatory and nonmalignant lesions to the detection of bleeding with increasing accuracy and has shortened the lengthy review time in image analysis. As most of the studies to evaluate AI are retrospective, the presence of inherent selection bias cannot be excluded. Besides, the interpretability (black-box nature) of AI models remains a cause for concern. Finally, issues related to medical ethics and AI need to be judiciously addressed to enable its seamless use in future.
Collapse
Affiliation(s)
- Dinesh Meher
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | - Mrinal Gogoi
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | - Pankaj Bharali
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | - Prajna Anirvan
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | | |
Collapse
|
22
|
Jani KK, Srivastava R. A Survey on Medical Image Analysis in Capsule Endoscopy. Curr Med Imaging 2020; 15:622-636. [PMID: 32008510 DOI: 10.2174/1573405614666181102152434] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2018] [Revised: 10/14/2018] [Accepted: 10/22/2018] [Indexed: 02/06/2023]
Abstract
BACKGROUND AND OBJECTIVE Capsule Endoscopy (CE) is a non-invasive, patient-friendly alternative to conventional endoscopy procedure. However, CE produces 6 to 8 hrs long video posing a tedious challenge to a gastroenterologist for abnormality detection. Major challenges to an expert are lengthy videos, need of constant concentration and subjectivity of the abnormality. To address these challenges along with high diagnostic accuracy, design and development of automated abnormality detection system is a must. Machine learning and computer vision techniques are devised to develop such automated systems. METHODS Study presents a review of quality research papers published in IEEE, Scopus, and Science Direct database with search criteria as capsule endoscopy, engineering, and journal papers. The initial search retrieved 144 publications. After evaluating all articles, 62 publications pertaining to image analysis are selected. RESULTS This paper presents a rigorous review comprising all the aspects of medical image analysis concerning capsule endoscopy namely video summarization and redundant image elimination, Image enhancement and interpretation, segmentation and region identification, Computer-aided abnormality detection in capsule endoscopy, Image and video compression. The study provides a comparative analysis of various approaches, experimental setup, performance, strengths, and limitations of the aspects stated above. CONCLUSIONS The analyzed image analysis techniques for capsule endoscopy have not yet overcome all current challenges mainly due to lack of dataset and complex nature of the gastrointestinal tract.
Collapse
Affiliation(s)
- Kuntesh Ketan Jani
- Computer Science and Engineering Department, Indian Institute of Technology (Banaras Hindu University) Varanasi, Varanasi, Uttar Pradesh, India
| | - Rajeev Srivastava
- Computer Science and Engineering Department, Indian Institute of Technology (Banaras Hindu University) Varanasi, Varanasi, Uttar Pradesh, India
| |
Collapse
|
23
|
Rahim T, Usman MA, Shin SY. A survey on contemporary computer-aided tumor, polyp, and ulcer detection methods in wireless capsule endoscopy imaging. Comput Med Imaging Graph 2020; 85:101767. [DOI: 10.1016/j.compmedimag.2020.101767] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Revised: 07/13/2020] [Accepted: 07/18/2020] [Indexed: 12/12/2022]
|
24
|
Oprić D, Stankovich AD, Nenadović A, Kovačević S, Obradović DD, de Luka S, Nešović-Ostojić J, Milašin J, Ilić AŽ, Trbovich AM. Fractal analysis tools for early assessment of liver inflammation induced by chronic consumption of linseed, palm and sunflower oils. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101959] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
25
|
Yang YJ. The Future of Capsule Endoscopy: The Role of Artificial Intelligence and Other Technical Advancements. Clin Endosc 2020; 53:387-394. [PMID: 32668529 PMCID: PMC7403015 DOI: 10.5946/ce.2020.133] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Accepted: 05/24/2020] [Indexed: 12/13/2022] Open
Abstract
Capsule endoscopy has revolutionized the management of small-bowel diseases owing to its convenience and noninvasiveness. Capsule endoscopy is a common method for the evaluation of obscure gastrointestinal bleeding, Crohn’s disease, small-bowel tumors, and polyposis syndrome. However, the laborious reading process, oversight of small-bowel lesions, and lack of locomotion are major obstacles to expanding its application. Along with recent advances in artificial intelligence, several studies have reported the promising performance of convolutional neural network systems for the diagnosis of various small-bowel lesions including erosion/ulcers, angioectasias, polyps, and bleeding lesions, which have reduced the time needed for capsule endoscopy interpretation. Furthermore, colon capsule endoscopy and capsule endoscopy locomotion driven by magnetic force have been investigated for clinical application, and various capsule endoscopy prototypes for active locomotion, biopsy, or therapeutic approaches have been introduced. In this review, we will discuss the recent advancements in artificial intelligence in the field of capsule endoscopy, as well as studies on other technological improvements in capsule endoscopy.
Collapse
Affiliation(s)
- Young Joo Yang
- Department of Internal Medicine, Hallym University College of Medicine, Chuncheon, Korea.,Institute for Liver and Digestive Diseases, Hallym University, Chuncheon, Korea
| |
Collapse
|
26
|
Guo X, Yuan Y. Semi-supervised WCE image classification with adaptive aggregated attention. Med Image Anal 2020; 64:101733. [PMID: 32574987 DOI: 10.1016/j.media.2020.101733] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2019] [Revised: 04/01/2020] [Accepted: 05/22/2020] [Indexed: 02/08/2023]
Abstract
Accurate abnormality classification in Wireless Capsule Endoscopy (WCE) images is crucial for early gastrointestinal (GI) tract cancer diagnosis and treatment, while it remains challenging due to the limited annotated dataset, the huge intra-class variances and the high degree of inter-class similarities. To tackle these dilemmas, we propose a novel semi-supervised learning method with Adaptive Aggregated Attention (AAA) module for automatic WCE image classification. Firstly, a novel deformation field based image preprocessing strategy is proposed to remove the black background and circular boundaries in WCE images. Then we propose a synergic network to learn discriminative image features, consisting of two branches: an abnormal regions estimator (the first branch) and an abnormal information distiller (the second branch). The first branch utilizes the proposed AAA module to capture global dependencies and incorporate context information to highlight the most meaningful regions, while the second branch mainly focuses on these calculated attention regions for accurate and robust abnormality classification. Finally, these two branches are jointly optimized by minimizing the proposed discriminative angular (DA) loss and Jensen-Shannon divergence (JS) loss with labeled data as well as unlabeled data. Comprehensive experiments have been conducted on the public CAD-CAP WCE dataset. The proposed method achieves 93.17% overall accuracy in a fourfold cross-validation, verifying its effectiveness for WCE image classification. The source code is available at https://github.com/Guo-Xiaoqing/SSL_WCE.
Collapse
Affiliation(s)
- Xiaoqing Guo
- Department of Electrical Engineering, City University of Hong Kong, Hong Kong SAR, China
| | - Yixuan Yuan
- Department of Electrical Engineering, City University of Hong Kong, Hong Kong SAR, China.
| |
Collapse
|
27
|
Lai H, Wang X, Cai J, Zhao X, Han Z, Zhang J, Chen Z, Lin Z, Zhou P, Hu B, Li A, Liu S. Standing-type magnetically guided capsule endoscopy versus gastroscopy for gastric examination: multicenter blinded comparative trial. Dig Endosc 2020; 32:557-564. [PMID: 31483889 PMCID: PMC7318584 DOI: 10.1111/den.13520] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2019] [Accepted: 08/27/2019] [Indexed: 02/05/2023]
Abstract
AIM To compare feasibility and safety after gastrointestinal checkup by standing-type magnetically controlled capsule endoscopy (SMCE) and conventional gastroscopy. METHODS This was a prospective multicenter, blinded study that compared SMCE with gastroscopy in patients from April 2018 to July 2018. All patients first underwent SMCE and then subsequently had gastroscopy with i.v. anesthesia. We calculated the compliance rates of gastric lesion detection by SMCE using gastroscopy as the standard. Capsule retention rate, incidence of adverse events, and patient satisfaction were documented throughout the study. RESULTS One hundred and sixty-one patients who completed SMCE and gastroscopy were included in the analysis. Positive compliance rate among SMCE and gastroscopy was 92.0% (95% CI: 80.77%-97.78%). Negative compliance rate was 95.5% (89.80%, 98.52%). Moreover, overall compliance rate was 94.41% (89.65%, 97.41%). Sixty-four pathological outcomes were identified. Of these 64 outcomes, 50 were detected by both procedures. The gastroscopy method neglected seven findings (such as five erosions, one polyp, and one ulcer). Furthermore, SMCE also overlooked seven lesions (i.e. one erosion, two polyps, one atrophy, and three submucosal tumors). Capsule retention or related adverse events were not reported. CONCLUSION Standing-type magnetically controlled capsule endoscopy provides equivalent agreement with gastroscopy and may be useful for screening of gastric illnesses without any anesthesia.
Collapse
Affiliation(s)
- Hua‐sheng Lai
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Xin‐ke Wang
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Jian‐qun Cai
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Xin‐mei Zhao
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Ze‐long Han
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Jie Zhang
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Zhen‐yu Chen
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Zhi‐zhao Lin
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Ping‐hong Zhou
- Department of GastroenterologyZhongshan HospitalFudan UniversityShanghaiChina
| | - Bing Hu
- Department of GastroenterologyWest China HospitalSichuan UniversityChengduChina
| | - Ai‐min Li
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| | - Si‐de Liu
- Guangdong Provincial Key Laboratory of GastroenterologyDepartment of GastroenterologyNanfang HospitalSouthern Medical UniversityGuangzhouChina
| |
Collapse
|
28
|
Kundu AK, Fattah SA, Wahid KA. Multiple Linear Discriminant Models for Extracting Salient Characteristic Patterns in Capsule Endoscopy Images for Multi-Disease Detection. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2020; 8:3300111. [PMID: 32190429 PMCID: PMC7062148 DOI: 10.1109/jtehm.2020.2964666] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/05/2019] [Revised: 11/05/2019] [Accepted: 12/03/2019] [Indexed: 01/01/2023]
Abstract
Background: Computer-aided disease detection schemes from wireless capsule endoscopy (WCE) videos have received great attention by the researchers for reducing physicians’ burden due to the time-consuming and risky manual review process. While single disease classification schemes are greatly dealt by the researchers in the past, developing a unified scheme which is capable of detecting multiple gastrointestinal (GI) diseases is very challenging due to the highly irregular behavior of diseased images in terms of color patterns. Method: In this paper, a computer-aided method is developed to detect multiple GI diseases from WCE videos utilizing linear discriminant analysis (LDA) based region of interest (ROI) separation scheme followed by a probabilistic model fitting approach. Commonly in training phase, as pixel-labeled images are available in small number, only the image-level annotations are used for detecting diseases in WCE images, whereas pixel-level knowledge, although a major source for learning the disease characteristics, is left unused. In view of learning the characteristic disease patterns from pixel-labeled images, a set of LDA models are trained which are later used to extract the salient ROI from WCE images both in training and testing stages. The intensity patterns of ROI are then modeled by a suitable probability distribution and the fitted parameters of the distribution are utilized as features in a supervised cascaded classification scheme. Results: For the purpose of validation of the proposed multi-disease detection scheme, a set of pixel-labeled images of bleeding, ulcer and tumor are used to extract the LDA models and then, a large WCE dataset is used for training and testing. A high level of accuracy is achieved even with a small number of pixel-labeled images. Conclusion: Therefore, the proposed scheme is expected to help physicians in reviewing a large number of WCE images to diagnose different GI diseases.
Collapse
Affiliation(s)
- Amit Kumar Kundu
- 1Department of Electrical and Electronic EngineeringBangladesh University of Engineering and TechnologyDhaka1205Bangladesh
| | - Shaikh Anowarul Fattah
- 1Department of Electrical and Electronic EngineeringBangladesh University of Engineering and TechnologyDhaka1205Bangladesh
| | - Khan A Wahid
- 2Department of Electrical and Computer EngineeringUniversity of SaskatchewanSaskatoonSKS7N 5A9Canada
| |
Collapse
|
29
|
Le Berre C, Sandborn WJ, Aridhi S, Devignes MD, Fournier L, Smaïl-Tabbone M, Danese S, Peyrin-Biroulet L. Application of Artificial Intelligence to Gastroenterology and Hepatology. Gastroenterology 2020; 158:76-94.e2. [PMID: 31593701 DOI: 10.1053/j.gastro.2019.08.058] [Citation(s) in RCA: 318] [Impact Index Per Article: 63.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Revised: 08/22/2019] [Accepted: 08/24/2019] [Indexed: 02/07/2023]
Abstract
Since 2010, substantial progress has been made in artificial intelligence (AI) and its application to medicine. AI is explored in gastroenterology for endoscopic analysis of lesions, in detection of cancer, and to facilitate the analysis of inflammatory lesions or gastrointestinal bleeding during wireless capsule endoscopy. AI is also tested to assess liver fibrosis and to differentiate patients with pancreatic cancer from those with pancreatitis. AI might also be used to establish prognoses of patients or predict their response to treatments, based on multiple factors. We review the ways in which AI may help physicians make a diagnosis or establish a prognosis and discuss its limitations, knowing that further randomized controlled studies will be required before the approval of AI techniques by the health authorities.
Collapse
Affiliation(s)
- Catherine Le Berre
- Institut des Maladies de l'Appareil Digestif, Nantes University Hospital, France; Institut National de la Santé et de la Recherche Médicale U954 and Department of Gastroenterology, Nancy University Hospital, University of Lorraine, France
| | | | - Sabeur Aridhi
- University of Lorraine, Le Centre National de la Recherche Scientifique, Inria, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Nancy, France
| | - Marie-Dominique Devignes
- University of Lorraine, Le Centre National de la Recherche Scientifique, Inria, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Nancy, France
| | - Laure Fournier
- Université Paris-Descartes, Institut National de la Santé et de la Recherche Médicale, Unité Mixte De Recherché S970, Assistance Publique-Hôpitaux de Paris, Paris, France
| | - Malika Smaïl-Tabbone
- University of Lorraine, Le Centre National de la Recherche Scientifique, Inria, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Nancy, France
| | - Silvio Danese
- Inflammatory Bowel Disease Center and Department of Biomedical Sciences, Humanitas Clinical and Research Center, Humanitas University, Milan, Italy
| | - Laurent Peyrin-Biroulet
- Institut National de la Santé et de la Recherche Médicale U954 and Department of Gastroenterology, Nancy University Hospital, University of Lorraine, France.
| |
Collapse
|
30
|
Vieira PM, Freitas NR, Valente J, Vaz IF, Rolanda C, Lima CS. Automatic detection of small bowel tumors in wireless capsule endoscopy images using ensemble learning. Med Phys 2019; 47:52-63. [PMID: 31299096 DOI: 10.1002/mp.13709] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2018] [Revised: 07/03/2019] [Accepted: 07/05/2019] [Indexed: 12/15/2022] Open
Abstract
PURPOSE Wireless Capsule Endoscopy (WCE) is a minimally invasive diagnosis tool for lesion detection in the gastrointestinal tract, reaching places where conventional endoscopy is unable to. However, the significant amount of acquired data leads to difficulties in the diagnosis by the physicians; which can be eased with computer assistance. This paper addresses a method for the automatic detection of tumors in WCE by using a two-step based procedure: region of interest selection and classification. METHODS The first step aims to separate abnormal from normal tissue by using automatic segmentation based on a Gaussian Mixture Model (GMM). A modified version of the Anderson method for convergence acceleration of the expectation-maximization (EM) algorithm is proposed. The proposed features for both segmentation and classification are based on the CIELab color space, as a way of bypassing lightness variations, where the L component is discarded. Tissue variability among subjects, light inhomogeneities and even intensity differences among different devices can be overcome by using simultaneously features from both regions. In the second step, an ensemble system with partition of the training data with a new training scheme is proposed. At this stage, the gating network is trained after the experts have been trained decoupling the joint maximization of both modules. The partition module is also used at the test step, leading the incoming data to the most likely expert allowing incremental adaptation by preserving data diversity. RESULTS This algorithm outperforms others based on texture features selected from Wavelets and Curvelets transforms, classified by a regular support vector machine (SVM) in more than 5%. CONCLUSIONS This work shows that simpler features can outperform more elaborate ones if appropriately designed. In the current case, luminance was discarded to cope with saturated tissue, facilitating the color perception. Ensemble systems remain an open research field. In the current case, changes in both topology and training strategy have led to significant performance improvements. A system with this level of performance can be used in current clinical practice.
Collapse
Affiliation(s)
- Pedro M Vieira
- CMEMS-UMinho Research Unit, University of Minho, Guimarães, Portugal
| | - Nuno R Freitas
- CMEMS-UMinho Research Unit, University of Minho, Guimarães, Portugal
| | - João Valente
- School of Health, Polytechnic Institute of Castelo Branco, Castelo Branco, Portugal
| | - Ismael F Vaz
- ALGORITMI Research Center, University of Minho, Campus of Gualtar, 4710-057, Braga, Portugal
| | - Carla Rolanda
- Gastroenterology Department of the Hospital of Braga, Braga, Portugal.,ICVS/3B's Associate Laboratory, University of Minho, Braga, Portugal
| | - Carlos S Lima
- CMEMS-UMinho Research Unit, University of Minho, Guimarães, Portugal
| |
Collapse
|
31
|
The future of capsule endoscopy in clinical practice: from diagnostic to therapeutic experimental prototype capsules. GASTROENTEROLOGY REVIEW 2019; 15:179-193. [PMID: 33005262 PMCID: PMC7509905 DOI: 10.5114/pg.2019.87528] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/11/2019] [Accepted: 06/17/2019] [Indexed: 02/08/2023]
Abstract
Capsule endoscopy (CE) is indicated as a first-line clinical examination for the detection of small-bowel pathology, and there is an ever-growing drive for it to become a method for the screening of the entire gastrointestinal tract (GI). Although CE's main function is diagnosis, the research for therapeutic capabilities has intensified to make therapeutic capsule endoscopy (TCE) a target within reach. This manuscript presents the research evolution of CE and TCE through the last 5 years and describes notable problems, as well as clinical and technological challenges to overcome. This review also reports the state-of-the-art of capsule devices with a focus on CE research prototypes promising an enhanced diagnostic yield (DY) and treatment. Lastly, this article provides an overview of the research progress made in software for enhancing DY by increasing the accuracy of abnormality detection and lesion localisation.
Collapse
|
32
|
Cummins G, Cox BF, Ciuti G, Anbarasan T, Desmulliez MPY, Cochran S, Steele R, Plevris JN, Koulaouzidis A. Gastrointestinal diagnosis using non-white light imaging capsule endoscopy. Nat Rev Gastroenterol Hepatol 2019; 16:429-447. [PMID: 30988520 DOI: 10.1038/s41575-019-0140-z] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
Capsule endoscopy (CE) has proved to be a powerful tool in the diagnosis and management of small bowel disorders since its introduction in 2001. However, white light imaging (WLI) is the principal technology used in clinical CE at present, and therefore, CE is limited to mucosal inspection, with diagnosis remaining reliant on visible manifestations of disease. The introduction of WLI CE has motivated a wide range of research to improve its diagnostic capabilities through integration with other sensing modalities. These developments have the potential to overcome the limitations of WLI through enhanced detection of subtle mucosal microlesions and submucosal and/or transmural pathology, providing novel diagnostic avenues. Other research aims to utilize a range of sensors to measure physiological parameters or to discover new biomarkers to improve the sensitivity, specificity and thus the clinical utility of CE. This multidisciplinary Review summarizes research into non-WLI CE devices by organizing them into a taxonomic structure on the basis of their sensing modality. The potential of these capsules to realize clinically useful virtual biopsy and computer-aided diagnosis (CADx) is also reported.
Collapse
Affiliation(s)
- Gerard Cummins
- School of Engineering and Physical Sciences, Heriot-Watt University, Edinburgh, UK.
| | | | - Gastone Ciuti
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy
| | | | - Marc P Y Desmulliez
- School of Engineering and Physical Sciences, Heriot-Watt University, Edinburgh, UK
| | - Sandy Cochran
- School of Engineering, University of Glasgow, Glasgow, UK
| | - Robert Steele
- School of Medicine, University of Dundee, Dundee, UK
| | - John N Plevris
- Centre for Liver and Digestive Disorders, The Royal Infirmary of Edinburgh, Edinburgh, UK
| | | |
Collapse
|
33
|
On Structural Entropy and Spatial Filling Factor Analysis of Colonoscopy Pictures. ENTROPY 2019; 21:e21030256. [PMID: 33266971 PMCID: PMC7514738 DOI: 10.3390/e21030256] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Revised: 02/19/2019] [Accepted: 02/27/2019] [Indexed: 12/21/2022]
Abstract
Colonoscopy is the standard device for diagnosing colorectal cancer, which develops from little lesions on the bowel wall called polyps. The Rényi entropies-based structural entropy and spatial filling factor are two scale- and resolution-independent quantities that characterize the shape of a probability distribution with the help of characteristic curves of the structural entropy–spatial filling factor map. This alternative definition of structural entropy is easy to calculate, independent of the image resolution, and does not require the calculation of neighbor statistics, unlike the other graph-based structural entropies.The distant goal of this study was to help computer aided diagnosis in finding colorectal polyps by making the Rényi entropy based structural entropy more understood. The direct goal was to determine characteristic curves that can differentiate between polyps and other structure on the picture. After analyzing the distribution of colonoscopy picture color channels, the typical structures were modeled with simple geometrical functions and the structural entropy–spatial filling factor characteristic curves were determined for these model structures for various parameter sets. A colonoscopy image analying method, i.e., the line- or column-wise scanning of the picture, was also tested, with satisfactory matching of the characteristic curve and the image.
Collapse
|
34
|
Al-shebani Q, Premaratne P, McAndrew DJ, Vial PJ, Abey S. A frame reduction system based on a color structural similarity (CSS) method and Bayer images analysis for capsule endoscopy. Artif Intell Med 2019; 94:18-27. [DOI: 10.1016/j.artmed.2018.12.008] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Revised: 10/31/2018] [Accepted: 12/27/2018] [Indexed: 02/07/2023]
|
35
|
Vasilakakis M, Koulaouzidis A, Yung DE, Plevris JN, Toth E, Iakovidis DK. Follow-up on: optimizing lesion detection in small bowel capsule endoscopy and beyond: from present problems to future solutions. Expert Rev Gastroenterol Hepatol 2019; 13:129-141. [PMID: 30791780 DOI: 10.1080/17474124.2019.1553616] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
This review presents noteworthy advances in clinical and experimental Capsule Endoscopy (CE), focusing on the progress that has been reported over the last 5 years since our previous review on the subject. Areas covered: This study presents the commercially available CE platforms, as well as the advances made in optimizing the diagnostic capabilities of CE. The latter includes recent concept and prototype capsule endoscopes, medical approaches to improve diagnostic yield, and progress in software for enhancing visualization, abnormality detection, and lesion localization. Expert commentary: Currently, moving through the second decade of CE evolution, there are still several open issues and remarkable challenges to overcome.
Collapse
Affiliation(s)
- Michael Vasilakakis
- a Department of Computer Science and Biomedical Informatics , University of Thessaly , Lamia , Greece
| | - Anastasios Koulaouzidis
- b Endoscopy Unit , The Royal Infirmary of Edinburgh , Edinburgh , Scotland.,c Department of Clinical Sciences , Lund University , Malmö , Sweden
| | - Diana E Yung
- b Endoscopy Unit , The Royal Infirmary of Edinburgh , Edinburgh , Scotland
| | - John N Plevris
- b Endoscopy Unit , The Royal Infirmary of Edinburgh , Edinburgh , Scotland
| | - Ervin Toth
- c Department of Clinical Sciences , Lund University , Malmö , Sweden.,d Section of Gastroenterology, Department of Clinical Sciences , Skåne University Hospital Malmö , Malmö , Sweden
| | - Dimitris K Iakovidis
- a Department of Computer Science and Biomedical Informatics , University of Thessaly , Lamia , Greece
| |
Collapse
|
36
|
Yuan Y, Yao X, Han J, Guo L, Meng MQH. Discriminative Joint-Feature Topic Model With Dual Constraints for WCE Classification. IEEE TRANSACTIONS ON CYBERNETICS 2018; 48:2074-2085. [PMID: 28749365 DOI: 10.1109/tcyb.2017.2726818] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Wireless capsule endoscopy (WCE) enables clinicians to examine the digestive tract without any surgical operations, at the cost of a large amount of images to be analyzed. The main challenge for automatic computer-aided diagnosis arises from the difficulty of robust characterization of these images. To tackle this problem, a novel discriminative joint-feature topic model (DJTM) with dual constraints is proposed to classify multiple abnormalities in WCE images. We first propose a joint-feature probabilistic latent semantic analysis (PLSA) model, where color and texture descriptors extracted from same image patches are jointly modeled with their conditional distributions. Then the proposed dual constraints: visual words importance and local image manifold are embedded into the joint-feature PLSA model simultaneously to obtain discriminative latent semantic topics. The visual word importance is proposed in our DJTM to guarantee that visual words with similar importance come from close latent topics while the local image manifold constraint enforces that images within the same category share similar latent topics. Finally, each image is characterized by distribution of latent semantic topics instead of low level features. Our proposed DJTM showed an excellent overall recognition accuracy 90.78%. Comprehensive comparison results demonstrate that our method outperforms existing multiple abnormalities classification methods for WCE images.
Collapse
|
37
|
Formulation and statistical evaluation of an automated algorithm for locating small bowel tumours in wireless capsule endoscopy. Biocybern Biomed Eng 2018. [DOI: 10.1016/j.bbe.2018.07.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|