1
|
Carrara S, Andreozzi M, Terrin M, Spadaccini M. Role of Artificial Intelligence for Endoscopic Ultrasound. Gastrointest Endosc Clin N Am 2025; 35:407-418. [PMID: 40021237 DOI: 10.1016/j.giec.2024.10.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/03/2025]
Abstract
Endoscopic ultrasound (EUS) is widely used for the diagnosis of biliopancreatic and gastrointestinal tract diseases, but it is one of the most operator-dependent endoscopic techniques, requiring a long and complex learning curve. The role of artificial intelligence (AI) in EUS is growing as AI algorithms can assist in lesion detection and characterization by analyzing EUS images. Deep learning (DL) techniques, such as convolutional neural networks, have shown great potential for tumor identification; the application of AI models can increase the EUS diagnostic accuracy, provide faster diagnoses, and provide more information that can be helpful also for a training program.
Collapse
Affiliation(s)
- Silvia Carrara
- Gastroenterology Department, IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, Milan 20089, Italy; Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, Milan 20072, Italy.
| | - Marta Andreozzi
- Gastroenterology Department, IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, Milan 20089, Italy
| | - Maria Terrin
- Gastroenterology Department, IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, Milan 20089, Italy; Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, Milan 20072, Italy
| | - Marco Spadaccini
- Gastroenterology Department, IRCCS Humanitas Research Hospital, Via Manzoni 56, Rozzano, Milan 20089, Italy; Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, Milan 20072, Italy
| |
Collapse
|
2
|
Zhou H, Wei G, Wu J. Radiomics analysis for prediction and classification of submucosal tumors based on gastrointestinal endoscopic ultrasonography. DEN OPEN 2025; 5:e374. [PMID: 38715895 PMCID: PMC11075076 DOI: 10.1002/deo2.374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2024] [Revised: 04/07/2024] [Accepted: 04/08/2024] [Indexed: 01/25/2025]
Abstract
Objectives To identify and classify submucosal tumors by building and validating a radiomics model with gastrointestinal endoscopic ultrasonography (EUS) images. Methods A total of 144 patients diagnosed with submucosal tumors through gastrointestinal EUS were collected between January 2019 and October 2020. There are 1952 radiomic features extracted from each patient's EUS images. The statistical test and the customized least absolute shrinkage and selection operator regression were used for feature selection. Subsequently, an extremely randomized trees algorithm was utilized to construct a robust radiomics classification model specifically tailored for gastrointestinal EUS images. The performance of the model was measured by evaluating the area under the receiver operating characteristic curve. Results The radiomics model comprised 30 selected features that showed good discrimination performance in the validation cohorts. During validation, the area under the receiver operating characteristic curve was calculated as 0.9203 and the mean value after 10-fold cross-validation was 0.9260, indicating excellent stability and calibration. These results confirm the clinical utility of the model. Conclusions Utilizing the dataset provided curated from gastrointestinal EUS examinations at our collaborating hospital, we have developed a well-performing radiomics model. It can be used for personalized and non-invasive prediction of the type of submucosal tumors, providing physicians with aid for early treatment and management of tumor progression.
Collapse
Affiliation(s)
- Hui Zhou
- College of ScienceUniversity of Shanghai for Science and TechnologyShanghaiChina
| | - Guoliang Wei
- Business SchoolUniversity of Shanghai for Science and TechnologyShanghaiChina
| | - Junke Wu
- Business SchoolUniversity of Shanghai for Science and TechnologyShanghaiChina
| |
Collapse
|
3
|
Onishi S, Kuwahara T, Tajika M, Tanaka T, Yamada K, Shimizu M, Niwa Y, Yamaguchi R. Artificial intelligence for body composition assessment focusing on sarcopenia. Sci Rep 2025; 15:1324. [PMID: 39779762 PMCID: PMC11711400 DOI: 10.1038/s41598-024-83401-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Accepted: 12/13/2024] [Indexed: 01/11/2025] Open
Abstract
This study aimed to address the limitations of conventional methods for measuring skeletal muscle mass for sarcopenia diagnosis by introducing an artificial intelligence (AI) system for direct computed tomography (CT) analysis. The primary focus was on enhancing simplicity, reproducibility, and convenience, and assessing the accuracy and speed of AI compared with conventional methods. A cohort of 3096 cases undergoing CT imaging up to the third lumbar (L3) level between 2011 and 2021 were included. Random division into preprocessing and sarcopenia cohorts was performed, with further random splits into training and validation cohorts for BMI_AI and Body_AI creation. Sarcopenia_AI utilizes the Skeletal Muscle Index (SMI), which is calculated as (total skeletal muscle area at L3)/(height)2. The SMI was conventionally measured twice, with the first as the AI label reference and the second for comparison. Agreement and diagnostic change rates were calculated. Three groups were randomly assigned and 10 images before and after L3 were collected for each case. AI models for body region detection (Deeplabv3) and sarcopenia diagnosis (EfficientNetV2-XL) were trained on a supercomputer, and their abilities and speed per image were evaluated. The conventional method showed a low agreement rate (κ coefficient) of 0.478 for the test cohort and 0.236 for the validation cohort, with diagnostic changes in 43% of cases. Conversely, the AI consistently produced identical results after two measurements. The AI demonstrated robust body region detection ability (intersection over Union (IoU) = 0.93), accurately detecting only the body region in all images. The AI for sarcopenia diagnosis exhibited high accuracy, with a sensitivity of 82.3%, specificity of 98.1%, and a positive predictive value of 89.5%. In conclusion, the reproducibility of the conventional method for sarcopenia diagnosis was low. The developed sarcopenia diagnostic AI, with its high positive predictive value and convenient diagnostic capabilities, is a promising alternative for addressing the shortcomings of conventional approaches.
Collapse
Affiliation(s)
- Sachiyo Onishi
- Department of Endoscopy, Aichi Cancer Center, Nagoya, Aichi, Japan
| | - Takamichi Kuwahara
- Department of Gastroenterology, Aichi Cancer Center, 1-1 Kanokoden, Chikusa-ku, Nagoya, Aichi, 464-8681, Japan.
| | - Masahiro Tajika
- Department of Endoscopy, Aichi Cancer Center, Nagoya, Aichi, Japan
| | - Tsutomu Tanaka
- Department of Endoscopy, Aichi Cancer Center, Nagoya, Aichi, Japan
| | - Keisaku Yamada
- Department of Endoscopy, Aichi Cancer Center, Nagoya, Aichi, Japan
| | - Masahito Shimizu
- Department of Gastroenterology/Internal Medicine, Gifu University School of Medicine Graduate School of Medicine, Gifu, Gifu, Japan
| | - Yasumasa Niwa
- Department of Endoscopy, Aichi Cancer Center, Nagoya, Aichi, Japan
| | - Rui Yamaguchi
- Division of Cancer Systems Biology, Aichi Cancer Center Research Institute, Nagoya, Aichi, Japan
- Division of Cancer Informatics, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| |
Collapse
|
4
|
Lin CK, Wu SH, Chua YW, Fan HJ, Cheng YC. TransEBUS: The interpretation of endobronchial ultrasound image using hybrid transformer for differentiating malignant and benign mediastinal lesions. J Formos Med Assoc 2025; 124:28-37. [PMID: 38702216 DOI: 10.1016/j.jfma.2024.04.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 03/14/2024] [Accepted: 04/24/2024] [Indexed: 05/06/2024] Open
Abstract
The purpose of this study is to establish a deep learning automatic assistance diagnosis system for benign and malignant classification of mediastinal lesions in endobronchial ultrasound (EBUS) images. EBUS images are in the form of video and contain multiple imaging modes. Different imaging modes and different frames can reflect the different characteristics of lesions. Compared with previous studies, the proposed model can efficiently extract and integrate the spatiotemporal relationships between different modes and does not require manual selection of representative frames. In recent years, Vision Transformer has received much attention in the field of computer vision. Combined with convolutional neural networks, hybrid transformers can also perform well on small datasets. This study designed a novel deep learning architecture based on hybrid transformer called TransEBUS. By adding learnable parameters in the temporal dimension, TransEBUS was able to extract spatiotemporal features from insufficient data. In addition, we designed a two-stream module to integrate information from three different imaging modes of EBUS. Furthermore, we applied contrastive learning when training TransEBUS, enabling it to learn discriminative representation of benign and malignant mediastinal lesions. The results show that TransEBUS achieved a diagnostic accuracy of 82% and an area under the curve of 0.8812 in the test dataset, outperforming other methods. It also shows that several models can improve performance by incorporating two-stream module. Our proposed system has shown its potential to help physicians distinguishing benign and malignant mediastinal lesions, thereby ensuring the accuracy of EBUS examination.
Collapse
Affiliation(s)
- Ching-Kai Lin
- Department of Medicine, National Taiwan University Cancer Center, Taipei, Taiwan; Department of Internal Medicine, National Taiwan University Hospital Hsin-Chu Branch, Hsin-Chu, Taiwan; Department of Internal Medicine, National Taiwan University Hospital, Taipei, Taiwan; Department of Department of Mechanical Engineering, College of Engineering, National Yang Ming Chiao Tung University, Hsin-Chu, Taiwan
| | - Shao-Hua Wu
- Department of Department of Mechanical Engineering, College of Engineering, National Yang Ming Chiao Tung University, Hsin-Chu, Taiwan.
| | - Yi-Wei Chua
- Department of Department of Mechanical Engineering, College of Engineering, National Yang Ming Chiao Tung University, Hsin-Chu, Taiwan
| | - Hung-Jen Fan
- Department of Medicine, National Taiwan University Cancer Center, Taipei, Taiwan; Department of Internal Medicine, National Taiwan University Biomedical Park Hospital, Hsin-Chu County, 302, Taiwan
| | - Yun-Chien Cheng
- Department of Department of Mechanical Engineering, College of Engineering, National Yang Ming Chiao Tung University, Hsin-Chu, Taiwan.
| |
Collapse
|
5
|
Noort FVD, Borg FT, Guitink A, Faber J, Wolterink JM. Deep learning for segmentation of colorectal carcinomas on endoscopic ultrasound. Tech Coloproctol 2024; 29:20. [PMID: 39671056 DOI: 10.1007/s10151-024-03056-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 11/06/2024] [Indexed: 12/14/2024]
Abstract
BACKGROUND Bowel-preserving local resection of early rectal cancer is less successful if the tumor infiltrates the muscularis propria as opposed to submucosal infiltration only. Magnetic resonance imaging currently lacks the spatial resolution to provide a reliable estimation of the infiltration depth. Endoscopic ultrasound (EUS) has better resolution, but its interpretation is investigator dependent. We hypothesize that automated image segmentation of EUS could be a way to standardize EUS interpretation. METHODS EUS media and outcome data were collected prospectively. Based on 373 expert manual segmentations, a convolutional neural network was developed to perform segmentation of the submucosa, muscularis propria, and tumors. The mean surface distance (MSD), maximal distance between segmentations (Hausdorff distance; HDD), and overlap (Dice similarity index; DSI) were calculated. RESULTS The median MSD and HDD values were 3.2 and 17.7 pixels for the tumor, 3.4 and 24.7 pixels for the submucosa, and 2.6 and 20.0 pixels for the muscularis propria, respectively. The median DSI values for the tumor, submucosa, and muscularis propria were 0.82, 0.57, and 0.59, respectively. These values reflect good agreement between manual and deep learning segmentation. CONCLUSIONS This study found encouraging results of using automated analysis of EUS images of early rectal cancer, supporting further exploration in clinical practice.
Collapse
Affiliation(s)
- F van den Noort
- Department of Applied Mathematics, Technical Medical Center, University of Twente, Drienerlolaan 5, 7522 NB, Enschede, the Netherlands.
| | - F Ter Borg
- Department of Gastroenterology & Hepatology, Deventer Hospital, Deventer, the Netherlands
| | - A Guitink
- Department of Gastroenterology & Hepatology, Deventer Hospital, Deventer, the Netherlands
| | - J Faber
- Department of Epidemiology, Deventer Hospital, Deventer, the Netherlands
| | - J M Wolterink
- Department of Applied Mathematics, Technical Medical Center, University of Twente, Drienerlolaan 5, 7522 NB, Enschede, the Netherlands
| |
Collapse
|
6
|
Li J, Zhang P, Yang X, Zhu L, Wang T, Zhang P, Liu R, Sheng B, Wang K. SSM-Net: Semi-supervised multi-task network for joint lesion segmentation and classification from pancreatic EUS images. Artif Intell Med 2024; 154:102919. [PMID: 38941908 DOI: 10.1016/j.artmed.2024.102919] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Revised: 04/30/2024] [Accepted: 06/19/2024] [Indexed: 06/30/2024]
Abstract
Pancreatic cancer does not show specific symptoms, which makes the diagnosis of early stages difficult with established image-based screening methods and therefore has the worst prognosis among all cancers. Although endoscopic ultrasonography (EUS) has a key role in diagnostic algorithms for pancreatic diseases, B-mode imaging of the pancreas can be affected by confounders such as chronic pancreatitis, which can make both pancreatic lesion segmentation and classification laborious and highly specialized. To address these challenges, this work proposes a semi-supervised multi-task network (SSM-Net) to leverage unlabeled and labeled EUS images for joint pancreatic lesion classification and segmentation. Specifically, we first devise a saliency-aware representation learning module (SRLM) on a large number of unlabeled images to train a feature extraction encoder network for labeled images by computing a contrastive loss with a semantic saliency map, which is obtained by our spectral residual module (SRM). Moreover, for labeled EUS images, we devise channel attention blocks (CABs) to refine the features extracted from the pre-trained encoder on unlabeled images for segmenting lesions, and then devise a merged global attention module (MGAM) and a feature similarity loss (FSL) for obtaining a lesion classification result. We collect a large-scale EUS-based pancreas image dataset (LS-EUSPI) consisting of 9,555 pathologically proven labeled EUS images (499 patients from four categories) and 15,500 unlabeled EUS images. Experimental results on the LS-EUSPI dataset and a public thyroid gland lesion dataset show that our SSM-Net clearly outperforms state-of-the-art methods.
Collapse
Affiliation(s)
- Jiajia Li
- School of Chemistry and Chemical Engineering and National Center for Translational Medicine, Shanghai Jiao Tong University, Shanghai, China.
| | - Pingping Zhang
- Department of Gastroenterology, Changhai Hospital, Second Military Medical University/Naval Medical University, Shanghai 200433, China.
| | - Xia Yang
- Department of Gastroenterology, Shandong Provincial Hospital Affiliated to Shangdong First Medical University, Jinan, Shandong, 250021, China.
| | - Lei Zhu
- Hong Kong University of Science and Technology (Guangzhou), Nansha, Guangzhou, 511400, Guangdong, China; Hong Kong University of Science and Technology, Hong Kong Special Administrative Region, China.
| | - Teng Wang
- Department of Gastroenterology, Changhai Hospital, Second Military Medical University/Naval Medical University, Shanghai 200433, China.
| | - Ping Zhang
- Department of Computer Science and Engineering, Ohio State University, Columbus, OH 43210, USA; Department of Biomedical Informatics, Ohio State University, Columbus, OH 43210, USA.
| | - Ruhan Liu
- Furong Laboratory, Central South University, Changsha, Hunan, China; Department of Dermatology, Xiangya Hospital, Central South University, Changsha, Hunan, China.
| | - Bin Sheng
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China.
| | - Kaixuan Wang
- Department of Gastroenterology, Changhai Hospital, Second Military Medical University/Naval Medical University, Shanghai 200433, China.
| |
Collapse
|
7
|
Iwashita T, Uemura S, Ryuichi T, Senju A, Iwata S, Ohashi Y, Shimizu M. Advances and efficacy in specimen handling for endoscopic ultrasound-guided fine needle aspiration and biopsy: A comprehensive review. DEN OPEN 2024; 4:e350. [PMID: 38495467 PMCID: PMC10941515 DOI: 10.1002/deo2.350] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 02/19/2024] [Accepted: 02/23/2024] [Indexed: 03/19/2024]
Abstract
Endoscopic ultrasound-guided fine needle aspiration and biopsy have significantly evolved since they offer a minimally invasive approach for obtaining pathological specimens from lesions adjacent to or within the intestine. This paper reviews advancements in endoscopic ultrasound-guided fine needle aspiration and biopsy techniques and devices, emphasizing the importance of handling specimens for diagnostic accuracy. Innovations of fine needle biopsy needles with features like side holes and Franseen shapes have enhanced histological sampling capabilities. Techniques for specimen handling, including rapid on-site evaluation and macroscopic on-site evaluation, play pivotal roles in assessing sample adequacy, thereby influencing diagnostic outcomes. The utility of artificial intelligence in augmenting rapid on-site evaluation and macroscopic on-site evaluation, although still in experimental stages, presents a promising avenue for improving procedural efficiency and diagnostic precision. The choice of specimen handling technique is dependent on various factors including endoscopist preference, procedure objectives, and available resources, underscoring the need for a comprehensive understanding of each method's characteristics to optimize diagnostic efficacy and procedural safety.
Collapse
Affiliation(s)
- Takuji Iwashita
- First Department of Internal MedicineGifu University HospitalGifuJapan
| | - Shinya Uemura
- First Department of Internal MedicineGifu University HospitalGifuJapan
| | - Tezuka Ryuichi
- First Department of Internal MedicineGifu University HospitalGifuJapan
| | - Akihiko Senju
- First Department of Internal MedicineGifu University HospitalGifuJapan
| | - Shota Iwata
- First Department of Internal MedicineGifu University HospitalGifuJapan
| | - Yosuke Ohashi
- First Department of Internal MedicineGifu University HospitalGifuJapan
| | - Masahito Shimizu
- First Department of Internal MedicineGifu University HospitalGifuJapan
| |
Collapse
|
8
|
Kuwahara T, Hara K, Mizuno N, Haba S, Okuno N, Fukui T, Urata M, Yamamoto Y. Current status of artificial intelligence analysis for the treatment of pancreaticobiliary diseases using endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography. DEN OPEN 2024; 4:e267. [PMID: 37397344 PMCID: PMC10312781 DOI: 10.1002/deo2.267] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 06/18/2023] [Indexed: 07/04/2023]
Abstract
Pancreatic and biliary diseases encompass a range of conditions requiring accurate diagnosis for appropriate treatment strategies. This diagnosis relies heavily on imaging techniques like endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography. Artificial intelligence (AI), including machine learning and deep learning, is becoming integral in medical imaging and diagnostics, such as the detection of colorectal polyps. AI shows great potential in diagnosing pancreatobiliary diseases. Unlike machine learning, which requires feature extraction and selection, deep learning can utilize images directly as input. Accurate evaluation of AI performance is a complex task due to varied terminologies, evaluation methods, and development stages. Essential aspects of AI evaluation involve defining the AI's purpose, choosing appropriate gold standards, deciding on the validation phase, and selecting reliable validation methods. AI, particularly deep learning, is increasingly employed in endoscopic ultrasonography and endoscopic retrograde cholangiopancreatography diagnostics, achieving high accuracy levels in detecting and classifying various pancreatobiliary diseases. The AI often performs better than doctors, even in tasks like differentiating benign from malignant pancreatic tumors, cysts, and subepithelial lesions, identifying gallbladder lesions, assessing endoscopic retrograde cholangiopancreatography difficulty, and evaluating the biliary strictures. The potential for AI in diagnosing pancreatobiliary diseases, especially where other modalities have limitations, is considerable. However, a crucial constraint is the need for extensive, high-quality annotated data for AI training. Future advances in AI, such as large language models, promise further applications in the medical field.
Collapse
Affiliation(s)
| | - Kazuo Hara
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Nobumasa Mizuno
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Shin Haba
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Nozomi Okuno
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Toshitaka Fukui
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | - Minako Urata
- Department of GastroenterologyAichi Cancer Center HospitalAichiJapan
| | | |
Collapse
|
9
|
Li J, Zhang P, Wang T, Zhu L, Liu R, Yang X, Wang K, Shen D, Sheng B. DSMT-Net: Dual Self-Supervised Multi-Operator Transformation for Multi-Source Endoscopic Ultrasound Diagnosis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:64-75. [PMID: 37368810 DOI: 10.1109/tmi.2023.3289859] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/29/2023]
Abstract
Pancreatic cancer has the worst prognosis of all cancers. The clinical application of endoscopic ultrasound (EUS) for the assessment of pancreatic cancer risk and of deep learning for the classification of EUS images have been hindered by inter-grader variability and labeling capability. One of the key reasons for these difficulties is that EUS images are obtained from multiple sources with varying resolutions, effective regions, and interference signals, making the distribution of the data highly variable and negatively impacting the performance of deep learning models. Additionally, manual labeling of images is time-consuming and requires significant effort, leading to the desire to effectively utilize a large amount of unlabeled data for network training. To address these challenges, this study proposes the Dual Self-supervised Multi-Operator Transformation Network (DSMT-Net) for multi-source EUS diagnosis. The DSMT-Net includes a multi-operator transformation approach to standardize the extraction of regions of interest in EUS images and eliminate irrelevant pixels. Furthermore, a transformer-based dual self-supervised network is designed to integrate unlabeled EUS images for pre-training the representation model, which can be transferred to supervised tasks such as classification, detection, and segmentation. A large-scale EUS-based pancreas image dataset (LEPset) has been collected, including 3,500 pathologically proven labeled EUS images (from pancreatic and non-pancreatic cancers) and 8,000 unlabeled EUS images for model development. The self-supervised method has also been applied to breast cancer diagnosis and was compared to state-of-the-art deep learning models on both datasets. The results demonstrate that the DSMT-Net significantly improves the accuracy of pancreatic and breast cancer diagnosis.
Collapse
|
10
|
Hung O, Coonan T. Artificial intelligence versus the art of anesthesia: a long and winding road ahead. Can J Anaesth 2023; 70:1422-1424. [PMID: 37085659 DOI: 10.1007/s12630-023-02473-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 12/01/2022] [Accepted: 12/05/2022] [Indexed: 04/23/2023] Open
Affiliation(s)
- Orlando Hung
- Department of Anesthesia, Pain Management & Perioperative Medicine, Dalhousie University, Halifax, NS, Canada.
- Department of Surgery, Dalhousie University, Halifax, NS, Canada.
- Department of Pharmacology, Dalhousie University, Halifax, NS, Canada.
- Department of Anesthesia, Pain Management & Perioperative Medicine, Queen Elizabeth II Health Sciences Centre, Dalhousie University, 1276 South Park St., 10 North, Rm 275, Halifax, NS, B3H 2H8, Canada.
| | - Thomas Coonan
- Department of Anesthesia, Pain Management & Perioperative Medicine, Dalhousie University, Halifax, NS, Canada
- Department of Surgery, Dalhousie University, Halifax, NS, Canada
| |
Collapse
|
11
|
Yao L, Zhang C, Xu B, Yi S, Li J, Ding X, Yu H. A deep learning-based system for mediastinum station localization in linear EUS (with video). Endosc Ultrasound 2023; 12:417-423. [PMID: 37969169 PMCID: PMC10631614 DOI: 10.1097/eus.0000000000000011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Accepted: 04/12/2023] [Indexed: 11/17/2023] Open
Abstract
Background and Objectives EUS is a crucial diagnostic and therapeutic method for many anatomical regions, especially in the evaluation of mediastinal diseases and related pathologies. Rapidly finding the standard stations is the key to achieving efficient and complete mediastinal EUS imaging. However, it requires substantial technical skills and extensive knowledge of mediastinal anatomy. We constructed a system, named EUS-MPS (EUS-mediastinal position system), for real-time mediastinal EUS station recognition. Methods The standard scanning of mediastinum EUS was divided into 7 stations. There were 33 010 images in mediastinum EUS examination collected to construct a station classification model. Then, we used 151 videos clips for video validation and used 1212 EUS images from 2 other hospitals for external validation. An independent data set containing 230 EUS images was applied for the man-machine contest. We conducted a crossover study to evaluate the effectiveness of this system in reducing the difficulty of mediastinal ultrasound image interpretation. Results For station classification, the model achieved an accuracy of 90.49% in image validation and 83.80% in video validation. At external validation, the models achieved 89.85% accuracy. In the man-machine contest, the model achieved an accuracy of 84.78%, which was comparable to that of expert (83.91%). The accuracy of the trainees' station recognition was significantly improved in the crossover study, with an increase of 13.26% (95% confidence interval, 11.04%-15.48%; P < 0.05). Conclusions This deep learning-based system shows great performance in mediastinum station localization, having the potential to play an important role in shortening the learning curve and establishing standard mediastinal scanning in the future.
Collapse
Affiliation(s)
- Liwen Yao
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Chenxia Zhang
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| | - Bo Xu
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Shanshan Yi
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Juan Li
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Xiangwu Ding
- Department of Gastroenterology, Wuhan Fourth Hospital, Wuhan, Hubei Province, China
| | - Honggang Yu
- Department of Gastroenterology, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
- Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, Renmin Hospital of Wuhan University, Wuhan, Hubei Province, China
| |
Collapse
|
12
|
Huang J, Fan X, Liu W. Applications and Prospects of Artificial Intelligence-Assisted Endoscopic Ultrasound in Digestive System Diseases. Diagnostics (Basel) 2023; 13:2815. [PMID: 37685350 PMCID: PMC10487217 DOI: 10.3390/diagnostics13172815] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 08/22/2023] [Accepted: 08/27/2023] [Indexed: 09/10/2023] Open
Abstract
Endoscopic ultrasound (EUS) has emerged as a widely utilized tool in the diagnosis of digestive diseases. In recent years, the potential of artificial intelligence (AI) in healthcare has been gradually recognized, and its superiority in the field of EUS is becoming apparent. Machine learning (ML) and deep learning (DL) are the two main AI algorithms. This paper aims to outline the applications and prospects of artificial intelligence-assisted endoscopic ultrasound (EUS-AI) in digestive diseases over the past decade. The results demonstrated that EUS-AI has shown superiority or at least equivalence to traditional methods in the diagnosis, prognosis, and quality control of subepithelial lesions, early esophageal cancer, early gastric cancer, and pancreatic diseases including pancreatic cystic lesions, autoimmune pancreatitis, and pancreatic cancer. The implementation of EUS-AI has opened up new avenues for individualized precision medicine and has introduced novel diagnostic and treatment approaches for digestive diseases.
Collapse
Affiliation(s)
| | | | - Wentian Liu
- Department of Gastroenterology and Hepatology, Tianjin Medical University General Hospital, No. 154, Anshan Road, Heping District, Tianjin 300052, China; (J.H.); (X.F.)
| |
Collapse
|
13
|
Khalaf K, Terrin M, Jovani M, Rizkala T, Spadaccini M, Pawlak KM, Colombo M, Andreozzi M, Fugazza A, Facciorusso A, Grizzi F, Hassan C, Repici A, Carrara S. A Comprehensive Guide to Artificial Intelligence in Endoscopic Ultrasound. J Clin Med 2023; 12:jcm12113757. [PMID: 37297953 DOI: 10.3390/jcm12113757] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Revised: 05/28/2023] [Accepted: 05/29/2023] [Indexed: 06/12/2023] Open
Abstract
BACKGROUND Endoscopic Ultrasound (EUS) is widely used for the diagnosis of bilio-pancreatic and gastrointestinal (GI) tract diseases, for the evaluation of subepithelial lesions, and for sampling of lymph nodes and solid masses located next to the GI tract. The role of Artificial Intelligence in healthcare in growing. This review aimed to provide an overview of the current state of AI in EUS from imaging to pathological diagnosis and training. METHODS AI algorithms can assist in lesion detection and characterization in EUS by analyzing EUS images and identifying suspicious areas that may require further clinical evaluation or biopsy sampling. Deep learning techniques, such as convolutional neural networks (CNNs), have shown great potential for tumor identification and subepithelial lesion (SEL) evaluation by extracting important features from EUS images and using them to classify or segment the images. RESULTS AI models with new features can increase the accuracy of diagnoses, provide faster diagnoses, identify subtle differences in disease presentation that may be missed by human eyes, and provide more information and insights into disease pathology. CONCLUSIONS The integration of AI in EUS images and biopsies has the potential to improve the diagnostic accuracy, leading to better patient outcomes and to a reduction in repeated procedures in case of non-diagnostic biopsies.
Collapse
Affiliation(s)
- Kareem Khalaf
- Division of Gastroenterology, St. Michael's Hospital, University of Toronto, Toronto, ON M5S 1A1, Canada
| | - Maria Terrin
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
| | - Manol Jovani
- Division of Gastroenterology, Maimonides Medical Center, SUNY Downstate University, Brooklyn, NY 11219, USA
| | - Tommy Rizkala
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, 20089 Milan, Italy
| | - Marco Spadaccini
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
| | - Katarzyna M Pawlak
- Division of Gastroenterology, St. Michael's Hospital, University of Toronto, Toronto, ON M5S 1A1, Canada
| | - Matteo Colombo
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
| | - Marta Andreozzi
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
| | - Alessandro Fugazza
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
| | - Antonio Facciorusso
- Section of Gastroenterology, Department of Medical and Surgical Sciences, University of Foggia, 71122 Foggia, Italy
| | - Fabio Grizzi
- Department of Immunology and Inflammation, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
| | - Cesare Hassan
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, 20089 Milan, Italy
| | - Alessandro Repici
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
- Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, 20089 Milan, Italy
| | - Silvia Carrara
- Division of Gastroenterology and Digestive Endoscopy, Humanitas Research Hospital IRCCS, Rozzano, 20089 Milan, Italy
| |
Collapse
|
14
|
Poiraud M, Gkolfakis P, Arvanitakis M. Recent Developments in the Field of Endoscopic Ultrasound for Diagnosis, Staging, and Treatment of Pancreatic Lesions. Cancers (Basel) 2023; 15:cancers15092547. [PMID: 37174012 PMCID: PMC10177103 DOI: 10.3390/cancers15092547] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 04/25/2023] [Accepted: 04/26/2023] [Indexed: 05/15/2023] Open
Abstract
Endoscopic ultrasound (EUS) plays a crucial role in the diagnosis of both solid and cystic pancreatic lesions and in the staging of patients with pancreatic cancer through its use for tissue and fluid sampling. Additionally, in cases of precancerous lesions, EUS-guided therapy can also be provided. This review aims to describe the most recent developments regarding the role of EUS in the diagnosis and staging of pancreatic lesions. Moreover, complementary EUS imaging modalities, the role of artificial intelligence, new devices, and modalities for tissue acquisition, and techniques for EUS-guided treatment are discussed.
Collapse
Affiliation(s)
- Marie Poiraud
- Department of Gastroenterology, CUB Erasme Hospital, Université Libre de Bruxelles, 1070 Brussels, Belgium
| | - Paraskevas Gkolfakis
- Department of Gastroenterology, CUB Erasme Hospital, Université Libre de Bruxelles, 1070 Brussels, Belgium
| | - Marianna Arvanitakis
- Department of Gastroenterology, CUB Erasme Hospital, Université Libre de Bruxelles, 1070 Brussels, Belgium
| |
Collapse
|
15
|
Kuwahara T, Hara K, Mizuno N, Haba S, Okuno N, Kuraishi Y, Fumihara D, Yanaidani T, Ishikawa S, Yasuda T, Yamada M, Onishi S, Yamada K, Tanaka T, Tajika M, Niwa Y, Yamaguchi R, Shimizu Y. Artificial intelligence using deep learning analysis of endoscopic ultrasonography images for the differential diagnosis of pancreatic masses. Endoscopy 2023; 55:140-149. [PMID: 35688454 DOI: 10.1055/a-1873-7920] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
BACKGROUND : There are several types of pancreatic mass, so it is important to distinguish between them before treatment. Artificial intelligence (AI) is a mathematical technique that automates learning and recognition of data patterns. This study aimed to investigate the efficacy of our AI model using endoscopic ultrasonography (EUS) images of multiple types of pancreatic mass (pancreatic ductal adenocarcinoma [PDAC], pancreatic adenosquamous carcinoma [PASC], acinar cell carcinoma [ACC], metastatic pancreatic tumor [MPT], neuroendocrine carcinoma [NEC], neuroendocrine tumor [NET], solid pseudopapillary neoplasm [SPN], chronic pancreatitis, and autoimmune pancreatitis [AIP]). METHODS : Patients who underwent EUS were included in this retrospective study. The included patients were divided into training, validation, and test cohorts. Using these cohorts, an AI model that can distinguish pancreatic carcinomas from noncarcinomatous pancreatic lesions was developed using a deep-learning architecture and the diagnostic performance of the AI model was evaluated. RESULTS : 22 000 images were generated from 933 patients. The area under the curve, sensitivity, specificity, and accuracy (95 %CI) of the AI model for the diagnosis of pancreatic carcinomas in the test cohort were 0.90 (0.84-0.97), 0.94 (0.88-0.98), 0.82 (0.68-0.92), and 0.91 (0.85-0.95), respectively. The per-category sensitivities (95 %CI) of each disease were PDAC 0.96 (0.90-0.99), PASC 1.00 (0.05-1.00), ACC 1.00 (0.22-1.00), MPT 0.33 (0.01-0.91), NEC 1.00 (0.22-1.00), NET 0.93 (0.66-1.00), SPN 1.00 (0.22-1.00), chronic pancreatitis 0.78 (0.52-0.94), and AIP 0.73 (0.39-0.94). CONCLUSIONS : Our developed AI model can distinguish pancreatic carcinomas from noncarcinomatous pancreatic lesions, but external validation is needed.
Collapse
Affiliation(s)
- Takamichi Kuwahara
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Kazuo Hara
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Nobumasa Mizuno
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Shin Haba
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Nozomi Okuno
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Yasuhiro Kuraishi
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Daiki Fumihara
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Takafumi Yanaidani
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Sho Ishikawa
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Tsukasa Yasuda
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Masanori Yamada
- Department of Gastroenterology, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Sachiyo Onishi
- Department of Endoscopy, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Keisaku Yamada
- Department of Endoscopy, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Tsutomu Tanaka
- Department of Endoscopy, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Masahiro Tajika
- Department of Endoscopy, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Yasumasa Niwa
- Department of Endoscopy, Aichi Cancer Center Hospital, Nagoya, Japan
| | - Rui Yamaguchi
- Division of Cancer Systems Biology, Aichi Cancer Center Research Institute, Nagoya, Japan
- Division of Cancer Informatics, Nagoya University Graduate School of Medicine, Nagoya, Japan
| | - Yasuhiro Shimizu
- Department of Gastroenterological Surgery, Aichi Cancer Center Hospital, Nagoya, Japan
| |
Collapse
|
16
|
Isayama H. Make the entrance wider and the depth deeper. Endoscopy 2023; 55:12-13. [PMID: 36162424 DOI: 10.1055/a-1929-1564] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Affiliation(s)
- Hiroyuki Isayama
- Department of Gastroenterology, Graduate School of Medicine, Juntendo University, Tokyo, Japan
| |
Collapse
|
17
|
Lu Y, Zhuo X, Zhong Q, Sun J, Li C, Zhi M. Endoscopic ultrasonography is useful for predicting perforation in the endoscopic resection of gastric submucosal tumors originating from the muscularis propria: a retrospective case-control study. Ultrasonography 2023; 42:78-88. [PMID: 36458370 PMCID: PMC9816697 DOI: 10.14366/usg.21265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Accepted: 07/17/2022] [Indexed: 01/13/2023] Open
Abstract
PURPOSE Models for predicting perforation during endoscopic resection (ER) of gastric submucosal tumors (SMTs) originating from the muscularis propria (MP) are rare. Therefore, this study was conducted to determine important parameters in endoscopic ultrasonography (EUS) images to predict perforation and to build predictive models. METHODS Consecutive patients with gastric SMTs originating from the MP who received ER from May 1, 2013 to January 15, 2021 were retrospectively reviewed. They were classified into case and control groups based on the presence of perforation. Logistic multivariate analysis was used to identify potential variables and build predictive models (models 1 and 2: with and without information on tumor pathology, respectively). RESULTS In total, 199 EUS procedures (194 patients) were finally chosen, with 99 procedures in the case group and 100 in the control group. The ratio of the inner distance to the outer distance (I/O ratio) was significantly larger in the case group than in the control group (median ratio, 2.20 vs. 1.53; P<0.001). Multivariate analysis showed that age (odds ratio [OR], 1.036 in model 1; OR, 1.046 in model 2), the I/O ratio (OR, 2.731 in model 1; OR, 2.372 in model 2), and the pathology of the tumors (OR, 10.977 for gastrointestinal stromal tumors; OR, 15.051 for others in model 1) were risk factors for perforation. The two models to predict perforation had areas under the curve of 0.836 (model 1) and 0.755 (model 2). CONCLUSION EUS was useful in predicting perforation in ER for gastric SMTs originating from the MP. Two predictive models were developed.
Collapse
Affiliation(s)
- Yi Lu
- Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Xianhua Zhuo
- Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Department of Otolaryngology, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Qinghua Zhong
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Department of Endoscopic Surgery, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Jiachen Sun
- Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Chujun Li
- Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Correspondence to: Chujun Li, MD, Department of Gastrointestinal Endoscopy, The Sixth Affiliated Hospital, Sun Yat-sen University and Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, 26 Yuancun Erheng Road, Guangzhou 510655, China Tel. +86-2038254116 Fax. +86-2038254116 E-mail:
| | - Min Zhi
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China,Department of Gastroenterology, The Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
18
|
Seo K, Lim JH, Seo J, Nguon LS, Yoon H, Park JS, Park S. Semantic Segmentation of Pancreatic Cancer in Endoscopic Ultrasound Images Using Deep Learning Approach. Cancers (Basel) 2022; 14:5111. [PMID: 36291895 PMCID: PMC9600976 DOI: 10.3390/cancers14205111] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 10/12/2022] [Accepted: 10/18/2022] [Indexed: 11/17/2022] Open
Abstract
Endoscopic ultrasonography (EUS) plays an important role in diagnosing pancreatic cancer. Surgical therapy is critical to pancreatic cancer survival and can be planned properly, with the characteristics of the target cancer determined. The physical characteristics of the pancreatic cancer, such as size, location, and shape, can be determined by semantic segmentation of EUS images. This study proposes a deep learning approach for the segmentation of pancreatic cancer in EUS images. EUS images were acquired from 150 patients diagnosed with pancreatic cancer. A network with deep attention features (DAF-Net) is proposed for pancreatic cancer segmentation using EUS images. The performance of the deep learning models (U-Net, Attention U-Net, and DAF-Net) was evaluated by 5-fold cross-validation. For the evaluation metrics, the Dice similarity coefficient (DSC), intersection over union (IoU), receiver operating characteristic (ROC) curve, and area under the curve (AUC) were chosen. Statistical analysis was performed for different stages and locations of the cancer. DAF-Net demonstrated superior segmentation performance for the DSC, IoU, AUC, sensitivity, specificity, and precision with scores of 82.8%, 72.3%, 92.7%, 89.0%, 98.1%, and 85.1%, respectively. The proposed deep learning approach can provide accurate segmentation of pancreatic cancer in EUS images and can effectively assist in the planning of surgical therapies.
Collapse
Affiliation(s)
- Kangwon Seo
- Department of Electrical and Electronics Engineering, Chung-Ang University, Seoul 06974, Korea
| | - Jung-Hyun Lim
- Division of Gastroenterology, Department of Internal Medicine, Inha University School of Medicine, Incheon 22332, Korea
| | - Jeongwung Seo
- Department of Electrical and Electronics Engineering, Chung-Ang University, Seoul 06974, Korea
| | - Leang Sim Nguon
- Department of Electronic and Electrical Engineering, Ewha Womans University, Seoul 03760, Korea
| | - Hongeun Yoon
- Department of Electronic and Electrical Engineering, Ewha Womans University, Seoul 03760, Korea
| | - Jin-Seok Park
- Division of Gastroenterology, Department of Internal Medicine, Inha University School of Medicine, Incheon 22332, Korea
| | - Suhyun Park
- Department of Electronic and Electrical Engineering, Ewha Womans University, Seoul 03760, Korea
| |
Collapse
|
19
|
Vilas-Boas F, Ribeiro T, Afonso J, Cardoso H, Lopes S, Moutinho-Ribeiro P, Ferreira J, Mascarenhas-Saraiva M, Macedo G. Deep Learning for Automatic Differentiation of Mucinous versus Non-Mucinous Pancreatic Cystic Lesions: A Pilot Study. Diagnostics (Basel) 2022; 12:diagnostics12092041. [PMID: 36140443 PMCID: PMC9498252 DOI: 10.3390/diagnostics12092041] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Revised: 08/20/2022] [Accepted: 08/22/2022] [Indexed: 12/12/2022] Open
Abstract
Endoscopic ultrasound (EUS) morphology can aid in the discrimination between mucinous and non-mucinous pancreatic cystic lesions (PCLs) but has several limitations that can be overcome by artificial intelligence. We developed a convolutional neural network (CNN) algorithm for the automatic diagnosis of mucinous PCLs. Images retrieved from videos of EUS examinations for PCL characterization were used for the development, training, and validation of a CNN for mucinous cyst diagnosis. The performance of the CNN was measured calculating the area under the receiving operator characteristic curve (AUC), sensitivity, specificity, and positive and negative predictive values. A total of 5505 images from 28 pancreatic cysts were used (3725 from mucinous lesions and 1780 from non-mucinous cysts). The model had an overall accuracy of 98.5%, sensitivity of 98.3%, specificity of 98.9% and AUC of 1. The image processing speed of the CNN was 7.2 ms per frame. We developed a deep learning algorithm that differentiated mucinous and non-mucinous cysts with high accuracy. The present CNN may constitute an important tool to help risk stratify PCLs.
Collapse
Affiliation(s)
- Filipe Vilas-Boas
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Tiago Ribeiro
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
| | - João Afonso
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
| | - Hélder Cardoso
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Susana Lopes
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - Pedro Moutinho-Ribeiro
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering of the University of Porto, Rua Dr. Roberto Frias, 4200-465 Porto, Portugal
- INEGI—Institute of Science and Innovation in Mechanical and Industrial Engineering, Rua Dr. Roberto Frias, 4200-465 Porto, Portugal
| | - Miguel Mascarenhas-Saraiva
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Correspondence:
| | - Guilherme Macedo
- Department of Gastroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- World Gastroenterology Organisation Gastroenterology and Hepatology Training Center, 4200-427 Porto, Portugal
- Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
| |
Collapse
|
20
|
Spadaccini M, Koleth G, Emmanuel J, Khalaf K, Facciorusso A, Grizzi F, Hassan C, Colombo M, Mangiavillano B, Fugazza A, Anderloni A, Carrara S, Repici A. Enhanced endoscopic ultrasound imaging for pancreatic lesions: The road to artificial intelligence. World J Gastroenterol 2022; 28:3814-3824. [PMID: 36157539 PMCID: PMC9367228 DOI: 10.3748/wjg.v28.i29.3814] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 06/07/2022] [Accepted: 07/06/2022] [Indexed: 02/06/2023] Open
Abstract
Early detection of pancreatic cancer has long eluded clinicians because of its insidious nature and onset. Often metastatic or locally invasive when symptomatic, most patients are deemed inoperable. In those who are symptomatic, multi-modal imaging modalities evaluate and confirm pancreatic ductal adenocarcinoma. In asymptomatic patients, detected pancreatic lesions can be either solid or cystic. The clinical implications of identifying small asymptomatic solid pancreatic lesions (SPLs) of < 2 cm are tantamount to a better outcome. The accurate detection of SPLs undoubtedly promotes higher life expectancy when resected early, driving the development of existing imaging tools while promoting more comprehensive screening programs. An imaging tool that has matured in its reiterations and received many image-enhancing adjuncts is endoscopic ultrasound (EUS). It carries significant importance when risk stratifying cystic lesions and has substantial diagnostic value when combined with fine needle aspiration/biopsy (FNA/FNB). Adjuncts to EUS imaging include contrast-enhanced harmonic EUS and EUS-elastography, both having improved the specificity of FNA and FNB. This review intends to compile all existing enhancement modalities and explore ongoing research around the most promising of all adjuncts in the field of EUS imaging, artificial intelligence.
Collapse
Affiliation(s)
- Marco Spadaccini
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - Glenn Koleth
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - James Emmanuel
- Department of Gastroenterology and Hepatology, Queen Elizabeth, Kota Kinabalu 88200, Sabah, Malaysia
| | - Kareem Khalaf
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - Antonio Facciorusso
- Section of Gastroenterology, Department of Medical Sciences, University of Foggia, Foggia 71122, Italy
| | - Fabio Grizzi
- Department of Immunology and Inflammation, Humanitas Clinical and Research Hospital, Rozzano 20089, Italy
| | - Cesare Hassan
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - Matteo Colombo
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - Benedetto Mangiavillano
- Digestive Endoscopy Unit, Division of Gasteroenterology, Humanitas Mater Domini, Castellanza 21053, Italy
| | - Alessandro Fugazza
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - Andrea Anderloni
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - Silvia Carrara
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| | - Alessandro Repici
- Digestive Endoscopy Unit, Division of Gastroenterology, Humanitas Research Hospital and University, Milan 20800, Italy
| |
Collapse
|
21
|
Ruano J, Jaramillo M, Gómez M, Romero E. Robust Descriptor of Pancreatic Tissue for Automatic Detection of Pancreatic Cancer in Endoscopic Ultrasonography. ULTRASOUND IN MEDICINE & BIOLOGY 2022; 48:1602-1614. [PMID: 35613973 DOI: 10.1016/j.ultrasmedbio.2022.04.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 04/06/2022] [Accepted: 04/10/2022] [Indexed: 06/15/2023]
Abstract
Pancreatic cancer (PC) has a reported mortality of 98% and a 5-y survival rate of 6.7%. Experienced gastroenterologists detect 80% of those with early-stage PC by endoscopic ultrasonography (EUS). Here we propose an automatic second reader strategy to detect PC in an entire EUS procedure, rather than focusing on pre-selected frames, as the state-of-the-art methods do. The method unmasks echo tumoral patterns in frames with a high probability of tumor. First, speeded up robust features define a set of interest points with correlated heterogeneities among different filtering scales. Afterward, intensity gradients of each interest point are summarized by 64 features at certain locations and scales. A frame feature vector is built by concatenating statistics of each feature of the 15 groups of scales. Then, binary classification is performed by Support Vector Machine and Adaboost models. Evaluation was performed using a data set comprising 55 participants, 18 of PC class (16,585 frames) and 37 subjects of non-PC class (49,664 frames), randomly splitting 10 times. The proposed method reached an accuracy of 92.1%, sensitivity of 96.3% and specificity of 87.8.3%. The observed results are also stable in noisy experiments while deep learning approaches fail to maintain similar performance.
Collapse
Affiliation(s)
- Josué Ruano
- Computer Imaging and Medical Applications Laboratory, Universidad Nacional de Colombia, Bogotá, Colombia
| | - María Jaramillo
- Computer Imaging and Medical Applications Laboratory, Universidad Nacional de Colombia, Bogotá, Colombia
| | - Martín Gómez
- Medicina Interna, Universidad Nacional de Colombia, Bogotá, Colombia
| | - Eduardo Romero
- Computer Imaging and Medical Applications Laboratory, Universidad Nacional de Colombia, Bogotá, Colombia.
| |
Collapse
|
22
|
Tanaka H, Kamata K, Ishihara R, Handa H, Otsuka Y, Yoshida A, Yoshikawa T, Ishikawa R, Okamoto A, Yamazaki T, Nakai A, Omoto S, Minaga K, Yamao K, Takenaka M, Watanabe T, Nishida N, Kudo M. Value of artificial intelligence with novel tumor tracking technology in the diagnosis of gastric submucosal tumors by contrast-enhanced harmonic endoscopic ultrasonography. J Gastroenterol Hepatol 2022; 37:841-846. [PMID: 35043456 DOI: 10.1111/jgh.15780] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 12/01/2021] [Accepted: 01/12/2022] [Indexed: 12/13/2022]
Abstract
BACKGROUND AND AIM Contrast-enhanced harmonic endoscopic ultrasonography (CH-EUS) is useful for the diagnosis of lesions inside and outside the digestive tract. This study evaluated the value of artificial intelligence (AI) in the diagnosis of gastric submucosal tumors by CH-EUS. METHODS This retrospective study included 53 patients with gastrointestinal stromal tumors (GISTs) and leiomyomas, all of whom underwent CH-EUS between June 2015 and February 2020. A novel technology, SiamMask, was used to track and trim the lesions in CH-EUS videos. CH-EUS was evaluated by AI using deep learning involving a residual neural network and leave-one-out cross-validation. The diagnostic accuracy of AI in discriminating between GISTs and leiomyomas was assessed and compared with that of blind reading by two expert endosonographers. RESULTS Of the 53 patients, 42 had GISTs and 11 had leiomyomas. Mean tumor size was 26.4 mm. The consistency rate of the segment range of the tumor image extracted by SiamMask and marked by the endosonographer was 96% with a Dice coefficient. The sensitivity, specificity, and accuracy of AI in diagnosing GIST were 90.5%, 90.9%, and 90.6%, respectively, whereas those of blind reading were 90.5%, 81.8%, and 88.7%, respectively (P = 0.683). The κ coefficient between the two reviewers was 0.713. CONCLUSIONS The diagnostic ability of CH-EUS results evaluated by AI to distinguish between GISTs and leiomyomas was comparable with that of blind reading by expert endosonographers.
Collapse
Affiliation(s)
- Hidekazu Tanaka
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Ken Kamata
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Rika Ishihara
- Department of Informatics, Kindai University, Osaka, Japan
| | - Hisashi Handa
- Department of Informatics, Kindai University, Osaka, Japan.,Cyber Informatics Research Institute, Kindai University, Osaka, Japan.,Research Institute of Science and Technology, Kindai University, Osaka, Japan
| | - Yasuo Otsuka
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Akihiro Yoshida
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Tomoe Yoshikawa
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Rei Ishikawa
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Ayana Okamoto
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Tomohiro Yamazaki
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Atsushi Nakai
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Shunsuke Omoto
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Kosuke Minaga
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Kentaro Yamao
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Mamoru Takenaka
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Tomohiro Watanabe
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Naoshi Nishida
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| | - Masatoshi Kudo
- Department of Gastroenterology and Hepatology, Kindai University Hospital, Osaka, Japan
| |
Collapse
|
23
|
Fujimori N, Minoda Y, Ogawa Y. What is the best modality for diagnosing pancreatic cancer? Dig Endosc 2022; 34:744-746. [PMID: 35318739 DOI: 10.1111/den.14283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
This Editorial refers to the article by S. Omoto et al., p 198‐206 of this issue DEN 34:1.
Collapse
Affiliation(s)
- Nao Fujimori
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Yosuke Minoda
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
- Department of Endoscopic Diagnostics and Therapeutics, Kyushu University Hospital, Fukuoka, Japan
| | - Yoshihiro Ogawa
- Department of Medicine and Bioregulatory Science, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| |
Collapse
|
24
|
Dlamini Z, Skepu A, Kim N, Mkhabele M, Khanyile R, Molefi T, Mbatha S, Setlai B, Mulaudzi T, Mabongo M, Bida M, Kgoebane-Maseko M, Mathabe K, Lockhat Z, Kgokolo M, Chauke-Malinga N, Ramagaga S, Hull R. AI and precision oncology in clinical cancer genomics: From prevention to targeted cancer therapies-an outcomes based patient care. INFORMATICS IN MEDICINE UNLOCKED 2022. [DOI: 10.1016/j.imu.2022.100965] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022] Open
|
25
|
Simsek C, Lee LS. Machine learning in endoscopic ultrasonography and the pancreas: The new frontier? Artif Intell Gastroenterol 2022; 3:54-65. [DOI: 10.35712/aig.v3.i2.54] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 03/28/2022] [Accepted: 04/19/2022] [Indexed: 02/06/2023] Open
Abstract
Pancreatic diseases have a substantial burden on society which is predicted to increase further over the next decades. Endoscopic ultrasonography (EUS) remains the best available diagnostic method to assess the pancreas, however, there remains room for improvement. Artificial intelligence (AI) approaches have been adopted to assess pancreatic diseases for over a decade, but this methodology has recently reached a new era with the innovative machine learning algorithms which can process, recognize, and label endosonographic images. Our review provides a targeted summary of AI in EUS for pancreatic diseases. Included studies cover a wide spectrum of pancreatic diseases from pancreatic cystic lesions to pancreatic masses and diagnosis of pancreatic cancer, chronic pancreatitis, and autoimmune pancreatitis. For these, AI models seemed highly successful, although the results should be evaluated carefully as the tasks, datasets and models were greatly heterogenous. In addition to use in diagnostics, AI was also tested as a procedural real-time assistant for EUS-guided biopsy as well as recognition of standard pancreatic stations and labeling anatomical landmarks during routine examination. Studies thus far have suggested that the adoption of AI in pancreatic EUS is highly promising and further opportunities should be explored in the field.
Collapse
Affiliation(s)
- Cem Simsek
- Department of Gastroenterology, Hepatology and Endoscopy, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02215, United States
| | - Linda S Lee
- Division of Gastroenterology, Hepatology and Endoscopy, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02115, United States
| |
Collapse
|
26
|
Mohan BP, Facciorusso A, Khan SR, Madhu D, Kassab LL, Ponnada S, Chandan S, Crino SF, Kochhar GS, Adler DG, Wallace MB. Pooled diagnostic parameters of artificial intelligence in EUS image analysis of the pancreas: A descriptive quantitative review. Endosc Ultrasound 2022; 11:156-169. [PMID: 35313417 PMCID: PMC9258019 DOI: 10.4103/eus-d-21-00063] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022] Open
Abstract
EUS is an important diagnostic tool in pancreatic lesions. Performance of single-center and/or single study artificial intelligence (AI) in the analysis of EUS-images of pancreatic lesions has been reported. The aim of this study was to quantitatively study the pooled rates of diagnostic performance of AI in EUS image analysis of pancreas using rigorous systematic review and meta-analysis methodology. Multiple databases were searched (from inception to December 2020) and studies that reported on the performance of AI in EUS analysis of pancreatic adenocarcinoma were selected. The random-effects model was used to calculate the pooled rates. In cases where multiple 2 × 2 contingency tables were provided for different thresholds, we assumed the data tables as independent from each other. Heterogeneity was assessed by I2% and 95% prediction intervals. Eleven studies were analyzed. The pooled overall accuracy, sensitivity, specificity, positive predictive value, and negative predictive value were 86% (95% confidence interval [82.8–88.6]), 90.4% (88.1–92.3), 84% (79.3–87.8), 90.2% (87.4–92.3) and 89.8% (86–92.7), respectively. On subgroup analysis, the corresponding pooled parameters in studies that used neural networks were 85.5% (80–89.8), 91.8% (87.8–94.6), 84.6% (73–91.7), 87.4% (82–91.3), and 91.4% (83.7–95.6)], respectively. Based on our meta-analysis, AI seems to perform well in the EUS-image analysis of pancreatic lesions.
Collapse
Affiliation(s)
- Babu P Mohan
- Department of Gastroenterology and Hepatology, University of Utah, Salt Lake City, Utah, USA
| | | | - Shahab R Khan
- Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Deepak Madhu
- Department of Gastroenterology, Aster MIMS, Calicut, Kerala, India
| | - Lena L Kassab
- Department of Internal Medicine, Mayo Clinic, Rochester, Minnesota, USA
| | - Suresh Ponnada
- Department of Internal Medicine, Roanoke Medical Center, Roanoke, Virginia, USA
| | - Saurabh Chandan
- Department of Gastroenterology, CHI Creighton University Medical Center, Omaha, NE, USA
| | - Stefano F Crino
- Gastroenterology and Digestive Endoscopy Unit, The Pancreas Institute, G. B. Rossi University Hospital, Verona, Italy
| | - Gursimran S Kochhar
- Department of Gastroenterology and Hepatology, Allegheny Health Network, Pittsburgh, PA, USA
| | - Douglas G Adler
- Department of Gastroenterology and Hepatology, University of Utah, Salt Lake City, Utah, USA
| | - Michael B Wallace
- Department of Gastroenterology and Hepatology, Sheikh Shahkbout Medical City, Abu Dhabi, UAE
| |
Collapse
|
27
|
Salom F, Prat F. Current role of endoscopic ultrasound in the diagnosis and management of pancreatic cancer. World J Gastrointest Endosc 2022; 14:35-48. [PMID: 35116098 PMCID: PMC8788172 DOI: 10.4253/wjge.v14.i1.35] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Revised: 07/03/2021] [Accepted: 12/23/2021] [Indexed: 02/06/2023] Open
Abstract
Endoscopic ultrasound (EUS) has emerged as an invaluable tool for the diagnosis, staging and treatment of pancreatic ductal adenocarcinoma (PDAC). EUS is currently the most sensitive imaging tool for the detection of solid pancreatic tumors. Conventional EUS has evolved, and new imaging techniques, such as contrast-enhanced harmonics and elastography, have been developed to improve diagnostic accuracy during the evaluation of focal pancreatic lesions. More recently, evaluation with artificial intelligence has shown promising results to overcome operator-related flaws during EUS imaging evaluation. Currently, an appropriate diagnosis is based on a proper histological assessment, and EUS-guided tissue acquisition is the standard procedure for pancreatic sampling. Newly developed cutting needles with core tissue procurement provide the possibility of molecular evaluation for personalized oncological treatment. Interventional EUS has modified the therapeutic approach, primarily for advanced pancreatic cancer. EUS-guided fiducial placement for local targeted radiotherapy treatment or EUS-guided radiofrequency ablation has been developed for local treatment, especially for patients with pancreatic cancer not suitable for surgical resection. Additionally, EUS-guided therapeutic procedures, such as celiac plexus neurolysis for pain control and EUS-guided biliary drainage for biliary obstruction, have dramatically improved in recent years toward a more effective and less invasive procedure to palliate complications related to PDAC. All the current benefits of EUS in the diagnosis and management of PDAC will be thoroughly discussed.
Collapse
Affiliation(s)
- Federico Salom
- Department of Gastroenterology, Hospital Mexico, Uruca 1641-2050, San Jose, Costa Rica
| | - Frédéric Prat
- Servide d'Endoscopie, Hopital Beaujon, Université Paris et INSERM U1016, Clichy 92118, Paris, France
| |
Collapse
|
28
|
Dhar J, Samanta J. Role of endoscopic ultrasound in the field of hepatology: Recent advances and future trends. World J Hepatol 2021; 13:1459-1483. [PMID: 34904024 PMCID: PMC8637671 DOI: 10.4254/wjh.v13.i11.1459] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 07/19/2021] [Accepted: 09/03/2021] [Indexed: 02/06/2023] Open
Abstract
The role of endoscopic ultrasound (EUS) as a diagnostic and therapeutic modality for the management of various gastrointestinal diseases has been expanding. The imaging or intervention for various liver diseases has primarily been the domain of radiologists. With the advances in EUS, the domain of endosonologists is rapidly expanding in the field of hepatology. The ability to combine endoscopy and sonography in one hybrid device is a unique property of EUS, together with the ability to bring its probe/transducer near the liver, the area of interest. Its excellent spatial resolution and ability to provide real-time images coupled with several enhancement techniques, such as contrast-enhanced (CE) EUS, have facilitated the growth of EUS. The concept of “Endo-hepatology” encompasses the wide range of diagnostic and therapeutic procedures that are now gradually becoming feasible for managing various liver diseases. Diagnostic advancements can enable a wide array of techniques from elastography and liver biopsy for liver parenchymal diseases, to CE-EUS for focal liver lesions to portal pressure measurements for managing various liver conditions. Similarly, therapeutic advancements range from EUS-guided eradication of varices, drainage of bilomas and abscesses to various EUS-guided modalities of liver tumor management. We provide a comprehensive review of all the different diagnostic and therapeutic EUS modalities available for the management of various liver diseases. A synopsis of all the technical details involving each procedure and the available data has been tabulated, and the future trends in this area have been highlighted.
Collapse
Affiliation(s)
- Jahnvi Dhar
- Department of Gastroenterology, Post Graduate Institute of Medical Education and Research, Chandigarh 160012, India
| | - Jayanta Samanta
- Department of Gastroenterology, Post Graduate Institute of Medical Education and Research, Chandigarh 160012, India
| |
Collapse
|
29
|
Mankoo R, Ali AH, Hammoud GM. Use of artificial intelligence in endoscopic ultrasound evaluation of pancreatic pathologies. Artif Intell Gastrointest Endosc 2021; 2:89-94. [DOI: 10.37126/aige.v2.i3.89] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 06/20/2021] [Accepted: 06/28/2021] [Indexed: 02/06/2023] Open
Abstract
The application of artificial intelligence (AI) using deep learning and machine learning approaches in modern medicine is rapidly expanding. Within the field of Gastroenterology, AI is being evaluated across a breadth of clinical and diagnostic applications including identification of pathology, differentiation of disease processes, and even automated procedure report generation. Many pancreatic pathologies can have overlapping features creating a diagnostic dilemma that provides a window for AI-assisted improvement in current evaluation and diagnosis, particularly using endoscopic ultrasound. This topic highlight will review the basics of AI, history of AI in gastrointestinal endoscopy, and prospects for AI in the evaluation of autoimmune pancreatitis, pancreatic ductal adenocarcinoma, chronic pancreatitis and intraductal papillary mucinous neoplasm.
Collapse
Affiliation(s)
- Ravinder Mankoo
- Division of Gastroenterology and Hepatology, University of Missouri School of Medicine, Columbia, MO 65212, United States
| | - Ahmad H Ali
- Division of Gastroenterology and Hepatology, University of Missouri School of Medicine, Columbia, MO 65212, United States
| | - Ghassan M Hammoud
- Division of Gastroenterology and Hepatology, University of Missouri School of Medicine, Columbia, MO 65212, United States
| |
Collapse
|
30
|
Mankoo R, Ali AH, Hammoud GM. Use of artificial intelligence in endoscopic ultrasound evaluation of pancreatic pathologies. Artif Intell Gastrointest Endosc 2021. [DOI: 10.37126/aige.v2.i3.88] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
|
31
|
Laoveeravat P, Abhyankar PR, Brenner AR, Gabr MM, Habr FG, Atsawarungruangkit A. Artificial intelligence for pancreatic cancer detection: Recent development and future direction. Artif Intell Gastroenterol 2021; 2:56-68. [DOI: 10.35712/aig.v2.i2.56] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Revised: 03/31/2021] [Accepted: 04/20/2021] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) has been increasingly utilized in medical applications, especially in the field of gastroenterology. AI can assist gastroenterologists in imaging-based testing and prediction of clinical diagnosis, for examples, detecting polyps during colonoscopy, identifying small bowel lesions using capsule endoscopy images, and predicting liver diseases based on clinical parameters. With its high mortality rate, pancreatic cancer can highly benefit from AI since the early detection of small lesion is difficult with conventional imaging techniques and current biomarkers. Endoscopic ultrasound (EUS) is a main diagnostic tool with high sensitivity for pancreatic adenocarcinoma and pancreatic cystic lesion. The standard tumor markers have not been effective for diagnosis. There have been recent research studies in AI application in EUS and novel biomarkers to early detect and differentiate malignant pancreatic lesions. The findings are impressive compared to the available traditional methods. Herein, we aim to explore the utility of AI in EUS and novel serum and cyst fluid biomarkers for pancreatic cancer detection.
Collapse
Affiliation(s)
- Passisd Laoveeravat
- Division of Digestive Diseases and Nutrition, University of Kentucky College of Medicine, Lexington, KY 40536, United States
| | - Priya R Abhyankar
- Department of Internal Medicine, University of Kentucky College of Medicine, Lexington, KY 40536, United States
| | - Aaron R Brenner
- Department of Internal Medicine, University of Kentucky College of Medicine, Lexington, KY 40536, United States
| | - Moamen M Gabr
- Division of Digestive Diseases and Nutrition, University of Kentucky College of Medicine, Lexington, KY 40536, United States
| | - Fadlallah G Habr
- Division of Gastroenterology, Warren Alpert Medical School of Brown University, Providence, RI 02903, United States
| | - Amporn Atsawarungruangkit
- Division of Gastroenterology, Warren Alpert Medical School of Brown University, Providence, RI 02903, United States
| |
Collapse
|
32
|
Ishii T, Katanuma A, Toyonaga H, Chikugo K, Nasuno H, Kin T, Hayashi T, Takahashi K. Role of Endoscopic Ultrasound in the Diagnosis of Pancreatic Neuroendocrine Neoplasms. Diagnostics (Basel) 2021; 11:diagnostics11020316. [PMID: 33672085 PMCID: PMC7919683 DOI: 10.3390/diagnostics11020316] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Accepted: 02/10/2021] [Indexed: 12/16/2022] Open
Abstract
Although pancreatic neuroendocrine neoplasms (PNENs) are relatively rare tumors, their number is increasing with advances in diagnostic imaging modalities. Even small lesions that are difficult to detect using computed tomography or magnetic resonance imaging can now be detected with endoscopic ultrasound (EUS). Contrast-enhanced EUS is useful, and not only diagnosis but also malignancy detection has become possible by evaluating the vascularity of tumors. Pathological diagnosis using EUS with fine-needle aspiration (EUS-FNA) is useful when diagnostic imaging is difficult. EUS-FNA can also be used to evaluate the grade of malignancy. Pooling the data of the studies that compared the PNENs grading between EUS-FNA samples and surgical specimens showed a concordance rate of 77.5% (κ-statistic = 0.65, 95% confidence interval = 0.59–0.71, p < 0.01). Stratified analysis for small tumor size (2 cm) showed that the concordance rate was 84.5% and the kappa correlation index was 0.59 (95% confidence interval = 0.43–0.74, p < 0.01). The evolution of ultrasound imaging technologies such as contrast-enhanced and elastography and the artificial intelligence that analyzes them, the evolution of needles, and genetic analysis, will further develop the diagnosis and treatment of PNENs in the future.
Collapse
Affiliation(s)
- Tatsuya Ishii
- Correspondence: ; Tel.: +81-11-681-8111; Fax: +81-11-685-2967
| | | | | | | | | | | | | | | |
Collapse
|
33
|
Endoscopic Ultrasonography Findings of Early and Suspected Early Chronic Pancreatitis. Diagnostics (Basel) 2020; 10:diagnostics10121018. [PMID: 33261170 PMCID: PMC7760161 DOI: 10.3390/diagnostics10121018] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 11/19/2020] [Accepted: 11/24/2020] [Indexed: 02/07/2023] Open
Abstract
Chronic pancreatitis (CP) is associated with a risk of pancreatic cancer and is characterized by irreversible morphological changes, fibrosis, calcification, and exocrine and endocrine insufficiency. CP is a progressive disease with a poor prognosis and is typically diagnosed at an advanced stage. The Japan Pancreas Society proposed criteria for early CP in 2009, and their usefulness has been reported. Recently, a mechanism definition was proposed by the International Consensus Guidelines and early CP was defined as a disease state that is not based on disease duration. CP is diagnosed by computed tomography, magnetic resonance imaging, and endoscopic cholangiopancreatography, which can detect calcification and dilation of the pancreatic ducts; however, detecting early CP with these modalities is difficult because subtle changes in early CP occur before established CP or end-stage CP. Endoscopic ultrasonography (EUS) is useful in the diagnosis of early CP because it allows high-resolution, close-up observation of the pancreas. In addition to imaging findings, EUS with elastography enables measurement of the stiffness of the pancreas, an objective diagnostic measure. Understanding the EUS findings of early CP is important because a histological diagnosis is problematic, and other modalities are not capable of detecting subtle changes in early CP.
Collapse
|
34
|
The Role of Endoscopic Ultrasound for Esophageal Varices. Diagnostics (Basel) 2020; 10:diagnostics10121007. [PMID: 33255736 PMCID: PMC7760989 DOI: 10.3390/diagnostics10121007] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Revised: 11/12/2020] [Accepted: 11/23/2020] [Indexed: 12/11/2022] Open
Abstract
Esophageal varices are caused by the development of collateral circulation in the esophagus as a result of portal hypertension. It is important to administer appropriate preventive treatment because bleeding varices can be fatal. Esophageal varices have complex and diverse hemodynamics, and there are various variations for each case. Endoscopic ultrasound (EUS) can estimate the hemodynamics of each case. Therefore, observation by EUS in esophageal varices provides useful information, such as safe and effective treatment selection, prediction of recurrence, and appropriate follow-up after treatment. Although treatment for the esophagogastric varices can be performed without EUS imaging, understanding the local hemodynamics of the varices using EUS prior to treatment will lead to more safe and effective treatment. EUS observation is an indispensable tool for thorough variceal care.
Collapse
|
35
|
Yamamiya A, Irisawa A, Kashima K, Kunogi Y, Nagashima K, Minaguchi T, Izawa N, Yamabe A, Hoshi K, Tominaga K, Iijima M, Goda K. Interobserver Reliability of Endoscopic Ultrasonography: Literature Review. Diagnostics (Basel) 2020; 10:E953. [PMID: 33203069 PMCID: PMC7696989 DOI: 10.3390/diagnostics10110953] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Revised: 11/10/2020] [Accepted: 11/12/2020] [Indexed: 12/12/2022] Open
Abstract
Endoscopic ultrasonography (EUS) has been applied to the diagnosis of various digestive disorders. Although it has been widely accepted and its diagnostic value is high, the dependence of EUS diagnosis on image interpretation done by the endosonographer has persisted as an important difficulty. Consequently, high interobserver reliability (IOR) in EUS diagnosis is important to demonstrate the reliability of EUS diagnosis. We reviewed the literature on the IOR of EUS diagnosis for various diseases such as chronic pancreatitis, pancreatic solid/cystic mass, lymphadenopathy, and gastrointestinal and subepithelial lesions. The IOR of EUS diagnosis differs depending on the disease; moreover, EUS findings with high IOR and those with IOR that was not necessarily high were used as diagnostic criteria. Therefore, to further increase the value of EUS diagnosis, EUS diagnostic criteria with high diagnostic characteristics based on EUS findings with high IOR must be established.
Collapse
Affiliation(s)
| | - Atsushi Irisawa
- Department of Gastroenterology, Dokkyo Medical University School of Medicine, 880 Kitakobayashi Mibu, Tochigi 321-0293, Japan; (A.Y.); (K.K.); (Y.K.); (K.N.); (T.M.); (N.I.); (A.Y.); (K.H.); (K.T.); (M.I.); (K.G.)
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|