1
|
Arribas Anta J, Moreno-Vedia J, García López J, Rios-Vives MA, Munuera J, Rodríguez-Comas J. Artificial intelligence for detection and characterization of focal hepatic lesions: a review. Abdom Radiol (NY) 2025; 50:1564-1583. [PMID: 39369107 DOI: 10.1007/s00261-024-04597-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Revised: 09/13/2024] [Accepted: 09/16/2024] [Indexed: 10/07/2024]
Abstract
Focal liver lesions (FLL) are common incidental findings in abdominal imaging. While the majority of FLLs are benign and asymptomatic, some can be malignant or pre-malignant, and need accurate detection and classification. Current imaging techniques, such as computed tomography (CT) and magnetic resonance imaging (MRI), play a crucial role in assessing these lesions. Artificial intelligence (AI), particularly deep learning (DL), offers potential solutions by analyzing large data to identify patterns and extract clinical features that aid in the early detection and classification of FLLs. This manuscript reviews the diagnostic capacity of AI-based algorithms in processing CT and MRIs to detect benign and malignant FLLs, with an emphasis in the characterization and classification of these lesions and focusing on differentiating benign from pre-malignant and potentially malignant lesions. A comprehensive literature search from January 2010 to April 2024 identified 45 relevant studies. The majority of AI systems employed convolutional neural networks (CNNs), with expert radiologists providing reference standards through manual lesion delineation, and histology as the gold standard. The studies reviewed indicate that AI-based algorithms demonstrate high accuracy, sensitivity, specificity, and AUCs in detecting and characterizing FLLs. These algorithms excel in differentiating between benign and malignant lesions, optimizing diagnostic protocols, and reducing the needs of invasive procedures. Future research should concentrate on the expansion of data sets, the improvement of model explainability, and the validation of AI tools across a range of clinical setting to ensure the applicability and reliability of such tools.
Collapse
Affiliation(s)
- Julia Arribas Anta
- Department of Gastroenterology, University Hospital, 12 Octubre, Madrid, Spain
| | - Juan Moreno-Vedia
- Scientific and Technical Department, Sycai Technologies S.L., Barcelona, Spain
| | - Javier García López
- Scientific and Technical Department, Sycai Technologies S.L., Barcelona, Spain
| | - Miguel Angel Rios-Vives
- Diagnostic Imaging Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain
- Advanced Medical Imaging, Artificial Intelligence, and Imaging-Guided Therapy Research Group, Institut de Recerca Sant Pau - Centre CERCA, Barceona, Spain
| | - Josep Munuera
- Diagnostic Imaging Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain
- Advanced Medical Imaging, Artificial Intelligence, and Imaging-Guided Therapy Research Group, Institut de Recerca Sant Pau - Centre CERCA, Barceona, Spain
| | | |
Collapse
|
2
|
Qiao S, Xue M, Zuo Y, Zheng J, Jiang H, Zeng X, Peng D. Four-phase CT lesion recognition based on multi-phase information fusion framework and spatiotemporal prediction module. Biomed Eng Online 2024; 23:103. [PMID: 39434126 PMCID: PMC11492744 DOI: 10.1186/s12938-024-01297-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Accepted: 10/02/2024] [Indexed: 10/23/2024] Open
Abstract
Multiphase information fusion and spatiotemporal feature modeling play a crucial role in the task of four-phase CT lesion recognition. In this paper, we propose a four-phase CT lesion recognition algorithm based on multiphase information fusion framework and spatiotemporal prediction module. Specifically, the multiphase information fusion framework uses the interactive perception mechanism to realize the channel-spatial information interactive weighting between multiphase features. In the spatiotemporal prediction module, we design a 1D deep residual network to integrate multiphase feature vectors, and use the GRU architecture to model the temporal enhancement information between CT slices. In addition, we employ CT image pseudo-color processing for data augmentation and train the whole network based on a multi-task learning framework. We verify the proposed network on a four-phase CT dataset. The experimental results show that the proposed network can effectively fuse the multi-phase information and model the temporal enhancement information between CT slices, showing excellent performance in lesion recognition.
Collapse
Affiliation(s)
- Shaohua Qiao
- HDU-ITMO Joint Institute, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China
| | - Mengfan Xue
- School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China
| | - Yan Zuo
- School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China
| | - Jiannan Zheng
- School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China
| | - Haodong Jiang
- School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China
| | - Xiangai Zeng
- School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China
| | - Dongliang Peng
- School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, Zhejiang, China.
| |
Collapse
|
3
|
Mak LY. Disease modifiers and novel markers in hepatitis B virus-related hepatocellular carcinoma. JOURNAL OF LIVER CANCER 2024; 24:145-154. [PMID: 39099070 PMCID: PMC11449577 DOI: 10.17998/jlc.2024.08.03] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2024] [Revised: 07/25/2024] [Accepted: 08/03/2024] [Indexed: 08/06/2024]
Abstract
Chronic hepatitis B (CHB) infection is responsible for 40% of the global burden of hepatocellular carcinoma (HCC) with a high case fatality rate. The risk of HCC differs among CHB subjects owing to differences in host and viral factors. Modifiable risk factors include viral load, use of antiviral therapy, co-infection with other hepatotropic viruses, concomitant metabolic dysfunctionassociated steatotic liver disease or diabetes mellitus, environmental exposure, and medication use. Detecting HCC at early stage improves survival, and current practice recommends HCC surveillance among individuals with cirrhosis, family history of HCC, or above an age cut-off. Ultrasonography with or without serum alpha feto-protein (AFP) every 6 months is widely accepted strategy for HCC surveillance. Novel tumor-specific markers, when combined with AFP, improve diagnostic accuracy than AFP alone to detect HCC at an early stage. To predict the risk of HCC, a number of clinical risk scores have been developed but none of them are clinically implemented nor endorsed by clinical practice guidelines. Biomarkers that reflect viral transcriptional activity and degree of liver fibrosis can potentially stratify the risk of HCC, especially among subjects who are already on antiviral therapy. Ongoing exploration of these novel biomarkers is required to confirm their performance characteristics, replicability and practicability.
Collapse
Affiliation(s)
- Lung-Yi Mak
- Department of Medicine, School of Clinical Medicine, The University of Hong Kong, Hong Kong SAR, China
- State Key Laboratory of Liver Research, The Li Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
4
|
Al-Obeidat F, Hafez W, Gador M, Ahmed N, Abdeljawad MM, Yadav A, Rashed A. Diagnostic performance of AI-based models versus physicians among patients with hepatocellular carcinoma: a systematic review and meta-analysis. Front Artif Intell 2024; 7:1398205. [PMID: 39224209 PMCID: PMC11368160 DOI: 10.3389/frai.2024.1398205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Accepted: 07/26/2024] [Indexed: 09/04/2024] Open
Abstract
Background Hepatocellular carcinoma (HCC) is a common primary liver cancer that requires early diagnosis due to its poor prognosis. Recent advances in artificial intelligence (AI) have facilitated hepatocellular carcinoma detection using multiple AI models; however, their performance is still uncertain. Aim This meta-analysis aimed to compare the diagnostic performance of different AI models with that of clinicians in the detection of hepatocellular carcinoma. Methods We searched the PubMed, Scopus, Cochrane Library, and Web of Science databases for eligible studies. The R package was used to synthesize the results. The outcomes of various studies were aggregated using fixed-effect and random-effects models. Statistical heterogeneity was evaluated using I-squared (I2) and chi-square statistics. Results We included seven studies in our meta-analysis;. Both physicians and AI-based models scored an average sensitivity of 93%. Great variation in sensitivity, accuracy, and specificity was observed depending on the model and diagnostic technique used. The region-based convolutional neural network (RCNN) model showed high sensitivity (96%). Physicians had the highest specificity in diagnosing hepatocellular carcinoma(100%); furthermore, models-based convolutional neural networks achieved high sensitivity. Models based on AI-assisted Contrast-enhanced ultrasound (CEUS) showed poor accuracy (69.9%) compared to physicians and other models. The leave-one-out sensitivity revealed high heterogeneity among studies, which represented true differences among the studies. Conclusion Models based on Faster R-CNN excel in image classification and data extraction, while both CNN-based models and models combining contrast-enhanced ultrasound (CEUS) with artificial intelligence (AI) had good sensitivity. Although AI models outperform physicians in diagnosing HCC, they should be utilized as supportive tools to help make more accurate and timely decisions.
Collapse
Affiliation(s)
- Feras Al-Obeidat
- College of Technological Innovation, Zayed University, Abu Dubai, United Arab Emirates
| | - Wael Hafez
- NMC Royal Hospital, Khalifa City, United Arab Emirates
- Internal Medicine Department, Medical Research and Clinical Studies Institute, The National Research Centre, Cairo, Egypt
| | - Muneir Gador
- Internal Medicine Department, Medical Research and Clinical Studies Institute, The National Research Centre, Cairo, Egypt
| | | | | | - Antesh Yadav
- NMC Royal Hospital, Khalifa City, United Arab Emirates
| | - Asrar Rashed
- NMC Royal Hospital, Khalifa City, United Arab Emirates
- Department of Computer Science, Edinburgh Napier University, Merchiston Campus, Edinburgh, United Kingdom
| |
Collapse
|
5
|
Haghshomar M, Rodrigues D, Kalyan A, Velichko Y, Borhani A. Leveraging radiomics and AI for precision diagnosis and prognostication of liver malignancies. Front Oncol 2024; 14:1362737. [PMID: 38779098 PMCID: PMC11109422 DOI: 10.3389/fonc.2024.1362737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 04/12/2024] [Indexed: 05/25/2024] Open
Abstract
Liver tumors, whether primary or metastatic, have emerged as a growing concern with substantial global health implications. Timely identification and characterization of liver tumors are pivotal factors in order to provide optimum treatment. Imaging is a crucial part of the detection of liver tumors; however, conventional imaging has shortcomings in the proper characterization of these tumors which leads to the need for tissue biopsy. Artificial intelligence (AI) and radiomics have recently emerged as investigational opportunities with the potential to enhance the detection and characterization of liver lesions. These advancements offer opportunities for better diagnostic accuracy, prognostication, and thereby improving patient care. In particular, these techniques have the potential to predict the histopathology, genotype, and immunophenotype of tumors based on imaging data, hence providing guidance for personalized treatment of such tumors. In this review, we outline the progression and potential of AI in the field of liver oncology imaging, specifically emphasizing manual radiomic techniques and deep learning-based representations. We discuss how these tools can aid in clinical decision-making challenges. These challenges encompass a broad range of tasks, from prognosticating patient outcomes, differentiating benign treatment-related factors and actual disease progression, recognizing uncommon response patterns, and even predicting the genetic and molecular characteristics of the tumors. Lastly, we discuss the pitfalls, technical limitations and future direction of these AI-based techniques.
Collapse
Affiliation(s)
| | | | | | | | - Amir Borhani
- Feinberg School of Medicine, Northwestern University, Chicago, IL, United States
| |
Collapse
|
6
|
Nikzad N, Fuentes DT, Roach M, Chowdhury T, Cagley M, Badawy M, Elkhesen A, Hassan M, Elsayes KM, Beretta L, Koay EJ, Jalal PK. Enhancement Pattern Mapping for Early Detection of Hepatocellular Carcinoma in Patients with Cirrhosis. J Hepatocell Carcinoma 2024; 11:595-606. [PMID: 38525156 PMCID: PMC10961013 DOI: 10.2147/jhc.s449996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 03/07/2024] [Indexed: 03/26/2024] Open
Abstract
Background and Aims Limited methods exist to accurately characterize the risk of malignant progression of liver lesions. Enhancement pattern mapping (EPM) measures voxel-based root mean square deviation (RMSD) of parenchyma and the contrast-to-noise (CNR) ratio enhances in malignant lesions. This study investigates the utilization of EPM to differentiate between HCC versus cirrhotic parenchyma with and without benign lesions. Methods Patients with cirrhosis undergoing MRI surveillance were studied prospectively. Cases (n=48) were defined as patients with LI-RADS 3 and 4 lesions who developed HCC during surveillance. Controls (n=99) were patients with and without LI-RADS 3 and 4 lesions who did not develop HCC. Manual and automated EPM signals of liver parenchyma between cases and controls were quantitatively validated on an independent patient set using cross validation with manual methods avoiding parenchyma with artifacts or blood vessels. Results With manual EPM, RMSD of 0.37 was identified as a cutoff for distinguishing lesions that progress to HCC from background parenchyma with and without lesions on pre-diagnostic scans (median time interval 6.8 months) with an area under the curve (AUC) of 0.83 (CI: 0.73-0.94) and a sensitivity, specificity, and accuracy of 0.65, 0.97, and 0.89, respectively. At the time of diagnostic scans, a sensitivity, specificity, and accuracy of 0.79, 0.93, and 0.88 were achieved with manual EPM with an AUC of 0.89 (CI: 0.82-0.96). EPM RMSD signals of background parenchyma that did not progress to HCC in cases and controls were similar (case EPM: 0.22 ± 0.08, control EPM: 0.22 ± 0.09, p=0.8). Automated EPM produced similar quantitative results and performance. Conclusion With manual EPM, a cutoff of 0.37 identifies quantifiable differences between HCC cases and controls approximately six months prior to diagnosis of HCC with an accuracy of 89%.
Collapse
Affiliation(s)
- Newsha Nikzad
- Department of Medicine and Surgery, Baylor College of Medicine, Houston, TX, USA
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
- Department of Internal Medicine, The University of Chicago Medical Center, Chicago, IL, USA
| | - David Thomas Fuentes
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Millicent Roach
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Tasadduk Chowdhury
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Matthew Cagley
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Mohamed Badawy
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Ahmed Elkhesen
- Department of Internal Medicine, Texas Tech University Health Sciences Center, Lubbock, TX, USA
| | - Manal Hassan
- Department of Epidemiology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Khaled M Elsayes
- Department of Abdominal Imaging, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Laura Beretta
- Department of Molecular and Cellular Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Eugene Jon Koay
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Prasun Kumar Jalal
- Department of Medicine and Surgery, Baylor College of Medicine, Houston, TX, USA
| |
Collapse
|
7
|
Lee H, Chang W, Kim HY, Sung P, Cho J, Lee YJ, Kim YH. Improving radiomics reproducibility using deep learning-based image conversion of CT reconstruction algorithms in hepatocellular carcinoma patients. Eur Radiol 2024; 34:2036-2047. [PMID: 37656175 DOI: 10.1007/s00330-023-10135-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 07/06/2023] [Accepted: 07/14/2023] [Indexed: 09/02/2023]
Abstract
OBJECTIVES CT reconstruction algorithms affect radiomics reproducibility. In this study, we evaluate the effect of deep learning-based image conversion on CT reconstruction algorithms. METHODS This study included 78 hepatocellular carcinoma (HCC) patients who underwent four-phase liver CTs comprising non-contrast, late arterial (LAP), portal venous (PVP), and delayed phase (DP), reconstructed using both filtered back projection (FBP) and advanced modeled iterative reconstruction (ADMIRE). PVP images were used to train a convolutional neural network (CNN) model to convert images from FBP to ADMIRE and vice versa. LAP, PVP, and DP images were used for validation and testing. Radiomic features were extracted for each patient with a semi-automatic segmentation tool. We used concordance correlation coefficients (CCCs) to evaluate the radiomics reproducibility for original FBP (oFBP) vs. original ADMIRE (oADMIRE), oFBP vs. converted FBP (cFBP), and oADMIRE vs. converted ADMIRE (cADMIRE). RESULTS In the test group including 30 patients, the CCC and proportion of reproducible features (CCC ≥ 0.85) for oFBP vs. oADMIRE were 0.65 and 32.9% (524/1595) for LAP, 0.65 and 35.9% (573/1595) for PVP, and 0.69 and 43.8% (699/1595) for DP. For oFBP vs. cFBP, the values increased to 0.92 and 83.9% (1339/1595) for LAP, 0.89 and 71.0% (1133/1595) for PVP, and 0.90 and 79.7% (1271/1595) for DP. Similarly, for oADMIRE vs. cADMIRE, the values increased to 0.87 and 68.1% (1086/1595) for LAP, 0.91 and 82.1% (1309/1595) for PVP, and 0.89 and 76.2% (1216/1595) for DP. CONCLUSIONS CNN-based image conversion between CT reconstruction algorithms improved the radiomics reproducibility of HCCs. CLINICAL RELEVANCE STATEMENT This study demonstrates that using a CNN-based image conversion technique significantly improves the reproducibility of radiomic features in HCCs, highlighting its potential for enhancing radiomics research in HCC patients. KEY POINTS Radiomics reproducibility of HCC was improved via CNN-based image conversion between two different CT reconstruction algorithms. This is the first clinical study to demonstrate improvements across a range of radiomic features in HCC patients. This study promotes the reproducibility and generalizability of different CT reconstruction algorithms in radiomics research.
Collapse
Affiliation(s)
- Heejin Lee
- Department of Applied Bioengineering, Graduate School of Convergence Science and Technology, Seoul National University, Suwon-si, Gyeonggi-do, Republic of Korea
| | - Won Chang
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Republic of Korea.
- Department of Radiology, Seoul National University College of Medicine, Seoul, Republic of Korea.
| | - Hae Young Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Republic of Korea
| | - Pamela Sung
- Department of Radiology, Seoul Metropolitan Government Seoul National University Boramae Medical Center, Seoul, Republic of Korea
| | - Jungheum Cho
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Republic of Korea
| | - Yoon Jin Lee
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Republic of Korea
| | - Young Hoon Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Republic of Korea
- Department of Radiology, Seoul National University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
8
|
Xu Y, Zhou C, He X, Song R, Liu Y, Zhang H, Wang Y, Fan Q, Chen W, Wu J, Wang J, Guo D. Deep learning-assisted LI-RADS grading and distinguishing hepatocellular carcinoma (HCC) from non-HCC based on multiphase CT: a two-center study. Eur Radiol 2023; 33:8879-8888. [PMID: 37392233 DOI: 10.1007/s00330-023-09857-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 05/05/2023] [Accepted: 05/14/2023] [Indexed: 07/03/2023]
Abstract
OBJECTIVES To develop a deep learning (DL) method that can determine the Liver Imaging Reporting and Data System (LI-RADS) grading of high-risk liver lesions and distinguish hepatocellular carcinoma (HCC) from non-HCC based on multiphase CT. METHODS This retrospective study included 1049 patients with 1082 lesions from two independent hospitals that were pathologically confirmed as HCC or non-HCC. All patients underwent a four-phase CT imaging protocol. All lesions were graded (LR 4/5/M) by radiologists and divided into an internal (n = 886) and external cohort (n = 196) based on the examination date. In the internal cohort, Swin-Transformer based on different CT protocols were trained and tested for their ability to LI-RADS grading and distinguish HCC from non-HCC, and then validated in the external cohort. We further developed a combined model with the optimal protocol and clinical information for distinguishing HCC from non-HCC. RESULTS In the test and external validation cohorts, the three-phase protocol without pre-contrast showed κ values of 0.6094 and 0.4845 for LI-RADS grading, and its accuracy was 0.8371 and 0.8061, while the accuracy of the radiologist was 0.8596 and 0.8622, respectively. The AUCs in distinguishing HCC from non-HCC were 0.865 and 0.715 in the test and external validation cohorts, while those of the combined model were 0.887 and 0.808. CONCLUSION The Swin-Transformer based on three-phase CT protocol without pre-contrast could feasibly simplify LI-RADS grading and distinguish HCC from non-HCC. Furthermore, the DL model have the potential in accurately distinguishing HCC from non-HCC using imaging and highly characteristic clinical data as inputs. CLINICAL RELEVANCE STATEMENT The application of deep learning model for multiphase CT has proven to improve the clinical applicability of the Liver Imaging Reporting and Data System and provide support to optimize the management of patients with liver diseases. KEY POINTS • Deep learning (DL) simplifies LI-RADS grading and helps distinguish hepatocellular carcinoma (HCC) from non-HCC. • The Swin-Transformer based on the three-phase CT protocol without pre-contrast outperformed other CT protocols. • The Swin-Transformer provide help in distinguishing HCC from non-HCC by using CT and characteristic clinical information as inputs.
Collapse
Affiliation(s)
- Yang Xu
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, People's Republic of China
| | - Chaoyang Zhou
- Department of Radiology, The First Affiliated Hospital of Army Military Medical University, Chongqing, 400038, People's Republic of China
| | - Xiaojuan He
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, People's Republic of China
| | - Rao Song
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, People's Republic of China
| | - Yangyang Liu
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, People's Republic of China
| | - Haiping Zhang
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, People's Republic of China
| | - Yudong Wang
- Institute of Research, Ocean International Center, InferVision, Chaoyang District, Beijing, 100025, China
| | - Qianrui Fan
- Institute of Research, Ocean International Center, InferVision, Chaoyang District, Beijing, 100025, China
| | - Weidao Chen
- Institute of Research, Ocean International Center, InferVision, Chaoyang District, Beijing, 100025, China
| | - Jiangfen Wu
- Institute of Research, Ocean International Center, InferVision, Chaoyang District, Beijing, 100025, China
| | - Jian Wang
- Department of Radiology, The First Affiliated Hospital of Army Military Medical University, Chongqing, 400038, People's Republic of China.
| | - Dajing Guo
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, 400010, People's Republic of China.
| |
Collapse
|
9
|
Yasaka K, Hatano S, Mizuki M, Okimoto N, Kubo T, Shibata E, Watadani T, Abe O. Effects of deep learning on radiologists' and radiology residents' performance in identifying esophageal cancer on CT. Br J Radiol 2023; 96:20220685. [PMID: 37000686 PMCID: PMC10546446 DOI: 10.1259/bjr.20220685] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 12/16/2022] [Accepted: 01/24/2023] [Indexed: 04/01/2023] Open
Abstract
OBJECTIVE To investigate the effectiveness of a deep learning model in helping radiologists or radiology residents detect esophageal cancer on contrast-enhanced CT images. METHODS This retrospective study included 250 and 25 patients with and without esophageal cancer, respectively, who underwent contrast-enhanced CT between December 2014 and May 2021 (mean age, 67.9 ± 10.3 years; 233 men). A deep learning model was developed using data from 200 and 25 patients with esophageal cancer as training and validation data sets, respectively. The model was then applied to the test data set, consisting of additional 25 and 25 patients with and without esophageal cancer, respectively. Four readers (one radiologist and three radiology residents) independently registered the likelihood of malignant lesions using a 3-point scale in the test data set. After the scorings were completed, the readers were allowed to reference to the deep learning model results and modify their scores, when necessary. RESULTS The area under the curve (AUC) of the deep learning model was 0.95 and 0.98 in the image- and patient-based analyses, respectively. By referencing to the deep learning model results, the AUCs for the readers were improved from 0.96/0.93/0.96/0.93 to 0.97/0.95/0.99/0.96 (p = 0.100/0.006/<0.001/<0.001, DeLong's test) in the image-based analysis, with statistically significant differences noted for the three less-experienced readers. Furthermore, the AUCs for the readers tended to improve from 0.98/0.96/0.98/0.94 to 1.00/1.00/1.00/1.00 (p = 0.317/0.149/0.317/0.073, DeLong's test) in the patient-based analysis. CONCLUSION The deep learning model mainly helped less-experienced readers improve their performance in detecting esophageal cancer on contrast-enhanced CT. ADVANCES IN KNOWLEDGE A deep learning model could mainly help less-experienced readers to detect esophageal cancer by improving their diagnostic confidence and diagnostic performance.
Collapse
Affiliation(s)
- Koichiro Yasaka
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Sosuke Hatano
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Masumi Mizuki
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Naomasa Okimoto
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Takatoshi Kubo
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Eisuke Shibata
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Takeyuki Watadani
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Osamu Abe
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| |
Collapse
|
10
|
Xue M, Jiang H, Zheng J, Wu Y, Xu Y, Pan J, Zhu W. Spatiotemporal Excitation Module-based CNN for Diagnosis of Hepatic Malignancy in Four-phase CT Images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38082966 DOI: 10.1109/embc40787.2023.10340787] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Liver cancer is a part of the common causes of cancer death worldwide, and the accurate diagnosis of hepatic malignancy is important for effective next treatment. In this paper, we propose a convolutional neural network (CNN) based on a spatiotemporal excitation (STE) module for identification of hepatic malignancy in four-phase computed tomography (CT) images. To enhance the display detail of lesion, we expand single-channel CT images into three channels by using the channel expansion method. Our proposed STE module consists of a spatial excitation (SE) module and a temporal interaction (TI) module. The SE module calculates the temporal differences of CT slices at the feature level, which is used to excite shape-sensitive channels of the lesion features. The TI module shifts a portion of the channels in the temporal dimension to exchange information among the current CT slice and adjacent CT slices. Four-phase CT images of 398 patients diagnosed with hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC) are used for experiments and five cross-validations are performed. Our model achieved average accuracy of 85.00% and average AUC of 88.91% for classifying HCC and ICC.Clinical Relevance- The proposed deep learning-based model can perform HCC and ICC recognition tasks based on four-phase CT images, assisting doctors to obtain better diagnostic performance.
Collapse
|
11
|
Wang K, Liu Y, Chen H, Yu W, Zhou J, Wang X. Fully automating LI-RADS on MRI with deep learning-guided lesion segmentation, feature characterization, and score inference. Front Oncol 2023; 13:1153241. [PMID: 37274239 PMCID: PMC10233056 DOI: 10.3389/fonc.2023.1153241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 05/02/2023] [Indexed: 06/06/2023] Open
Abstract
Introduction Leveraging deep learning in the radiology community has great potential and practical significance. To explore the potential of fitting deep learning methods into the current Liver Imaging Reporting and Data System (LI-RADS) system, this paper provides a complete and fully automatic deep learning solution for the LI-RADS system and investigates its model performance in liver lesion segmentation and classification. Methods To achieve this, a deep learning study design process is formulated, including clinical problem formulation, corresponding deep learning task identification, data acquisition, data preprocessing, and algorithm validation. On top of segmentation, a UNet++-based segmentation approach with supervised learning was performed by using 33,078 raw images obtained from 111 patients, which are collected from 2010 to 2017. The key innovation is that the proposed framework introduces one more step called feature characterization before LI-RADS score classification in comparison to prior work. In this step, a feature characterization network with multi-task learning and joint training strategy was proposed, followed by an inference module to generate the final LI-RADS score. Results Both liver segmentation and feature characterization models were evaluated, and comprehensive statistical analysis was conducted with detailed discussions. Median DICE of liver lesion segmentation was able to achieve 0.879. Based on different thresholds, recall changes within a range of 0.7 to 0.9, and precision always stays high greater than 0.9. Segmentation model performance was also evaluated on the patient level and lesion level, and the evaluation results of (precision, recall) on the patient level were much better at approximately (1, 0.9). Lesion classification was evaluated to have an overall accuracy of 76%, and most mis-classification cases happen in the neighboring categories, which is reasonable since it is naturally difficult to distinguish LI-RADS 4 from LI-RADS 5. Discussion In addition to investigating the performance of the proposed model itself, extensive comparison experiment was also conducted. This study shows that our proposed framework with feature characterization greatly improves the diagnostic performance which also validates the effectiveness of the added feature characterization step. Since this step could output the feature characterization results instead of simply generating a final score, it is able to unbox the black-box for the proposed algorithm thus improves the explainability.
Collapse
Affiliation(s)
- Ke Wang
- First Hospital, Peking University, Beijing, China
| | - Yuehua Liu
- Department of Precision Diagnosis & Image Guided Therapy, Philips Research, Shanghai, China
| | - Hongxin Chen
- Department of Precision Diagnosis & Image Guided Therapy, Philips Research, Shanghai, China
| | - Wenjin Yu
- Department of Precision Diagnosis & Image Guided Therapy, Philips Research, Shanghai, China
| | - Jiayin Zhou
- Department of Precision Diagnosis & Image Guided Therapy, Philips Research, Shanghai, China
| | | |
Collapse
|
12
|
Okimoto N, Yasaka K, Kaiume M, Kanemaru N, Suzuki Y, Abe O. Improving detection performance of hepatocellular carcinoma and interobserver agreement for liver imaging reporting and data system on CT using deep learning reconstruction. Abdom Radiol (NY) 2023; 48:1280-1289. [PMID: 36757454 PMCID: PMC10115733 DOI: 10.1007/s00261-023-03834-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 01/23/2023] [Accepted: 01/24/2023] [Indexed: 02/10/2023]
Abstract
PURPOSE This study aimed to compare the hepatocellular carcinoma (HCC) detection performance, interobserver agreement for Liver Imaging Reporting and Data System (LI-RADS) categories, and image quality between deep learning reconstruction (DLR) and conventional hybrid iterative reconstruction (Hybrid IR) in CT. METHODS This retrospective study included patients who underwent abdominal dynamic contrast-enhanced CT between October 2021 and March 2022. Arterial, portal, and delayed phase images were reconstructed using DLR and Hybrid IR. Two blinded readers independently read the image sets with detecting HCCs, scoring LI-RADS, and evaluating image quality. RESULTS A total of 26 patients with HCC (mean age, 73 years ± 12.3) and 23 patients without HCC (mean age, 66 years ± 14.7) were included. The figures of merit (FOM) for the jackknife alternative free-response receiver operating characteristic analysis in detecting HCC averaged for the readers were 0.925 (reader 1, 0.937; reader 2, 0.913) in DLR and 0.878 (reader 1, 0.904; reader 2, 0.851) in Hybrid IR, and the FOM in DLR were significantly higher than that in Hybrid IR (p = 0.038). The interobserver agreement (Cohen's weighted kappa statistics) for LI-RADS categories was moderate for DLR (0.595; 95% CI, 0.585-0.605) and significantly superior to Hybrid IR (0.568; 95% CI, 0.553-0.582). According to both readers, DLR was significantly superior to Hybrid IR in terms of image quality (p ≤ 0.021). CONCLUSION DLR improved HCC detection, interobserver agreement for LI-RADS categories, and image quality in evaluations of HCC compared to Hybrid IR in abdominal dynamic contrast-enhanced CT.
Collapse
Affiliation(s)
- Naomasa Okimoto
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Koichiro Yasaka
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan.
| | - Masafumi Kaiume
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Noriko Kanemaru
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Yuichi Suzuki
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| |
Collapse
|
13
|
Wei J, Jiang H, Zhou Y, Tian J, Furtado FS, Catalano OA. Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma. Dig Liver Dis 2023:S1590-8658(22)00863-5. [PMID: 36641292 DOI: 10.1016/j.dld.2022.12.015] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 12/15/2022] [Accepted: 12/19/2022] [Indexed: 01/16/2023]
Abstract
The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.
Collapse
Affiliation(s)
- Jingwei Wei
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China.
| | - Hanyu Jiang
- Department of Radiology, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, PR. China
| | - Yu Zhou
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China; School of Life Science and Technology, Xidian University, Xi'an, PR. China
| | - Jie Tian
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, PR. China; Beijing Key Laboratory of Molecular Imaging, Beijing 100190, PR. China; Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, 100191, PR. China; Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi, 710126, PR. China.
| | - Felipe S Furtado
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, United States; Harvard Medical School, 25 Shattuck St, Boston, MA 02115, United States
| | - Onofrio A Catalano
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, United States; Harvard Medical School, 25 Shattuck St, Boston, MA 02115, United States.
| |
Collapse
|
14
|
Laino ME, Viganò L, Ammirabile A, Lofino L, Generali E, Francone M, Lleo A, Saba L, Savevski V. The added value of artificial intelligence to LI-RADS categorization: A systematic review. Eur J Radiol 2022; 150:110251. [PMID: 35303556 DOI: 10.1016/j.ejrad.2022.110251] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Revised: 01/05/2022] [Accepted: 03/07/2022] [Indexed: 02/07/2023]
Abstract
PURPOSE The objective of this systematic review was to critically assess the available literature on deep learning (DL) and radiomics applied to the Liver Imaging Reporting and Data System (LI-RADS) in terms of 1) automatic LI-RADS classification of liver nodules; 2) the contribution of DL and radiomics to human evaluation in the classification of liver nodules following LI-RADS protocol. MATERIALS AND METHODS A literature search was conducted to identify original research studies published up to April 2021. The inclusion criteria were: English language, focus on computed tomography (CT) and/or magnetic resonance (MR) with specified number of patients and lesions, adoption of LI-RADS classification for the detected hepatic lesions, and application of AI in the classification of liver nodules. Review articles, conference papers, editorials and commentaries, animal studies or studies with absence of AI and/or LI-RADS were excluded. After screening 221 articles, 11 studies were included in this review. RESULTS All the included studies proved that DL and radiomics have high performances in liver nodules classification, sometimes similar or better than human evaluation. The best performances of DL was an AUC of 0.95 on MR and the best performance of radiomics was AUC of 0.98 either on CT and MR, while the lower ones were respectively AUC of 0.63 either on CT and MR for DL and AUC of 0.70 on CT for radiomics. CONCLUSION DL and radiomics could be a useful tool in assisting radiologists in the diagnosis and classification of liver nodules according to LI-RADS.
Collapse
Affiliation(s)
- Maria Elena Laino
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy.
| | - Luca Viganò
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy; Humanitas Clinical and Research Center-IRCCS, Via Manzoni 56, 20089 Rozzano, Italy.
| | - Angela Ammirabile
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy; Humanitas Clinical and Research Center-IRCCS, Via Manzoni 56, 20089 Rozzano, Italy.
| | - Ludovica Lofino
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy; Humanitas Clinical and Research Center-IRCCS, Via Manzoni 56, 20089 Rozzano, Italy.
| | - Elena Generali
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy; Humanitas Clinical and Research Center-IRCCS, Via Manzoni 56, 20089 Rozzano, Italy.
| | - Marco Francone
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy; Humanitas Clinical and Research Center-IRCCS, Via Manzoni 56, 20089 Rozzano, Italy.
| | - Ana Lleo
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy; Humanitas Clinical and Research Center-IRCCS, Via Manzoni 56, 20089 Rozzano, Italy.
| | - Luca Saba
- Department of Radiology, Policlinico Universitario, Via Ospedale, 54, 09124 Cagliari, Italy.
| | - Victor Savevski
- Artificial Intelligence Center, IRCCS Humanitas Research Hospital, via Manzoni 56, Rozzano, 20089 Milan, Italy.
| |
Collapse
|
15
|
Park J, Lee JM, Kim TH, Yoon JH. Imaging Diagnosis of HCC: Future directions with special emphasis on hepatobiliary MRI and contrast-enhanced ultrasound. Clin Mol Hepatol 2021; 28:362-379. [PMID: 34955003 PMCID: PMC9293611 DOI: 10.3350/cmh.2021.0361] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 12/21/2021] [Indexed: 11/16/2022] Open
Abstract
Hepatocellular carcinoma (HCC) is a unique cancer entity that can be noninvasively diagnosed using imaging modalities without pathologic confirmation. In 2018, several major guidelines for HCC were updated to include hepatobiliary contrast agent magnetic resonance imaging (HBA-MRI) and contrast-enhanced ultrasound (CEUS) as major imaging modalities for HCC diagnosis. HBA-MRI enables the achievement of high sensitivity in HCC detection using the hepatobiliary phase (HBP). CEUS is another imaging modality with real-time imaging capability, and it is reported to be useful as a second-line modality to increase sensitivity without losing specificity for HCC diagnosis. However, until now, there is an unsolved discrepancy among guidelines on whether to accept “HBP hypointensity” as a definite diagnostic criterion for HCC or include CEUS in the diagnostic algorithm for HCC diagnosis. Furthermore, there is variability in terminology and inconsistencies in the definition of imaging findings among guidelines; therefore, there is an unmet need for the development of a standardized lexicon. In this article, we review the performance and limitations of HBA-MRI and CEUS after guideline updates in 2018 and briefly introduce some future aspects of imaging-based HCC diagnosis.
Collapse
Affiliation(s)
- Junghoan Park
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea
| | - Jeong Min Lee
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Republic of Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Republic of Korea
| | - Tae-Hyung Kim
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, USA
| | - Jeong Hee Yoon
- Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
16
|
Yao S, Ye Z, Wei Y, Jiang HY, Song B. Radiomics in hepatocellular carcinoma: A state-of-the-art review. World J Gastrointest Oncol 2021; 13:1599-1615. [PMID: 34853638 PMCID: PMC8603458 DOI: 10.4251/wjgo.v13.i11.1599] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Revised: 04/22/2021] [Accepted: 08/20/2021] [Indexed: 02/06/2023] Open
Abstract
Hepatocellular carcinoma (HCC) is the most common cancer and the second major contributor to cancer-related mortality. Radiomics, a burgeoning technology that can provide invisible high-dimensional quantitative and mineable data derived from routine-acquired images, has enormous potential for HCC management from diagnosis to prognosis as well as providing contributions to the rapidly developing deep learning methodology. This article aims to review the radiomics approach and its current state-of-the-art clinical application scenario in HCC. The limitations, challenges, and thoughts on future directions are also summarized.
Collapse
Affiliation(s)
- Shan Yao
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Zheng Ye
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Yi Wei
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Han-Yu Jiang
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Bin Song
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| |
Collapse
|
17
|
Ballotin VR, Bigarella LG, Soldera J, Soldera J. Deep learning applied to the imaging diagnosis of hepatocellular carcinoma. Artif Intell Gastrointest Endosc 2021; 2:127-135. [DOI: 10.37126/aige.v2.i4.127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Revised: 06/05/2021] [Accepted: 07/19/2021] [Indexed: 02/06/2023] Open
|
18
|
Sheng R, Huang J, Zhang W, Jin K, Yang L, Chong H, Fan J, Zhou J, Wu D, Zeng M. A Semi-Automatic Step-by-Step Expert-Guided LI-RADS Grading System Based on Gadoxetic Acid-Enhanced MRI. J Hepatocell Carcinoma 2021; 8:671-683. [PMID: 34235105 PMCID: PMC8255313 DOI: 10.2147/jhc.s316385] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2021] [Accepted: 06/11/2021] [Indexed: 12/12/2022] Open
Abstract
PURPOSE Liver imaging reporting and data system (LI-RADS) classification, especially the identification of LR-3 to 5 lesions with hepatocellular carcinoma (HCC) probability, is of great significance to treatment strategy determination. We aimed to develop a semi-automatic LI-RADS grading system on multiphase gadoxetic acid-enhanced MRI using deep convolutional neural networks (CNN). PATIENTS AND METHODS An internal data set of 439 patients and external data set of 71 patients with suspected HCC were included and underwent gadoxetic acid-enhanced MRI. The expert-guided LI-RADS grading system consisted of four deep 3D CNN models including a tumor segmentation model for automatic diameter estimation and three classification models of LI-RADS major features including arterial phase hyper-enhancement (APHE), washout and enhancing capsule. An end-to-end learning system comprising single deep CNN model that directly classified the LI-RADS grade was developed for comparison. RESULTS On internal testing set, the segmentation model reached a mean dice of 0.84, with the accuracy of mapped diameter intervals as 82.7% (95% CI: 74.4%, 91.7%). The area under the curves (AUCs) were 0.941 (95% CI: 0.914, 0.961), 0.859 (95% CI: 0.823, 0.890) and 0.712 (95% CI: 0.668, 0.754) for APHE, washout and capsule, respectively. The expert-guided system significantly outperformed the end-to-end system with a LI-RADS grading accuracy of 68.3% (95% CI: 60.8%, 76.5%) vs 55.6% (95% CI: 48.8%, 63.0%) (P<0.0001). On external testing set, the accuracy of mapped diameter intervals was 91.5% (95% CI: 81.9%, 100.0%). The AUCs were 0.792 (95% CI: 0.745, 0.833), 0.654 (95% CI: 0.602, 0.703) and 0.658 (95% CI: 0.606, 0.707) for APHE, washout and capsule, respectively. The expert-guided system achieved an overall grading accuracy of 66.2% (95% CI: 58.0%, 75.2%), significantly higher than the end-to-end system of 50.1% (95% CI: 43.1%, 58.1%) (P<0.0001). CONCLUSION We developed a semi-automatic step-by-step expert-guided LI-RADS grading system (LR-3 to 5), superior to the conventional end-to-end learning system. This deep learning-based system may improve workflow efficiency for HCC diagnosis in clinical practice.
Collapse
Affiliation(s)
- Ruofan Sheng
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Shanghai Institute of Medical Imaging, Shanghai, People’s Republic of China
| | - Jing Huang
- Shanghai United Imaging Intelligence Co., Ltd., Shanghai, People’s Republic of China
| | - Weiguo Zhang
- Dushuhu District, No. 1 Affiliated Hospital, Suzhou University, Suzhou, Jiangsu, People’s Republic of China
| | - Kaipu Jin
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Shanghai Institute of Medical Imaging, Shanghai, People’s Republic of China
| | - Li Yang
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Shanghai Institute of Medical Imaging, Shanghai, People’s Republic of China
| | - Huanhuan Chong
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Shanghai Institute of Medical Imaging, Shanghai, People’s Republic of China
| | - Jia Fan
- Department of Liver Surgery, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Cancer Center, Shanghai Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
| | - Jian Zhou
- Department of Liver Surgery, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Cancer Center, Shanghai Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
| | - Dijia Wu
- Shanghai United Imaging Intelligence Co., Ltd., Shanghai, People’s Republic of China
| | - Mengsu Zeng
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Shanghai Institute of Medical Imaging, Shanghai, People’s Republic of China
- Cancer Center, Shanghai Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
| |
Collapse
|
19
|
Alksas A, Shehata M, Saleh GA, Shaffie A, Soliman A, Ghazal M, Khelifi A, Khalifeh HA, Razek AA, Giridharan GA, El-Baz A. A novel computer-aided diagnostic system for accurate detection and grading of liver tumors. Sci Rep 2021; 11:13148. [PMID: 34162893 PMCID: PMC8222341 DOI: 10.1038/s41598-021-91634-0] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Accepted: 05/28/2021] [Indexed: 12/13/2022] Open
Abstract
Liver cancer is a major cause of morbidity and mortality in the world. The primary goals of this manuscript are the identification of novel imaging markers (morphological, functional, and anatomical/textural), and development of a computer-aided diagnostic (CAD) system to accurately detect and grade liver tumors non-invasively. A total of 95 patients with liver tumors (M = 65, F = 30, age range = 34–82 years) were enrolled in the study after consents were obtained. 38 patients had benign tumors (LR1 = 19 and LR2 = 19), 19 patients had intermediate tumors (LR3), and 38 patients had hepatocellular carcinoma (HCC) malignant tumors (LR4 = 19 and LR5 = 19). A multi-phase contrast-enhanced magnetic resonance imaging (CE-MRI) was collected to extract the imaging markers. A comprehensive CAD system was developed, which includes the following main steps: i) estimation of morphological markers using a new parametric spherical harmonic model, ii) estimation of textural markers using a novel rotation invariant gray-level co-occurrence matrix (GLCM) and gray-level run-length matrix (GLRLM) models, and iii) calculation of the functional markers by estimating the wash-in/wash-out slopes, which enable quantification of the enhancement characteristics across different CE-MR phases. These markers were subsequently processed using a two-stages random forest-based classifier to classify the liver tumor as benign, intermediate, or malignant and determine the corresponding grade (LR1, LR2, LR3, LR4, or LR5). The overall CAD system using all the identified imaging markers achieved a sensitivity of 91.8%±0.9%, specificity of 91.2%±1.9%, and F\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$_{1}$$\end{document}1 score of 0.91±0.01, using the leave-one-subject-out (LOSO) cross-validation approach. Importantly, the CAD system achieved overall accuracies of \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$88\%\pm 5\%$$\end{document}88%±5%, 85%±2%, 78%±3%, 83%±4%, and 79%±3% in grading liver tumors into LR1, LR2, LR3, LR4, and LR5, respectively. In addition to LOSO, the developed CAD system was tested using randomly stratified 10-fold and 5-fold cross-validation approaches. Alternative classification algorithms, including support vector machine, naive Bayes classifier, k-nearest neighbors, and linear discriminant analysis all produced inferior results compared to the proposed two stage random forest classification model. These experiments demonstrate the feasibility of the proposed CAD system as a novel tool to objectively assess liver tumors based on the new comprehensive imaging markers. The identified imaging markers and CAD system can be used as a non-invasive diagnostic tool for early and accurate detection and grading of liver cancer.
Collapse
Affiliation(s)
- Ahmed Alksas
- BioImaging Lab, Department of Bioengineering, University of Louisville, Louisville, KY, 40292, USA
| | - Mohamed Shehata
- BioImaging Lab, Department of Bioengineering, University of Louisville, Louisville, KY, 40292, USA
| | - Gehad A Saleh
- Department of Radiology, Faculty of Medicine, Mansoura University, Mansoura, 35516, Egypt
| | - Ahmed Shaffie
- BioImaging Lab, Department of Bioengineering, University of Louisville, Louisville, KY, 40292, USA
| | - Ahmed Soliman
- BioImaging Lab, Department of Bioengineering, University of Louisville, Louisville, KY, 40292, USA
| | - Mohammed Ghazal
- College of Engineering, Abu Dhabi University, Abu Dhabi, UAE
| | - Adel Khelifi
- Computer Science and Information Technology, Abu Dhabi University, Abu Dhabi, UAE
| | | | - Ahmed Abdel Razek
- Department of Radiology, Faculty of Medicine, Mansoura University, Mansoura, 35516, Egypt
| | - Guruprasad A Giridharan
- BioImaging Lab, Department of Bioengineering, University of Louisville, Louisville, KY, 40292, USA
| | - Ayman El-Baz
- BioImaging Lab, Department of Bioengineering, University of Louisville, Louisville, KY, 40292, USA.
| |
Collapse
|
20
|
Moura Cunha G, Chernyak V, Fowler KJ, Sirlin CB. Up-to-Date Role of CT/MRI LI-RADS in Hepatocellular Carcinoma. J Hepatocell Carcinoma 2021; 8:513-527. [PMID: 34104640 PMCID: PMC8180267 DOI: 10.2147/jhc.s268288] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Accepted: 04/01/2021] [Indexed: 12/16/2022] Open
Abstract
Hepatocellular carcinoma (HCC) is a leading cause of mortality worldwide and a major healthcare burden in most societies. Computed tomography (CT) and magnetic resonance imaging (MRI) play a pivotal role in the medical care of patients with or at risk for hepatocellular carcinoma (HCC). When stringent imaging criteria are fulfilled, CT and MRI allow for diagnosis, staging, and assessment of response to treatment, without the need for invasive workup, and can inform clinical decision making. Owing to the central role of these imaging modalities in HCC management, standardization is essential to facilitate proper imaging technique, accurate interpretation, and clear communication among all stakeholders in both the clinical practice and research settings. The Liver Imaging Reporting and Data System (LI-RADS) is a comprehensive system that provides standardization across the continuum of HCC imaging, including ordinal probabilistic approach for reporting that directs individualized management. This review discusses the up-to-date role of CT and MRI in HCC imaging from the LI-RADS perspective. It also provides a glimpse into the future by discussing how advances in knowledge and technology are likely to enrich the LI-RADS approach.
Collapse
Affiliation(s)
- Guilherme Moura Cunha
- Liver Imaging Group, Department of Radiology, University of California San Diego, La Jolla, CA, USA
| | - Victoria Chernyak
- Department of Radiology, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Kathryn J Fowler
- Liver Imaging Group, Department of Radiology, University of California San Diego, La Jolla, CA, USA
| | - Claude B Sirlin
- Liver Imaging Group, Department of Radiology, University of California San Diego, La Jolla, CA, USA
| |
Collapse
|
21
|
Nakamura Y, Higaki T, Honda Y, Tatsugami F, Tani C, Fukumoto W, Narita K, Kondo S, Akagi M, Awai K. Advanced CT techniques for assessing hepatocellular carcinoma. Radiol Med 2021; 126:925-935. [PMID: 33954894 DOI: 10.1007/s11547-021-01366-4] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 04/26/2021] [Indexed: 02/07/2023]
Abstract
Hepatocellular carcinoma (HCC) is the sixth-most common cancer in the world, and hepatic dynamic CT studies are routinely performed for its evaluation. Ongoing studies are examining advanced imaging techniques that may yield better findings than are obtained with conventional hepatic dynamic CT scanning. Dual-energy CT-, perfusion CT-, and artificial intelligence-based methods can be used for the precise characterization of liver tumors, the quantification of treatment responses, and for predicting the overall survival rate of patients. In this review, the advantages and disadvantages of conventional hepatic dynamic CT imaging are reviewed and the general principles of dual-energy- and perfusion CT, and the clinical applications and limitations of these technologies are discussed with respect to HCC. Finally, we address the utility of artificial intelligence-based methods for diagnosing HCC.
Collapse
Affiliation(s)
- Yuko Nakamura
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan.
| | - Toru Higaki
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Yukiko Honda
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Fuminari Tatsugami
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Chihiro Tani
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Wataru Fukumoto
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Keigo Narita
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Shota Kondo
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Motonori Akagi
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Kazuo Awai
- Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| |
Collapse
|
22
|
Nakai H, Fujimoto K, Yamashita R, Sato T, Someya Y, Taura K, Isoda H, Nakamoto Y. Convolutional neural network for classifying primary liver cancer based on triple-phase CT and tumor marker information: a pilot study. Jpn J Radiol 2021; 39:690-702. [PMID: 33689107 DOI: 10.1007/s11604-021-01106-8] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Accepted: 02/25/2021] [Indexed: 02/06/2023]
Abstract
PURPOSE To develop convolutional neural network (CNN) models for differentiating intrahepatic cholangiocarcinoma (ICC) from hepatocellular carcinoma (HCC) and predicting histopathological grade of HCC. MATERIALS AND METHODS Preoperative computed tomography and tumor marker information of 617 primary liver cancer patients were retrospectively collected to develop CNN models categorizing tumors into three categories: moderately differentiated HCC (mHCC), poorly differentiated HCC (pHCC), and ICC, where the histopathological diagnoses were considered as ground truths. The models processed manually cropped tumor with and without tumor marker information (two-input and one-input models, respectively). Overall accuracy was assessed using a held-out dataset (10%). Area under the curve, sensitivity, and specificity for differentiating ICC from HCCs (mHCC + pHCC), and pHCC from mHCC were also evaluated. We assessed two radiologists' performance without tumor marker information as references (overall accuracy, sensitivity, and specificity). The two-input model was compared with the one-input model and radiologists using permutation tests. RESULTS The overall accuracy was 0.61, 0.60, 0.55, 0.53 for the two-input model, one-input model, radiologist 1, and radiologist 2, respectively. For differentiating pHCC from mHCC, the two-input model showed significantly higher specificity than radiologist 1 (0.68 [95% confidence interval: 0.50-0.83] vs 0.45 [95% confidence interval: 0.27-0.63]; p = 0.04). CONCLUSION Our CNN model with tumor marker information showed feasibility and potential for three-class classification within primary liver cancer.
Collapse
Affiliation(s)
- Hirotsugu Nakai
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan.
| | - Koji Fujimoto
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
- Department of Real World Data Research and Development, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Rikiya Yamashita
- Department of Biomedical Data Science, Stanford University School of Medicine, 1265 Welch Road, Stanford, CA, 94305, USA
| | - Toshiyuki Sato
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Yuko Someya
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Kojiro Taura
- Division of Hepato-Biliary-Pancreatic Surgery and Transplantation, Department of Surgery, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Hiroyoshi Isoda
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
- Preemptive Medicine and Lifestyle Disease Research Center, Kyoto University Hospital, 53 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| | - Yuji Nakamoto
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Kawahara-cho, Shogoin, Sakyo-ku, Kyoto, 606-8507, Japan
| |
Collapse
|
23
|
Lai Q, Spoletini G, Mennini G, Laureiro ZL, Tsilimigras DI, Pawlik TM, Rossi M. Prognostic role of artificial intelligence among patients with hepatocellular cancer: A systematic review. World J Gastroenterol 2020; 26:6679-6688. [PMID: 33268955 PMCID: PMC7673961 DOI: 10.3748/wjg.v26.i42.6679] [Citation(s) in RCA: 45] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2020] [Revised: 09/14/2020] [Accepted: 10/01/2020] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Prediction of survival after the treatment of hepatocellular carcinoma (HCC) has been widely investigated, yet remains inadequate. The application of artificial intelligence (AI) is emerging as a valid adjunct to traditional statistics due to the ability to process vast amounts of data and find hidden interconnections between variables. AI and deep learning are increasingly employed in several topics of liver cancer research, including diagnosis, pathology, and prognosis. AIM To assess the role of AI in the prediction of survival following HCC treatment. METHODS A web-based literature search was performed according to the Preferred Reporting Items for Systemic Reviews and Meta-Analysis guidelines using the keywords "artificial intelligence", "deep learning" and "hepatocellular carcinoma" (and synonyms). The specific research question was formulated following the patient (patients with HCC), intervention (evaluation of HCC treatment using AI), comparison (evaluation without using AI), and outcome (patient death and/or tumor recurrence) structure. English language articles were retrieved, screened, and reviewed by the authors. The quality of the papers was assessed using the Risk of Bias In Non-randomized Studies of Interventions tool. Data were extracted and collected in a database. RESULTS Among the 598 articles screened, nine papers met the inclusion criteria, six of which had low-risk rates of bias. Eight articles were published in the last decade; all came from eastern countries. Patient sample size was extremely heterogenous (n = 11-22926). AI methodologies employed included artificial neural networks (ANN) in six studies, as well as support vector machine, artificial plant optimization, and peritumoral radiomics in the remaining three studies. All the studies testing the role of ANN compared the performance of ANN with traditional statistics. Training cohorts were used to train the neural networks that were then applied to validation cohorts. In all cases, the AI models demonstrated superior predictive performance compared with traditional statistics with significantly improved areas under the curve. CONCLUSION AI applied to survival prediction after HCC treatment provided enhanced accuracy compared with conventional linear systems of analysis. Improved transferability and reproducibility will facilitate the widespread use of AI methodologies.
Collapse
Affiliation(s)
- Quirino Lai
- Hepato-biliary and Organ Transplant Unit, Department of Surgery, Sapienza University of Rome, Rome 00161, Italy
| | - Gabriele Spoletini
- General Surgery and Liver Transplantation Unit, Fondazione Policlinico Universitario A Gemelli IRCCS, Rome 00100, Italy
| | - Gianluca Mennini
- Hepato-biliary and Organ Transplant Unit, Department of Surgery, Sapienza University of Rome, Rome 00161, Italy
| | - Zoe Larghi Laureiro
- Hepato-biliary and Organ Transplant Unit, Department of Surgery, Sapienza University of Rome, Rome 00161, Italy
| | | | | | - Massimo Rossi
- Hepato-biliary and Organ Transplant Unit, Department of Surgery, Sapienza University of Rome, Rome 00161, Italy
| |
Collapse
|
24
|
Zhen SH, Cheng M, Tao YB, Wang YF, Juengpanich S, Jiang ZY, Jiang YK, Yan YY, Lu W, Lue JM, Qian JH, Wu ZY, Sun JH, Lin H, Cai XJ. Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data. Front Oncol 2020; 10:680. [PMID: 32547939 PMCID: PMC7271965 DOI: 10.3389/fonc.2020.00680] [Citation(s) in RCA: 94] [Impact Index Per Article: 18.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Accepted: 04/09/2020] [Indexed: 12/12/2022] Open
Abstract
Background: Early-stage diagnosis and treatment can improve survival rates of liver cancer patients. Dynamic contrast-enhanced MRI provides the most comprehensive information for differential diagnosis of liver tumors. However, MRI diagnosis is affected by subjective experience, so deep learning may supply a new diagnostic strategy. We used convolutional neural networks (CNNs) to develop a deep learning system (DLS) to classify liver tumors based on enhanced MR images, unenhanced MR images, and clinical data including text and laboratory test results. Methods: Using data from 1,210 patients with liver tumors (N = 31,608 images), we trained CNNs to get seven-way classifiers, binary classifiers, and three-way malignancy-classifiers (Model A-Model G). Models were validated in an external independent extended cohort of 201 patients (N = 6,816 images). The area under receiver operating characteristic (ROC) curve (AUC) were compared across different models. We also compared the sensitivity and specificity of models with the performance of three experienced radiologists. Results: Deep learning achieves a performance on par with three experienced radiologists on classifying liver tumors in seven categories. Using only unenhanced images, CNN performs well in distinguishing malignant from benign liver tumors (AUC, 0.946; 95% CI 0.914–0.979 vs. 0.951; 0.919–0.982, P = 0.664). New CNN combining unenhanced images with clinical data greatly improved the performance of classifying malignancies as hepatocellular carcinoma (AUC, 0.985; 95% CI 0.960–1.000), metastatic tumors (0.998; 0.989–1.000), and other primary malignancies (0.963; 0.896–1.000), and the agreement with pathology was 91.9%.These models mined diagnostic information in unenhanced images and clinical data by deep-neural-network, which were different to previous methods that utilized enhanced images. The sensitivity and specificity of almost every category in these models reached the same high level compared to three experienced radiologists. Conclusion: Trained with data in various acquisition conditions, DLS that integrated these models could be used as an accurate and time-saving assisted-diagnostic strategy for liver tumors in clinical settings, even in the absence of contrast agents. DLS therefore has the potential to avoid contrast-related side effects and reduce economic costs associated with current standard MRI inspection practices for liver tumor patients.
Collapse
Affiliation(s)
- Shi-Hui Zhen
- Department of General Surgery, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China.,State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China
| | - Ming Cheng
- State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China
| | - Yu-Bo Tao
- State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China
| | - Yi-Fan Wang
- Department of General Surgery, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China
| | - Sarun Juengpanich
- Department of General Surgery, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China
| | - Zhi-Yu Jiang
- Department of General Surgery, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China
| | - Yan-Kai Jiang
- Department of General Surgery, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China.,State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China
| | - Yu-Yu Yan
- State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China
| | - Wei Lu
- Department of Radiology, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China.,Department of Medical Imaging, Hwa Mei Hospital, University of Chinese Academy of Sciences, Ningbo, China
| | - Jie-Min Lue
- Department of General Surgery, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China
| | - Jia-Hong Qian
- State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China
| | - Zhong-Yu Wu
- Department of Surgical Oncology, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China
| | - Ji-Hong Sun
- Department of Radiology, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China
| | - Hai Lin
- State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, China
| | - Xiu-Jun Cai
- Department of General Surgery, School of Medicine, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, China
| |
Collapse
|