Retrospective Cohort Study Open Access
Copyright ©The Author(s) 2020. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Gastroenterol. Mar 14, 2020; 26(10): 1042-1055
Published online Mar 14, 2020. doi: 10.3748/wjg.v26.i10.1042
Prognostic factors and predictors of postoperative adjuvant transcatheter arterial chemoembolization benefit in patients with resected hepatocellular carcinoma
Ming-Yu Chen, Jia-Sheng Cao, Xiu-Jun Cai, Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310000, Zhejiang Province, China
Ming-Yu Chen, Sarun Juengpanich, Jia-Hao Hu, Win Topatana, Xiu-Jun Cai, School of Medicine, Zhejiang University, Hangzhou 310016, Zhejiang Province, China
Ming-Yu Chen, Engineering Research Center of Cognitive Healthcare of Zhejiang Province, Hangzhou 310000, Zhejiang Province, China
Chen-Hao Tong, Department of General Surgery, Shaoxing People’s Hospital, Zhejiang University, Shaoxing 312000, Zhejiang Province, China
Jian Lin, Department of General Surgery, Longyou People’s Hospital, Quzhou 314400, Zhejiang Province, China
ORCID number: Ming-Yu Chen (0000-0001-5113-754X); Sarun Juengpanich (0000-0002-1449-5564); Jia-Hao Hu (0000-0001-5835-1012); Win Topatana (0000-0001-8580-1920); Jia-Sheng Cao (0000-0002-4047-8899); Chen-Hao Tong (0000-0001-8729-7262); Jian Lin (0000-0002-8104-005X); Xiu-Jun Cai (0000-0002-6457-0577).
Author contributions: Chen MY, Cao JS, Juengpanich S, and Hu JH were involved in study design, collected and analyzed data, and drafted the paper; Topatana W, Tong CH, and Lin J collected and checked data; Cai XJ designed and supervised the study; and all authors wrote the paper.
Supported by Opening Fund of Engineering Research Center of Cognitive Healthcare of Zhejiang Province, No. 2018KFJJ09; and National Natural Science Foundation of China, No. 81827804.
Institutional review board statement: The study was reviewed and approved by the Sir Run-Run Shaw Hospital Institutional Review Board.
Informed consent statement: Patients were not required to give informed consent to the study because the analysis used anonymous clinical data that were obtained after each patient agreed to treatment by written consent.
Conflict-of-interest statement: All authors declare no conflicts of interest related to this article.
Data sharing statement: No additional data are available.
STROBE statement: The authors have read the STROBE Statement—checklist of items, and the manuscript was prepared and revised according to the STROBE Statement—checklist of items.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Corresponding author: Xiu-Jun Cai, FACS, FRCS, MD, PhD, Professor, Surgeon, Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, No. 3, East Qingchun Road, Hangzhou 310000, Zhejiang Province, China. srrsh_cxj@zju.edu.cn
Received: November 13, 2019
Peer-review started: November 13, 2019
First decision: December 4, 2019
Revised: December 20, 2019
Accepted: February 9, 2020
Article in press: February 9, 2020
Published online: March 14, 2020

Abstract
BACKGROUND

Postoperative adjuvant transcatheter arterial chemoembolization (PA-TACE) has improved overall survival (OS) in patients with hepatocellular carcinoma (HCC). However, the prognostic and predictive factors remain unclear.

AIM

To assess the prognostic factors and the predictors of PA-TACE benefit for OS in patients with resected HCC.

METHODS

Univariate and multivariate analyses were performed to identify the potential prognostic factors for OS. In order to assess the predictive factors of PA-TACE benefit, the interaction variables between treatments for each subgroup were evaluated using the Cox proportional hazards regression model.

RESULTS

A total of 378 patients (PA-TACE vs surgery alone, 189:189) from three centers were included after a propensity-score 1:1 matching analysis. Compared to the group receiving surgery alone, PA-TACE prolonged the OS rate in patients with resected HCC (P < 0.001). The Barcelona Clinic Liver Cancer system and ferritin-to-hemoglobin ratio (FHR) were used as the prognostic factors for OS in both groups. Age (P = 0.023) and microscopic vascular invasion (MVI) (P = 0.002) were also identified in the PA-TACE group, while gender (P = 0.027), hepatitis B virus (P = 0.034) and albumin-bilirubin grade (P = 0.027) were also selected in the surgery alone group. In addition, PA-TACE resulted in longer OS than surgery alone across subgroups [all hazard ratios (PA-TACE-to-surgery alone) < 1]. Notably, a significantly prolonged OS following PA-TACE was observed in patients with high FHR (P = 0.038) and without MVI (P = 0.048).

CONCLUSION

FHR and Barcelona Clinic Liver Cancer stages were regarded as prognostic factors for OS. Moreover, high FHR and the absence of MVI were important predictive factors, which can be used to assist clinicians in selecting which patients could achieve a better OS with PA-TACE.

Key Words: Postoperative adjuvant transcatheter arterial chemoembolization, Hepatocellular carcinoma, Prognostic factors, Predictive factors, Overall survival

Core tip: We have identified the prognostic and predictive factors that can assist clinicians in selecting hepatocellular carcinoma patients who could achieve a better overall survival with postoperative adjuvant transcatheter arterial chemoembolization (PA-TACE). Our study demonstrated that PA-TACE showed a better outcome with longer overall survival in each variable compared to surgery alone. Both Barcelona Clinic Liver Cancer staging and the ferritin-to-hemoglobin ratio demonstrated significance as prognostic factors, whereas high ferritin-to-hemoglobin ratio and the absence of microscopic vascular invasion were predictive factors. The potential prognostic factors identified in this study could prove to be helpful for the future design of clinical trials regarding PA-TACE.



INTRODUCTION

Liver cancer is the fourth leading cause of cancer-related mortality and is currently the main cause of liver-related death worldwide[1,2]. Hepatocellular carcinoma (HCC) is the most common type of liver cancer, and causes nearly one million deaths every year[2-4]. Overall, the 5-year survival rate of patients with HCC is less than 20%. Surgery is recommended as one of the most effective radical treatments for patients with early-stage HCC[5,6], whereas systemic therapy such as sorafenib is recommended as the first-line drug for the treatment of patients with advanced HCC[7]. Even though transcatheter arterial chemoembolization (TACE) is not the first choice for early-stage HCC, it is regarded as one of the primary treatment options for HCC patients with intermediate and advanced stages. In addition, TACE is widely recommended in preoperative and postoperative therapy, due to satisfactory results in eliminating tiny invisible tumor spots with few complications[8]. Recent studies have demonstrated that postoperative adjuvant TACE (PA-TACE) can improve the outcome of HCC associated with hepatic vein invasion and prolong overall survival (OS) in patients with multinodular HCC. It is recommended that patients should undergo PA-TACE when the liver function has recovered at 1-3 months after the initial operation[9]. However, it is still unclear whether PA-TACE can prolong OS in patients with HCC after R0 hepatectomy.

The prognostic factors and predictors of PA-TACE benefit in a patient after surgery remains limited. Although analyses of potential predictive factors for PA-TACE benefit have been studied using data from an observational study on HCC patients with microscopic vascular invasion (MVI), the number of patients and the lack of variables prevented accurate differentiation between prognostic and predictive factors[10]. A prognostic factor is a clinical, laboratory or molecular variable which is correlated with the natural course of the disease regardless of treatment, whereas a predictive factor is a variable used to identify a subgroup of patients most likely to benefit from a specific treatment[11,12]. Moreover, elucidation of predictive factors related to treatment response is key to designing and analyzing future clinical trials, when PA-TACE is regarded as a comparator[13].

Therefore, we aim to compare OS following PA-TACE and surgery alone, and to assess prognostic factors for OS and predictive factors of PA-TACE benefit in patients with HCC after R0 hepatectomy.

MATERIALS AND METHODS
Patient population

Patients with resectable HCC were identified and selected from three centers between January 2010 and January 2014. The inclusion criteria were as follows: (1) Patients underwent surgery with/without PA-TACE; (2) Pathology-confirmed HCC; and (3) Preoperative diagnosis of a single intrahepatic mass. The exclusion criteria were as follows: (1) Tumor size larger than 5 cm; (2) Positive margin; (3) Combined with other tumors; (4) Concurrently treated with conventional medicine; (5) Barcelona Clinic Liver Cancer (BCLC) stage higher than stage A; (6) OS less than 3 mo; and (7) Lack of necessary preoperative laboratory test results. Briefly, patients with Child-Pugh A and BCLC (0-A stage) enrolled in the study had undergone R0 hepatectomy for HCC with/without PA-TACE and had not received any other previous treatment. Details of the enrolled patients are summarized in Figure 1.

Figure 1
Figure 1 Flow diagram of the enrolled patients. BCLC: Barcelona Clinic Liver Cancer; HCC: Hepatocellular carcinoma; PA-TACE: Postoperative adjuvant transcatheter arterial chemoembolization.

An informed consent was obtained from each patient before surgery. The medical ethics committee at the three medical centers approved this study. To protect patient confidentiality, during this retrospective clinical study, only preoperative laboratory test results without identifiable information were used. This study complied with the provisions in the Helsinki Declaration, the regulations of each Medical Institutional Review Board and local law.

Treatments and follow-up

According to our medical center regulations, following the selection of suitable patients for PA-TACE, all patients were suggested to undergo PA-TACE when the patient had recovered liver function at 1 month after the initial operation. The patients were followed up once every 3 mo. At each follow-up visit, tumor markers, abdominal ultrasound, and liver function assessments were performed. Every 6 mo or when recurrence was suspected, enhanced computed tomography scanning or magnetic resonance imaging was performed.

Data collection

A standardized data form was created to collect all relevant information on the patients’ demographic and clinical characteristics, including age, gender, body mass index, BCLC stage, hepatitis B virus (HBV), hepatitis C virus (HCV), cirrhosis, family history, MVI, alpha-fetoprotein (AFP), albumin-bilirubin (ALBI) grade, neutrophil-to-lymphocyte ratio (NLR), ferritin, ferritin-to-hemoglobin ratio (FHR), C-reactive protein, treatment details, follow-up, etc. Continuous variables (age, AFP, NLR, ferritin, FHR, C-reactive protein) were transformed into categorical variables based on recognized cutoff values or median.

Statistical analysis

OS was the primary focus of this study. In order to avoid migration from retrospective analysis, a propensity-score 1:1 matching analysis was performed by R 3.6.0 (http://www.r-project.org) with the MatchIt package. The OS in the two treatment groups (PA-TACE vs surgery alone) was estimated and compared using Kaplan-Meier curves and the log-rank test, respectively. Univariate and multivariate analyses were then performed to identify potential prognostic factors for OS in each group. Finally, variables with significance in the univariate analyses (P < 0.05), were included in the multivariate analyses by the back-ward step using the Cox proportional hazards regression model. The number of events and 5-year survival rates were summarized based on Kaplan-Meier curves for OS across subgroups. In order to evaluate the treatment effect among subgroups, the potential interaction between treatment and each subgroup was assessed by hazard ratios (HRs) using a stratified Cox proportional hazard model. A P value for interaction based on HRs was used to estimate the strength of predictive value[14]. Variables with a P value less than 0.05 were regarded as significant.

RESULTS
Demographic and clinical characteristics of the patients

A total of 653 patients were selected from three centers as original data, and 378 patients (PA-TACE vs surgery alone, 189:189) were identified for exploratory analysis after a propensity-score 1:1 matching analysis. No significant difference was observed in each variable in the matched data (Table 1). All Kaplan-Meier curves for OS between the PA-TACE and surgery alone group showed significance before and after propensity score matching (Figure 2). In the PA-TACE group with matched data, the median age was 55 years, ranging from 26 to 86 years, and 170 patients (89.9%) were male. Almost half of the patient population in this study had a body mass index of less than 23. Most patients in this study were at BCLC stage A (79.9%), with HBV infection (88.4%) and with or without HCV infection (96.8%). 56.1% of the patients presented with cirrhosis, 14.8% presented with MVI, and 12.2% had a family history of HCC. Moreover, elevations in laboratory values, including high AFP (> 200 ng/mL), high NLR [> median (2.2)], high ferritin (> 400 ng/mL), high FHR [> median (23)], were present in almost half of the patients in this study. Overall, similar results were observed in the surgery alone group (Table 1).

Table 1 Patient demographics and clinical characteristics, n (%).
Original data
Matched data
CharacteristicPA-TACESurgery aloneP valuePA-TACESurgery aloneP value
Age (yr)< 0.0010.889
< 65196 (73.0)281 (66.0)158 (83.6)159 (84.1)
≥ 6531 (13.7)145 (34.0)31 (16.4)30 (15.9)
Gender0.2450.866
Male197 (86.8)355 (83.3)170 (89.9)169 (89.4)
Female30 (13.2)71 (16.7)19 (10.1)20 (10.6)
BMI0.0740.905
< 2397 (42.7)188 (44.1)84 (44.4)81 (42.9)
23-2576 (33.5)110 (25.8)57 (30.2)61 (32.3)
≥ 2554 (23.8)128 (30.0)48 (25.4)47 (24.9)
BCLC stage0.5090.614
043 (18.9)90 (21.1)38 (20.1)42 (22.2)
A184 (81.1)336 (78.9)151 (79.9)147 (77.8)
HBV< 0.0010.362
Negative25 (11.0)101 (23.7)22 (11.6)28 (14.8)
Positive202 (89.0)325 (76.3)167 (88.4)161 (85.2)
HCV0.2820.351
Negative218 (96.0)402 (94.4)183 (96.8)182 (96.3)
Positive3 (1.4)3 (0.7)0 (0)2 (1.1)
Unknown6 (2.6)21 (4.9)6 (3.2)5 (2.6)
Cirrhosis0.0670.678
No114 (50.2)182 (42.7)83 (43.9)79 (41.8)
Yes113 (49.8)224 (57.3)106 (56.1)110 (58.2)
Family history0.6050.876
No200 (88.1)381 (89.4)166 (87.8)165 (87.3)
Yes27 (11.9)45 (10.6)23 (12.2)24 (12.7)
MVI0.0060.884
No187 (82.4)383 (89.9)161 (85.2)162 (85.7)
Yes40 (17.6)43 (10.1)28 (14.8)27 (14.3)
AFP (ng/mL)< 0.0011.000
≤ 20096 (42.3)252 (59.2)96 (50.8)96 (50.8)
> 200131 (57.7)174 (40.8)93 (49.2)93 (49.2)
ALBI grade0.0010.678
1129 (56.8)223 (52.3)104 (55.0)108 (57.1)
292 (40.5)203 (47.7)85 (45.0)81 (42.9)
36 (2.6)0 (0)--
NLR0.9860.918
≤ Median116 (51.1)218 (51.2)86 (45.5)85 (45.0)
> Median111 (48.9)208 (48.8)103 (54.5)104 (55.0)
Ferritin (ng/mL)0.1960.914
≤ 400147 (64.8)297 (69.7)125 (66.1)124 (65.6)
> 40080 (35.2)129 (30.3)64 (33.9)65 (34.4)
FHR0.0950.918
≤ Median114 (50.2)243 (57.0)98 (51.9)97 (51.3)
> Median113 (49.8)183 (43.0)91 (48.1)92 (48.7)
CRP (mg/L)0.0890.341
≤ 5176 (77.5)304 (71.4)138 (73.0)146 (77.2)
> 551 (22.5)122 (28.6)51 (27.0)43 (22.8)
Times--
1166 (73.1)-136 (71.9)-
255 (24.2)-47 (24.9)-
> 36 (2.7)-6 (3.2)-
Figure 2
Figure 2 Kaplan-Meier curve for liver cancer survival. A: Original data; B: Matched data. PA-TACE: Postoperative adjuvant transcatheter arterial chemoembolization.
Prognostic factors for overall survival

Univariate and multivariate analyses were performed to identify potential prognostic factors for OS using the Cox proportional hazards regression model. Factors with a P-value of less than 0.05 were selected after univariate analyses. Four factors, including age (P = 0.043), BCLC stage (P = 0.015), MVI (P = 0.005), and FHR (P = 0.001), were identified in the PA-TACE group, and, five factors, including gender (P = 0.001), BCLC stage (P = 0.045), HBV (P = 0.038), ALBI grade (P < 0.001) and FHR (P < 0.001), were identified in the surgery alone group (Table 2).

Table 2 Prognostic factors for overall survival based on univariate analysis of the matched data.
PA-TACE
Surgery alone
CharacteristicHazard ratio95%CIP valueHazard ratio95%CIP value
Age (yr)0.0430.166
< 65ReferenceReference
≥ 650.3000.093-0.9630.0431.4900.848-2.6190.166
Gender0.5780.001
MaleReferenceReference
Female0.7850.334-1.8440.5780.3820.217-06740.001
BMI0.1870.121
< 23ReferenceReference
23-250.4970.233-1.0600.0700.8590.525-1.4070.546
≥ 250.9120.476-1.7470.7810.5170.275-0.9710.040
BCLC stage0.0150.045
0ReferenceReference
A4.2871.333-13.7850.0151.8391.014-3.4030.045
HBV0.6930.038
NegativeReferenceReference
Positive1.2050.478-3.0380.6932.4141.049-5.5530.038
HCV0.3670.645
NegativeReferenceReference
Positive--00.000-NA0.963
Unknown0.0470-36.1040.3670.3900.054-2.8040.350
Cirrhosis0.1660.129
NoReferenceReference
Yes1.5160.841-2.7300.1661.4400.899-2.3070.129
Family history0.9360.543
NoReferenceReference
Yes0.9660.411-2.2690.9360.8060.402-1.6150.543
MVI0.0050.439
NoReferenceReference
Yes2.5571.332-4.9100.0051.2750.689-2.3590.439
AFP (ng/mL)0.4290.416
≤ 200ReferenceReference
> 2001.2550.715-2.2030.4291.2030.771-1.8780.416
ALBI grade0.085< 0.001
1ReferenceReference
21.6370.934-2.8710.0852.3031.466-3.620< 0.001
3------
NLR0.9620.578
≤ MedianReferenceReference
> Median0.9860.563-17290.9620.8810.564-1.3760.578
Ferritin (ng/mL)0.0560.323
≤ 400ReferenceReference
> 4001.7310.986-3.0400.0561.4470.695-3.0150.323
FHR0.001< 0.001
≤ MedianReferenceReference
> Median2.8301.541-5.1980.0014.0842.452-6.802< 0.001
CRP (mg/L)0.6700.875
≤ 5ReferenceReference
> 50.8640.441-1.6910.6701.0430.616-1.7670.875
Times0.193-
1Reference--
20.6610.319-1.3700.266--
32.1710.668-7.0590.197--

According to multivariate analyses, FHR (all P < 0.001) and BCLC stage (PA-TACE vs surgery alone, P = 0.021 and P = 0.036, respectively) were regarded as prognostic factors for OS in both groups. In addition, five prognostic factors, including age (P = 0.023) and MVI (P = 0.002) for PA-TACE, and gender (P = 0.027), HBV (P = 0.034), and ALBI grade (P = 0.027) for surgery alone (Table 3) were identified.

Table 3 Identification of prognostic factors for overall survival based on multivariate analysis of the matched data.
PA-TACE
Surgery Alone
CharacteristicHazard ratio95%CIP valueHazard ratio95%CIP value
Age (yr)0.023-
< 65Reference---
≥ 650.2570.080-0.8260.023---
Gender-0.027
Male---Reference
Female---0.5230.294-0.9300.027
BCLC stage0.0210.036
0ReferenceReference
A3.9721.23-12.8250.0211.9631.044-3.6890.036
HBV-0.034
Negative---Reference
Positive---1.9821.013-4.7360.034
MVI0.002-
NoReference---
Yes2.8501.475-5.5060.002---
ALBI grade-0.027
1---Reference
2---1.7321.064-2.8210.027
3------
FHR< 0.001< 0.001
≤ MedianReferenceReference
> Median3.3381.810-6.157< 0.0011.9631.044-3.689< 0.001
Predictors of PA-TACE benefit

Compared to surgery alone, PA-TACE showed a statistically significant benefit across subgroups [all HRs (PA-TACE-to-surgery alone) < 1] (Table 4). In addition, according to treatment response to PA-TACE and surgery alone, PA-TACE had a better outcome compared to surgery alone, with longer OS in each variable. Notably, significantly prolonged OS following PA-TACE (P < 0.05) was observed in patients with high FHR (Figure 3) and the absence of MVI (Figure 4).

Figure 3
Figure 3 Kaplan-Meier curve for liver cancer survival in the low and high ferritin-to-hemoglobin ratio group. A: Low ferritin-to-hemoglobin ratio; B: High ferritin-to-hemoglobin ratio. PA-TACE: Postoperative adjuvant transcatheter arterial chemoembolization.
Table 4 Predictive factors for treatment response: Postoperative adjuvant transcatheter arterial chemoembolization vs surgery alone.
Events, n (%)
5-yr survival rate, %
CharacteristicPA-TACESurgery alonePA-TACESurgery aloneHR(P/S)95%CIP value for interaction
Age (yr)0.059
< 6546 (29.3)63 (39.6)70.960.40.6530.347-0.956
≥ 653 (9.7)15 (50.0)90.350.00.1640.040-0.584
Gender0.131
Male43 (25.3)63 (37.3)74.762.70.5980.406-0.882
Female4 (21.1)7 (35.0)78.965.00.2700.104-0.703
BMI0.261
< 2326 (31.0)38 (46.9)69.053.10.5300.321-0.873
23-259 (15.8)27 (44.3)84.255.70.3150.148-0.671
≥ 2514 (29.2)13 (27.7)70.872.30.9730.457-2.070
BCLC stage0.236
03 (7.9)12 (28.6)92.171.40.2560.072-0.909
A46 (30.5)66 (44.9)69.555.10.5700.391-0.830
HBV0.274
Negative5 (22.7)6 (21.4)77.378.60.9880.302-3.247
Positive44 (26.3)72 (44.7)73.755.30.4930.339-0.717
HCV0.527
Negative49 (26.8)77 (42.3)73.257.70.5600.376-0.770
Positive0 (0)0 (0)100100--
Unknown0 (0)1 (20.0)10080.00.0130.000-1357
Cirrhosis0.943
No17 (20.5)26 (32.9)79.567.10.5500.298-1.013
Yes32 (30.2)52 (47.3)69.852.70.5350.345-0.832
Family History0.793
No43 (25.9)69 (41.8)74.158.20.5280.360-0.772
Yes6 (26.1)9 (37.5)73.962.50.6120.218-1.721
MVI0.048
No37 (23.0)66 (40.7)77.059.30.4690.313-0.701
Yes12 (42.9)12 (44.4)57.155.60.9110.605-1.708
AFP0.984
≤ 200 ng/mL22 (22.9)36 (37.5)77.162.50.5290.311-0.898
> 200 ng/mL27 (29.0)42 (45.2)71.054.80.5330.328-0.865
ALBI grade0.333
123 (22.1)32 (29.6)77.970.40.6470.378-1.105
226 (30.6)46 (56.8)69.443.20.4530.280-0.734
3------
NLR0.791
≤ Median23 (26.7)36 (42.4)73.357.60.5100.302-0.860
> Median26 (25.2)42 (40.3)74.859.60.5620.344-0.917
Ferritin0.289
≤ 400 ng/mL27 (21.6)33 (26.6)78.473.40.6910.354-1.349
> 400 ng/mL22 (34.4)45 (69.2)65.630.80.4500.294-0.688
FHR0.038
≤ Median15 (15.3)20 (20.6)84.779.40.7480.450-1.244
> Median34 (37.4)58 (63.0)62.637.00.3480.209-0.582
CRP0.853
≤ 5 mg/L38 (27.5)60 (41.1)72.558.90.5560.370-0.835
> 5 mg/L11 (21.6)18 (41.9)78.458.10.5130.242-1.088
Figure 4
Figure 4 Kaplan-Meier curve for liver cancer survival in patients with and without microscopic vascular invasion. A: Absence of microscopic vascular invasion; B: Presence of microscopic vascular invasion. PA-TACE: Postoperative adjuvant transcatheter arterial chemoembolization.
DISCUSSION

The improved outcome and prolonged OS of PA-TACE have been demonstrated in previous studies. However, it is still unclear whether the combination of PA-TACE and surgery can improve the prognosis of patients with resectable HCC. In this retrospective, multi-center study, we analyzed the potential prognostic factors and predictive factors of PA-TACE benefit in patients with resectable HCC. We utilized propensity-score 1:1 matching before exploratory analysis, which was beneficial in reducing bias due to the confounding variables and accurately distinguished the prognostic factors from the predictive factors. In this study, FHR was not only considered an independent prognostic factor (P < 0.001) in both groups, but it was also one of the most significant predictive factors of PA-TACE benefit (P = 0.038) in patients with resectable HCC. Most importantly, we reduced selective bias by (1) choosing patients with HCC who were identified and selected from three different centers; (2) using a standardized data form which was created to collect all the relevant information regarding these patients; and (3) using propensity score matching, which was carried out to avoid migration from the retrospective case studies.

There are various clinical elements that affect the prognosis of patients who have undergone PA-TACE. In this study, various factors were considered in the prediction of prognosis including ferritin, FHR, BCLC stage, MVI, HBC, and HCV, etc. The upregulation of ferritin is usually observed in patients with HCC[15,16] and is accompanied by a poor OS[17-19]. Previous studies have shown that serum ferritin reflects the iron load of the body and originates from hepatocytes and macrophages[20]. Rapid development would require a large amount of iron for the proliferation and progression of cancer cells, leading to the association of high iron levels in malignant cancers[21]. The higher the serum ferritin level is, the more impact it has on the OS. High serum ferritin level results in multiple system malfunctions which worsen the patient’s condition and overall health[22,23]. Moreover, cancer can lead to low hemoglobin levels due to multifactorial issues, such as immune, nutritional and metabolic components[21,24]. Therefore, serum ferritin is regarded as one of the biomarkers of HCC.

FHR is a unique factor that indicates multiple pathophysiological processes related to the relationship between the tumor and the host[25]. It is calculated by dividing serum ferritin, which is increased due to tumor progression, and hemoglobin, which reflects the current overall condition of the patient. The increase in FHR is associated with advanced tumor progression, leading to a higher likelihood of PA-TACE in patients with advanced HCC. Our study indicated that high FHR was associated with tumor progression and poor OS. According to these results, patients with higher FHR had poorer OS compared to those with lower FHR in both groups (P < 0.001). Significantly prolonged OS following PA-TACE was observed in patients with high FHR (P = 0.038). Normal liver cells primarily depend on the blood supply provided by the hepatic portal vein, while HCC cells primarily receive most of their blood supply from the hepatic artery[26]. Therefore, PA-TACE treatment may be able to decrease the number of residual tumor cells and improve overall long-term survival. In addition, a high FHR level is a predictive factor that is used to assist clinicians in managing and selecting patients who could receive maximal benefit from PA-TACE after hepatectomy. Therefore, FHR is an important marker for the prediction of prognosis after treatment in HCC patients.

The BCLC staging system is commonly used to manage patients with HCC. The treatment plan for patients with HCC is usually derived from BCLC guidelines[27]. It is indicated that patients with preserved liver function and a tumor diameter of less than 5 cm will benefit most from PA-TACE. In our study, the BCLC stage was considered another prognostic factor in both groups. Patients with BCLC stage 0 had a longer OS than those with BCLC stage A. However, patients had similar benefits from PA-TACE regardless of their BCLC stage (P = 0.236). All HRs showed significance in BCLC stage 0 and A (HR = 0.256, 95%CI: 0.072-0.909 and HR = 0.570, 95%CI: 0.391-0.830, respectively). Recent studies have shown that deterioration in liver function is known to be a risk factor for hepatectomy. The prognosis of patients is determined by how advanced the liver disease is[28]. Hence, the BCLC stage can be regarded as a prognostic factor but not a predictive factor.

Previous studies have suggested that HCC with a large tumor diameter and vascular invasion are better for predicting prognosis. MVI has been indicated as a strong predictor of tumor recurrence and OS in patients receiving surgery alone[29]. Residual tumor cells that are supplied by the malignant MVI are usually left behind after surgical resection, resulting in the prognosis of patients without MVI being better than those with MVI. Due to the correlation between MVI and poor OS, MVI is considered one of the most powerful prognostic factors[10]. According to our results, patients with MVI who received surgery alone showed poor OS. However, patients without MVI had a prolonged OS following PA-TACE (P = 0.048). PA-TACE should be able to eliminate some of the MVI and residual tumor cells, improving the OS of patients who have undergone PA-TACE. Therefore, MVI may be a predictive factor of PA-TACE treatment benefit and a prognostic factor for patients receiving surgery alone.

Various studies have been conducted on the elements that impact the long-term prognosis of patients that have undergone PA-TACE. Overall, most prognostic factors used in our study were consistent with those in previous studies. Both studies by Kim et al[30] and Cai et al[31] reported the same results, which showed that ALBI was one of the most important prognostic factors for predicting OS in patients who had undergone PA-TACE after hepatectomy. Studies have shown that HBV reactivation is an obstacle for hepatic cell regeneration, which results in reduced OS in patients with HBV infection. However, PA-TACE can also eliminate HBV within tumor cells and lower the viral load, thus slightly increasing OS in HCC patients with HBV infection.

There are some limitations in this study. The major limitation is the retrospective nature of the data acquired. Although a propensity score matching analysis was performed, potential bias could not be completely eliminated. Moreover, several clinical variables in the data could not be measured, for example, PA-TACE drugs and dosages may have varied across the three different centers. Hence, a prospective study is required to confirm PA-TACE treatment efficacy and its impact on OS. In addition, even though this study was based on multiple medical centers, most patients with HCC also had HBV infection and less than 10% of patients with HCV infection were included. Therefore, future studies should pay more attention to HCV, and multicenter randomized controlled trials are required to verify these results. This study has provided many paths for future research. Tumors evolve spontaneously, and a reliable way of predicting OS and response to PA-TACE is essential for physicians to create a treatment plan that will improve the patient’s prognosis. By using the potential prognostic factors identified in this study, artificial intelligence could be used to assess the clinical outcome of patients with HCC.

In conclusion, PA-TACE resulted in a better outcome with longer OS in each variable compared to surgery alone. Prolonged OS following PA-TACE (P < 0.05) was observed in patients with high FHR and the absence of MVI. This study demonstrated that FHR and BCLC stages were the most important prognostic factors for OS. Moreover, high FHR [> median (23)] and absence of MVI were predictive factors of PA-TACE benefit, and can be used to assist clinicians in selecting which patients would achieve a better OS with PA-TACE.

ARTICLE HIGHLIGHTS
Research background

Transcatheter arterial chemoembolization (TACE) is one of the primary treatment options for hepatocellular carcinoma (HCC) patients with intermediate and advanced stages, and is widely recommended in preoperative and postoperative therapy, due to satisfactory results in eliminating tiny invisible tumor spots with few complications. Recent studies have demonstrated that postoperative adjuvant TACE (PA-TACE) can improve the outcome of HCC associated with hepatic vein invasion and prolong overall survival (OS) in patients with multinodular HCC. However, it is still unclear whether PA-TACE can prolong OS in patients with HCC after R0 hepatectomy.

Research motivation

Although analyses of potential predictive factors for PA-TACE benefit have been carried out using data from an observational study on HCC patients with microscopic vascular invasion (MVI), the number of patients and the lack of variables prevented accurate differentiation between prognostic and predictive factors. Therefore, we aimed to compare OS following PA-TACE and surgery alone, and to assess prognostic factors for OS and predictive factors of PA-TACE benefit in patients with HCC after R0 hepatectomy.

Research objectives

The main objective of this study was to identify the prognostic and predictive factors that can assist clinicians in selecting HCC patients who would achieve a better OS with PA-TACE. We conducted a retrospective, multi-center study to assess the prognostic factors for HCC and the predictive factors of PA-TACE. The potential prognostic factors identified in this study could lead to the utilization of artificial intelligence to assess the clinical outcome of HCC patients.

Research methods

A total of 653 patients were selected from three centers as original data, and 378 patients (PA-TACE vs surgery alone, 189:189) were identified for exploratory analysis after a propensity-score 1:1 matching analysis. Univariate and multivariate analyses were performed to identify the potential prognostic factors for OS. In order to assess the predictive factors of PA-TACE benefit, the interaction variables between treatments for each subgroup were evaluated using the Cox proportional hazards regression model.

Research results

Compared to the group receiving surgery alone, PA-TACE prolonged the OS rate in patients with resected HCC (P < 0.001). The Barcelona Clinic Liver Cancer system and ferritin-to-hemoglobin ratio (FHR) were used as the prognostic factors for OS in both groups. PA-TACE showed longer OS than surgery alone across subgroups [all hazard ratios (PA-TACE-to-surgery alone) < 1]. Notably, the significantly prolonged OS following PA-TACE was observed in patients with high FHR (P = 0.038) and without MVI (P = 0.048).

Research conclusions

Previous studies have demonstrated improved outcomes following PA-TACE, but it is still unclear whether the combination of PA-TACE and surgery improves the prognosis of patients with resectable HCC. This study demonstrated that FHR and Barcelona Clinic Liver Cancer stages were the most important prognostic factors for OS. Moreover, high FHR [> median (23)] and absence of MVI were predictive factors of PA-TACE benefit, and can be used to assist clinicians in selecting which patients would achieve a better OS with PA-TACE. This study has provided many paths for future research. Tumors evolve spontaneously, and a reliable way of predicting OS and response to PA-TACE is essential for physicians to create a treatment plan that will improve the patient’s prognosis. By using the potential prognostic factors identified in this study, artificial intelligence could be used to assess the clinical outcome of patients with HCC. However, due to the limitations in our study, a prospective study is needed in the future to confirm PA-TACE treatment efficacy and its impact on OS.

Research perspectives

Due to the limitations in this study, several lessons can be learned. Although a propensity score matching analysis was performed, potential bias could not be completely eliminated. Moreover, several clinical variables in the data could not be measured. Hence, a prospective study is needed to confirm PA-TACE treatment efficacy and its impact on OS. This study has provided many paths for future research. Tumors evolve spontaneously, and a reliable way of predicting OS and response to PA-TACE is essential for physicians to create a treatment plan that will improve the patient’s prognosis. By using the potential prognostic factors identified in this study, artificial intelligence could be used to assess the clinical outcome of patients with HCC.

ACKNOWLEDGEMENTS

We are grateful to Cai Y for providing language help, and all our colleagues for assistance in this study.

Footnotes

Manuscript source: Unsolicited manuscript

Specialty type: Gastroenterology and hepatology

Country of origin: China

Peer-review report classification

Grade A (Excellent): A

Grade B (Very good): 0

Grade C (Good): C, C

Grade D (Fair): 0

Grade E (Poor): 0

P-Reviewer: Boscá L, Bramhall SR, Que J S-Editor: Yan JP L-Editor: Webster JR E-Editor: Zhang YL

References
1.  Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394-424.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 53206]  [Cited by in F6Publishing: 50964]  [Article Influence: 8494.0]  [Reference Citation Analysis (122)]
2.  Miller KD, Goding Sauer A, Ortiz AP, Fedewa SA, Pinheiro PS, Tortolero-Luna G, Martinez-Tyson D, Jemal A, Siegel RL. Cancer Statistics for Hispanics/Latinos, 2018. CA Cancer J Clin. 2018;68:425-445.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 256]  [Cited by in F6Publishing: 282]  [Article Influence: 47.0]  [Reference Citation Analysis (0)]
3.  DeSantis CE, Miller KD, Goding Sauer A, Jemal A, Siegel RL. Cancer statistics for African Americans, 2019. CA Cancer J Clin. 2019;69:211-233.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 385]  [Cited by in F6Publishing: 465]  [Article Influence: 93.0]  [Reference Citation Analysis (0)]
4.  Siegel RL, Miller KD, Jemal A. Cancer statistics, 2019. CA Cancer J Clin. 2019;69:7-34.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 13300]  [Cited by in F6Publishing: 14465]  [Article Influence: 2893.0]  [Reference Citation Analysis (2)]
5.  Cai X. Laparoscopic liver resection: the current status and the future. Hepatobiliary Surg Nutr. 2018;7:98-104.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 20]  [Cited by in F6Publishing: 30]  [Article Influence: 5.0]  [Reference Citation Analysis (0)]
6.  Juengpanich S, Shi L, Iranmanesh Y, Chen J, Cheng Z, Khoo AK, Pan L, Wang Y, Cai X. The role of natural killer cells in hepatocellular carcinoma development and treatment: A narrative review. Transl Oncol. 2019;12:1092-1107.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 21]  [Cited by in F6Publishing: 25]  [Article Influence: 5.0]  [Reference Citation Analysis (0)]
7.  Chen M, Hu J, Cao J, Cai X. Comprehensive Consideration before the Decision-Making of the Systemic Treatment in Patients with Advanced Hepatocellular Carcinoma. Liver cancer. 2019;.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 5]  [Article Influence: 1.3]  [Reference Citation Analysis (0)]
8.  Zhang Z, Liu Q, He J, Yang J, Yang G, Wu M. The effect of preoperative transcatheter hepatic arterial chemoembolization on disease-free survival after hepatectomy for hepatocellular carcinoma. Cancer. 2000;89:2606-2612.  [PubMed]  [DOI]  [Cited in This Article: ]
9.  Wang H, Du PC, Wu MC, Cong WM. Postoperative adjuvant transarterial chemoembolization for multinodular hepatocellular carcinoma within the Barcelona Clinic Liver Cancer early stage and microvascular invasion. Hepatobiliary Surg Nutr. 2018;7:418-428.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 29]  [Cited by in F6Publishing: 50]  [Article Influence: 8.3]  [Reference Citation Analysis (0)]
10.  Sun JJ, Wang K, Zhang CZ, Guo WX, Shi J, Cong WM, Wu MC, Lau WY, Cheng SQ. Postoperative Adjuvant Transcatheter Arterial Chemoembolization After R0 Hepatectomy Improves Outcomes of Patients Who have Hepatocellular Carcinoma with Microvascular Invasion. Ann Surg Oncol. 2016;23:1344-1351.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 99]  [Cited by in F6Publishing: 126]  [Article Influence: 14.0]  [Reference Citation Analysis (0)]
11.  Adolfsson J, Steineck G. Prognostic and treatment-predictive factors-is there a difference? Prostate Cancer Prostatic Dis. 2000;3:265-268.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 13]  [Cited by in F6Publishing: 13]  [Article Influence: 0.5]  [Reference Citation Analysis (0)]
12.  Bruix J, Cheng AL, Meinhardt G, Nakajima K, De Sanctis Y, Llovet J. Corrigendum to "Prognostic factors and predictors of sorafenib benefit in patients with hepatocellular carcinoma: Analysis of two phase III studies" [J hepatol 67 (2017) 999-1008]. J Hepatol. 2018;69:990-991.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 4]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
13.  Chen M, Cao J, Zhang B, Pan L, Cai X. A Nomogram for Prediction of Overall Survival in Patients with Node-negative Gallbladder Cancer. J Cancer. 2019;10:3246-3252.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 13]  [Article Influence: 2.6]  [Reference Citation Analysis (0)]
14.  Altman DG, Bland JM. Interaction revisited: the difference between two estimates. BMJ. 2003;326:219.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2009]  [Cited by in F6Publishing: 2133]  [Article Influence: 101.6]  [Reference Citation Analysis (0)]
15.  Jung M, Mertens C, Tomat E, Brüne B. Iron as a Central Player and Promising Target in Cancer Progression. Int J Mol Sci. 2019;20:pii: E273.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 122]  [Cited by in F6Publishing: 164]  [Article Influence: 32.8]  [Reference Citation Analysis (0)]
16.  Wang Y, Yu L, Ding J, Chen Y. Iron Metabolism in Cancer. Int J Mol Sci. 2018;20:pii: E95.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 117]  [Cited by in F6Publishing: 156]  [Article Influence: 26.0]  [Reference Citation Analysis (0)]
17.  Jiao Y, Wilkinson J 4th, Di X, Wang W, Hatcher H, Kock ND, D'Agostino R Jr, Knovich MA, Torti FM, Torti SV. Curcumin, a cancer chemopreventive and chemotherapeutic agent, is a biologically active iron chelator. Blood. 2009;113:462-469.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 163]  [Cited by in F6Publishing: 171]  [Article Influence: 10.7]  [Reference Citation Analysis (0)]
18.  Manz DH, Blanchette NL, Paul BT, Torti FM, Torti SV. Iron and cancer: recent insights. Ann N Y Acad Sci. 2016;1368:149-161.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 215]  [Cited by in F6Publishing: 296]  [Article Influence: 37.0]  [Reference Citation Analysis (0)]
19.  Torti SV, Manz DH, Paul BT, Blanchette-Farra N, Torti FM. Iron and Cancer. Annu Rev Nutr. 2018;38:97-125.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 161]  [Cited by in F6Publishing: 242]  [Article Influence: 48.4]  [Reference Citation Analysis (0)]
20.  Cohen LA, Gutierrez L, Weiss A, Leichtmann-Bardoogo Y, Zhang DL, Crooks DR, Sougrat R, Morgenstern A, Galy B, Hentze MW, Lazaro FJ, Rouault TA, Meyron-Holtz EG. Serum ferritin is derived primarily from macrophages through a nonclassical secretory pathway. Blood. 2010;116:1574-1584.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 285]  [Cited by in F6Publishing: 298]  [Article Influence: 21.3]  [Reference Citation Analysis (0)]
21.  Macciò A, Madeddu C, Gramignano G, Mulas C, Tanca L, Cherchi MC, Floris C, Omoto I, Barracca A, Ganz T. The role of inflammation, iron, and nutritional status in cancer-related anemia: results of a large, prospective, observational study. Haematologica. 2015;100:124-132.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 109]  [Cited by in F6Publishing: 130]  [Article Influence: 13.0]  [Reference Citation Analysis (0)]
22.  Gao S, Zhao D, Qi Y, Wang M, Zhao F, Sun J, Liu J. The association between serum ferritin levels and the risk of new-onset type 2 diabetes mellitus: A 10-year follow-up of the Chinese Multi-Provincial Cohort Study. Diabetes Res Clin Pract. 2017;130:154-162.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10]  [Cited by in F6Publishing: 11]  [Article Influence: 1.6]  [Reference Citation Analysis (0)]
23.  Gye HJ, Kim JM, Yoo C, Shim SH, Won YS, Sung KC, Lee MY, Park KH. Relationship between high serum ferritin level and glaucoma in a South Korean population: the Kangbuk Samsung health study. Br J Ophthalmol. 2016;100:1703-1707.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 16]  [Cited by in F6Publishing: 16]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]
24.  Lee CL, Tsai CH, Yeh DC, Lin CS, Li YF, Tzeng HE. Hemoglobin level trajectories in the early treatment period are related with survival outcomes in patients with breast cancer. Oncotarget. 2017;8:1569-1579.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 8]  [Cited by in F6Publishing: 9]  [Article Influence: 1.5]  [Reference Citation Analysis (0)]
25.  Lee S, Jeon H, Shim B. Prognostic Value of Ferritin-to-Hemoglobin Ratio in Patients with Advanced Non-Small-Cell Lung Cancer. J Cancer. 2019;10:1717-1725.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 13]  [Cited by in F6Publishing: 14]  [Article Influence: 2.8]  [Reference Citation Analysis (0)]
26.  Portolani N, Coniglio A, Ghidoni S, Giovanelli M, Benetti A, Tiberio GA, Giulini SM. Early and late recurrence after liver resection for hepatocellular carcinoma: prognostic and therapeutic implications. Ann Surg. 2006;243:229-235.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 558]  [Cited by in F6Publishing: 661]  [Article Influence: 36.7]  [Reference Citation Analysis (0)]
27.  Heimbach JK, Kulik LM, Finn RS, Sirlin CB, Abecassis MM, Roberts LR, Zhu AX, Murad MH, Marrero JA. AASLD guidelines for the treatment of hepatocellular carcinoma. Hepatology. 2018;67:358-380.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2107]  [Cited by in F6Publishing: 2583]  [Article Influence: 430.5]  [Reference Citation Analysis (2)]
28.  Marrero JA, Kulik LM, Sirlin CB, Zhu AX, Finn RS, Abecassis MM, Roberts LR, Heimbach JK. Diagnosis, Staging, and Management of Hepatocellular Carcinoma: 2018 Practice Guidance by the American Association for the Study of Liver Diseases. Hepatology. 2018;68:723-750.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2121]  [Cited by in F6Publishing: 2685]  [Article Influence: 447.5]  [Reference Citation Analysis (1)]
29.  Hu H, Han XK, Long XR, Fan J, Yan ZP, Wang JH, Liu R. Prognostic nomogram for post-surgical treatment with adjuvant TACE in hepatitis B virus-related hepatocellular carcinoma. Oncotarget. 2016;7:58302-58314.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 9]  [Article Influence: 1.5]  [Reference Citation Analysis (0)]
30.  Kim JH, Sinn DH, Lee JH, Hyun D, Cho SK, Shin SW, Chang Y, Kim YJ, Yoon JH, Kang W, Gwak GY, Paik YH, Lee JH, Koh KC, Paik SW, Choi MS. Novel Albumin-Bilirubin Grade-Based Risk Prediction Model for Patients with Hepatocellular Carcinoma Undergoing Chemoembolization. Dig Dis Sci. 2018;63:1062-1071.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 17]  [Cited by in F6Publishing: 14]  [Article Influence: 2.3]  [Reference Citation Analysis (0)]
31.  Cai XR, Chen ZH, Liu MM, Lin JX, Zhang XP, Chen J, Lin Q, Ma XK, Wen JY, Xie SD, Wu XY, Dong M. Modified CLIP score with the albumin-bilirubin grade retains prognostic value in HBV-related hepatocellular carcinoma patients treated with trans-catheter arterial chemoembolization therapy. J Cancer. 2018;9:2380-2388.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 11]  [Article Influence: 1.8]  [Reference Citation Analysis (0)]