Lau Y, Cheng JY, Wong SH, Yen KY, Cheng LJ. Effectiveness of digital psychotherapeutic intervention among perinatal women: A systematic review and meta-analysis of randomized controlled trials. World J Psychiatr 2021; 11(4): 133-152 [PMID: 33889538 DOI: 10.5498/wjp.v11.i4.133]
Corresponding Author of This Article
Ying Lau, BSc, MSN, PhD, RN, Associate Professor, Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Block MD 11, Level 2, 10 Medical Drive, Singapore 117597, Singapore. firstname.lastname@example.org
Checklist of Responsibilities for the Scientific Editor of This Article
This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Author contributions: Lau Y conceived and guided the study; Cheng JY, Wong SH and Yen KY carried out the literature searches; Cheng JY and Yen KY extracted the data; Cheng JY and Yen KY assessed the study quality; Lau Y, Wong SH, and Cheng LJ performed the statistical analysis; Lau Y wrote the manuscript; Lau Y, Cheng JY, Wong SH, Yen KY and Cheng LJ revised the manuscript.
Supported byMinistry of Education Academic Research Fund (AcRF) Tier 1, No. NUHSRO/2017/054/T1.
Conflict-of-interest statement: All the authors report no relevant conflicts of interest.
PRISMA 2009 Checklist statement: The authors have read the PRISMA 2009 Checklist, and the manuscript was prepared and revised according to the PRISMA 2009 Checklist.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Ying Lau, BSc, MSN, PhD, RN, Associate Professor, Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Block MD 11, Level 2, 10 Medical Drive, Singapore 117597, Singapore. email@example.com
Received: December 30, 2020 Peer-review started: December 30, 2020 First decision: January 11, 2021 Revised: January 11, 2021 Accepted: March 10, 2021 Article in press: March 10, 2021 Published online: April 19, 2021
The perinatal period is a challenging time of substantial emotional, physiological, social, and relational changes. Depression, anxiety, and stress symptoms are common, and co-exist in the perinatal period. Digital technology continues to grow at an unprecedented pace with wide application, including psychotherapeutic intervention. A growing number of meta-analyses supported the application of digital psychotherapeutic intervention across different populations, but relatively few meta- and meta-regression analyses have concentrated on perinatal women.
To evaluate the effectiveness of digital psychotherapeutic intervention on improving psychological outcomes among perinatal women and identify its essential features.
Randomized controlled trials (RCTs) were obtained from eight databases, including Cumulative Index to Nursing and Allied Health Literature, Cochrane Library, Embase, Scopus, PsycINFO, PubMed, Web of Science, and ProQuest Dissertation and Theses from inception up until November 24, 2020. Comprehensive Meta-analysis 3.0 software was used to conduct meta- and meta-regression analyses. The Cochrane risk-of-bias tool and the Grading of the Recommendation, Assessment, Development, and Evaluation system were adopted to assess the individual and overall qualities of the evidence, respectively.
A total of 25 RCTs that included 3239 women were identified. Meta-analyses revealed that intervention significantly improved depression (Hedges’s g = 0.49), anxiety (g = 0.25), and stress (g = 0.47) symptoms compared to the control. Subgroup analyses demonstrated that a website platform with ≥ eight therapist-guided sessions using the theoretical principle of cognitive behavioral therapy was more effective than other treatments in improving depression symptoms in postnatal women. Meta-regression analyses observed that the age of perinatal women and the type of psychotherapy also had statistically significant effects on depression symptoms. Egger’s regression asymmetry tests suggested that no publication biases occurred, but the overall quality of the evidence was very low.
This review suggests that digital psychotherapeutic intervention may be a potential solution to reduce psychological problems in perinatal women. Further high-quality RCTs with large sample sizes are needed.
Core Tip: This systematic review identified and analyzed the findings of 25 randomized controlled trials, and the results indicated that digital psychotherapeutic intervention could significantly reduce depression, anxiety, and stress symptoms among perinatal women. The essential features of this intervention were a website platform with ≥ eight therapist-guided sessions using the cognitive behavioral therapy theoretical principle. This intervention was also effective in reducing depression symptoms when treating young postnatal women. The overall evidence grade of outcomes was very low according to the Grading of Recommendations, Assessment, Development, and Evaluation criteria. Thus, future trials need to include a high-quality design and a large sample size.
Citation: Lau Y, Cheng JY, Wong SH, Yen KY, Cheng LJ. Effectiveness of digital psychotherapeutic intervention among perinatal women: A systematic review and meta-analysis of randomized controlled trials. World J Psychiatr 2021; 11(4): 133-152
Perinatal period is a challenging time of substantial emotional, physiological, social, familial, and role changes[1,2]. These changes may affect psychological and physical resources, resulting in increased susceptibility of psychological problems, including depression, anxiety, and stress. A systematic review observed that depression, anxiety, and stress symptoms co-existed in the perinatal period. The prevalence in the perinatal period was estimated to be 7.4%-12.8% for depressive disorders, 3%-6% for anxiety disorders, and 3.3%-4.0% for posttraumatic stress disorders. Perinatal mental disorders during pregnancy and postpartum period are associated with considerable maternal, infant, and child morbidity and mortality[8-10]. In addition, they lead to huge economic burden on health and social care. Therefore, effective intervention is imperative. Psychotherapeutic intervention is considered a highly effective intervention for depression, anxiety, and stress.
Psychotherapeutic interventions are based on several principles, including cognitive behavioral therapy (CBT), mindfulness therapy, problem-solving therapy, stress-reduction therapy, psychoeducation intervention, or their combination. The assumption of CBT is that dysfunctional cognitive patterns result in emotional distress and subsequent maladaptive behavior. CBT aims to improve psychological outcomes by helping women learn how to recognize and modify destructive thought patterns. Mindfulness therapy suggests that negative psychological outcomes are due to automatic reaction. It works by training women to react to things differently, and it involves the awareness of existing thoughts, emotions, and sensations to cultivate acceptance of every moment.
The core assumption of problem-solving therapy is that psychological symptoms are generated when women become overwhelmed by practical problems they face in their daily lives. This type of therapy aims to help perinatal women by teaching structured means to solve their problems, which in turn alleviate their psychological outcomes. Stress-reduction therapy focuses on stress management that helps women develop skills to manage, cope with, and reduce stress to promote well-being. Psychoeducation intervention integrates and synergizes psychotherapeutic and educational components to help women deal with problems. Psychoeducational techniques are used to improve awareness of cognitive distortions, communication, and problem-solving skills by providing information in a proactive fashion.
Empirical evidence suggests that CBT, mindfulness therapy, problem-solving therapy, stress-reduction therapy, and psychoeducation intervention using face-to-face approach is effective in improving psychological outcomes among perinatal women. However, traditional face-to-face psychotherapeutic interventions may reduce effectiveness due to structural and psychological barriers[22-24]. Structural barriers include insufficient mental health professionals, difficulties booking appointments, and transportation problems[24,25]. Psychological barriers could arise due to the lack of motivation and self-stigmatization to seek treatment or overestimated barriers to seek treatment[26,27].
Digital technology continues to grow at an unprecedented pace with wide application, including psychotherapeutic intervention[28,29]. Psychotherapeutic intervention is considered as digital when technology, such as website, mobile application, email, or text messaging services, is used in its delivery. Given that 80% of the population own mobile phones and 50% have access to the Internet, the use of digital technology in psychotherapeutic interventions has increased rapidly over the past several years. Digital psychotherapeutic interventions essentially allow for improved connectivity, accessibility, and availability of support. With the interventions being delivered online, a potential exists for a larger audience to receive these interventions because they could likely be accessed regardless of geographical location. The option of implementing online programs helps mitigate the problem of insufficient healthcare professionals and reduce waiting times. Thus, digital psychotherapeutic interventions could be comparatively more cost effective than other interventions. Another important benefit is that digital psychotherapeutic interventions may be more attractive to individuals who may not feel comfortable with being out in public places or are reluctant to seek treatment due to social stigma.
Digital psychotherapeutic intervention aims at alleviating psychological symptoms with different assumptions and mechanisms in accordance with the different principles of psychotherapy. Figure 1 illustrates the possible mechanisms by which digital psychotherapeutic intervention could improve depression, anxiety, and stress symptoms in perinatal women. These mechanisms were proposed by extracting the frameworks of CBT, mindfulness therapy, problem-solving therapy, stress-reduction therapy, and psychoeducation intervention. Perinatal women experienced psychological problems due to dysfunctional thoughts, automatic reaction, being overwhelmed by problems, perceived stress, and knowledge deficit. They may learn how to modify destructive thought patterns, improve awareness, solve problems, reduce stress, and enhance their knowledge. The use of digital technology could improve the connectivity, accessibility, and flexibility of psychotherapeutic intervention in accordance with a wide array of functions of digital platform[28,29,31]. Besides, the digitalization of psychotherapy could reduce time strain, stigma, and personnel costs[22,32,33]. Consequently, perinatal women may alleviate their depression, anxiety, and stress symptoms.
Figure 1 Potential mechanisms of digital psychotherapeutic intervention in improving psychological outcomes.
A growing number of systematic reviews[28,34,35] have supported the effectiveness of digital psychotherapeutic intervention among college students, patients with serious mental illness, and young adults. However, relatively little is known about its effectiveness in the perinatal population. Previous reviews[36-38] have investigated the potential effect of digital psychotherapeutic intervention among perinatal women. However, these reviews were limited to few selected trials[37,38], a mixture of different research designs[36-38], few databases, and only narrative synthesis. None of these reviews investigated the preferred features and the overall evidence. In addition, none of them used meta-regression analysis to assess the influence of covariates on their effect size. Thus, the effectiveness and essential features of digital psychotherapeutic intervention among perinatal women remain unclear.
In light of the abovementioned limitations of the existing systematic reviews[36-38], the present review aims to synthesize the best evidence to (1) assess the effectiveness of digital psychotherapeutic intervention in reducing depression, anxiety, and stress symptoms; (2) evaluate the preferred design features of the intervention.
MATERIALS AND METHODS
The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines was followed. This review was registered in the PROSPERO database at the Centre of Reviews and Dissemination in the United Kingdom (CRD42021226534).
All types of randomized controlled trials (RCTs) were included because of the strongest empirical evidence of the intervention’s effectiveness. Published and unpublished trials in the English language without restriction to publication year were included to maximize the search scope. A description of the eligibility criteria is summarized in Supplementary Table 1. The RCTs were selected on the basis of their fulfilment of the Participants, Interventions, Comparisons, Outcomes, and Study design framework. The population involved perinatal women aged 18 years and older from the start of pregnancy to first-year postpartum. The psychotherapeutic interventions were included if the content design was based on the CBT theoretical principle, mindfulness therapy, problem-solving therapy, stress-reduction therapy, psychoeducation intervention, or their combination and if they were delivered via website or/and mobile application. The comparators or counterparts consisted of treatment as usual, waitlist control, or placebo control. Outcomes were depression, anxiety, and stress symptoms.
A scoping search was conducted in the Cochrane Central Register of Controlled Trials, Joanne Briggs Institute Evidence Synthesis, and PROSPERO databases to prevent duplication of similar systematic reviews. A senior librarian was consulted regarding the search strategy. A comprehensive three-step search strategy was conducted in congruence with the recommendations of the Cochrane Handbook for Systematic Reviews of Interventions. First, a search of published literature up until November 24, 2020 was conducted using keyword and index terms in eight electronic databases as follows: Cumulative Index to Nursing and Allied Health Literature, Cochrane Library, Embase, Scopus, PsycINFO, PubMed, Web of Science, and ProQuest Dissertation and Theses, as shown in Supplementary Table 2. Next, ongoing trials from various clinical trial registries (ClinicalTrials.gov, World Health Organization International Clinical Trials Registry Platform, and ISRCTN Registry) were explored. Lastly, the bibliographies of RCTs and systematic reviews were hand-searched using snowballing. In addition, specific journals and different grey literature resources (Google Scholar and GreySource) were checked to ensure the comprehensiveness of the search.
Study selection was conducted in accordance with the PRISMA flow diagram. EndNote X9 (version 9.3.3) software was used to import all identified citations and remove duplicates. After records from the databases were identified, two independent reviewers (JYC and KYY) screened the titles and abstracts for relevance. Full-text articles of eligible studies were retrieved and examined by the two reviewers independently on the basis of eligibility criteria. Differing responses were discussed and referred to a third reviewer (YL). Reasons for excluding trials in the full-text screening stage were recorded. A Kappa statistic (κ) larger than 0.6 was computed to determine an acceptable inter-rater agreement.
A standardized data extraction form was developed and piloted in accordance with the Cochrane Handbook for Systematic Reviews of Intervention. The items extracted in relation to the characteristics of the trials included study setting, city/country, study design, sample size, participants’ age (mean and standard deviation), sample size, intervention (name), comparator, outcome (measure), attrition rate, grant support, intention to treat (ITT), missing data management, published protocol, and registration. The items involving digital psychotherapeutic intervention included aim, types, component, platform, regime (length, number of sessions, frequency, duration, and follow-up), guidance (from therapist/self), and theoretical basis. Dichotomous or continuous psychological outcomes, such as depression, anxiety, and stress symptoms at post-intervention, were extracted. The authors of the selected trials were contacted to obtain unpublished data or clarify questionable information.
The Cochrane Collaboration risk-of-bias tool was adopted to individually evaluate the quality of the trials. Two reviewers (JYC and KYY) conducted the assessments independently to minimize errors. Selection, performance, detection, attrition, and reporting biases were assessed using the following six domains: (1) Random sequence generation; (2) Allocation concealment; (3) Participant and personnel blinding; (4) Outcome assessment blinding; (5) Incomplete outcome data; and (6) Selective reporting. The risk for each author was graded as low, high, or unclear. The attrition rate, ITT, missing data management, published protocol, and registration of selected trials were investigated to further assess the quality of evidence.
The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) checklist was adopted to judge the overall quality and strength of the recommendations by using GRADEpro 3.6 software. The overall evidence was graded as high, moderate, low, or very low in accordance with five aspects: Methodological limitations, inconsistency, indirectness, imprecision, and publication bias. Publication bias was evaluated through visual inspection of the funnel plot asymmetry and Egger’s test when each outcome included 10 or more trials.
Comprehensive Meta-Analysis software (version 3) was used for meta-analyses. The random-effect model was also used because it accounts for the statistical assumption of variation in the estimation of mean across all trials. The overall effect was computed using Z-statistics at a significance level of P < 0.05. The pooled mean effect sizes of psychological outcomes were estimated using Hedges’ g, which provides an accurate estimation of the overall effect size when the included trials have small sample sizes. The effect size was interpreted as small (0.2), medium (0.5), large (0.8), and very large (1.2).
The inverse-variance statistical method was utilized to compute continuous outcomes. Heterogeneity was evaluated on the basis of the Cochran Q test, in which P < 0.10 indicates the presence of significant statistical heterogeneity. The I2statistic was used to quantify the degree of heterogeneity, in which I2 indicates the variation percentage, such as 0%-40% (may not be important), 30%-60% (moderately important), 50%-90% (substantially important), and 75%-100% (considerably important).
Sensitivity analyses were conducted to identify heterogeneous trials that were removed to maintain overall homogeneity. Subgroup analyses were also performed to reduce the overall heterogeneity across studies (I2 > 40%) and compare the effects among various populations, settings, and features of intervention. The predefined subgroups included population nature, theoretical principle, digital platform, aim of intervention, guidance, and number of sessions.
Meta-regression analysis was conducted to explain whether the heterogeneity between trials could be attributed to covariates. A random-effect meta-regression model was used to assess if the year of publication, mean age, sample size, type of psychotherapy, number of sessions, and duration influenced the effect size of digital psychotherapeutic intervention. A significance level of P < 0.05 was used for the random-effect meta-regression analysis. Narrative synthesis of outcomes was performed when meta-analysis could not be conducted on the data.
Figure 2 illustrates a PRIMSA flowchart of the selection of trials. A total of 34249 articles were identified from eight databases, and 8046 duplicates were removed using Endnote. Six additional records obtained from snowballing were included. After screening was conducted by two independent reviewers (JYC and KYY), 26167 articles were excluded in accordance with their titles and abstracts, and 42 full-test articles were selected for eligibility. Twenty-five RCTs were eventually selected. Among them, 24 were international peer-reviewed articles[61-84] and one was an unpublished doctoral dissertation. Moderate agreement was reached between the dyad raters (κ = 0.78).
Figure 2 Study selection.
Characteristics of included randomized controlled trials
Table 1 summarizes the characteristics of 3239 perinatal women in the 25 included RCTs from 2009 to 2020 in Australia[73,75], Canada, China, Germany[70,71], Iran, Netherlands[66,76,76], Portugal, Scotland, Singapore, Sweden[65,74,78], Switzerland[82,83], the United States of America[62,63,69,85], the United Kingdom[79,80], and 23 countries. The RCTs were two armed (k = 22) or three armed (k = 3)[67,68,74]. They were conducted in hospital (k = 2)[68,84] or in the community (k = 23). The populations studied included healthy antenatal[61,62,74,76,77] and postnatal[68,85] women and women who experienced psychological problems[64-67,73,75,77-81,84], insomnia[63,69], preterm labor[82,83], miscarriage, or pregnancy loss[70,71]. The sample size ranged from 25 to 910. The mean age was between 27.7 and 34.6 years.
Table 1 Characteristics of selected 25 randomised controlled trials.
BAI: Beck anxiety inventory; BDI-II: Beck depression inventory-II; C: Control; CES-D: Center for epidemiological studies depression; CES-D: Centre for epidemiologic studies-depression scale; DASS-21-A: Depression, anxiety and stress scales-21- anxiety subscale; DASS-21-D: Depression, anxiety and stress scales-21- depression subscale; DASS-21-S: Depression, anxiety and stress scales-21- stress subscale; EPDS: Edinburgh postnatal depression scale; GAD-7: Generalized anxiety disorder scale; GSI-A: Global severity index-anxiety subscale; GSI-D: Global severity index-depression subscale; HADS-A: Hospital anxiety and depression scale-anxiety subscale; HADS-A: Hospital anxiety and depression scale-anxiety subscale; HADS-D: Hospital anxiety and depression scale-depression subscale; HDRS: Hamilton depression rating scale; I: Intervention; IES: Impact of event scale; IES-R: Impact of event scale-revised; ISI: Insomnia severity index; ITT: Intention-to-treat analysis; K-10: Kessler psychological distress 10-item scale; MADRS-S: Montgomery-Asberg depression rating scale self-report version; MDM: Missing data management; MINI: International neuropsychiatric interview; NR: Not reported; PDPI-R: Postpartum depression predictors inventory-revised; PDQ: Prenatal distress scale; PHQ-8: Patient health questionnaire-8; PRA: The pregnancy related anxiety test; PSI: Parenting stress index; PSS: Perceived stress scale; RCT: Randomised controlled trial; SCI: Sleep condition indicator; SCI-I: Structural clinical interview for DSM Axis I disorders; STAI: State trait anxiety inventory; STAI-S: Spielberger state trait anxiety inventory; TES: Traumatic event scale.
Risk of bias
A risk-of-bias summary is shown in Supplementary Figure 1 with moderate inter-rater agreement (κ = 0.72). Among the 25 included RCTs, 53.33% had low risk of bias across six domains. More than half (56%) had unclear allocation concealment. The participants and personnel in the majority of trials were not blinded (92%). Assessment of the outcomes was also not blinded in most trials (72%). Eleven RCTs[61,70-72,74,78-80,84,85] did not have published protocols nor were registered in any clinical trial registry. Therefore, 44% of the reported bias was unclear. The attrition rates ranged from 1.1% to 66.1%. The majority of trials used ITT analysis (68%) and mentioned missing data management (60%).
Digital psychotherapeutic intervention
A detailed description of digital psychotherapeutic intervention for the 25 trials is presented in Supplementary Table 3. The aims of intervention were divided into prevention and treatment using CBT principles, mindfulness therapy, problem-solving therapy, stress-reduction therapy, psychoeducation intervention, or the combined version. The interventions were mainly delivered via website (k = 22) or mobile application (k = 4)[63,67,77,84], and some of them were supplemented with email, phone call, short messaging service, or home visit. The elements consisted of counselling, education, advice, assignment, feedback, reminder, forum, support, self-monitoring, questions, and answers. The interventions lasted between 10 and 90 min and ranged from three sessions to 12 sessions for 3-15 wk. They were either self-guided (k = 7)[61,64,65,67,73,83,85] or therapist-guided (k = 18). The majority of them reported follow-up assessment (k = 19) a using theoretical basis (k = 23).
A total of 19 RCTs[62,65-76,78-81,84,85] considered depression symptoms as the outcome among 1736 perinatal women by using various measures. Meta-analysis results observed that digital psychotherapeutic intervention had a medium effect size (g = 0.49) in alleviating depression symptoms significantly (Z = -3.75, P < 0.001) compared with the control. Figure 3 illustrates the pooled results of meta-analysis using the random-effect model. Sensitivity and subgroup analyses were conducted given the considerable heterogeneity (I2 = 84.41). However, the heterogeneity remained unexplained.
Figure 3 Forest plot of Hedges’s g (95% confidence interval) in depression symptoms for digital psychotherapeutic intervention and comparators.
A series of subgroup analyses was conducted (Table 2) on the basis of population nature, theoretical principle, digital platform, aim of intervention, guidance, and number of sessions. The effect sizes were greater and significant among postnatal women (g = 0.67) than antenatal women (g = 0.24). Subgroup analyses demonstrated that the essential features of the intervention, that is, the use of CBT principle only (g = 0.56) via a website platform (g = 0.32) for the purpose of treatment (g = 0.71) were significant. Therapist-guided intervention (g = 0.40) and ≥ eight sessions were more effective than their counterparts. However, no significant subgroup differences (P = 0.09–0.54) were found.
Table 2 Subgroup analyses of digital psychotherapeutic intervention on depression symptoms.
Univariate and multivariate random-effect regression was performed to examine whether the effect size magnitude was related to covariates (year of trials, age, sample size, number of sessions, type of psychotherapy, and duration of intervention), as shown in Table 3. The results of univariate and multivariate random-effect regression analyses showed that age (β = 0.18, P = 0.02; β = 0.14, P = 0.04, respectively) and the use of CBT (β = 0.07, P < 0.001; β = 0.07, P < 0.001, respectively) had significant effects on depression symptoms. The Q-value for the multivariate random-effect regression model was 68.76, with df = 16 and P < 0.001. Thus, the null hypothesis was rejected, and the effect size was related to covariates. The explained variance (R2 = 0.364) was calculated using the regression model, and it revealed that 36.40% of the variance in true effects could be explained by these two covariates. Two bubble plots of depression symptoms on age and types of psychotherapy are presented in Supplementary Figure 2. The multivariate meta-regression model suggested that younger perinatal women who received CBT showed a larger effect size in terms of improving depression symptoms than older perinatal women who received other psychotherapies. However, covariates such as year of trial, sample size, number of sessions, and duration of intervention had no effect on these symptoms.
Table 3 Random-effects univariate and multivariate meta-regression analyses of covariates on depression symptoms.
β: Coefficient; SE: Standard error; CI: Confident interval.
Anxiety and stress symptoms
Fourteen RCTs[65,66,70-73,75,76,78,79,81,82,84,85] assessed the effectiveness of digital psychotherap-eutic intervention in 1091 perinatal women by using anxiety as an outcome. Meta-analysis results indicated that digital psychotherapeutic intervention exerted a significant effect on improving anxiety symptoms (Z = -5.72, P = 0.007), with a small effect size (g = 0.25), as shown Figure 4. Moderate heterogeneity (I2 = 50.70%) was also found. Another 10 RCTs[70,71,73-76,78,81,82,85] used stress as an outcome in 720 perinatal women. Meta-analysis results demonstrated that stress symptoms were significantly reduced (Z = -2.90, P < 0.001) in the intervention group with a medium effect size (g = 0.47) compared with the comparator (Figure 5). Considerable heterogeneity (I2 = 75.34%) was also revealed. Sensitivity and subgroup analyses were conducted to decrease the I2 in both outcomes, but the heterogeneity did not improve.
Figure 4 Forest plot of Hedges’s g (95% confidence interval) in anxiety symptoms for digital psychotherapeutic intervention and comparators.
Figure 5 Forest plot of Hedges’s g (95% confidence interval) in stress symptoms for digital psychotherapeutic intervention and comparators.
Given that five trials[61,63,64,77,83] did not report inadequate data for pooling of data in the present meta-analysis, the authors were contacted three times to ask for supplementary data on the psychological outcomes. Unfortunately, the team did not receive any reply. Thus, narrative synthesis was conducted. One trial showed that digital CBT considerably reduced depression and anxiety symptoms. However, one trial did not clearly report psychological outcomes after intervention, and another three[61,77,83] suggested that the intervention did not significantly improve the psychological outcomes. These inconsistencies indicated the need for further investigation.
In accordance with the GRADE criteria, the overall quality of evidence was graded as very low (Supplementary Figure 2). For the outcome measures of depression, anxiety, and stress symptoms, methodological limitations were downgraded because of performance, selection, and detection biases. Inconsistency was downgraded because of moderate to considerable heterogeneities (50.70%–84.41%). Indirectness was downgraded due to the variation in digital psychotherapeutic interventions. Imprecision was downgraded because of small sample size with wide confidence intervals. Publication bias was not detected for trials that reported depression, anxiety, and stress scores, as observed from the symmetrical distribution of the included trials on the funnel plots (Supplementary Table 4). The P value of Egger’s regression asymmetry tests ranged from 0.24 to 0.33, thereby suggesting no evidence of publication bias.
This review revealed statistically significantly lower depression, anxiety, and stress symptom scores with small to medium effect in digital psychotherapeutic intervention than in the comparators. Subgroup analyses identified that the essential features of the intervention, that is a website platform with ≥ eight therapist-guided sessions using CBT principle for treatment among postnatal women appeared to be more effective in improving depression symptoms than their counterparts. Meta-regression analyses observed that the age of perinatal women and the type of psychotherapy had statistically significant effects on depression symptoms.
The findings revealed that digital psychotherapeutic interventions were effective in improving depression, anxiety, and stress symptoms among perinatal women. These results are consistent with those of previous reviews[36-38]. They could explain the proposed mechanistic pathways linking digital psychotherapeutic intervention to psychological outcomes (Figure 1). Digital psychotherapeutic interventions aid perinatal women to modify their dysfunctional thoughts, ameliorate their level of awareness, enhance their problem-solving skills, deal with stress, and acquire further knowledge. Such principles of psychotherapy help build resilience, as women are able to learn and strengthen their cognitive flexibility. Digital platform allows for improving connectivity, accessibility, and availability. Moreover, it could reduce the time constraint, social stigma, and cost[22,32,33]. The components of digital psychotherapeutic interventions involve reminders, forums, and self-monitoring; they help enhance the ability of women to actively adapt to their circumstances and improve their abilities to cope with stressful perinatal situations. As a result, perinatal women may improve their depression, anxiety and stress symptoms.
Subgroup and meta-regression analyses highlighted that the use of the CBT principle, therapist support, and ≥ eight sessions using website platform for treatment among postnatal young women could optimize the intervention effect. Efficacious intervention adopted the CBT principle, possibly because CBT is a patient-centered and personalized therapy that uses collaborative psychological approach. The core components of cognitive restructuring and behavioral activation assist perinatal women to understand their own special beliefs and behavior patterns via counselling, education, advice, and assignment and finding an enhanced method to modify their dysfunctional thoughts, thus bringing about emotional and behavioral changes and improving their psychological problems. Therapist support involved increased levels of customized human support to provide feedback, support, questions, and answers in a flexible manner for clarifications that could intensify the effect of intervention and improve depression symptoms. In addition, ≥ eight sessions was suggested to be the appropriate number for intervention. This finding seems to be a possible explanation of a dose-response effect from the cumulative intervention intensity.
The interventions are effective for the purpose of treatment, and they are targeted at complicated perinatal women, such as those who experienced psychological problems[65-67,73,75,78-81,84], insomnia, miscarriage, or pregnancy loss[70,71]. This finding is consistent with that of a previous review, which showed that preventive digital psychotherapy may not be as effective as when targeted at high-risk perinatal women. High-risk women are possibly more willing to seek help and be actively involved in psychotherapy because they felt depressed, anxious, or stressed for a long period than low-risk women[3,24].
Young women are particularly at high risk of having perinatal mental disorders because they may not access antenatal care or mental health services in a timely manner. Similar to the findings of a previous review, interventions implemented during the postnatal period were more effective than those implemented during the antenatal period. Postnatal period is a time of adaptation to parenthood, and postnatal women need to adjust to the new role of motherhood and familial relationships. Therefore, interventions were found to be more effective in postnatal women. Website was found to be the preferred platform among perinatal women. This case may be linked to perinatal women expressing interest in the use of web-based resources and their increased engagement in e-mental health. One study suggested that mobile applications are an important source of support during childbearing. Low statistical power in small sample size was possible because only two trials were conducted in 198 perinatal women by using mobile applications in subgroup analysis. Further investigation is necessary.
This review demonstrates that digital psychotherapeutic intervention may be a potential solution to reduce psychological problems in perinatal women. The poor quality of existing evidence reduced certainty in implementing digital psychotherapeutic intervention at this phase. However, the subgroup and meta-regression analysis results could provide a future direction in designing interventions effectively. Future designs should consider therapist-guided treatment among young postnatal women.
This systematic review has several strengths. It is the first systematic review to investigate the essential features, covariates, and quality of the overall evidence. A total of 25 RCTs were selected, and the PRISMA criteria were strictly followed, with a robust three-step search strategy throughout eight databases. RCTs were selected from over 23 countries using published and unpublished resources. Hedges’s g was adopted to accurately estimate the overall effect size because of the small sample size in most of the included RCTs. However, this review also has some limitations. First, the restriction to trials in English and self-selected samples from media recruitment may have limited the generalization of the findings. Second, the high heterogeneities in the meta-analyses could have resulted from the low accuracy of pooled estimates. Third, self-report measures may have led to overestimation or underestimation of the effect size. Fourth, very low overall evidence could have diminished the internal validity of the findings. Lastly, this review only pooled post-intervention outcomes; thus, the sustainability of digital psychotherapeutic intervention remains uncertain.
This review highlighted a number of directions for future trials. Further well-designed RCTs are needed, particularly allocation concealment, participant and personnel blinding, and outcome assessment blinding. Future RCTs should stick to the consolidated standards of reporting trial statements. Future trials should also consider a large sample size to provide a more precise estimate of the effect size and generalize the results. Considering that CBTs using website platform have dominated the existing literature, upcoming research should focus on different types of psychotherapy using other digital platforms for fair comparison. Future trials are warranted to assess the long-term effect and cost-effectiveness of digital psychotherapeutic intervention among perinatal women.
Meta-analyses found a small to medium and significant group difference favoring digital psychotherapeutic interventions over the comparators in regard to depression, anxiety, and stress outcomes. This systematic review provides evidence for the effectiveness of digital psychotherapeutic intervention in reducing psychological problems during the perinatal period. Future designs should consider the use of CBT principle, therapist support, and ≥ eight sessions using website platform for the treatment of postnatal young women. Further high-quality RCTs with large sample sizes are required to evaluate the sustainability of the intervention.
Perinatal women are at increased susceptibility of psychological problems, including depression, anxiety, and stress. Perinatal psychological problems are associated with considerable adverse effects on women, offspring, family, and healthcare services.
Previous reviews were limited to few selected trials, a mixture of different research designs, few databases, and only narrative synthesis. None of the previous reviews investigated the preferred features of digital psychotherapeutic intervention and the influence of covariates on study effect size.
This review aimed to synthesize the best evidence to (1) assess the effectiveness of digital psychotherapeutic intervention in reducing depression, anxiety, and stress symptoms; and (2) evaluate the preferred design features of the intervention.
A comprehensive three-step search strategy was conducted in congruence with the recommendations of the Cochrane Handbook for Systematic Reviews of Interventions from eight databases. Comprehensive Meta-analysis 3.0 software was used to conduct meta- and meta-regression analyses. The individual and overall quality of the evidence were evaluated using the Cochrane risk-of-bias tool and the Grading of Recommendations, Assessment, Development, and Evaluation criteria.
A total of 25 randomized controlled trials that included 3239 perinatal women were identified. Meta-analyses revealed that digital psychotherapeutic intervention significantly improved the depression (g = 0.49), anxiety (g = 0.25), and stress (g = 0.47) symptoms of perinatal women compared to the control. Subgroup analyses demonstrated that a website platform with ≥ eight therapist-guided sessions using the cognitive behavioral therapy theoretical principle was more effective than other treatments in postnatal women. Meta-regression analyses observed that the age of perinatal women and the type of psychotherapy had statistically significant effects on depression symptoms. Egger’s regression asymmetry tests found no publication biases, but the overall quality of evidence was very low.
This systematic review provides evidence for the effectiveness of digital psychotherapeutic intervention in reducing psychological problems during the perinatal period, particularly depression, anxiety, and stress symptoms. Future designs should consider the use of the cognitive behavioral therapy principle, therapist support, and ≥ eight sessions using a website platform for the treatment of postnatal young women.
Given that the poor quality of the existing evidence reduced certainty in implementing digital psychotherapeutic intervention at this phase, further high-quality randomized controlled trials with large sample sizes are required to evaluate the sustainability of the intervention.
The authors would like to thank authors of the randomized controlled trials considered for sharing their additional data for use in our meta-analysis.
P-Reviewer: Feng QS, Lee PN S-Editor: Zhang L L-Editor: A P-Editor: Li JH
Garcia ER, Yim IS. A systematic review of concepts related to women's empowerment in the perinatal period and their associations with perinatal depressive symptoms and premature birth.BMC Pregnancy Childbirth. 2017;17:347.
Lederman RP, Weis KL.
Psychosocial anxiety, stress, and adaptation in pregnancy: assessment of seven dimensions of maternal development. Psychosocial adaptation to pregnancy: seven dimensions of maternal development. Cham: Springer International Publishing, 2020: 1-50.
Howard LM, Khalifeh H. Perinatal mental health: a review of progress and challenges.World Psychiatry. 2020;19:313-327.
Agius A, Xuereb RB, Carrick-Sen D, Sultana R, Rankin J. The co-existence of depression, anxiety and post-traumatic stress symptoms in the perinatal period: A systematic review.Midwifery. 2016;36:70-79.
Howdeshell KL, Ornoy A. Depression and Its Treatment During Pregnancy: Overview and Highlights.Birth Defects Res. 2017;109:877-878.
Viswasam K, Eslick GD, Starcevic V. Prevalence, onset and course of anxiety disorders during pregnancy: A systematic review and meta-analysis.J Affect Disord. 2019;255:27-40.
Yildiz PD, Ayers S, Phillips L. The prevalence of posttraumatic stress disorder in pregnancy and after birth: A systematic review and meta-analysis.J Affect Disord. 2017;208:634-645.
Pais M, Pai MV. Stress among pregnant women: a systematic review.J Clin Diagn. 2018;12:LE01-LE04.
Rees S, Channon S, Waters CS. The impact of maternal prenatal and postnatal anxiety on children's emotional problems: a systematic review.Eur Child Adolesc Psychiatry. 2019;28:257-280.
Nillni YI, Mehralizade A, Mayer L, Milanovic S. Treatment of depression, anxiety, and trauma-related disorders during the perinatal period: A systematic review.Clin Psychol Rev. 2018;66:136-148.
Cognitive behavior therapy: Basic and beyond. 3rd ed. New York: The Guilford Press, 2021.
Van Lieshout RJ, Yang L, Haber E, Ferro MA. Evaluating the effectiveness of a brief group cognitive behavioural therapy intervention for perinatal depression.Arch Womens Ment Health. 2017;20:225-228.
Luberto CM, Park ER, Goodman JH. Postpartum Outcomes and Formal Mindfulness Practice in Mindfulness-Based Cognitive Therapy for Perinatal Women.Mindfulness (N Y). 2018;9:850-859.
Sampson M, Villarreal Y, Rubin A. A problem-solving therapy intervention for low-income, pregnant women at risk for postpartum depression.Res Soc Work Pract. 2014;26:236.
Urizar GG Jr, Caliboso M, Gearhart C, Yim IS, Dunkel Schetter C. Process Evaluation of a Stress Management Program for Low-Income Pregnant Women: The SMART Moms/Mamás LÍSTAS Project.Health Educ Behav. 2019;46:930-941.
Kariuki EW, Kuria MW, Were FN, Ndetei DM. Effectiveness of a brief psychoeducational intervention on postnatal depression in the slums, Nairobi: a longitudinal study.Arch Womens Ment Health. 2020;.
Tal A, Torous J. The digital mental health revolution: Opportunities and risks.Psychiatr Rehabil J. 2017;40:263-265.
Renn BN, Hoeft TJ, Lee HS, Bauer AM, Areán PA. Preference for in-person psychotherapy vs digital psychotherapy options for depression: survey of adults in the U.S.NPJ Digit Med. 2019;2:6.
Sambrook Smith M, Lawrence V, Sadler E, Easter A. Barriers to accessing mental health services for women with perinatal mental illness: systematic review and meta-synthesis of qualitative studies in the UK.BMJ Open. 2019;9:e024803.
Baker N, Gillman L, Coxon K. Assessing mental health during pregnancy: An exploratory qualitative study of midwives' perceptions.Midwifery. 2020;86:102690.
Chan SYY, Ho GWK, Bressington D. Experiences of self-stigmatization and parenting in Chinese mothers with severe mental illness.Int J Ment Health Nurs. 2019;28:527-537.
Husain W. Barriers in Seeking Psychological Help: Public Perception in Pakistan.Community Ment Health J. 2020;56:75-78.
Fu Z, Burger H, Arjadi R, Bockting CLH. Effectiveness of digital psychological interventions for mental health problems in low-income and middle-income countries: a systematic review and meta-analysis.Lancet Psychiatry. 2020;7:851-864.
Garrido S, Millington C, Cheers D, Boydell K, Schubert E, Meade T, Nguyen QV. What Works and What Doesn't Work?Front Psychiatry. 2019;10:759.
The World Bank Group.
World development report 2016: Digital dividends. [cited 30 December 2020]. Available from: https://www.worldbank.org/en/publication/wdr2016.
Graham AK, Lattie EG, Powell BJ, Lyon AR, Smith JD, Schueller SM, Stadnick NA, Brown CH, Mohr DC. Implementation strategies for digital mental health interventions in health care settings.Am Psychol. 2020;75:1080-1092.
Kraepelien M, Mattsson S, Hedman-Lagerlöf E, Petersson IF, Forsell Y, Lindefors N, Kaldo V. Cost-effectiveness of internet-based cognitive-behavioural therapy and physical exercise for depression.BJPsych Open. 2018;4:265-273.
Rogers MA, Lemmen K, Kramer R, Mann J, Chopra V. Internet-Delivered Health Interventions That Work: Systematic Review of Meta-Analyses and Evaluation of Website Availability.J Med Internet Res. 2017;19:e90.
Batra S, Baker RA, Wang T, Forma F, DiBiasi F, Peters-Strickland T. Digital health technology for use in patients with serious mental illness: a systematic review of the literature.Med Devices (Auckl). 2017;10:237-251.
Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital Mental Health Interventions for Depression, Anxiety, and Enhancement of Psychological Well-Being Among College Students: Systematic Review.J Med Internet Res. 2019;21:e12869.
Ashford MT, Olander EK, Ayers S. Computer- or web-based interventions for perinatal mental health: A systematic review.J Affect Disord. 2016;197:134-146.
Lee EW, Denison FC, Hor K, Reynolds RM. Web-based interventions for prevention and treatment of perinatal mood disorders: a systematic review.BMC Pregnancy Childbirth. 2016;16:38.
Loughnan SA, Joubert AE, Grierson A, Andrews G, Newby JM. Internet-delivered psychological interventions for clinical anxiety and depression in perinatal women: a systematic review and meta-analysis.Arch Womens Ment Health. 2019;22:737-750.
Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.PLoS Med. 2009;6:e1000097.
Hariton E, Locascio JJ. Randomised controlled trials - the gold standard for effectiveness research: Study design: randomised controlled trials.BJOG. 2018;125:1716.
Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors).
Cochrane Handbook for Systematic Reviews of Interventions. 2nd ed. Chichester (UK): John Wiley & Sons, 2019.
Paez A. Gray literature: An important resource in systematic reviews.J Evid Based Med. 2017;10:233-240.
EndNote X9 [Computer Program]. Philadelphia: Clarivate Analytics, 2019. [cited 30 December 2020]. Available from: https://clarivate.libguides.com/endnote_training/users/enx9.
McHugh ML. Interrater reliability: the kappa statistic.Biochem Med (Zagreb). 2012;22:276-282.
Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, Guyatt GH, Harbour RT, Haugh MC, Henry D, Hill S, Jaeschke R, Leng G, Liberati A, Magrini N, Mason J, Middleton P, Mrukowicz J, O'Connell D, Oxman AD, Phillips B, Schünemann HJ, Edejer T, Varonen H, Vist GE, Williams JW Jr, Zaza S; GRADE Working Group. Grading quality of evidence and strength of recommendations.BMJ. 2004;328:1490.
Guideline Development Tool [Software]. [cited 30 December 2020]. McMaster University, 2020 (developed by Evidence Prime, Inc.). Available from: https://gradepro.org/.
Schünemann H, Brożek J, Guyatt G, Oxman A.
GRADE handbook for grading quality of evidence and strength of recommendations, 2013. [cited 30 December 2020]. Available from: https://gdt.gradepro.org/app/handbook/handbook.html.
Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, Carpenter J, Rücker G, Harbord RM, Schmid CH, Tetzlaff J, Deeks JJ, Peters J, Macaskill P, Schwarzer G, Duval S, Altman DG, Moher D, Higgins JP. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials.BMJ. 2011;343:d4002.
Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test.BMJ. 1997;315:629-634.
Borenstein M, Hedges L, Higgins J, Rothstein H.
Comprehensive Meta-Analysis Version 3. Englewood, NJ: Biostat, 2013.
Borenstein M, Hedges LV, Higgins JP, Rothstein HR. A basic introduction to fixed-effect and random-effects models for meta-analysis.Res Synth Methods. 2010;1:97-111.
Parametric measures of effect size. In: Cooper H, Hedges L. The handbook of research synthesis. New York: Russell Sage Foundation, 1994: 231-244.
Hedges LV, Olkin I.
Statistical methods for meta-analysis: Academic press, 2014.
Sedgwick P. Meta-analyses: heterogeneity and subgroup analysis.BMJ . 2013;346:f4040.
Deeks JJ, Higgins JPT, Altman DG.
Analysing data and undertaking meta-analyses. 2nd ed. Chichester (UK): John Wiley & Sons, 2019.
Saltelli A, Tarantola S, Campolongo F, Ratto M.
Sensitivity analysis in practice: A guide to assessing scientific models. Ispra, Italy: John Wiley & Sons, 2004: 1-29.
Richardson M, Garner P, Donegan S. Interpretation of subgroup analyses in systematic reviews: A tutorial.Clin Epidemiol Glob Health. 2019;7:192.
Borenstein M, Higgins JP. Meta-analysis and subgroups.Prev Sci. 2013;14:134-143.
Borenstein M, Hedges L, Higgins J, Rothstein H.
Introduction to meta-analysis. John Wiley & Sons, 2011.
Barrera AZ, Wickham RE, Muñoz RF. Online prevention of postpartum depression for Spanish- and English-speaking pregnant women: A pilot randomized controlled trial.Internet Interv. 2015;2:257-265.
Duffecy J, Grekin R, Hinkel H, Gallivan N, Nelson G, O'Hara MW. A Group-Based Online Intervention to Prevent Postpartum Depression (Sunnyside): Feasibility Randomized Controlled Trial.JMIR Ment Health. 2019;6:e10778.
Felder JN, Epel ES, Neuhaus J, Krystal AD, Prather AA. Efficacy of Digital Cognitive Behavioral Therapy for the Treatment of Insomnia Symptoms Among Pregnant Women: A Randomized Clinical Trial.JAMA Psychiatry. 2020;77:484-492.
Fonseca A, Monteiro F, Alves S, Gorayeb R, Canavarro MC. Be a Mom, a Web-Based Intervention to Prevent Postpartum Depression: The Enhancement of Self-Regulatory Skills and Its Association with Postpartum Depressive Symptoms.Front Psychol. 2019;10:265.
Forsell E, Bendix M, Holländare F, Szymanska von Schultz B, Nasiell J, Blomdahl-Wetterholm M, Eriksson C, Kvarned S, Lindau van der Linden J, Söderberg E, Jokinen J, Wide K, Kaldo V. Internet delivered cognitive behavior therapy for antenatal depression: A randomised controlled trial.J Affect Disord. 2017;221:56-64.
Heller HM, Hoogendoorn AW, Honig A, Broekman BFP, van Straten A. The Effectiveness of a Guided Internet-Based Tool for the Treatment of Depression and Anxiety in Pregnancy (MamaKits Online): Randomized Controlled Trial.J Med Internet Res. 2020;22:e15172.
Jannati N, Mazhari S, Ahmadian L, Mirzaee M. Effectiveness of an app-based cognitive behavioral therapy program for postpartum depression in primary care: A randomized controlled trial.Int J Med Inform. 2020;141:104145.
Jiao N, Zhu L, Chong YS, Chan WS, Luo N, Wang W, Hu R, Chan YH, He HG. Web-based vs home-based postnatal psychoeducational interventions for first-time mothers: A randomised controlled trial.Int J Nurs Stud. 2019;99:103385.
Kalmbach DA, Cheng P, O'Brien LM, Swanson LM, Sangha R, Sen S, Guille C, Cuamatzi-Castelan A, Henry AL, Roth T, Drake CL. A randomized controlled trial of digital cognitive behavioral therapy for insomnia in pregnant women.Sleep Med. 2020;72:82-92.
Kersting A, Dölemeyer R, Steinig J, Walter F, Kroker K, Baust K, Wagner B. Brief Internet-based intervention reduces posttraumatic stress and prolonged grief in parents after the loss of a child during pregnancy: a randomized controlled trial.Psychother Psychosom. 2013;82:372-381.
Kersting A, Kroker K, Schlicht S, Baust K, Wagner B. Efficacy of cognitive behavioral internet-based therapy in parents after the loss of a child during pregnancy: pilot data from a randomized controlled trial.Arch Womens Ment Health. 2011;14:465-477.
Klein S, Cumming GP, Lee AJ, Alexander DA, Bolsover D. Evaluating the effectiveness of a web-based intervention to promote mental wellbeing in women and partners following miscarriage, using a modified patient preference trial design: an external pilot.BJOG. 2012;119:762-767.
Loughnan SA, Sie A, Hobbs MJ, Joubert AE, Smith J, Haskelberg H, Mahoney AEJ, Kladnitski N, Holt CJ, Milgrom J, Austin MP, Andrews G, Newby JM. A randomized controlled trial of 'MUMentum Pregnancy': Internet-delivered cognitive behavioral therapy program for antenatal anxiety and depression.J Affect Disord. 2019;243:381-390.
Matvienko-Sikar K, Dockray S. Effects of a novel positive psychological intervention on prenatal stress and well-being: A pilot randomised controlled trial.Women Birth. 2017;30:e111-e118.
Milgrom J, Danaher BG, Gemmill AW, Holt C, Holt CJ, Seeley JR, Tyler MS, Ross J, Ericksen J. Internet Cognitive Behavioral Therapy for Women with Postnatal Depression: A Randomized Controlled Trial of MumMoodBooster.J Med Internet Res. 2016;18:e54.
Missler M, van Straten A, Denissen J, Donker T, Beijers R. Effectiveness of a psycho-educational intervention for expecting parents to prevent postpartum parenting stress, depression and anxiety: a randomized controlled trial.BMC Pregnancy Childbirth. 2020;20:658.
Molenaar NM, Brouwer ME, Burger H, Kamperman AM, Bergink V, Hoogendijk WJG, Williams AD, Bockting CLH, Lambregtse-van den Berg MP. Preventive Cognitive Therapy with Antidepressant Discontinuation during Pregnancy: Results from a Randomized Controlled Trial.J Clin Psychiatry. 2020;81.
Nieminen K, Berg I, Frankenstein K, Viita L, Larsson K, Persson U, Spånberger L, Wretman A, Silfvernagel K, Andersson G, Wijma K. Internet-provided cognitive behaviour therapy of posttraumatic stress symptoms following childbirth-a randomized controlled trial.Cogn Behav Ther. 2016;45:287-306.
O'Mahen HA, Richards DA, Woodford J, Wilkinson E, McGinley J, Taylor RS, Warren FC. Netmums: a phase II randomized controlled trial of a guided Internet behavioural activation treatment for postpartum depression.Psychol Med. 2014;44:1675-1689.
O'Mahen HA, Woodford J, McGinley J, Warren FC, Richards DA, Lynch TR, Taylor RS. Internet-based behavioral activation--treatment for postnatal depression (Netmums): a randomized controlled trial.J Affect Disord. 2013;150:814-822.
Pugh NE, Hadjistavropoulos HD, Dirkse D. A Randomised Controlled Trial of Therapist-Assisted, Internet-Delivered Cognitive Behavior Therapy for Women with Maternal Depression.PLoS One. 2016;11:e0149186.
Scherer S, Alder J, Gaab J, Berger T, Ihde K, Urech C. Patient satisfaction and psychological well-being after internet-based cognitive behavioral stress management (IB-CBSM) for women with preterm labor: A randomized controlled trial.J Psychosom Res. 2016;80:37-43.
Urech C, Scherer S, Emmenegger M, Gaab J, Tschudin S, Hoesli I, Berger T, Alder J. Efficacy of an internet-based cognitive behavioral stress management training in women with idiopathic preterm labor: A randomized controlled intervention study.J Psychosom Res. 2017;103:140-146.
Yang M, Jia G, Sun S, Ye C, Zhang R, Yu X. Effects of an Online Mindfulness Intervention Focusing on Attention Monitoring and Acceptance in Pregnant Women: A Randomized Controlled Trial.J Midwifery Womens Health. 2019;64:68-77.
The effectiveness of an Internet-based stress management program in the prevention of postpartum stress, anxiety and depression for new mothers. Dissertations & Theses - Gradworks, 2009 [cited 30 December 2020]. Available from: https://xueshu.baidu.com/usercenter/paper/show?paperid=73cb128bc68565f0d391427d0a7c30cc&site=xueshu_se.
Nagata S, Seki Y, Shibuya T, Yokoo M, Murata T, Hiramatsu Y, Yamada F, Ibuki H, Minamitani N, Yoshinaga N, Kusunoki M, Inada Y, Kawasoe N, Adachi S, Oshiro K, Matsuzawa D, Hirano Y, Yoshimura K, Nakazato M, Iyo M, Nakagawa A, Shimizu E. Does cognitive behavioral therapy alter mental defeat and cognitive flexibility in patients with panic disorder?BMC Res Notes. 2018;11:23.
Sockol LE. A systematic review of the efficacy of cognitive behavioral therapy for treating and preventing perinatal depression.J Affect Disord. 2015;177:7-21.
Lau Y, Htun TP, Wong SN, Tam WSW, Klainin-Yobas P. Therapist-Supported Internet-Based Cognitive Behavior Therapy for Stress, Anxiety, and Depressive Symptoms Among Postpartum Women: A Systematic Review and Meta-Analysis.J Med Internet Res. 2017;19:e138.
Robinson L, Delgadillo J, Kellett S. The dose-response effect in routinely delivered psychological therapies: A systematic review.Psychother Res. 2020;30:79-96.
Finlayson K, Crossland N, Bonet M, Downe S. What matters to women in the postnatal period: A meta-synthesis of qualitative studies.PLoS One. 2020;15:e0231415.
Fonseca A, Gorayeb R, Canavarro MC. Women's use of online resources and acceptance of e-mental health tools during the perinatal period.Int J Med Inform. 2016;94:228-236.
Connor K, Wambach K, Baird MB. Descriptive, Qualitative Study of Women Who Use Mobile Health Applications to Obtain Perinatal Health Information.J Obstet Gynecol Neonatal Nurs. 2018;47:728-737.
Moher D, Schulz KF, Altman D; CONSORT Group (Consolidated Standards of Reporting Trials). The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials.JAMA. 2001;285:1987-1991.