|
1
|
Bahadoran Z, Mirmiran P, Kashfi K, Ghasemi A. Importance of Systematic Reviews and Meta-analyses of Animal Studies: Challenges for Animal-to-Human Translation. JOURNAL OF THE AMERICAN ASSOCIATION FOR LABORATORY ANIMAL SCIENCE : JAALAS 2020; 59:469-477. [PMID: 32727637 PMCID: PMC7479780 DOI: 10.30802/aalas-jaalas-19-000139] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2019] [Revised: 11/29/2019] [Accepted: 02/18/2020] [Indexed: 12/15/2022]
Abstract
Results of animal experiments are used for understanding the pathophysiology of diseases, assessing safety and efficacy of newly developed drugs, and monitoring environmental health hazards among others. Systematic reviews and meta-analyses of animal data are important tools to condense animal evidence and translate the data into practical clinical applications. Such studies are conducted to explore heterogeneity, to generate new hypotheses about pathophysiology and treatment, to design new clinical trial modalities, and to test the efficacy and the safety of the various interventions. Here, we provide an overview regarding the importance of systematic reviews and meta-analyses of animal data and discuss common challenges and their potential solutions. Current evidence highlights various problems and challenges that surround these issues, including lack of generalizability of data obtained from animal models, failure in translating data obtained from animals to humans, poor experimental design and the reporting of the animal studies, heterogeneity of the data collected, and methodologic weaknesses of animal systematic reviews and meta-analyses. Systematic reviews and meta-analyses of animal studies can catalyze translational processes more effectively if they focus on a well-defined hypothesis along with addressing clear inclusion and exclusion criteria, publication bias, heterogeneity of the data, and a coherent and well-balanced assessment of studies' quality.
Collapse
Affiliation(s)
- Zahra Bahadoran
- Nutrition and Endocrine Research Center, Research Institute for Endocrine Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Parvin Mirmiran
- Department of Clinical Nutrition and Human Dietetics, Faculty of Nutrition Sciences and Food Technology, National Nutrition and Food Technology Research Institute, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Khosrow Kashfi
- Department of Molecular, Cellular and Biomedical Sciences, Sophie Davis School of Biomedical Education, City University of New York School of Medicine, New York, New York
| | - Asghar Ghasemi
- Endocrine Physiology Research Center, Research Institute for Endocrine Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran;,
| |
Collapse
|
|
2
|
Malterud K. The Impact of Evidence-Based Medicine on Qualitative Metasynthesis: Benefits to be Harvested and Warnings to be Given. QUALITATIVE HEALTH RESEARCH 2019; 29:7-17. [PMID: 30160202 DOI: 10.1177/1049732318795864] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Qualitative metasynthesis, developed as an interpretative and inductive methodology, is increasingly influenced by standards from evidence-based medicine, established as a strategy to support policy decisions and guidelines. Currently, principles and procedures from the format developed for systematic reviews are often applied for review and synthesis of all kinds of evidence, including results from qualitative studies. In this article, I substantiate these claims, discussing benefits to be harvested and warnings to be given when qualitative metasynthesis approaches the evidence-based medicine methodology. Situating my exploration in the context of clinical practice, I contrast missions and values of these methodologies regarding review and synthesis of research literature, highlighting potential mismatches between ontology and epistemology, emphasizing challenges regarding sample, analysis, and transferability. Approving systematic and transparent strategies as generic for such purposes, I warn against the idea that methodology developed for evidence-based medicine is a universal gold standard for synthesis of research evidence.
Collapse
Affiliation(s)
- Kirsti Malterud
- 1 Uni Research Health, Bergen, Norway
- 2 University of Bergen, Norway
- 3 University of Copenhagen, Denmark
| |
Collapse
|
|
3
|
Affiliation(s)
- Mike Clarke
- School of Medicine, Dentistry and Biomedical Sciences, Centre for Public Health, Institute for Health Sciences, Queen's University, Belfast, UK
| | | |
Collapse
|
|
4
|
Zoccali C. Moderator's view: Meta-analysis: the best knowledge but not always shining gold. Nephrol Dial Transplant 2017; 31:886-9. [PMID: 27217396 DOI: 10.1093/ndt/gfw093] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2016] [Accepted: 03/28/2016] [Indexed: 11/13/2022] Open
Abstract
Meta-analysis has gained top status in medicine. Correctly so, well-performed meta-analysis is perceived as an unbeatable method for distilling first class medical knowledge. However, such a high status should in no way be considered as a guarantee that all information derived from meta-analyses is pure gold. Systematic reviews and meta-analyses not performed with due methodological attention abound and nephrology is not at all a protected territory. Herein I give concrete examples of meta-analyses published in major journals whose findings are not pure gold.
Collapse
Affiliation(s)
- Carmine Zoccali
- CNR-IFC Clinical Epidemiology and Pathophysiology of Renal Diseases and Hypertension, Reggio Cal Unit, Reggio Calabria, Italy
| |
Collapse
|
|
5
|
What Does It "Mean"? A Review of Interpreting and Calculating Different Types of Means and Standard Deviations. Pharmaceutics 2017; 9:pharmaceutics9020014. [PMID: 28406450 PMCID: PMC5489931 DOI: 10.3390/pharmaceutics9020014] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2017] [Revised: 03/31/2017] [Accepted: 04/05/2017] [Indexed: 11/25/2022] Open
Abstract
Typically, investigations are conducted with the goal of generating inferences about a population (humans or animal). Since it is not feasible to evaluate the entire population, the study is conducted using a randomly selected subset of that population. With the goal of using the results generated from that sample to provide inferences about the true population, it is important to consider the properties of the population distribution and how well they are represented by the sample (the subset of values). Consistent with that study objective, it is necessary to identify and use the most appropriate set of summary statistics to describe the study results. Inherent in that choice is the need to identify the specific question being asked and the assumptions associated with the data analysis. The estimate of a “mean” value is an example of a summary statistic that is sometimes reported without adequate consideration as to its implications or the underlying assumptions associated with the data being evaluated. When ignoring these critical considerations, the method of calculating the variance may be inconsistent with the type of mean being reported. Furthermore, there can be confusion about why a single set of values may be represented by summary statistics that differ across published reports. In an effort to remedy some of this confusion, this manuscript describes the basis for selecting among various ways of representing the mean of a sample, their corresponding methods of calculation, and the appropriate methods for estimating their standard deviations.
Collapse
|
|
6
|
Kalra R, Arora P, Morgan C, Hage FG, Iskandrian AE, Bajaj NS. Conducting and interpreting high-quality systematic reviews and meta-analyses. J Nucl Cardiol 2017; 24:471-481. [PMID: 27484213 DOI: 10.1007/s12350-016-0598-9] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2016] [Accepted: 04/13/2016] [Indexed: 11/27/2022]
Abstract
Systematic reviews and meta-analyses are powerful tools for summarizing existing literature and combining evidence from multiple studies. These methods employ complex searches, statistical techniques, and presentation techniques with which the clinical audience may not be very familiar. This review article aims to familiarize the clinical audience with the various techniques employed to conduct a high-quality systematic review and meta-analysis.
Collapse
Affiliation(s)
- Rajat Kalra
- Department of Medicine, University of Alabama at Birmingham, Birmingham, AL, USA
| | - Pankaj Arora
- Division of Cardiovascular Disease, University of Alabama at Birmingham, BDB D-201, 1808 7th Avenue South, Birmingham, AL, 35294-0012, USA
- Section of Cardiology, Birmingham Veterans Affairs Medical Center, Birmingham, AL, USA
| | - Charity Morgan
- Department of Biostatistics, University of Alabama at Birmingham, Birmingham, AL, USA
| | - Fadi G Hage
- Division of Cardiovascular Disease, University of Alabama at Birmingham, BDB D-201, 1808 7th Avenue South, Birmingham, AL, 35294-0012, USA
- Section of Cardiology, Birmingham Veterans Affairs Medical Center, Birmingham, AL, USA
| | - Ami E Iskandrian
- Division of Cardiovascular Disease, University of Alabama at Birmingham, BDB D-201, 1808 7th Avenue South, Birmingham, AL, 35294-0012, USA
| | - Navkaranbir S Bajaj
- Division of Cardiovascular Disease, University of Alabama at Birmingham, BDB D-201, 1808 7th Avenue South, Birmingham, AL, 35294-0012, USA.
- Section of Cardiology, Birmingham Veterans Affairs Medical Center, Birmingham, AL, USA.
| |
Collapse
|
|
7
|
Li YF, Nanayakkara G, Sun Y, Li X, Wang L, Cueto R, Shao Y, Fu H, Johnson C, Cheng J, Chen X, Hu W, Yu J, Choi ET, Wang H, Yang XF. Analyses of caspase-1-regulated transcriptomes in various tissues lead to identification of novel IL-1β-, IL-18- and sirtuin-1-independent pathways. J Hematol Oncol 2017; 10:40. [PMID: 28153032 PMCID: PMC5290602 DOI: 10.1186/s13045-017-0406-2] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2016] [Accepted: 01/25/2017] [Indexed: 01/06/2023] Open
Abstract
BACKGROUND It is well established that caspase-1 exerts its biological activities through its downstream targets such as IL-1β, IL-18, and Sirt-1. The microarray datasets derived from various caspase-1 knockout tissues indicated that caspase-1 can significantly impact the transcriptome. However, it is not known whether all the effects exerted by caspase-1 on transcriptome are mediated only by its well-known substrates. Therefore, we hypothesized that the effects of caspase-1 on transcriptome may be partially independent from IL-1β, IL-18, and Sirt-1. METHODS To determine new global and tissue-specific gene regulatory effects of caspase-1, we took novel microarray data analysis approaches including Venn analysis, cooperation analysis, and meta-analysis methods. We used these statistical methods to integrate different microarray datasets conducted on different caspase-1 knockout tissues and datasets where caspase-1 downstream targets were manipulated. RESULTS We made the following important findings: (1) Caspase-1 exerts its regulatory effects on the majority of genes in a tissue-specific manner; (2) Caspase-1 regulatory genes partially cooperates with genes regulated by sirtuin-1 during organ injury and inflammation in adipose tissue but not in the liver; (3) Caspase-1 cooperates with IL-1β in regulating less than half of the genes involved in cardiovascular disease, organismal injury, and cancer in mouse liver; (4) The meta-analysis identifies 40 caspase-1 globally regulated genes across tissues, suggesting that caspase-1 globally regulates many novel pathways; and (5) The meta-analysis identified new cooperatively and non-cooperatively regulated genes in caspase-1, IL-1β, IL-18, and Sirt-1 pathways. CONCLUSIONS Our findings suggest that caspase-1 regulates many new signaling pathways potentially via its known substrates and also via transcription factors and other proteins that are yet to be identified.
Collapse
Affiliation(s)
- Ya-Feng Li
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA.,Cardiovascular Research, & Thrombosis Research, Departments of Pharmacology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA.,The Shanxi Provincial People's Hospital, an Affiliate Hospital of Shanxi Medical University, Taiyuan, Shanxi, 030001, China
| | - Gayani Nanayakkara
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Yu Sun
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Xinyuan Li
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Luqiao Wang
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Ramon Cueto
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Ying Shao
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Hangfei Fu
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Candice Johnson
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Jiali Cheng
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Xiongwen Chen
- Cardiovascular Research, & Thrombosis Research, Departments of Pharmacology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA.,Department of Immunology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA
| | - Wenhui Hu
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA
| | - Jun Yu
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA.,Department of Immunology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA
| | - Eric T Choi
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA.,Department of Surgery, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA
| | - Hong Wang
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA.,Department of Physiology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA
| | - Xiao-Feng Yang
- Centers for Metabolic Disease Research and Cardiovascular Research, Lewis Katz School of Medicine at Temple University, 3500 North Broad Street, MERB-1059, Philadelphia, PA, 19140, USA. .,Cardiovascular Research, & Thrombosis Research, Departments of Pharmacology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA. .,Department of Physiology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA. .,Department of Immunology, Lewis Katz School of Medicine at Temple University, Philadelphia, PA, 19140, USA.
| |
Collapse
|
|
8
|
|
|
9
|
Cheung MWL, Vijayakumar R. A Guide to Conducting a Meta-Analysis. Neuropsychol Rev 2016; 26:121-8. [DOI: 10.1007/s11065-016-9319-z] [Citation(s) in RCA: 56] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2016] [Accepted: 05/02/2016] [Indexed: 10/21/2022]
|
|
10
|
Tricco AC, Soobiah C, Antony J, Cogo E, MacDonald H, Lillie E, Tran J, D'Souza J, Hui W, Perrier L, Welch V, Horsley T, Straus SE, Kastner M. A scoping review identifies multiple emerging knowledge synthesis methods, but few studies operationalize the method. J Clin Epidemiol 2016; 73:19-28. [PMID: 26891949 DOI: 10.1016/j.jclinepi.2015.08.030] [Citation(s) in RCA: 78] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2015] [Revised: 06/05/2015] [Accepted: 08/07/2015] [Indexed: 11/18/2022]
Abstract
OBJECTIVES To systematically identify, define, and classify emerging knowledge synthesis methods through a scoping review. STUDY DESIGN AND SETTING MEDLINE, CINAHL, EMBASE, PsycINFO, the Cochrane Methodology Register, the Cochrane Database of Systematic Reviews, Social Sciences Abstracts, Library and Information Science Abstracts, Philosopher's Index, and Education Resources Information Center were searched to identify articles reporting emerging knowledge synthesis methods across the disciplines of health, education, sociology, and philosophy. Two reviewers independently selected studies and abstracted data for each article. RESULTS In total, 409 articles reporting on 25 knowledge synthesis methods were included after screening of 17,962 titles and abstracts and 1,010 potentially relevant full-text articles. Most of the included articles were an application of the method (83.9%); only 3.7% were seminal articles that fully described the method (i.e., operationalized the steps). Most of the included articles were published after 2005. The methods were most commonly used across the fields of nursing, health care science and services, and health policy. CONCLUSION We found a lack of guidance on how to select a knowledge synthesis method. We propose convening an international group of leaders in the knowledge synthesis field to help clarify emerging approaches to knowledge synthesis.
Collapse
Affiliation(s)
- Andrea C Tricco
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada; Epidemiology Division, Dalla Lana School of Public Health, University of Toronto, Health Sciences Building, 155 College Street, 6th Floor, Toronto, Ontario M5T 3M7, Canada
| | - Charlene Soobiah
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Health Sciences Building, 155 College Street, Suite 425, Toronto, Ontario M5T 3M6, Canada
| | - Jesmin Antony
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada
| | - Elise Cogo
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada
| | - Heather MacDonald
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada
| | - Erin Lillie
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada
| | - Judy Tran
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada
| | - Jennifer D'Souza
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada
| | - Wing Hui
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada
| | - Laure Perrier
- Institute of Health Policy, Management and Evaluation, University of Toronto, Health Sciences Building, 155 College Street, Suite 425, Toronto, Ontario M5T 3M6, Canada
| | - Vivian Welch
- Bruyère Research Institute, 85 Primrose Avenue, Ottawa, Ontario K1R 6M1, Canada
| | - Tanya Horsley
- Research Unit, Royal College of Physicians and Surgeons of Canada, 774 Echo Drive, Ottawa, Ontario K1S 5N8, Canada
| | - Sharon E Straus
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada; Department of Geriatric Medicine, Faculty of Medicine, University of Toronto, 27 King's College Circle, Toronto, Ontario M5S 1A1, Canada.
| | - Monika Kastner
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, 209 Victoria Street, Toronto, Ontario M5B 1W8, Canada; Epidemiology Division, Dalla Lana School of Public Health, University of Toronto, Health Sciences Building, 155 College Street, 6th Floor, Toronto, Ontario M5T 3M7, Canada
| |
Collapse
|
|
11
|
Higgins S. Meta-synthesis and comparative meta-analysis of education research findings: some risks and benefits. ACTA ACUST UNITED AC 2016. [DOI: 10.1002/rev3.3067] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
|
12
|
McFarland LV. Application of meta-analysis to specific research fields: Lessons learned. World J Meta-Anal 2015; 3:188-192. [DOI: 10.13105/wjma.v3.i4.188] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/05/2015] [Accepted: 07/08/2015] [Indexed: 02/05/2023] Open
Abstract
Scientific research is challenged to translate findings from multiple, often conflicting, clinical trials into a simple answer of whether a treatment works or not. The public and healthcare providers alike frequently voice their frustrations when the media reports a treatment working on one day, but seemingly the next day reports a study refuting the previous one. Meta-analyses are being used more commonly by researchers to convey an understandable summary of scientific studies to the general public and healthcare providers. As time goes by, we have learned how to improve meta-analytic techniques to reflect more valid results and when it is appropriate to pool or not to pool results from different studies. Retrospective reviews often don’t acknowledge this learning curve and may fail to recommend the most current valid guidelines. This editorial presents an example of how the current use of meta-analysis has shifted in one field (the therapeutic effects of probiotics) and recommendations on how to correctly interpret the results of such an analysis.
Collapse
|
|
13
|
Tebala GD. What is the future of biomedical research? Med Hypotheses 2015; 85:488-90. [PMID: 26194725 DOI: 10.1016/j.mehy.2015.07.003] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2015] [Revised: 06/06/2015] [Accepted: 07/04/2015] [Indexed: 11/17/2022]
Abstract
Randomized controlled trials require hard work and financial commitment, whereas meta-analyses and systematic reviews can be relatively easy to perform and often get published in high impact journals. Many researchers might decide to devote themselves to the latter approach, resulting in a negative impact on clinical research. We have reviewed the number of indexed meta-analyses and systematic reviews on PubMed and compared it with the number of randomized controlled trials over the same period. Statistical analysis showed an exponential increase of synthetic studies with respect to randomized trials. The ratio between RCTs and synthetic studies is quickly decreasing. These results suggest that a growing number of researchers might prefer to commit themselves to synthetic studies more than be involved in more time consuming and funds demanding observational trials. If we are unable to invert this trend, in the future we will have a growing number of synthetic studies utilizing someone else's original data and fewer raw data to base our knowledge upon.
Collapse
Affiliation(s)
- Giovanni Domenico Tebala
- Colorectal and Gastrointestinal Surgery Unit, Department of Surgery, Noble's Hospital, Strang, Douglas, Isle of Man IM4 4RJ, United Kingdom.
| |
Collapse
|
|
14
|
Buzás GM. Fate of meta-analyses: The case of Helicobacter pylori. World J Meta-Anal 2015; 3:20-25. [DOI: 10.13105/wjma.v3.i1.20] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/02/2014] [Revised: 11/10/2014] [Accepted: 12/10/2014] [Indexed: 02/05/2023] Open
Abstract
AIM: To overview the current diversity of meta-analysis and the implementation of their results in international guidelines.
METHODS: Relevant meta-analysis were identified from PubMed/Medline. The topics of meta-analyses were determined. Some topics (genetics, extragastric tumors) were analysed separately. Core journals publishing meta-analyses on Helicobacter pylori were ranked. The rate of citation of meta-analysis in major guidelines was calculated.
RESULTS: Between 1992 and 2014, some 356 meta-analyses were published on PubMed. These mainly appeared in core journals, but were also found in 128 other journals. Eradicating of the infection was the most addressed topic with 134 articles. Meta-analyses were rarely used in formulating statements and recommendations in the international guidelines. In other topics - genetics, extraintestinal manifestations - meta-analyses were rather overused.
CONCLUSION: The implementation of meta-analysis in current guidelines is rather rare, while other topics benefit from many studies. A more extensive use of meta-analyses in evidence-based medicine is recommended in the future, otherwise their continuous proliferation will lose reason and scientific significance.
Collapse
|
|
15
|
Abstract
This article looks at the impact of meta-analysis and then explores why meta-analysis was developed at the time and by the scholars it did in the social sciences in the 1970s. For the first problem, impact, it examines the impact of meta-analysis using citation network analysis. The impact is seen in the sciences, arts and humanities, and on such contemporaneous developments as multilevel modeling, medical statistics, qualitative methods, program evaluation, and single-case design. Using a constrained snowball sample of citations, we highlight key articles that are either most highly cited or most central to the systematic review network. Then, the article examines why meta-analysis came to be in the 1970s in the social sciences through the work of Gene Glass, Robert Rosenthal, and Frank Schmidt, each of whom developed similar theories of meta-analysis at about the same time. The article ends by explaining how Simonton's chance configuration theory and Campbell's evolutionary epistemology can illuminate why meta-analysis occurred with these scholars when it did and not in medical sciences.
Collapse
Affiliation(s)
- William R Shadish
- School of Social Sciences, Humanities and Arts, University of California, Merced, CA, USA
| | - Jesse D Lecy
- 420 Maxwell School of Syracuse University, Syracuse, NY, USA
| |
Collapse
|
|
16
|
Haddaway NR. Maximizing legacy and impact of primary research: a call for better reporting of results. AMBIO 2014; 43:703-6. [PMID: 24870934 PMCID: PMC4132460 DOI: 10.1007/s13280-014-0535-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2014] [Revised: 04/22/2014] [Accepted: 05/02/2014] [Indexed: 05/23/2023]
Abstract
Much of the scientific literature in existence today is based on model systems and case studies, which help to split research into manageable blocks. The impact of this research can be greatly increased in meta-analyses that combine individual studies published over time to identify patterns across studies; patterns that may go undetected by smaller studies and that may not be the main subject of investigation. However, many potentially useful studies fail to provide sufficient data (typically means, true sample sizes, and measures of variability) to permit meta-analysis. Authors of primary research studies should provide these summary statistics as a minimum, and editors should require them to do so. By putting policies in place that require these summary statistics to be included, or even those that require raw data, editors and authors can maximize the legacy and impact of the research they publish beyond that of their initial target audience.
Collapse
Affiliation(s)
- Neal R Haddaway
- Centre for Evidence-Based Conservation, School of Environment, Natural Resources and Geography, Bangor University, Bangor, LL57 2UW, UK,
| |
Collapse
|
|
17
|
Affiliation(s)
- Madelon van Wely
- Center for Reproductive Medicine, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
|
18
|
Moulis G, Sommet A. Comment lire une méta-analyse ? Rev Med Interne 2014; 35:250-8. [DOI: 10.1016/j.revmed.2013.07.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2013] [Accepted: 07/31/2013] [Indexed: 10/26/2022]
|
|
19
|
Richardson AJ, Laurence JM, Lam VWT. Use of pre-operative steroids in liver resection: a systematic review and meta-analysis. HPB (Oxford) 2014; 16:12-9. [PMID: 23461716 PMCID: PMC3892310 DOI: 10.1111/hpb.12066] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/15/2012] [Accepted: 12/05/2012] [Indexed: 12/12/2022]
Abstract
BACKGROUND By attenuating the systemic inflammatory response to major surgery, the pre-operative administration of steroids may reduce the incidence of complications. METHODS A systematic review was conducted to identify randomized controlled trials (RCT) comparing pre-operative steroid administration with placebo during a liver resection. Meta-analyses were performed. RESULTS Five RCTs were identified including a total of 379 patients. Pre-operative steroids were associated with statistically significant reductions in the levels of serum bilirubin and interleukin 6 (IL-6) on post-operative day one. There was a trend towards a lower incidence of post-operative complications and prothrombin time (PT), but this did not reach statistical significance. CONCLUSION Pre-operative steroids may be associated with a clinically significant benefit in liver resection.
Collapse
Affiliation(s)
- Arthur J Richardson
- Department of Surgery, Westmead Hospital, Sydney, NSW, Australia; Discipline of Surgery, University of Sydney, Sydney, NSW, Australia
| | | | | |
Collapse
|
|
20
|
McKenzie JE, Salanti G, Lewis SC, Altman DG. Meta-analysis and The Cochrane Collaboration: 20 years of the Cochrane Statistical Methods Group. Syst Rev 2013; 2:80. [PMID: 24280020 PMCID: PMC4219183 DOI: 10.1186/2046-4053-2-80] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/09/2013] [Accepted: 11/07/2013] [Indexed: 11/10/2022] Open
Abstract
The Statistical Methods Group has played a pivotal role in The Cochrane Collaboration over the past 20 years. The Statistical Methods Group has determined the direction of statistical methods used within Cochrane reviews, developed guidance for these methods, provided training, and continued to discuss and consider new and controversial issues in meta-analysis. The contribution of Statistical Methods Group members to the meta-analysis literature has been extensive and has helped to shape the wider meta-analysis landscape.In this paper, marking the 20th anniversary of The Cochrane Collaboration, we reflect on the history of the Statistical Methods Group, beginning in 1993 with the identification of aspects of statistical synthesis for which consensus was lacking about the best approach. We highlight some landmark methodological developments that Statistical Methods Group members have contributed to in the field of meta-analysis. We discuss how the Group implements and disseminates statistical methods within The Cochrane Collaboration. Finally, we consider the importance of robust statistical methodology for Cochrane systematic reviews, note research gaps, and reflect on the challenges that the Statistical Methods Group faces in its future direction.
Collapse
Affiliation(s)
- Joanne E McKenzie
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia.
| | | | | | | |
Collapse
|
|
21
|
Association between interleukin 10 gene -1082 A/G polymorphism and the risk of type 2 diabetes mellitus: a meta-analysis of 4250 subjects. Cytokine 2013; 62:226-31. [PMID: 23541976 DOI: 10.1016/j.cyto.2013.02.025] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2012] [Revised: 01/30/2013] [Accepted: 02/21/2013] [Indexed: 11/21/2022]
Abstract
Increasing evidence suggests that interleukin 10 (IL 10) gene -1082 A/G (rsl800896) polymorphism may be associated with an increased risk of type 2 diabetes mellitus (T2DM). However, the results are inconsistent. The aim of this study is to analyze the association between this variant and the T2DM risk by meta-analysis. PubMed, Embase, Web of Science, and Google Scholar were searched from January 1, 1989 to February 17, 2012, as well as hand searching of the references of identified articles were performed. All the statistical tests were performed using Stata 11.0. Seven case-control studies were identified, covering a total of 1879 T2DM cases and 2371 controls. The results showed evidence of significant association between IL 10 gene -1082 A/G polymorphism and T2DM risk (for G/G+G/A vs. A/A: OR=1.21, 95% CI=1.05-1.40, p=0.010, p=0.040 after Bonferroni testing). In the subgroup analysis by ethnicity, no significant association was found between IL 10 gene -1082 A/G polymorphism and T2DM risk in Europeans. In summary, results from this meta-analysis provide evidence that IL 10 gene -1082 G allele is associated with increased risk of T2DM.
Collapse
|
|
22
|
Richardson AJ, Laurence JM, Lam VWT. Portal triad clamping versus other methods of vascular control in liver resection: a systematic review and meta-analysis. HPB (Oxford) 2012; 14:355-64. [PMID: 22568411 PMCID: PMC3384859 DOI: 10.1111/j.1477-2574.2012.00466.x] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/15/2012] [Accepted: 02/29/2012] [Indexed: 12/12/2022]
Abstract
BACKGROUND Portal triad clamping (PTC) is the most commonly used method of achieving vascular control during liver resection. However, the efficacy and safety of PTC, compared with those of other methods of vascular control, are uncertain. METHODS A systematic review was conducted to identify randomized controlled trials (RCTs) comparing PTC with other methods of vascular control during liver resection. Endpoints included in-hospital mortality, need for transfusion, number of complications and length of hospital stay. Meta-analyses were performed using a random-effects model. RESULTS Ten RCTs were identified; these included a total of 820 patients. No statistically significant differences between PTC and other forms of vascular control in liver resection were demonstrated. CONCLUSIONS There is no evidence, on the basis of this meta-analysis of RCTs, of any difference between PTC and other forms of vascular control in liver resection.
Collapse
|
|
23
|
Abstract
The growth of electronic publication and informatics archives makes it possible to harvest vast quantities of knowledge about knowledge, or "metaknowledge." We review the expanding scope of metaknowledge research, which uncovers regularities in scientific claims and infers the beliefs, preferences, research tools, and strategies behind those regularities. Metaknowledge research also investigates the effect of knowledge context on content. Teams and collaboration networks, institutional prestige, and new technologies all shape the substance and direction of research. We argue that as metaknowledge grows in breadth and quality, it will enable researchers to reshape science-to identify areas in need of reexamination, reweight former certainties, and point out new paths that cut across revealed assumptions, heuristics, and disciplinary boundaries.
Collapse
Affiliation(s)
- James A Evans
- Department of Sociology, University of Chicago, Chicago, IL 60637, USA.
| | | |
Collapse
|