1
|
Schoeps B, Lauer UM, Elbers K. Deciphering permissivity of human tumor ecosystems to oncolytic viruses. Oncogene 2025; 44:1069-1077. [PMID: 40148688 PMCID: PMC11996678 DOI: 10.1038/s41388-025-03357-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2024] [Revised: 02/10/2025] [Accepted: 03/17/2025] [Indexed: 03/29/2025]
Abstract
Effective cancer therapy involves initiation of a tumor-specific immune response. Consequently, the interest in oncolytic viruses (OV) capable of triggering immunogenic cell death has sparked in recent years. However, the common use of pre-clinical models that fail to mirror patient tumor ecosystems (TES) hinders clinical translation. Here, we provide a condensed view on the intricate interplay between several aspects of TES and OV action and discuss these considerations in the view of recently developed pre-clinical human model systems. Given the urgent demand for innovative cancer treatments, the purpose of this review is to highlight the so-far overlooked complex impact of the tumor microenvironment (TME) on OV permissivity, with the intent to provide a foundation for future, more effective pre-clinical studies.
Collapse
Affiliation(s)
| | - Ulrich M Lauer
- Department of Medical Oncology and Pneumology, Virotherapy Center Tübingen (VCT), Medical University Hospital, Tübingen, Germany
- German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Tübingen, Germany
| | | |
Collapse
|
2
|
Hamilton DG, Page MJ, Everitt S, Fraser H, Fidler F. Cancer researchers' experiences with and perceptions of research data sharing: Results of a cross-sectional survey. Account Res 2025; 32:530-557. [PMID: 38299475 DOI: 10.1080/08989621.2024.2308606] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 01/18/2024] [Indexed: 02/02/2024]
Abstract
BACKGROUND Despite wide recognition of the benefits of sharing research data, public availability rates have not increased substantially in oncology or medicine more broadly over the last decade. METHODS We surveyed 285 cancer researchers to determine their prior experience with sharing data and views on known drivers and inhibitors. RESULTS We found that 45% of respondents had shared some data from their most recent empirical publication, with respondents who typically studied non-human research participants, or routinely worked with human genomic data, more likely to share than those who did not. A third of respondents added that they had previously shared data privately, with 74% indicating that doing so had also led to authorship opportunities or future collaborations for them. Journal and funder policies were reported to be the biggest general drivers toward sharing, whereas commercial interests, agreements with industrial sponsors and institutional policies were the biggest prohibitors. We show that researchers' decisions about whether to share data are also likely to be influenced by participants' desires. CONCLUSIONS Our survey suggests that increased promotion and support by research institutions, alongside greater championing of data sharing by journals and funders, may motivate more researchers in oncology to share their data.
Collapse
Affiliation(s)
- Daniel G Hamilton
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, Australia
- Melbourne Medical School, Faculty of Medicine, Dentistry & Health Sciences, University of Melbourne, Melbourne, Australia
| | - Matthew J Page
- Methods in Evidence Synthesis Unit, School of Public Health & Preventive Medicine, Monash University, Melbourne, Australia
| | - Sarah Everitt
- Sir Peter MacCallum Department of Oncology, University of Melbourne, Melbourne, Australia
| | - Hannah Fraser
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, Australia
| | - Fiona Fidler
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, Australia
- School of History & Philosophy of Sciences, University of Melbourne, Melbourne, Australia
| |
Collapse
|
3
|
Miedel MT, Varmazyad M, Xia M, Brooks MM, Gavlock DC, Reese C, Behari J, Soto-Gutierrez A, Gough A, Taylor DL, Schurdak ME. Validation of microphysiological systems for interpreting patient heterogeneity requires robust reproducibility analytics and experimental metadata. CELL REPORTS METHODS 2025:101028. [PMID: 40233763 DOI: 10.1016/j.crmeth.2025.101028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Revised: 12/24/2024] [Accepted: 03/20/2025] [Indexed: 04/17/2025]
Abstract
Multi-cell-type, 3D microphysiological systems (MPS) that recapitulate normal organ/organ system functions and the progression of diseases are being applied in drug discovery and development programs to enable precision medicine. A critical step for this application is to demonstrate the reproducibility of the MPS and its ability to identify biologic/clinical heterogeneity from experimental variability, which requires capturing detailed metadata associated with MPS studies as well as a strong analytical approach for assessing reproducibility. Detailed metadata ensure that identical study parameters are being compared when evaluating reproducibility. We have developed the Pittsburgh reproducibility protocol (PReP), which uses a set of common statistical metrics, the coefficient of variation (CV), ANOVA, and intraclass correlation coefficient (ICC), in a pipeline as a standard approach to evaluate the intra- and interstudy reproducibility of MPS performance. The PReP can be employed to identify biological/clinical heterogeneity relevant to precision medicine.
Collapse
Affiliation(s)
- Mark T Miedel
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Pathology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Mahboubeh Varmazyad
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Mengying Xia
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Maria Mori Brooks
- Department of Epidemiology, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA; Department of Biostatistics, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA
| | - Dillon C Gavlock
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Celeste Reese
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Jaideep Behari
- Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Division of Gastroenterology, Hepatology and Nutrition, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Alejandro Soto-Gutierrez
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Pathology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Center for Transcriptional Medicine, Pittsburgh, PA 15261, USA
| | - Albert Gough
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - D Lansing Taylor
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Computational and System Biology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15260, USA
| | - Mark E Schurdak
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Computational and System Biology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15260, USA.
| |
Collapse
|
4
|
Bicer S, Nelson A, Carayannis K, Kimmelman J. Supporting evidence in phase 2 cancer trial protocols: a content analysis. J Natl Cancer Inst 2025; 117:637-643. [PMID: 39531308 PMCID: PMC11972674 DOI: 10.1093/jnci/djae281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2024] [Revised: 10/21/2024] [Accepted: 11/03/2024] [Indexed: 11/16/2024] Open
Abstract
BACKGROUND Phase 2 trials are instrumental for designing definitive efficacy trials or attaining accelerated approval. However, high attrition of drug candidates in phase 2 trials raises questions about their supporting evidence. METHODS We developed a typology of supporting evidence for phase 2 cancer trials. We also devised a scheme for capturing elements that enable an assessment of the strength of such evidence. Using this framework, we content analyzed supporting evidence provided in protocols of 50 randomly sampled phase 2 cancer monotherapy trials between January 2014 and January 2019, available on ClinicalTrials.gov. RESULTS Of the 50 protocols in our sample, 52% were industry funded. Most invoked supporting evidence deriving from trials against different cancers (n = 28, 56%) or preclinical studies (n = 48, 96%) but not from clinical studies involving the target drug-indication pairing (n = 23, 46%). When presenting evidence from models, only 1 (2%) protocol explained its translational relevance. Instead, protocols implied translatability by describing molecular (86%) and pathophysiological (84%) processes shared by model and target systems. Protocols often provided information for assessing the magnitude, precision, and risk of bias for supporting trials (n = 43; 93%, 91%, 47%, respectively). However, such information was often unavailable for preclinical studies (n = 49; 53%, 22%, 59%, respectively). CONCLUSIONS Supporting evidence is key to justifying the commitment of scientific resources and patients to a clinical hypothesis. Protocols often omit elements that would enable critical assessment of supporting evidence for phase 2 monotherapy cancer trials. These gaps suggest the promise of more structured approaches for presenting supporting evidence.
Collapse
Affiliation(s)
- Selin Bicer
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| | - Angela Nelson
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| | - Katerina Carayannis
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| | - Jonathan Kimmelman
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| |
Collapse
|
5
|
Tang G. Mapping nine decades of research integrity studies (1935-2024): A scientometric analysis. Account Res 2025:1-36. [PMID: 40083052 DOI: 10.1080/08989621.2025.2470860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2024] [Accepted: 02/19/2025] [Indexed: 03/16/2025]
Abstract
BACKGROUND Research integrity is fundamental to responsible research practice. Despite attention, the intellectual structure and evolution of this field remains underexplored. This study maps the knowledge landscape of research integrity, identifying key themes, contributions, and trends. METHODS A scientometric analysis was conducted on 6,895 records from Web of Science and Scopus (1935-2024). CiteSpace facilitated network analysis, including co-authorship, keyword co-occurrence, and co-citation patterns, while burst detection identified topics. RESULTS Research integrity studies have grown significantly since the 1980s, with interdisciplinary collaboration. Keyword and co-citation analyses reveal a shift from early discussions on scientific misconduct to concerns such as open science, AI ethics, and research governance. A collaboration network has emerged, with leading contributions from North America, Europe, and Asia. CONCLUSIONS Research integrity has matured into an interdisciplinary field, reaching academic consensus with growing integration of policies, regulations, and technology. Future research is expected to focus on AI's role in research integrity. Key areas of concern include algorithmic bias, automation ethics, and implications for scholarly publishing. Open science and transparency will remain central, particularly in addressing data fabrication, paper mills, and predatory publishing. Institutional policies will continue evolving, embedding integrity principles into governance and public engagement initiatives.
Collapse
Affiliation(s)
- Gengyan Tang
- Werklund School of Education, University of Calgary, Calgary, Canada
| |
Collapse
|
6
|
Pelot NA, Wang B, Marshall DP, Hussain MA, Musselman ED, Yu GJ, Dale J, Baumgart IW, Dardani D, Zamani PT, Chang Villacreses D, Wagenaar JB, Grill WM. Guidance for sharing computational models of neural stimulation: from project planning to publication. J Neural Eng 2025; 22:021001. [PMID: 39993327 DOI: 10.1088/1741-2552/adb997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Accepted: 02/24/2025] [Indexed: 02/26/2025]
Abstract
Objective. Sharing computational models offers many benefits, including increased scientific rigor during project execution, readership of the associated paper, resource usage efficiency, replicability, and reusability. In recognition of the growing practice and requirement of sharing models, code, and data, herein, we provide guidance to facilitate sharing of computational models by providing an accessible resource for regular reference throughout a project's stages.Approach. We synthesized literature on good practices in scientific computing and on code and data sharing with our experience in developing, sharing, and using models of neural stimulation, although the guidance will also apply well to most other types of computational models.Main results. We first describe the '6 R' characteristics of shared models, leaning on prior scientific computing literature, which enforce accountability and enable advancement: re-runnability, repeatability, replicability, reproducibility, reusability, and readability. We then summarize action items associated with good practices in scientific computing, including selection of computational tools during project planning, code and documentation design during development, and user instructions for deployment. We provide a detailed checklist of the contents of shared models and associated materials, including the model itself, code for reproducing published figures, documentation, and supporting datasets. We describe code, model, and data repositories, including a list of characteristics to consider when selecting a platform for sharing. We describe intellectual property (IP) considerations to balance permissive, open-source licenses versus software patents and bespoke licenses that govern and incentivize commercialization. Finally, we exemplify these practices with our ASCENT pipeline for modeling peripheral nerve stimulation.Significance. We hope that this paper will serve as an important and actionable reference for scientists who develop models-from project planning through publication-as well as for model users, institutions, IP experts, journals, funding sources, and repository platform developers.
Collapse
Affiliation(s)
- Nicole A Pelot
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Boshuo Wang
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Duke University, Durham, NC, United States of America
| | - Daniel P Marshall
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Minhaj A Hussain
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Eric D Musselman
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Gene J Yu
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Duke University, Durham, NC, United States of America
| | - Jahrane Dale
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Ian W Baumgart
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Daniel Dardani
- Office for Translation & Commercialization, Duke University, Durham, NC, United States of America
| | - Princess Tara Zamani
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - David Chang Villacreses
- Office for Translation & Commercialization, Duke University, Durham, NC, United States of America
| | - Joost B Wagenaar
- Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Warren M Grill
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
- Department of Electrical and Computer Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
- Department of Neurobiology, School of Medicine, Duke University, Durham, NC, United States of America
- Department of Neurosurgery, School of Medicine, Duke University, Durham, NC, United States of America
| |
Collapse
|
7
|
Skubera M, Korbmacher M, Evans TR, Azevedo F, Pennington CR. International initiatives to enhance awareness and uptake of open research in psychology: a systematic mapping review. ROYAL SOCIETY OPEN SCIENCE 2025; 12:241726. [PMID: 40109933 PMCID: PMC11919529 DOI: 10.1098/rsos.241726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2024] [Revised: 02/07/2025] [Accepted: 02/07/2025] [Indexed: 03/22/2025]
Abstract
Concerns about the replicability, reproducibility and transparency of research have ushered in a set of practices and behaviours under the umbrella of 'open research'. To this end, many new initiatives have been developed that represent procedural (i.e. behaviours and sets of commonly used practices in the research process), structural (new norms, rules, infrastructure and incentives), and community-based change (working groups, networks). The objectives of this research were to identify and outline international initiatives that enhance awareness and uptake of open research practices in the discipline of psychology. A systematic mapping review was conducted in three stages: (i) a Web search to identify open research initiatives in psychology; (ii) a literature search to identify related articles; and (iii) a hand search of grey literature. Eligible initiatives were then coded into an overarching theme of procedural, structural or community-based change. A total of 187 initiatives were identified; 30 were procedural (e.g. toolkits, resources, software), 70 structural (e.g. policies, strategies, frameworks) and 87 community-based (e.g. working groups, networks). This review highlights that open research is progressing at pace through various initiatives that share a common goal to reform research culture. We hope that this review promotes their further adoption and facilitates coordinated efforts between individuals, organizations, institutions, publishers and funders.
Collapse
Affiliation(s)
- Magda Skubera
- School of Psychology, Aston University, Birmingham, UK
| | - Max Korbmacher
- Mohn Medical Imaging and Visualisation Centre, Bergen, Norway
- Department of Neurology, Haukeland University Hospital, Bergen, Norway
| | - Thomas Rhys Evans
- School of Human Sciences and Institute for Lifecourse Developments, University of Greenwich, London, UK
| | - Flavio Azevedo
- Department of Interdisciplinary Social Sciences, Utrecht University, Utrecht, The Netherlands
| | | |
Collapse
|
8
|
Fonseca Teixeira A, Pires BRB, Panis C, Monte-Alto-Costa A, da Fonseca ADS, Mencalha AL. Low-Power Blue LED Modulates NF-κB and Proinflammatory Cytokines in Doxorubicin-Treated MDA-MB-231 Cells. J Biochem Mol Toxicol 2025; 39:e70192. [PMID: 39987519 DOI: 10.1002/jbt.70192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2024] [Revised: 01/08/2025] [Accepted: 02/11/2025] [Indexed: 02/25/2025]
Abstract
Doxorubicin is a crucial chemotherapy used in the treatment of triple-negative breast cancer (TNBC) patients, but elevated doxorubicin doses may induce therapeutic resistance. To overcome this limitation, we have previously established a photodynamic therapeutic (PDT)-like strategy that irradiates doxorubicin-treated cells with a low-power nonionizing blue LED device. This combined treatment increases the production of reactive oxygen species to promote cell death, consequently enabling reduced doxorubicin dosages. Yet, precisely determining the molecular mechanisms that drive this outcome is still required for advancing such PDT-like approach. Here, we aimed to correlate the expression of the inflammatory markers NF-κB, IL-8, IL-6, and IL-1β with the survival of TNBC cells submitted to our PDT-like protocol. Our results show that NF-κB/p65 nuclear levels were enhanced in MDA-MB-231 cells treated with doxorubicin and blue LED. Moreover, this PDT-like strategy increased IL-6 mRNA levels in MDA-MB-231 cells. IL-1β and IL-8 mRNA were upregulated in samples incubated with doxorubicin regardless of concomitant irradiation with blue LED. These results show that our PDT-like protocol is effective in elevating inflammatory signals, shedding light on the molecular mechanisms that underlie the efficacy of this innovative anticancer therapeutic approach.
Collapse
Affiliation(s)
- Adilson Fonseca Teixeira
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Bruno Ricardo Barreto Pires
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Carolina Panis
- Centro de Ciências da Saúde, Universidade Estadual do Oeste do Paraná, Paraná, Brazil
| | - Andréa Monte-Alto-Costa
- Departamento de Histologia e Embriologia, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Adenilson de Souza da Fonseca
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Andre Luiz Mencalha
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| |
Collapse
|
9
|
Unger JM, Mazza GL, Elsaid MI, Duan F, Dressler EV, Snavely AC, Enserro DM, Pugh SL. When to adjust for multiplicity in cancer clinical trials. J Natl Cancer Inst Monogr 2025; 2025:3-9. [PMID: 39989044 PMCID: PMC11848029 DOI: 10.1093/jncimonographs/lgae051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Revised: 10/21/2024] [Accepted: 11/19/2024] [Indexed: 02/25/2025] Open
Abstract
Interpreting cancer clinical trial results often depends on addressing issues of multiplicity. When testing multiple hypotheses, unreliable findings can occur by chance due to the inflation of the type I error rate, the probability of mistakenly rejecting the null hypothesis when the null hypothesis is true. In this setting, researchers may often set the type I error rate (or the alpha level) low to limit false positive findings and the interpretation of a causal relationship where none exists. Conversely, overly conservative type I error control may result in declaring findings, that do not meet multiplicity-adjusted alpha levels, as false when they are actually true, reducing opportunities for new discovery. This presentation focuses on multiplicity adjustment in the context of clinical trials conducted within the NCI's Community Oncology Research Program (NCORP). Because federally sponsored trials often require long-term participation from patients and represent a substantial investment by taxpayers, striking the right balance between optimizing what is learned from these trials, while avoiding false positive results, should be a priority.
Collapse
Affiliation(s)
- Joseph M Unger
- SWOG Statistics and Data Management Center, Fred Hutchinson Cancer Center, Seattle, WA 98109, United States
| | - Gina L Mazza
- Alliance Statistics and Data Management Center, Mayo Clinic, Scottsdale, AZ 85259, United States
| | - Mohamed I Elsaid
- Department of Biomedical Informatics, College of Medicine, The Ohio State University, Columbus, OH 43210, United States
- Division of Medical Oncology, Department of Internal Medicine, College of Medicine, The Ohio State University, Columbus, OH 43210, United States
- Center for Biostatistics, College of Medicine, The Ohio State University, Columbus, OH 43210, United States
| | - Fenhai Duan
- Department of Biostatistics and Center for Statistical Sciences, Brown University School of Public Health, Providence, RI 02903, United States
| | - Emily V Dressler
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, NC 27157, United States
| | - Anna C Snavely
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, NC 27157, United States
| | - Danielle M Enserro
- Department of Biostatistics and Bioinformatics, Roswell Park Comprehensive Cancer Center, Buffalo, NY 14203, United States
| | - Stephanie L Pugh
- NRG Oncology Statistics and Data Management Center, Philadelphia, PA 19103, United States
| |
Collapse
|
10
|
Franzen DL, Salholz-Hillel M, Müller-Ohlraun S, Strech D. Improving research transparency with individualized report cards: A feasibility study in clinical trials at a large university medical center. BMC Med Res Methodol 2025; 25:37. [PMID: 39948475 PMCID: PMC11823227 DOI: 10.1186/s12874-025-02482-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Accepted: 01/21/2025] [Indexed: 02/17/2025] Open
Abstract
BACKGROUND Research transparency is crucial for ensuring the relevance, integrity, and reliability of scientific findings. However, previous work indicates room for improvement across transparency practices. The primary objective of this study was to develop an extensible tool to provide individualized feedback and guidance for improved transparency across phases of a study. Our secondary objective was to assess the feasibility of implementing this tool to improve transparency in clinical trials. METHODS We developed study-level "report cards" that combine tailored feedback and guidance to investigators across several transparency practices, including prospective registration, availability of summary results, and open access publication. The report cards were generated through an automated pipeline for scalability. We also developed an infosheet to summarize relevant laws, guidelines, and resources relating to transparency. To assess the feasibility of using these tools to improve transparency, we conducted a single-arm intervention study at Berlin's university medical center, the Charité - Universitätsmedizin Berlin. Investigators (n = 92) of 155 clinical trials were sent individualized report cards and the infosheet, and surveyed to assess their perceived usefulness. We also evaluated included trials for improvements in transparency following the intervention. RESULTS Survey responses indicated general appreciation for the report cards and infosheet, with a majority of participants finding them helpful to build awareness of the transparency of their trial and transparency requirements. However, improvement on transparency practices was minimal and largely limited to linking publications in registries. Investigators also commented on various challenges associated with implementing transparency, including a lack of clarity around best practices and institutional hurdles. CONCLUSIONS This study demonstrates the potential of developing and using tools, such as report cards, to provide individualized feedback at scale to investigators on the transparency of their study. While these tools were positively received by investigators, the limited improvement in transparency practices suggests that awareness alone is likely not sufficient to drive improvement. Future research and implementation efforts may adapt the tools to further practices or research areas, and explore integrated approaches that combine the report cards with incentives and institutional support to effectively strengthen transparency in research.
Collapse
Affiliation(s)
- Delwen L Franzen
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany.
| | - Maia Salholz-Hillel
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany.
| | - Stephanie Müller-Ohlraun
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany
| | - Daniel Strech
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany
| |
Collapse
|
11
|
Elliott C, Patterson ED, Tarcea A, Mattiello B, Frizzell B, Walker REA, Hildebrand KA, White NJ. An endpoint adjudication committee for the assessment of computed tomography scans in fracture healing. Injury 2025; 56:112067. [PMID: 39622103 DOI: 10.1016/j.injury.2024.112067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Revised: 11/04/2024] [Accepted: 11/23/2024] [Indexed: 02/07/2025]
Abstract
INTRODUCTION Endpoint Adjudication Committees (EACs) benefit the quality of randomized control trials (RCTs) where outcomes depend on subjective interpretations. However, assembling a committee to adjudicate large datasets is cumbersome. In a recent RCT, the primary outcome was time to union following operative fixation of scaphoid non-union, with real or placebo adjunctive ultrasound treatment. Union status was determined with computed tomography (CT) scans interpreted by treating surgeons and radiologists. An EAC was established to deliberate discrepancies between radiologists' and surgeons' interpretations of union status. METHODS Three hundred sixty-four CT scans from 142 participants were collected in the RCT. The treating surgeon and an MSK radiologist categorized images by percent-union (0 %, 1-24 %, 25-49 %, 50-74 %, 75-99 %, 100 %). Union was defined as at least 50 % trabecular bridging. The EAC adjudicated those images that were deemed major discrepancies. The committee was composed of three members assembled by the committee chair, an MSK radiologist. A charter was established to guide the adjudication process. Ten minutes were allotted to each scan, including 2-3 min of an independent adjudicator's review, followed by 5-7 min of committee discussion to reach a diagnosis. RESULTS Adjudicators spent an average of seven minutes on each scan. The EAC assessed 101 CT scans from 69 patients collected across five study sites: four scans from the agreed upon group as practice interpretations, 75 major discrepancies, and 22 missing interpretations from either the initial MSK radiologist, the treating orthopaedic surgeon, or both. These were adjudicated for final union status. Twenty-eight of the images with major discrepancies were adjudicated to union, and 47 to non-union. Adjudication changed the primary outcome of time to union in 40/142 (28 %) of study participants. CONCLUSION This adjudication process provides a valuable research tool for reference by other clinical investigators whose RCTs' outcomes are dependent on interpretation of radiographic images.
Collapse
Affiliation(s)
- Chloe Elliott
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Ethan D Patterson
- University of Saskatchewan, College of Medicine, 107 Wiggins Rd, Saskatoon, SK S7N 5E5, Canada
| | - Adina Tarcea
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada.
| | - Brenna Mattiello
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Bevan Frizzell
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Richard E A Walker
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Kevin A Hildebrand
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Neil J White
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| |
Collapse
|
12
|
Hair K, Arroyo-Araujo M, Vojvodic S, Economou M, Wong C, Tinsdeall F, Smith S, Rackoll T, Sena ES, McCann SK. Connecting the dots in neuroscience research: The future of evidence synthesis. Exp Neurol 2025; 384:115047. [PMID: 39510296 DOI: 10.1016/j.expneurol.2024.115047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2024] [Revised: 10/31/2024] [Accepted: 11/03/2024] [Indexed: 11/15/2024]
Abstract
Making progress in neuroscience research involves learning from existing data. In this perspective piece, we explore the potential of a data-driven evidence ecosystem to connect all primary data streams, and synthesis efforts to inform evidence-based research and translational success from bench to bedside. To enable this transformation, we set out how we can produce evidence designed with evidence curation in mind. All data should be findable, understandable, and easily synthesisable, using a combination of human and machine effort. This will require shifts in research culture and tailored infrastructure to support rapid dissemination, data sharing, and transparency. We also discuss improvements in the way we can synthesise evidence to better inform primary research, including the potential of emerging technologies, big-data approaches, and breaking down research silos. Through a case study in stroke research, one of the most well-established areas for synthesis efforts, we demonstrate the progress in implementing elements of this ecosystem, with an emphasis on the need for coordinated efforts between laboratory researchers and synthesists.
Collapse
Affiliation(s)
- Kaitlyn Hair
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - María Arroyo-Araujo
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Sofija Vojvodic
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Maria Economou
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Charis Wong
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom; Euan MacDonald Centre for Motor Neuron Disease Research, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom; Anne Rowling Regenerative Neurology Clinic, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom; MRC Clinical Trials Unit, 90 High Holborn, London WC1V 6LJ, United Kingdom.
| | - Francesca Tinsdeall
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - Sean Smith
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - Torsten Rackoll
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Emily S Sena
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - Sarah K McCann
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| |
Collapse
|
13
|
Marcoci A, Wilkinson DP, Vercammen A, Wintle BC, Abatayo AL, Baskin E, Berkman H, Buchanan EM, Capitán S, Capitán T, Chan G, Cheng KJG, Coupé T, Dryhurst S, Duan J, Edlund JE, Errington TM, Fedor A, Fidler F, Field JG, Fox N, Fraser H, Freeman ALJ, Hanea A, Holzmeister F, Hong S, Huggins R, Huntington-Klein N, Johannesson M, Jones AM, Kapoor H, Kerr J, Kline Struhl M, Kołczyńska M, Liu Y, Loomas Z, Luis B, Méndez E, Miske O, Mody F, Nast C, Nosek BA, Simon Parsons E, Pfeiffer T, Reed WR, Roozenbeek J, Schlyfestone AR, Schneider CR, Soh A, Song Z, Tagat A, Tutor M, Tyner AH, Urbanska K, van der Linden S. Predicting the replicability of social and behavioural science claims in COVID-19 preprints. Nat Hum Behav 2025; 9:287-304. [PMID: 39706868 PMCID: PMC11860236 DOI: 10.1038/s41562-024-01961-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2023] [Accepted: 07/19/2024] [Indexed: 12/23/2024]
Abstract
Replications are important for assessing the reliability of published findings. However, they are costly, and it is infeasible to replicate everything. Accurate, fast, lower-cost alternatives such as eliciting predictions could accelerate assessment for rapid policy implementation in a crisis and help guide a more efficient allocation of scarce replication resources. We elicited judgements from participants on 100 claims from preprints about an emerging area of research (COVID-19 pandemic) using an interactive structured elicitation protocol, and we conducted 29 new high-powered replications. After interacting with their peers, participant groups with lower task expertise ('beginners') updated their estimates and confidence in their judgements significantly more than groups with greater task expertise ('experienced'). For experienced individuals, the average accuracy was 0.57 (95% CI: [0.53, 0.61]) after interaction, and they correctly classified 61% of claims; beginners' average accuracy was 0.58 (95% CI: [0.54, 0.62]), correctly classifying 69% of claims. The difference in accuracy between groups was not statistically significant and their judgements on the full set of claims were correlated (r(98) = 0.48, P < 0.001). These results suggest that both beginners and more-experienced participants using a structured process have some ability to make better-than-chance predictions about the reliability of 'fast science' under conditions of high uncertainty. However, given the importance of such assessments for making evidence-based critical decisions in a crisis, more research is required to understand who the right experts in forecasting replicability are and how their judgements ought to be elicited.
Collapse
Affiliation(s)
- Alexandru Marcoci
- Centre for the Study of Existential Risk, University of Cambridge, Cambridge, UK.
- School of Politics and International Relations, University of Nottingham, Nottingham, UK.
| | - David P Wilkinson
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- QAECO, University of Melbourne, Melbourne, Victoria, Australia
| | - Ans Vercammen
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- School of Communication and Arts, The University of Queensland, Brisbane, Queensland, Australia
- School of Population Health, Curtin University, Bentley, Western Australia, Australia
| | - Bonnie C Wintle
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
| | - Anna Lou Abatayo
- Environmental Economics and Natural Resources Group, Wageningen University and Research, Wageningen, the Netherlands
| | - Ernest Baskin
- Department of Food, Pharma and Healthcare, Saint Joseph's University, Philadelphia, PA, USA
| | - Henk Berkman
- Business School, University of Auckland, Auckland, New Zealand
| | - Erin M Buchanan
- Analytics, Harrisburg University of Science and Technology, Harrisburg, PA, USA
| | - Sara Capitán
- Department of Ecology, Swedish University of Agricultural Sciences, Uppsala, Sweden
| | - Tabaré Capitán
- Department of Economics, Swedish University of Agricultural Sciences, Uppsala, Sweden
| | - Ginny Chan
- Rhizom Psychological Services LLC, Atlanta, GA, USA
| | - Kent Jason G Cheng
- Center for Healthy Aging, The Pennsylvania State University, University Park, PA, USA
| | - Tom Coupé
- UCMeta, University of Canterbury, Christchurch, New Zealand
| | - Sarah Dryhurst
- Department of Psychology, University of Cambridge, Cambridge, UK
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
- UCL Institute for Risk and Disaster Reduction, University College London, London, UK
| | - Jianhua Duan
- Statistics New Zealand, Christchurch, New Zealand
| | - John E Edlund
- Rochester Institute of Technology, Rochester, NY, USA
| | | | - Anna Fedor
- Independent researcher, Budapest, Hungary
| | - Fiona Fidler
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
| | - James G Field
- Department of Management, John Chambers School of Business and Economics, West Virginia University, Morgantown, WV, USA
| | - Nicholas Fox
- Center for Open Science, Charlottesville, VA, USA
| | - Hannah Fraser
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
| | - Alexandra L J Freeman
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
| | - Anca Hanea
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- Centre of Excellence for Biosecurity Risk Analysis, University of Melbourne, Melbourne, Victoria, Australia
| | - Felix Holzmeister
- Department of Economics, University of Innsbruck, Innsbruck, Austria
| | - Sanghyun Hong
- UCMeta, University of Canterbury, Christchurch, New Zealand
| | - Raquel Huggins
- Analytics, Harrisburg University of Science and Technology, Harrisburg, PA, USA
| | | | - Magnus Johannesson
- Department of Economics, Stockholm School of Economics, Stockholm, Sweden
| | - Angela M Jones
- School of Criminal Justice and Criminology, Texas State University, San Marcos, TX, USA
| | - Hansika Kapoor
- Department of Psychology, Monk Prayogshala, Mumbai, India
- Neag School of Education, University of Connecticut, Storrs, USA
| | - John Kerr
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
- Department of Public Health, University of Otago, Wellington, New Zealand
| | | | - Marta Kołczyńska
- Institute of Political Studies, Polish Academy of Sciences, Warszawa, Poland
| | - Yang Liu
- Department of Computer Science and Engineering, University of California, Santa Cruz, Santa Cruz, CA, USA
| | | | - Brianna Luis
- Center for Open Science, Charlottesville, VA, USA
| | | | - Olivia Miske
- Center for Open Science, Charlottesville, VA, USA
| | - Fallon Mody
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- History and Philosophy of Science, University of Melbourne, Melbourne, Victoria, Australia
| | - Carolin Nast
- University of Stavanger, School of Business and Law, Stavanger, Norway
| | - Brian A Nosek
- Center for Open Science, Charlottesville, VA, USA
- Department of Psychology, University of Virginia, Charlottesville, VA, USA
| | | | | | - W Robert Reed
- UCMeta, University of Canterbury, Christchurch, New Zealand
| | - Jon Roozenbeek
- Department of Psychology, University of Cambridge, Cambridge, UK
| | | | - Claudia R Schneider
- Department of Psychology, University of Cambridge, Cambridge, UK
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
- School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand
| | - Andrew Soh
- Department of Philosophy, University of Hawaii at Manoa, Honolulu, HI, USA
| | - Zhongchen Song
- New Zealand Institute of Economic Research (NZIER), Wellington, New Zealand
| | - Anirudh Tagat
- Department of Economics, Monk Prayogshala, Mumbai, India
| | - Melba Tutor
- Independent researcher, Quezon City, Philippines
| | | | | | | |
Collapse
|
14
|
Holzmeister F, Johannesson M, Camerer CF, Chen Y, Ho TH, Hoogeveen S, Huber J, Imai N, Imai T, Jin L, Kirchler M, Ly A, Mandl B, Manfredi D, Nave G, Nosek BA, Pfeiffer T, Sarafoglou A, Schwaiger R, Wagenmakers EJ, Waldén V, Dreber A. Examining the replicability of online experiments selected by a decision market. Nat Hum Behav 2025; 9:316-330. [PMID: 39562799 PMCID: PMC11860227 DOI: 10.1038/s41562-024-02062-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 10/11/2024] [Indexed: 11/21/2024]
Abstract
Here we test the feasibility of using decision markets to select studies for replication and provide evidence about the replicability of online experiments. Social scientists (n = 162) traded on the outcome of close replications of 41 systematically selected MTurk social science experiments published in PNAS 2015-2018, knowing that the 12 studies with the lowest and the 12 with the highest final market prices would be selected for replication, along with 2 randomly selected studies. The replication rate, based on the statistical significance indicator, was 83% for the top-12 and 33% for the bottom-12 group. Overall, 54% of the studies were successfully replicated, with replication effect size estimates averaging 45% of the original effect size estimates. The replication rate varied between 54% and 62% for alternative replication indicators. The observed replicability of MTurk experiments is comparable to that of previous systematic replication projects involving laboratory experiments.
Collapse
Affiliation(s)
- Felix Holzmeister
- Department of Economics, University of Innsbruck, Innsbruck, Austria
| | - Magnus Johannesson
- Department of Economics, Stockholm School of Economics, Stockholm, Sweden
| | - Colin F Camerer
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - Yiling Chen
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Boston, MA, USA
| | - Teck-Hua Ho
- Nanyang Technological University, Singapore, Singapore
| | - Suzanne Hoogeveen
- Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, The Netherlands
| | - Juergen Huber
- Department of Banking and Finance, University of Innsbruck, Innsbruck, Austria
| | - Noriko Imai
- Institute of Social and Economic Research, Osaka University, Osaka, Japan
| | - Taisuke Imai
- Institute of Social and Economic Research, Osaka University, Osaka, Japan
| | - Lawrence Jin
- Lee Kuan Yew School of Public Policy, National University of Singapore, Singapore, Singapore
| | - Michael Kirchler
- Department of Banking and Finance, University of Innsbruck, Innsbruck, Austria
| | - Alexander Ly
- Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
- Machine Learning, Centrum Wiskunde and Informatica, Amsterdam, The Netherlands
| | | | - Dylan Manfredi
- Marketing Department, Wharton School, University of Pennsylvania, Philadelphia, PA, USA
| | - Gideon Nave
- Marketing Department, Wharton School, University of Pennsylvania, Philadelphia, PA, USA
| | - Brian A Nosek
- Department of Psychology, University of Virginia, Charlottesville, VA, USA
- Center for Open Science, Charlottesville, VA, USA
| | - Thomas Pfeiffer
- Institute for Advanced Study, Massey University, Auckland, New Zealand
| | - Alexandra Sarafoglou
- Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
| | - Rene Schwaiger
- Department of Banking and Finance, University of Innsbruck, Innsbruck, Austria
| | - Eric-Jan Wagenmakers
- Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
| | | | - Anna Dreber
- Department of Economics, University of Innsbruck, Innsbruck, Austria.
- Department of Economics, Stockholm School of Economics, Stockholm, Sweden.
| |
Collapse
|
15
|
Kerpel-Fronius S, Becker AL. The Value and Importance of a Professional Ethical Code for Medicines Development: IFAPP International Ethics Framework. Pharmaceut Med 2025:10.1007/s40290-024-00547-6. [PMID: 39873953 DOI: 10.1007/s40290-024-00547-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/23/2024] [Indexed: 01/30/2025]
Abstract
Pharmaceutical medicine professionals have to face many ethical problems during the entire life span of new medicines extending from animal studies to broad clinical practice. The primary aim of the general ethical principles governing research conducted in humans is to diminish the physical and psychological burdens of the participants in human drug studies but overlooks many additional social and ethical problems faced by medicine developers. These arise mainly at the interface connecting the profit-oriented pharmaceutical industry and the healthcare-centered medical profession cooperating in medicines development. In 2002, the International Federation of Associations of Pharmaceutical Physicians and Pharmaceutical Medicine developed the International Code of Ethical Conduct for Pharmaceutical Physicians for providing ethical advice for their members to manage the frequently competitive goals characteristic for their specialty. The ethical framework compiled by the International Federation of Associations of Pharmaceutical Physicians and Pharmaceutical Medicine serves its members by presenting morally acceptable or inacceptable behaviors in frequently encountered controversies arising from competing industrial and healthcare interests in medicines development. The authors selected this format to encourage reflection and debate for finding optimal moral conclusions in specific issues. Many recent examples of serious scientific-ethical misconduct, such as the oxycodone tragedy, the recommendations of unproven useless occasionally dangerous therapies during the coronavirus disease 2019 pandemic, and the withdrawal of many papers containing non-reproducible results, contributed to the increasing loss of trust by the public in science including pharmaceutical medicine. We are convinced that the ethical guidance developed by the International Federation of Associations of Pharmaceutical Physicians and Pharmaceutical Medicine will encourage its members to reflect intensively on optimal ethical behavior in drug development for strengthening the trust of society in innovative new medicines. Finally, considering the increasingly active participation of non-medically trained scientists in producing and applying complex biological medicines, distant monitoring methods coupled together with artificial intelligence technology in innovative clinical trials, the Ethics Working Group recommended already in 2017 measures to optimize their smooth cooperation and underlined their joint ethical responsibilities in guarding the safety and human dignity of trial participants.
Collapse
Affiliation(s)
- Sandor Kerpel-Fronius
- Department of Pharmacology and Pharmacotherapy, Semmelweis University, Nagyvárad tér 4, 1089, Budapest, Hungary.
| | - Alexander L Becker
- Consultants in Pharmaceutical Medicine, Dover Heights, Sydney, NSW, Australia
| |
Collapse
|
16
|
Wu Y, Xie L. AI-driven multi-omics integration for multi-scale predictive modeling of genotype-environment-phenotype relationships. Comput Struct Biotechnol J 2025; 27:265-277. [PMID: 39886532 PMCID: PMC11779603 DOI: 10.1016/j.csbj.2024.12.030] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2024] [Revised: 12/22/2024] [Accepted: 12/26/2024] [Indexed: 02/01/2025] Open
Abstract
Despite the wealth of single-cell multi-omics data, it remains challenging to predict the consequences of novel genetic and chemical perturbations in the human body. It requires knowledge of molecular interactions at all biological levels, encompassing disease models and humans. Current machine learning methods primarily establish statistical correlations between genotypes and phenotypes but struggle to identify physiologically significant causal factors, limiting their predictive power. Key challenges in predictive modeling include scarcity of labeled data, generalization across different domains, and disentangling causation from correlation. In light of recent advances in multi-omics data integration, we propose a new artificial intelligence (AI)-powered biology-inspired multi-scale modeling framework to tackle these issues. This framework will integrate multi-omics data across biological levels, organism hierarchies, and species to predict genotype-environment-phenotype relationships under various conditions. AI models inspired by biology may identify novel molecular targets, biomarkers, pharmaceutical agents, and personalized medicines for presently unmet medical needs.
Collapse
Affiliation(s)
- You Wu
- Ph.D. Program in Computer Science, The Graduate Center, The City University of New York, New York, NY, USA
| | - Lei Xie
- Ph.D. Program in Computer Science, The Graduate Center, The City University of New York, New York, NY, USA
- Ph.D. Program in Biology and Biochemistry, The Graduate Center, The City University of New York, New York, NY, USA
- Department of Computer Science, Hunter College, The City University of New York, New York, NY, USA
- Helen & Robert Appel Alzheimer's Disease Research Institute, Feil Family Brain & Mind Research Institute, Weill Cornell Medicine, Cornell University, New York, NY, USA
| |
Collapse
|
17
|
Matsumoto K, Harada SY, Yoshida SY, Narumi R, Mitani TT, Yada S, Sato A, Morii E, Shimizu Y, Ueda HR. DECODE enables high-throughput mapping of antibody epitopes at single amino acid resolution. PLoS Biol 2025; 23:e3002707. [PMID: 39847587 PMCID: PMC11756784 DOI: 10.1371/journal.pbio.3002707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2024] [Accepted: 12/06/2024] [Indexed: 01/25/2025] Open
Abstract
Antibodies are extensively used in biomedical research, clinical fields, and disease treatment. However, to enhance the reproducibility and reliability of antibody-based experiments, it is crucial to have a detailed understanding of the antibody's target specificity and epitope. In this study, we developed a high-throughput and precise epitope analysis method, DECODE (Decoding Epitope Composition by Optimized-mRNA-display, Data analysis, and Expression sequencing). This method allowed identifying patterns of epitopes recognized by monoclonal or polyclonal antibodies at single amino acid resolution and predicted cross-reactivity against the entire protein database. By applying the obtained epitope information, it has become possible to develop a new 3D immunostaining method that increases the penetration of antibodies deep into tissues. Furthermore, to demonstrate the applicability of DECODE to more complex blood antibodies, we performed epitope analysis using serum antibodies from mice with experimental autoimmune encephalomyelitis (EAE). As a result, we were able to successfully identify an epitope that matched the sequence of the peptide inducing the disease model without relying on existing antigen information. These results demonstrate that DECODE can provide high-quality epitope information, improve the reproducibility of antibody-dependent experiments, diagnostics and therapeutics, and contribute to discover pathogenic epitopes from antibodies in the blood.
Collapse
Affiliation(s)
- Katsuhiko Matsumoto
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Systems Pharmacology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Shoko Y. Harada
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Shota Y. Yoshida
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Pathology, Graduate School of Medicine, Osaka University, Osaka, Japan
| | - Ryohei Narumi
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Tomoki T. Mitani
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Systems Biology, Graduate school of Medicine, Osaka University, Osaka, Japan
- Department of Neurology, Graduate school of Medicine, Osaka University, Osaka, Japan
| | - Saori Yada
- Department of Systems Pharmacology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Aya Sato
- Laboratory for Cell-Free Protein Synthesis, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Eiichi Morii
- Department of Pathology, Graduate School of Medicine, Osaka University, Osaka, Japan
| | - Yoshihiro Shimizu
- Laboratory for Cell-Free Protein Synthesis, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Hiroki R. Ueda
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Systems Pharmacology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
- Department of Pathology, Graduate School of Medicine, Osaka University, Osaka, Japan
- Institute of Life Science, Kurume University, Kurume, Japan
| |
Collapse
|
18
|
Poole D, Linden A, Sedgewick F, Allchin O, Hobson H. A systematic review of pre-registration in autism research journals. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2024:13623613241308312. [PMID: 39720839 DOI: 10.1177/13623613241308312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2024]
Abstract
LAY ABSTRACT When researchers write down their plans for a study ahead of time and make this public, this is called pre-registration. Pre-registration allows others to see if the researchers stuck to their original plan or changed as they went along. Pre-registration is growing in popularity but we do not know how widely it is used in autism research. In this study, we looked at papers published in six major autism journals between 2011 and 2022. We found that only 2.23% of papers published in autism journals had been pre-registered. We also took a close look at a selection of the pre-registrations to check how good they were and if researchers stuck to their plans. We found that the pre-registrations generally lacked specifics, particularly about how the study was designed and the data would be analysed. We also found that only 28% of the papers closely followed the pre-registered plans or reported the changes.Based on these findings, we recommend that autism researchers consider pre-registering their work and transparently report any changes from their original plans. We have provided some recommendations for researchers and journals on how pre-registration could be better used in autism research.
Collapse
|
19
|
Wang B, Kim HJ, Bradley KM, Chen C, McLendon C, Yang Z, Benner SA. Joining Natural and Synthetic DNA Using Biversal Nucleotides: Efficient Sequencing of Six-Nucleotide DNA. J Am Chem Soc 2024; 146:35129-35138. [PMID: 39625448 DOI: 10.1021/jacs.4c11043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2024]
Abstract
By rearranging hydrogen bond donor and acceptor groups within a standard Watson-Crick geometry, DNA can add eight independently replicable nucleotides forming four additional not found in standard Terran DNA. For many applications, the orthogonal pairing of standard and nonstandard pairs offers a key advantage. However, other applications require standard and nonstandard nucleotides to communicate with each other. This is especially true when seeking to recruit high-throughput instruments (e.g., Illumina), designed to sequence standard 4-nucleotide DNA, to sequence DNA that includes added nucleotides. For this purpose, PCR workflows are needed to replace nonstandard nucleotides in (for example) a 6-letter DNA sequence by defined mixtures of standard nucleotides built from 4 nucleotides. High-throughput sequencing can then report the sequences of those mixtures to bioinformatic alignment tools, which infer the original 6-nucleotide sequence by analysis of the mixtures. Unfortunately, the intrinsic orthogonality of standard and nonstandard nucleotides often demand polymerases that violate pairing biophysics to do this replacement, leading to inefficiencies in this "transliteration" process. Thus, laboratory in vitro evolution (LIVE) using "anthropogenic evolvable genetic information systems" (AEGIS), an important "consumer" of new sequencing tools, has been slow to be democratized; robust sequencing is needed to identify the AegisBodies and AegisZymes that AEGIS-LIVE delivers. This work introduces a new way to connect synthetic and standard molecular biology: biversal nucleotides. In an example presented here, a pyrimidine analogue (pyridine-2-one, y) pairs with Watson-Crick geometry to both a nonstandard base (2-amino-8-imidazo-[1,2a]-1,3,5-triazin-[8H]-4-one, P, the Watson-Crick partner of 6-amino-5-nitro-[1H]-pyridin-2-one, Z) and a base that completes the Watson-Crick hydrogen bond pattern (2-amino-2'-deoxyadenosine, amA). PCR amplification of GACTZP DNA with dyTP delivers products where Z:P pairs are cleanly transliterated to A:T pairs. In parallel, PCR of the same GACTZP sample at higher pH delivers products where Z:P pairs are cleanly transliterated to C:G pairs. By allowing robust sequencing of 6-letter GACTZP DNA, this workflow will help democratize AEGIS-LIVE. Further, other implementations of the biversal concept can enable communication across and between standard DNA and synthetic DNA more generally.
Collapse
Affiliation(s)
- Bang Wang
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Hyo-Joong Kim
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
| | - Kevin M Bradley
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Cen Chen
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
| | - Chris McLendon
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Zunyi Yang
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Steven A Benner
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| |
Collapse
|
20
|
Fikar P, Alvarez L, Berne L, Cienciala M, Kan C, Kasl H, Luo M, Novackova Z, Ordonez S, Sramkova Z, Holubova M, Lysak D, Avery L, Caro AA, Crowder RN, Diaz-Martinez LA, Donley DW, Giorno RR, Reed IKG, Hensley LL, Johnson KC, Kim AY, Kim P, LaGier AJ, Newman JJ, Padilla-Crespo E, Reyna NS, Tsotakos N, Al-Saadi NN, Appleton T, Arosemena-Pickett A, Bell BA, Bing G, Bishop B, Forde C, Foster MJ, Gray K, Hasley BL, Johnson K, Jones DJ, LaShall AC, McGuire K, McNaughton N, Morgan AM, Norris L, Ossman LA, Rivera-Torres PA, Robison ME, Thibodaux K, Valmond L, Georgiev D. Enhancing reproducibility in single cell research with biocytometry: An inter-laboratory study. PLoS One 2024; 19:e0314992. [PMID: 39652549 PMCID: PMC11627387 DOI: 10.1371/journal.pone.0314992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 11/19/2024] [Indexed: 12/12/2024] Open
Abstract
Biomedicine today is experiencing a shift towards decentralized data collection, which promises enhanced reproducibility and collaboration across diverse laboratory environments. This inter-laboratory study evaluates the performance of biocytometry, a method utilizing engineered bioparticles for enumerating cells based on their surface antigen patterns. In centralized and aggregated inter-lab studies, biocytometry demonstrated significant statistical power in discriminating numbers of target cells at varying concentrations as low as 1 cell per 100,000 background cells. User skill levels varied from expert to beginner capturing a range of proficiencies. Measurement was performed in a decentralized environment without any instrument cross-calibration or advanced user training outside of a basic instruction manual. The results affirm biocytometry to be a viable solution for immunophenotyping applications demanding sensitivity as well as scalability and reproducibility and paves the way for decentralized analysis of rare cells in heterogeneous samples.
Collapse
Affiliation(s)
- Pavel Fikar
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Laura Alvarez
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Laura Berne
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Martin Cienciala
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Christopher Kan
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Hynek Kasl
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Mona Luo
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Zuzana Novackova
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Sheyla Ordonez
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Zuzana Sramkova
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Monika Holubova
- Department of Hematology and Oncology, University Hospital Pilsen, Pilsen, Czech Republic
| | - Daniel Lysak
- Department of Hematology and Oncology, University Hospital Pilsen, Pilsen, Czech Republic
| | - Lyndsay Avery
- Department of Biology, Saint Michael’s College, Colchester, Vermont, United States of America
| | - Andres A. Caro
- Chemistry Department, Hendrix College, Conway, Arkansas, United States of America
| | - Roslyn N. Crowder
- Department of Biology, Stetson University, Deland, Florida, United States of America
| | - Laura A. Diaz-Martinez
- Department of Biology, Gonzaga University, Spokane, Washington, United States of America
| | - David W. Donley
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Rebecca R. Giorno
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Irene K. Guttilla Reed
- Department of Biology, University of Saint Joseph, West Hartford, Connecticut, United States of America
| | - Lori L. Hensley
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Kristen C. Johnson
- Department of Life Sciences, University of New Hampshire, Manchester, New Hampshire, United States of America
| | - Audrey Y. Kim
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Paul Kim
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Adriana J. LaGier
- Department of Biology, College of Social and Natural Sciences, Grand View University, Des Moines, Iowa, United States of America
| | - Jamie J. Newman
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Elizabeth Padilla-Crespo
- Department of Science and Technology, Inter American University of Puerto Rico-Aguadilla, Aguadilla, Puerto Rico, United States of America
| | - Nathan S. Reyna
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Nikolaos Tsotakos
- Department of Biological Sciences, School of Science Engineering and Technology, Penn State Harrisburg, Middletown, Pennsylvania, United States of America
| | - Noha N. Al-Saadi
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Tayler Appleton
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Ana Arosemena-Pickett
- Department of Science and Technology, Inter American University of Puerto Rico-Aguadilla, Aguadilla, Puerto Rico, United States of America
| | - Braden A. Bell
- Department of Biology, Gonzaga University, Spokane, Washington, United States of America
| | - Grace Bing
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Bre Bishop
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Christa Forde
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Michael J. Foster
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Kassidy Gray
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Bennett L. Hasley
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Kennedy Johnson
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Destiny J. Jones
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Allison C. LaShall
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Kennedy McGuire
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Naomi McNaughton
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Angelina M. Morgan
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Lucas Norris
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Landon A. Ossman
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Paollette A. Rivera-Torres
- Department of Science and Technology, Inter American University of Puerto Rico-Aguadilla, Aguadilla, Puerto Rico, United States of America
| | - Madeline E. Robison
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Kathryn Thibodaux
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Lescia Valmond
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Daniel Georgiev
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
- Faculty of Applied Sciences, University of West Bohemia, Pilsen, Czech Republic
| |
Collapse
|
21
|
Agudogo S, Moody R, Whelan A, Wagner S, Berghella V, Chauhan SP, Ramos S, Gupta M. Characteristics of obstetrical randomized controlled trials with large versus modest or no treatment effects. Eur J Obstet Gynecol Reprod Biol 2024; 303:369-370. [PMID: 39448353 DOI: 10.1016/j.ejogrb.2024.10.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Revised: 10/07/2024] [Accepted: 10/14/2024] [Indexed: 10/26/2024]
Affiliation(s)
- Sroda Agudogo
- Beth Israel Deaconess Medical Center/Harvard Medical School, Boston, MA, United States
| | - Rachel Moody
- Brown Medical School, Providence, RI, United States
| | - Anna Whelan
- University of Massachusetts, Worchester, MA, United States
| | - Stephen Wagner
- Beth Israel Deaconess Medical Center/Harvard Medical School, Boston, MA, United States.
| | | | | | | | - Megha Gupta
- Beth Israel Deaconess Medical Center/Harvard Medical School, Boston, MA, United States
| |
Collapse
|
22
|
Di Camillo F, Grimaldi DA, Cattarinussi G, Di Giorgio A, Locatelli C, Khuntia A, Enrico P, Brambilla P, Koutsouleris N, Sambataro F. Magnetic resonance imaging-based machine learning classification of schizophrenia spectrum disorders: a meta-analysis. Psychiatry Clin Neurosci 2024; 78:732-743. [PMID: 39290174 PMCID: PMC11612547 DOI: 10.1111/pcn.13736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 07/31/2024] [Accepted: 08/19/2024] [Indexed: 09/19/2024]
Abstract
BACKGROUND Recent advances in multivariate pattern recognition have fostered the search for reliable neuroimaging-based biomarkers in psychiatric conditions, including schizophrenia. These approaches consider the complex pattern of alterations in brain function and structure, overcoming the limitations of traditional univariate methods. To assess the reliability of neuroimaging-based biomarkers and the contribution of study characteristics in distinguishing individuals with schizophrenia spectrum disorder (SSD) from healthy controls (HCs), we conducted a systematic review of the studies that used multivariate pattern recognition for this objective. METHODS We systematically searched PubMed, Scopus, and Web of Science for studies on SSD classification using multivariate pattern analysis on magnetic resonance imaging data. We employed a bivariate random-effects meta-analytic model to explore the classification of sensitivity (SE) and specificity (SP) across studies while also evaluating the moderator effects of clinical and non-clinical variables. RESULTS A total of 119 studies (with 12,723 patients with SSD and 13,196 HCs) were identified. The meta-analysis estimated a SE of 79.1% (95% confidence interval [CI], 77.1%-81.0%) and a SP of 80.0% (95% CI, 77.8%-82.0%). In particular, the Positive and Negative Syndrome Scale and the Global Assessment of Functioning scores, age, age of onset, duration of untreated psychosis, deep learning, algorithm type, features selection, and validation methods had significant effects on classification performance. CONCLUSIONS Multivariate pattern analysis reliably identifies neuroimaging-based biomarkers of SSD, achieving ∼80% SE and SP. Despite clinical heterogeneity, discernible brain modifications effectively differentiate SSD from HCs. Classification performance depends on patient-related and methodological factors crucial for the development, validation, and application of prospective models in clinical settings.
Collapse
Affiliation(s)
| | | | - Giulia Cattarinussi
- Department of Neuroscience (DNS)University of PadovaPaduaItaly
- Padova Neuroscience CenterUniversity of PadovaPaduaItaly
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and NeuroscienceKing's College LondonLondonUnited Kingdom
| | | | - Clara Locatelli
- Department of Mental Health and AddictionsASST Papa Giovanni XXIIIBergamoItaly
| | - Adyasha Khuntia
- Department of Psychiatry and PsychotherapyLudwig‐Maximilian UniversityMunichGermany
- International Max Planck Research School for Translational Psychiatry (IMPRS‐TP)MunichGermany
- Max‐Planck‐Institute of PsychiatryMunichGermany
| | - Paolo Enrico
- Department of Psychiatry and PsychotherapyLudwig‐Maximilian UniversityMunichGermany
- Department of Pathophysiology and TransplantationUniversity of MilanMilanItaly
- Department of Neurosciences and Mental HealthFondazione IRCSS Ca’ Granda Ospedale Maggiore PoliclinicoMilanItaly
| | - Paolo Brambilla
- Department of Pathophysiology and TransplantationUniversity of MilanMilanItaly
- Department of Neurosciences and Mental HealthFondazione IRCSS Ca’ Granda Ospedale Maggiore PoliclinicoMilanItaly
| | - Nikolaos Koutsouleris
- Max‐Planck‐Institute of PsychiatryMunichGermany
- Department of PsychiatryMunich University HospitalMunichGermany
- Department of Psychosis Studies, Institute of Psychiatry, Psychology and NeuroscienceKing's College LondonLondonUnited Kingdom
| | - Fabio Sambataro
- Department of Neuroscience (DNS)University of PadovaPaduaItaly
- Padova Neuroscience CenterUniversity of PadovaPaduaItaly
| |
Collapse
|
23
|
Harbut E, Makris Y, Pertsemlidis A, Bleris L. The history, landscape, and outlook of human cell line authentication and security. SLAS DISCOVERY : ADVANCING LIFE SCIENCES R & D 2024; 29:100194. [PMID: 39522879 DOI: 10.1016/j.slasd.2024.100194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 09/30/2024] [Accepted: 11/04/2024] [Indexed: 11/16/2024]
Affiliation(s)
- Elijah Harbut
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX, USA; Center for Systems Biology, The University of Texas at Dallas, Richardson, TX, USA; Department of Biological Sciences, The University of Texas at Dallas, Richardson, TX, USA
| | - Yiorgos Makris
- Department of Electrical and Computer Engineering, The University of Texas at Dallas, Richardson, TX, USA
| | - Alexander Pertsemlidis
- Department of Pediatrics, The University of Texas Health Science Center at San Antonio, San Antonio, TX, USA; Department of Cell Systems & Anatomy, The University of Texas Health Science Center at San Antonio, San Antonio, TX, USA; Greehey Children's Cancer Research Institute, The University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| | - Leonidas Bleris
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX, USA; Center for Systems Biology, The University of Texas at Dallas, Richardson, TX, USA; Department of Biological Sciences, The University of Texas at Dallas, Richardson, TX, USA.
| |
Collapse
|
24
|
Wittau J, Seifert R. How to fight fake papers: a review on important information sources and steps towards solution of the problem. NAUNYN-SCHMIEDEBERG'S ARCHIVES OF PHARMACOLOGY 2024; 397:9281-9294. [PMID: 38970685 PMCID: PMC11582211 DOI: 10.1007/s00210-024-03272-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2024] [Accepted: 07/01/2024] [Indexed: 07/08/2024]
Abstract
Scientific fake papers, containing manipulated or completely fabricated data, are a problem that has reached dramatic dimensions. Companies known as paper mills (or more bluntly as "criminal science publishing gangs") produce and sell such fake papers on a large scale. The main drivers of the fake paper flood are the pressure in academic systems and (monetary) incentives to publish in respected scientific journals and sometimes the personal desire for increased "prestige." Published fake papers cause substantial scientific, economic, and social damage. There are numerous information sources that deal with this topic from different points of view. This review aims to provide an overview of these information sources until June 2024. Much more original research with larger datasets is needed, for example on the extent and impact of the fake paper problem and especially on how to detect them, as many findings are based more on small datasets, anecdotal evidence, and assumptions. A long-term solution would be to overcome the mantra of publication metrics for evaluating scientists in academia.
Collapse
Affiliation(s)
- Jonathan Wittau
- Institute of Pharmacology, Hannover Medical School, Carl-Neuberg-Straße 1, 30625, Hannover, Germany
| | - Roland Seifert
- Institute of Pharmacology, Hannover Medical School, Carl-Neuberg-Straße 1, 30625, Hannover, Germany.
| |
Collapse
|
25
|
Hartung J, Reuter S, Kulow VA, Fähling M, Spreckelsen C, Mrowka R. Experts fail to reliably detect AI-generated histological data. Sci Rep 2024; 14:28677. [PMID: 39562595 PMCID: PMC11577117 DOI: 10.1038/s41598-024-73913-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2024] [Accepted: 09/23/2024] [Indexed: 11/21/2024] Open
Abstract
AI-based methods to generate images have seen unprecedented advances in recent years challenging both image forensic and human perceptual capabilities. Accordingly, these methods are expected to play an increasingly important role in the fraudulent fabrication of data. This includes images with complicated intrinsic structures such as histological tissue samples, which are harder to forge manually. Here, we use stable diffusion, one of the most recent generative algorithms, to create such a set of artificial histological samples. In a large study with over 800 participants, we study the ability of human subjects to discriminate between these artificial and genuine histological images. Although they perform better than naive participants, we find that even experts fail to reliably identify fabricated data. While participant performance depends on the amount of training data used, even low quantities are sufficient to create convincing images, necessitating methods and policies to detect fabricated data in scientific publications.
Collapse
Affiliation(s)
- Jan Hartung
- Institute for Physiology, Faculty of Medicine, University of Freiburg, 79108, Freiburg, Germany.
- BrainLinks-BrainTools, IMBIT (Institute for Machine-Brain Interfacing Technology), University of Freiburg, Georges-Köhler-Allee 201, 79110, Freiburg, Germany.
- Department of Internal Medicine III, Experimental Nephrology, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany.
- Section of Translational Neuroimmunology, Department of Neurology, Jena University Hospital, 07747, Jena, Germany.
| | - Stefanie Reuter
- ThIMEDOP, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany
| | - Vera Anna Kulow
- Charité - Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Freie Universität Berlin and Humboldt-Universität zu Berlin, Institut für Translationale Physiologie (CCM), Charitéplatz 1, 10117, Berlin, Germany
| | - Michael Fähling
- Charité - Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Freie Universität Berlin and Humboldt-Universität zu Berlin, Institut für Translationale Physiologie (CCM), Charitéplatz 1, 10117, Berlin, Germany
| | - Cord Spreckelsen
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, Bachstrase 18, 07743, Jena, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Jena, Germany
| | - Ralf Mrowka
- Department of Internal Medicine III, Experimental Nephrology, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany.
- ThIMEDOP, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany.
| |
Collapse
|
26
|
Ioannidis JP. Transparency, bias, and reproducibility across science: a meta-research view. J Clin Invest 2024; 134:e181923. [PMID: 39545412 PMCID: PMC11563668 DOI: 10.1172/jci181923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2024] Open
|
27
|
Balas EA, De Leo G, Shaw K. Strategic policy options to improve quality and productivity of biomedical research. Politics Life Sci 2024; 44:108-119. [PMID: 39530190 PMCID: PMC11968251 DOI: 10.1017/pls.2024.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2024]
Abstract
Emerging societal expectations from biomedical research and intensifying international scientific competition are becoming existential matters. Based on a review of pertinent evidence, this article analyzes challenges and formulates public policy recommendations for improving productivity and impact of life sciences. Critical risks include widespread quality defects of research, particularly non-reproducible results, and narrow access to scientifically sound information giving advantage to health misinformation. In funding life sciences, the simultaneous shift to nondemocratic societies is an added challenge. Simply spending more on research will not be enough in the global competition. Considering the pacesetter role of the federal government, five national policy recommendations are put forward: (i) funding projects with comprehensive expectations of reproducibility; (ii) public-private partnerships for contemporaneous quality support in laboratories; (iii) making research institutions accountable for quality control; (iv) supporting new quality filtering standards for scientific journals and repositories, and (v) establishing a new network of centers for scientific health communications.
Collapse
Affiliation(s)
- E. Andrew Balas
- Biomedical Research Innovation Laboratory at Augusta University, Augusta GA
| | - Gianluca De Leo
- Biomedical Research Innovation Laboratory at Augusta University, Augusta GA
- Department of Health Management, Economics and Policy at Augusta University, Augusta GA
| | - Kelly Shaw
- Department of Political Science at Iowa State University, Ames IA
| |
Collapse
|
28
|
Morel VJ, Rössler J, Bernasconi M. Targeted immunotherapy and nanomedicine for rhabdomyosarcoma: The way of the future. Med Res Rev 2024; 44:2730-2773. [PMID: 38885148 DOI: 10.1002/med.22059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 04/17/2024] [Accepted: 05/20/2024] [Indexed: 06/20/2024]
Abstract
Rhabdomyosarcoma (RMS) is the most common soft tissue sarcoma of childhood. Histology separates two main subtypes: embryonal RMS (eRMS; 60%-70%) and alveolar RMS (aRMS; 20%-30%). The aggressive aRMS carry one of two characteristic chromosomal translocations that result in the expression of a PAX3::FOXO1 or PAX7::FOXO1 fusion transcription factor; therefore, aRMS are now classified as fusion-positive (FP) RMS. Embryonal RMS have a better prognosis and are clinically indistinguishable from fusion-negative (FN) RMS. Next to histology and molecular characteristics, RMS risk groupings are now available defining low risk tumors with excellent outcomes and advanced stage disease with poor prognosis, with an overall survival of about only 20% despite intensified multimodal treatment. Therefore, development of novel effective targeted strategies to increase survival and to decrease long-term side effects is urgently needed. Recently, immunotherapies and nanomedicine have been emerging for potent and effective tumor treatments with minimal side effects, raising hopes for effective and safe cures for RMS patients. This review aims to describe the most relevant preclinical and clinical studies in immunotherapy and targeted nanomedicine performed so far in RMS and to provide an insight in future developments.
Collapse
Affiliation(s)
- Victoria Judith Morel
- Department of Pediatric Hematology and Oncology, Inselspital, Bern University Hospital, Bern, Switzerland
- Department for BioMedical Research (DBMR), University of Bern, Bern, Switzerland
| | - Jochen Rössler
- Department of Pediatric Hematology and Oncology, Inselspital, Bern University Hospital, Bern, Switzerland
- Department for BioMedical Research (DBMR), University of Bern, Bern, Switzerland
| | - Michele Bernasconi
- Department of Pediatric Hematology and Oncology, Inselspital, Bern University Hospital, Bern, Switzerland
- Department for BioMedical Research (DBMR), University of Bern, Bern, Switzerland
| |
Collapse
|
29
|
Ghislat G, Hernandez-Hernandez S, Piyawajanusorn C, Ballester PJ. Data-centric challenges with the application and adoption of artificial intelligence for drug discovery. Expert Opin Drug Discov 2024; 19:1297-1307. [PMID: 39316009 DOI: 10.1080/17460441.2024.2403639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 09/09/2024] [Indexed: 09/25/2024]
Abstract
INTRODUCTION Artificial intelligence (AI) is exhibiting tremendous potential to reduce the massive costs and long timescales of drug discovery. There are however important challenges currently limiting the impact and scope of AI models. AREAS COVERED In this perspective, the authors discuss a range of data issues (bias, inconsistency, skewness, irrelevance, small size, high dimensionality), how they challenge AI models, and which issue-specific mitigations have been effective. Next, they point out the challenges faced by uncertainty quantification techniques aimed at enhancing and trusting the predictions from these AI models. They also discuss how conceptual errors, unrealistic benchmarks and performance misestimation can confound the evaluation of models and thus their development. Lastly, the authors explain how human bias, whether from AI experts or drug discovery experts, constitutes another challenge that can be alleviated by gaining more prospective experience. EXPERT OPINION AI models are often developed to excel on retrospective benchmarks unlikely to anticipate their prospective performance. As a result, only a few of these models are ever reported to have prospective value (e.g. by discovering potent and innovative drug leads for a therapeutic target). The authors have discussed what can go wrong in practice with AI for drug discovery. The authors hope that this will help inform the decisions of editors, funders investors, and researchers working in this area.
Collapse
Affiliation(s)
- Ghita Ghislat
- Department of Life Sciences, Imperial College London, London, UK
| | | | | | | |
Collapse
|
30
|
Ahuis TP, Smyk MK, Laloux C, Aulehner K, Bray J, Waldron AM, Miljanovic N, Seiffert I, Song D, Boulanger B, Jucker M, Potschka H, Platt B, Riedel G, Voehringer P, Nicholson JR, Drinkenburg WHIM, Kas MJH, Leiser SC. Evaluation of variation in preclinical electroencephalographic (EEG) spectral power across multiple laboratories and experiments: An EQIPD study. PLoS One 2024; 19:e0309521. [PMID: 39471212 PMCID: PMC11521305 DOI: 10.1371/journal.pone.0309521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 08/13/2024] [Indexed: 11/01/2024] Open
Abstract
The European Quality In Preclinical Data (EQIPD) consortium was born from the fact that publications report challenges with the robustness, rigor, and/or validity of research data, which may impact decisions about whether to proceed with further preclinical testing or to advance to clinical testing, as well as draw conclusions on the predictability of preclinical models. To address this, a consortium including multiple research laboratories from academia and industry participated in a series of electroencephalography (EEG) experiments in mice aimed to detect sources of variance and to gauge how protocol harmonisation and data analytics impact such variance. Ultimately, the goal of this first ever between-laboratory comparison of EEG recordings and analyses was to validate the principles that supposedly increase data quality, robustness, and comparability. Experiments consisted of a Localisation phase, which aimed to identify the factors that influence between-laboratory variability, a Harmonisation phase to evaluate whether harmonisation of standardized protocols and centralised processing and data analysis reduced variance, and a Ring-Testing phase to verify the ability of the harmonised protocol to generate consistent findings. Indeed, between-laboratory variability reduced from Localisation to Harmonisation and this reduction remained during the Ring-Testing phase. Results obtained in this multicentre preclinical qEEG study also confirmed the complex nature of EEG experiments starting from the surgery and data collection through data pre-processing to data analysis that ultimately influenced the results and contributed to variance in findings across laboratories. Overall, harmonisation of protocols and centralized data analysis were crucial in reducing laboratory-to-laboratory variability. To this end, it is recommended that standardized guidelines be updated and followed for collection and analysis of preclinical EEG data.
Collapse
Affiliation(s)
- Tim P. Ahuis
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
- Department of CNS Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Magdalena K. Smyk
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
- Department of Neuroscience, Janssen Research & Development, A Division of Janssen Pharmaceutica NV, Beerse, Belgium
| | | | - Katharina Aulehner
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Jack Bray
- Institute of Medical Sciences, University of Aberdeen, Foresterhill, Aberdeen, Scotland, United Kingdom
| | - Ann-Marie Waldron
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Nina Miljanovic
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Isabel Seiffert
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Dekun Song
- Translational EEG, PsychoGenics Inc., Paramus, New Jersey, United States of America
| | | | - Mathias Jucker
- Department of Cellular Neurology, Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Heidrun Potschka
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Bettina Platt
- Institute of Medical Sciences, University of Aberdeen, Foresterhill, Aberdeen, Scotland, United Kingdom
| | - Gernot Riedel
- Institute of Medical Sciences, University of Aberdeen, Foresterhill, Aberdeen, Scotland, United Kingdom
| | - Patrizia Voehringer
- Department of CNS Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Janet R. Nicholson
- Department of CNS Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Wilhelmus H. I. M. Drinkenburg
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
- Department of Neuroscience, Janssen Research & Development, A Division of Janssen Pharmaceutica NV, Beerse, Belgium
| | - Martien J. H. Kas
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
| | - Steven C. Leiser
- Translational EEG, PsychoGenics Inc., Paramus, New Jersey, United States of America
| |
Collapse
|
31
|
Ameen-Ali KE, Allen C. The 3Rs in zebrafish research. Zebrafish 2024:225-250. [DOI: 10.1079/9781800629431.0008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2025] Open
|
32
|
Glover CN, Borowiec BG, Joyce W. Editorial: Common methodological issues in comparative biochemistry and physiology. Comp Biochem Physiol A Mol Integr Physiol 2024; 296:111697. [PMID: 39002941 DOI: 10.1016/j.cbpa.2024.111697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/15/2024]
Affiliation(s)
| | | | - William Joyce
- Centro Nacional de Investigaciones Cardiovasculares, Spain
| |
Collapse
|
33
|
Ronquillo JG, South B, Naik P, Singh R, De Jesus M, Watt SJ, Habtezion A. Informatics and Artificial Intelligence-Guided Assessment of the Regulatory and Translational Research Landscape of First-in-Class Oncology Drugs in the United States, 2018-2022. JCO Clin Cancer Inform 2024; 8:e2400087. [PMID: 39348666 DOI: 10.1200/cci.24.00087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Revised: 06/23/2024] [Accepted: 08/13/2024] [Indexed: 10/02/2024] Open
Abstract
PURPOSE Cancer drug development remains a critical but challenging process that affects millions of patients and their families. Using biomedical informatics and artificial intelligence (AI) approaches, we assessed the regulatory and translational research landscape defining successful first-in-class drugs for patients with cancer. METHODS This is a retrospective observational study of all novel first-in-class drugs approved by the US Food and Drug Administration (FDA) from 2018 to 2022, stratified by cancer versus noncancer drugs. A biomedical informatics pipeline leveraging interoperability standards and ChatGPT performed integration and analysis of public databases provided by the FDA, National Institutes of Health, and WHO. RESULTS Between 2018 and 2022, the FDA approved a total of 247 novel drugs, of which 107 (43.3%) were first-in-class drugs involving a new biologic target. Of these first-in-class drugs, 30 (28%) treatments were indicated for patients with cancer, including 19 (63.3%) for solid tumors and the remaining 11 (36.7%) for hematologic cancers. A median of 68 publications of basic, clinical, and other relevant translational science preceded successful FDA approval of first-in-class cancer drugs, with oncology-related treatments involving fewer median years of target-based research than therapies not related to cancer (33 v 43 years; P < .05). Overall, 94.4% of first-in-class drugs had at least 25 years of target-related research papers, while 85.5% of first-in-class drugs had at least 10 years of translational research publications. CONCLUSION Novel first-in-class cancer treatments are defined by diverse clinical indications, personalized molecular targets, dependence on expedited regulatory pathways, and translational research metrics reflecting this complex landscape. Biomedical informatics and AI provide scalable, data-driven ways to assess and even address important challenges in the drug development pipeline.
Collapse
Affiliation(s)
- Jay G Ronquillo
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Brett South
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Prakash Naik
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Rominder Singh
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Magdia De Jesus
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Stephen J Watt
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Aida Habtezion
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| |
Collapse
|
34
|
Jarvis MF. Decatastrophizing research irreproducibility. Biochem Pharmacol 2024; 228:116090. [PMID: 38408680 DOI: 10.1016/j.bcp.2024.116090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Revised: 02/03/2024] [Accepted: 02/23/2024] [Indexed: 02/28/2024]
Abstract
The reported inability to replicate research findings from the published literature precipitated extensive efforts to identify and correct perceived deficiencies in the execution and reporting of biomedical research. Despite these efforts, quantification of the magnitude of irreproducible research or the effectiveness of associated remediation initiatives, across diverse biomedical disciplines, has made little progress over the last decade. The idea that science is self-correcting has been further challenged in recent years by the proliferation of unverified or fraudulent scientific content generated by predatory journals, paper mills, pre-print server postings, and the inappropriate use of artificial intelligence technologies. The degree to which the field of pharmacology has been negatively impacted by these evolving pressures is unknown. Regardless of these ambiguities, pharmacology societies and their associated journals have championed best practices to enhance the experimental rigor and reporting of pharmacological research. The value of transparent and independent validation of raw data generation and its analysis in basic and clinical research is exemplified by the discovery, development, and approval of Highly Effective Modulator Therapy (HEMT) for Cystic Fibrosis (CF) patients. This provides a didactic counterpoint to concerns regarding the current state of biomedical research. Key features of this important therapeutic advance include objective construction of basic and translational research hypotheses, associated experimental designs, and validation of experimental effect sizes with quantitative alignment to meaningful clinical endpoints with input from the FDA, which enhanced scientific rigor and transparency with real world deliverables for patients in need.
Collapse
Affiliation(s)
- Michael F Jarvis
- Department of Pharmaceutical Sciences, University of Illinois-Chicago, USA.
| |
Collapse
|
35
|
Ramadan A, Chleilat E, Martinez-Navarro H, Brennan-McLean J, Copier J, Caldwell J, Greiner J, Martínez Díaz P, Sobota V. Gordon Research Conference on Cardiac Arrhythmia Mechanisms 2023: early career investigators' views on emerging concepts and technologies. J Physiol 2024; 602:5151-5153. [PMID: 37462064 DOI: 10.1113/jp284666] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 06/28/2023] [Indexed: 10/22/2024] Open
Affiliation(s)
- Ahmed Ramadan
- School of Biomedical Engineering, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Enaam Chleilat
- Institute for Experimental Cardiovascular Medicine, University Heart Center Freiburg Bad Krozingen, and Medical Faculty of the University of Freiburg, Freiburg, Germany
| | - Hector Martinez-Navarro
- Department of Computer Science, British Heart Foundation Centre of Research Excellence, University of Oxford, Oxford, UK
| | - Jaclyn Brennan-McLean
- American Association for the Advancement of Science (AAAS) Science and Technology Policy Fellowships Program, Washington, DC, USA
| | - Jaël Copier
- Amsterdam UMC location University of Amsterdam, Experimental Cardiology, Amsterdam Cardiovascular Sciences, Heart failure & arrhythmias, Amsterdam, The Netherlands
| | - Jessica Caldwell
- Department of Pharmacology, University of California Davis, Davis, California, USA
| | - Joachim Greiner
- Institute for Experimental Cardiovascular Medicine, University Heart Center Freiburg Bad Krozingen, and Medical Faculty of the University of Freiburg, Freiburg, Germany
| | - Patricia Martínez Díaz
- Karlsruhe Institute of Technology (KIT), Institute of Biomedical Engineering, Karlsruhe, Germany
| | - Vladimír Sobota
- IHU Liryc, Electrophysiology and Heart Modeling Institute, Fondation Bordeaux Université, Bordeaux, France
| |
Collapse
|
36
|
Li Y, Zhou X, Chen R, Zhang X, Cao H. STAREG: Statistical replicability analysis of high throughput experiments with applications to spatial transcriptomic studies. PLoS Genet 2024; 20:e1011423. [PMID: 39361716 PMCID: PMC11478871 DOI: 10.1371/journal.pgen.1011423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 10/15/2024] [Accepted: 09/10/2024] [Indexed: 10/05/2024] Open
Abstract
Replicable signals from different yet conceptually related studies provide stronger scientific evidence and more powerful inference. We introduce STAREG, a statistical method for replicability analysis of high throughput experiments, and apply it to analyze spatial transcriptomic studies. STAREG uses summary statistics from multiple studies of high throughput experiments and models the the joint distribution of p-values accounting for the heterogeneity of different studies. It effectively controls the false discovery rate (FDR) and has higher power by information borrowing. Moreover, it provides different rankings of important genes. With the EM algorithm in combination with pool-adjacent-violator-algorithm (PAVA), STAREG is scalable to datasets with millions of genes without any tuning parameters. Analyzing two pairs of spatially resolved transcriptomic datasets, we are able to make biological discoveries that otherwise cannot be obtained by using existing methods.
Collapse
Affiliation(s)
- Yan Li
- School of Computer Science and Technology, Changchun University of Science and Technology, Changchun, Jilin, China
- School of Mathematics, Jilin University, Changchun, Jilin, China
| | - Xiang Zhou
- Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Rui Chen
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas, United States of America
| | - Xianyang Zhang
- Department of Statistics, Texas A&M University, College Station, Texas, United States of America
| | - Hongyuan Cao
- Department of Statistics, Florida State University, Tallahassee, Florida, United States of America
| |
Collapse
|
37
|
Miyahira AK, Soule HR. The 30th Annual Prostate Cancer Foundation Scientific Retreat Report. Prostate 2024; 84:1271-1289. [PMID: 39021296 DOI: 10.1002/pros.24768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Accepted: 07/02/2024] [Indexed: 07/20/2024]
Abstract
BACKGROUND The 30th Annual Prostate Cancer Foundation (PCF) Scientific Retreat was held at the Omni La Costa Resort in Carlsbad, CA, from October 26 to 28, 2023. A hybrid component was included for virtual attendees. METHODS The Annual PCF Scientific Retreat is a leading international scientific conference focused on pioneering, unpublished, and impactful studies across the spectrum of basic through clinical prostate cancer research, as well as research from related fields with significant potential for improving prostate cancer research and patient outcomes. RESULTS The 2023 PCF Retreat concentrated on key areas of research, including: (i) the biology of cancer stem cells and prostate cancer lineage plasticity; (ii) mechanisms of treatment resistance; (iii) emerging AI applications in diagnostic medicine; (iv) analytical and computational biology approaches in cancer research; (v) the role of nerves in prostate cancer; (vi) the biology of prostate cancer bone metastases; (vii) the contribution of ancestry and genomics to prostate cancer disparities; (viii) prostate cancer 3D genomics; (ix) progress in new targets and treatments for prostate cancer; (x) the biology and translational applications of tumor extracellular vesicles; (xi) updates from PCF TACTICAL Award teams; (xii) novel platforms for small molecule molecular glues and binding inhibitors; and (xiii) diversity, equity and inclusion strategies for advancing cancer care equity. CONCLUSIONS This meeting report summarizes the presentations and discussions from the 2023 PCF Scientific Retreat. We hope that sharing this information will deepen our understanding of current and emerging research and drive future advancements in prostate cancer patient care.
Collapse
Affiliation(s)
- Andrea K Miyahira
- Department of Science, Prostate Cancer Foundation, Santa Monica, California, USA
| | - Howard R Soule
- Department of Science, Prostate Cancer Foundation, Santa Monica, California, USA
| |
Collapse
|
38
|
Calin-Jageman R, Cumming G. From significance testing to estimation and Open Science: How esci can help. INTERNATIONAL JOURNAL OF PSYCHOLOGY 2024; 59:672-689. [PMID: 38679926 DOI: 10.1002/ijop.13132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 04/02/2024] [Indexed: 05/01/2024]
Abstract
We argue that researchers should test less, estimate more, and adopt Open Science practices. We outline some of the flaws of null hypothesis significance testing and take three approaches to demonstrating the unreliability of the p value. We explain some advantages of estimation and meta-analysis ("the new statistics"), especially as contributions to Open Science practices, which aim to increase the openness, integrity, and replicability of research. We then describe esci (estimation statistics with confidence intervals): a set of online simulations and an R package for estimation that integrates into jamovi and JASP. This software provides (a) online activities to sharpen understanding of statistical concepts (e.g., "The Dance of the Means"); (b) effects sizes and confidence intervals for a range of study designs, largely by using techniques recently developed by Bonett; (c) publication-ready visualisations that make uncertainty salient; and (d) the option to conduct strong, fair hypothesis evaluation through specification of an interval null. Although developed specifically to support undergraduate learning through the 2nd edition of our textbook, esci should prove a valuable tool for graduate students and researchers interested in adopting the estimation approach. Further information is at ( https://thenewstatistics.com).
Collapse
Affiliation(s)
| | - Geoff Cumming
- School of Psychology and Public Health, La Trobe University, Melbourne, Australia
| |
Collapse
|
39
|
Lin C, Sniezek CM, McGann CD, Karki R, Giglio RM, Garcia BA, McFaline-Figeroa JL, Schweppe DK. Defining the heterogeneous molecular landscape of lung cancer cell responses to epigenetic inhibition. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.23.592075. [PMID: 38853901 PMCID: PMC11160595 DOI: 10.1101/2024.05.23.592075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2024]
Abstract
Epigenetic inhibitors exhibit powerful antiproliferative and anticancer activities. However, cellular responses to small-molecule epigenetic inhibition are heterogenous and dependent on factors such as the genetic background, metabolic state, and on-/off-target engagement of individual small-molecule compounds. The molecular study of the extent of this heterogeneity often measures changes in a single cell line or using a small number of compounds. To more comprehensively profile the effects of small-molecule perturbations and their influence on these heterogeneous cellular responses, we present a molecular resource based on the quantification of chromatin, proteome, and transcriptome remodeling due to histone deacetylase inhibitors (HDACi) in non-isogenic cell lines. Through quantitative molecular profiling of 10,621 proteins, these data reveal coordinated molecular remodeling of HDACi treated cancer cells. HDACi-regulated proteins differ greatly across cell lines with consistent (JUN, MAP2K3, CDKN1A) and divergent (CCND3, ASF1B, BRD7) cell-state effectors. Together these data provide valuable insight into cell-type driven and heterogeneous responses that must be taken into consideration when monitoring molecular perturbations in culture models.
Collapse
Affiliation(s)
- Chuwei Lin
- Genome Sciences, University of Washington, Seattle, WA 98105, USA
| | | | | | - Rashmi Karki
- Department of Biochemistry and Molecular Biophysics, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Ross M. Giglio
- Biomedical Engineer, Columbia University, New York, NY 10027, USA
| | - Benjamin A. Garcia
- Department of Biochemistry and Molecular Biophysics, Washington University School of Medicine, St. Louis, MO 63110, USA
| | | | - Devin K. Schweppe
- Genome Sciences, University of Washington, Seattle, WA 98105, USA
- Brotman Baty Institute for Precision Medicine, Seattle, Washington, USA
- Institute of Stem Cell and Regenerative Medicine, University of Washington, Seattle, Washington, USA
| |
Collapse
|
40
|
Mahooti M, Abdolalipour E, Sanami S, Zare D. Inflammatory Modulation Effects of Probiotics: A Safe and Promising Modulator for Cancer Prevention. Curr Microbiol 2024; 81:372. [PMID: 39312034 DOI: 10.1007/s00284-024-03901-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 09/15/2024] [Indexed: 10/22/2024]
Abstract
Chronic inflammation is the gate of many human illnesses and happens when the immune system is unable to suppress external attacks in the correct form. Nonetheless, the gut microbiome plays a pivotal role in keeping homeostasis in the human body and preventing inflammation. Imbalanced microbiota and many diseases can result in inflammation, which when not taken seriously, can be turned into chronic ones and ultimately lead to serious diseases such as cancer. One approach to maintaining hemostasis in the human body is consumption of probiotics as a supplement. Probiotics impact the immune functions of dendritic cells (DCs), T cells, and B cells in the gut-associated lymphoid tissue by inducing the secretion of an array of cytokines. They activate the innate immune response through their microbial-associated molecular pattern, and this activation is followed by multiple cytokine secretion and adaptive elicitation that mitigates pro-inflammatory expression levels and tumor incidence. Thus, according to several studies showing the benefit of probiotics application, alone or in combination with other agents, to induce potent immune responses in individuals against some inflammatory disorders and distinct types of cancers, this review is devoted to surveying the role of probiotics and the modulation of inflammation in some cancer models.
Collapse
Affiliation(s)
- Mehran Mahooti
- Department of Biotechnology, Iranian Research Organization for Science and Technology, P. O. Box 3353-5111, Tehran, Iran
| | - Elahe Abdolalipour
- Department of Virology, Pasteur Institute of Iran, P.O.Box: 1316943551, Tehran, Iran
| | - Samira Sanami
- Ubnormal Uterine Bleeding Research Center, Semnan University of Medical Sciences, Semnan, Iran
| | - Davood Zare
- Department of Biotechnology, Iranian Research Organization for Science and Technology, P. O. Box 3353-5111, Tehran, Iran.
| |
Collapse
|
41
|
Kokudeva M, Vichev M, Naseva E, Miteva DG, Velikova T. Artificial intelligence as a tool in drug discovery and development. World J Exp Med 2024; 14:96042. [PMID: 39312699 PMCID: PMC11372739 DOI: 10.5493/wjem.v14.i3.96042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 08/06/2024] [Accepted: 08/12/2024] [Indexed: 08/29/2024] Open
Abstract
The rapidly advancing field of artificial intelligence (AI) has garnered substantial attention for its potential application in drug discovery and development. This opinion review critically examined the feasibility and prospects of integrating AI as a transformative tool in the pharmaceutical industry. AI, encompassing machine learning algorithms, deep learning, and data analytics, offers unprecedented opportunities to streamline and enhance various stages of drug development. This opinion review delved into the current landscape of AI-driven approaches, discussing their utilization in target identification, lead optimization, and predictive modeling of pharmacokinetics and toxicity. We aimed to scrutinize the integration of large-scale omics data, electronic health records, and chemical informatics, highlighting the power of AI in uncovering novel therapeutic targets and accelerating drug repurposing strategies. Despite the considerable potential of AI, the review also addressed inherent challenges, including data privacy concerns, interpretability of AI models, and the need for robust validation in real-world clinical settings. Additionally, we explored ethical considerations surrounding AI-driven decision-making in drug development. This opinion review provided a nuanced perspective on the transformative role of AI in drug discovery by discussing the existing literature and emerging trends, presenting critical insights and addressing potential hurdles. In conclusion, this study aimed to stimulate discourse within the scientific community and guide future endeavors to harness the full potential of AI in drug development.
Collapse
Affiliation(s)
- Maria Kokudeva
- Department of Pharmacology and Toxicology, Faculty of Pharmacy, Medical University of Sofia, Sofia 1000, Bulgaria
| | | | - Emilia Naseva
- Faculty of Public Health, Medical University of Sofia, Sofia 1431, Bulgaria
| | - Dimitrina Georgieva Miteva
- Department of Genetics, Faculty of Biology, Sofia University St. Kliment Ohridski, Sofia 1164, Bulgaria
- Medical Faculty, Sofia University St. Kliment Ohridski, Sofia 1407, Bulgaria
| | - Tsvetelina Velikova
- Medical Faculty, Sofia University St. Kliment Ohridski, Sofia 1407, Bulgaria
| |
Collapse
|
42
|
Grimes DR. Towards replicability and sustainability in cancer research. BJC REPORTS 2024; 2:65. [PMID: 39516681 PMCID: PMC11524053 DOI: 10.1038/s44276-024-00090-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Revised: 07/23/2024] [Accepted: 08/08/2024] [Indexed: 11/16/2024]
Abstract
High-quality cancer research is crucial to both save lives and improve quality of life. Spurious findings, however, impedes these laudable goals by misleading research efforts and creating research waste that is inherently difficult to counteract. Irreproducible research is intrinsically wasteful, and unsustainable over the long term. In this perspective piece, we elucidate the extent of the current replication crisis and the underlying causes, identifying practices that lend themselves to unsustainable spurious findings, and the factors that underpin these practices. Finally we outline some remedies to the problem of irreproducible research, and how we might move towards more sustainable and trustworthy research in biomedical science.
Collapse
Affiliation(s)
- David Robert Grimes
- TCD Biostatistics Unit, Discipline of Public Health and Primary Care, School of Medicine, Trinity College Dublin, Dublin, Ireland.
- School of Physical Sciences, Dublin City University, Dublin, Ireland.
| |
Collapse
|
43
|
Kahn RA, Virk H, Laflamme C, Houston DW, Polinski NK, Meijers R, Levey AI, Saper CB, Errington TM, Turn RE, Bandrowski A, Trimmer JS, Rego M, Freedman LP, Ferrara F, Bradbury ARM, Cable H, Longworth S. Antibody characterization is critical to enhance reproducibility in biomedical research. eLife 2024; 13:e100211. [PMID: 39140332 PMCID: PMC11324233 DOI: 10.7554/elife.100211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Accepted: 08/06/2024] [Indexed: 08/15/2024] Open
Abstract
Antibodies are used in many areas of biomedical and clinical research, but many of these antibodies have not been adequately characterized, which casts doubt on the results reported in many scientific papers. This problem is compounded by a lack of suitable control experiments in many studies. In this article we review the history of the 'antibody characterization crisis', and we document efforts and initiatives to address the problem, notably for antibodies that target human proteins. We also present recommendations for a range of stakeholders - researchers, universities, journals, antibody vendors and repositories, scientific societies and funders - to increase the reproducibility of studies that rely on antibodies.
Collapse
Affiliation(s)
- Richard A Kahn
- Department of Biochemistry, Emory University School of MedicineAtlantaUnited States
| | - Harvinder Virk
- Department of Respiratory Sciences, University of LeicesterLeicesterUnited Kingdom
| | - Carl Laflamme
- Department of Neurology and Neurosurgery, Structural Genomics Consortium, The Montreal Neurological Institute, McGill UniversityMontrealCanada
| | - Douglas W Houston
- The Development Studies Hybridoma Databank, University of IowaIowa CityUnited States
| | - Nicole K Polinski
- The Michael J Fox Foundation for Parkinson’s ResearchNew YorkUnited States
| | - Rob Meijers
- Institute for Protein InnovationBostonUnited States
| | - Allan I Levey
- Department of Neurology, Emory University School of MedicineAtlantaUnited States
| | - Clifford B Saper
- Department of Neurology and Program in Neuroscience, Harvard Medical School and Beth Israel Deaconess Medical CenterBostonUnited States
| | | | - Rachel E Turn
- Department of Microbiology and Immunology, Stanford University School of MedicineStanfordUnited States
| | - Anita Bandrowski
- Department of Neuroscience, University of California, San DiegoLa JollaUnited States
| | - James S Trimmer
- Department of Physiology and Membrane Biology, University of California, Davis School of MedicineDavisUnited States
| | | | | | | | | | - Hannah Cable
- Department of Research and Development, AbcamCambridgeUnited Kingdom
| | | |
Collapse
|
44
|
Meinhardt MW, Gerlach B, Spanagel R. Good Practice Guideline for Preclinical Alcohol Research: The STRINGENCY Framework. Curr Top Behav Neurosci 2024. [PMID: 39117860 DOI: 10.1007/7854_2024_484] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/10/2024]
Abstract
Research in the field of preclinical alcohol research, but also science in general, has a problem: Many published scientific results cannot be repeated. As a result, findings from preclinical research often do not translate well to humans, causing increasing disappointment and calls for restructuring of preclinical research, that is, better reproducibility of preclinical research. However, the replication crisis is an inherent problem in biomedical research. Replication failures are not only due to small experimental variations but are often the result of poor methodology. In response to the replication crisis, numerous guidelines and recommendations have been proposed to promote transparency, rigor, and reproducibility in scientific research. What is missing today is a framework that integrates all the confusing information that results from all these guidelines and recommendations. Here we present STRINGENCY, an integrative approach to good practice guidelines for preclinical alcohol research, which can also apply to behavioral research in general and which aims to improve preclinical research to better prepare it for translation and minimize the "valley of death" in translational research. STRINGENCY includes systematic review and, when possible, meta-analysis prior to study design, sample size calculation, preregistration, multisite experiments, scientific data management (FAIR), reporting of data using ARRIVE, generalization of research data, and transparent publications that allow reporting of null results. We invite the scientific community to adopt STRINGENCY to improve the reliability and impact of preclinical alcohol research.
Collapse
Affiliation(s)
- Marcus W Meinhardt
- Institute of Psychopharmacology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Heidelberg, Germany.
- Department of Molecular Neuroimaging, Medical Faculty Mannheim, Central Institute of Mental Health, University of Heidelberg, Heidelberg, Germany.
| | - Björn Gerlach
- Institute of Psychopharmacology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Heidelberg, Germany
- Guarantors of EQIPD e.V., Heidelberg, Germany
- PAASP GmbH, Heidelberg, Germany
| | - Rainer Spanagel
- Institute of Psychopharmacology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Heidelberg, Germany.
- German Center for Mental Health (DZPG), Mannheim, Heidelberg, Ulm, Germany.
| |
Collapse
|
45
|
Silverstein P, Pennington CR, Branney P, O'Connor DB, Lawlor E, O'Brien E, Lynott D. A registered report survey of open research practices in psychology departments in the UK and Ireland. Br J Psychol 2024; 115:497-534. [PMID: 38520079 DOI: 10.1111/bjop.12700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2022] [Accepted: 03/05/2024] [Indexed: 03/25/2024]
Abstract
Open research practices seek to enhance the transparency and reproducibility of research. While there is evidence of increased uptake in these practices, such as study preregistration and open data, facilitated by new infrastructure and policies, little research has assessed general uptake of such practices across psychology university researchers. The current study estimates psychologists' level of engagement in open research practices across universities in the United Kingdom and Ireland, while also assessing possible explanatory factors that may impact their engagement. Data were collected from 602 psychology researchers in the United Kingdom and Ireland on the extent to which they have implemented various practices (e.g., use of preprints, preregistration, open data, open materials). Here we present the summarized descriptive results, as well as considering differences between various categories of researcher (e.g., career stage, subdiscipline, methodology), and examining the relationship between researcher's practices and their self-reported capability, opportunity, and motivation (COM-B) to engage in open research practices. Results show that while there is considerable variability in engagement of open research practices, differences across career stage and subdiscipline of psychology are small by comparison. We observed consistent differences according to respondent's research methodology and based on the presence of institutional support for open research. COM-B dimensions were collectively significant predictors of engagement in open research, with automatic motivation emerging as a consistently strong predictor. We discuss these findings, outline some of the challenges experienced in this study, and offer suggestions and recommendations for future research. Estimating the prevalence of responsible research practices is important to assess sustained behaviour change in research reform, tailor educational training initiatives, and to understand potential factors that might impact engagement.
Collapse
Affiliation(s)
- Priya Silverstein
- Psychology Department, Ashland University, Ashland, OR, USA
- Institute for Globally Distributed Open Research and Education, Gothenburg, Sweden
| | | | - Peter Branney
- School of Social Sciences, University of Bradford, Bradford, UK
| | | | - Emma Lawlor
- Department of Psychology, Maynooth University, Maynooth, Ireland
| | - Emer O'Brien
- Department of Psychology, Maynooth University, Maynooth, Ireland
| | - Dermot Lynott
- Department of Psychology, Maynooth University, Maynooth, Ireland
| |
Collapse
|
46
|
Buffenstein R, Amoroso VG. The Untapped Potential of Comparative Biology in Aging Research: Insights From the Extraordinary-Long-Lived Naked Mole-Rat. J Gerontol A Biol Sci Med Sci 2024; 79:glae110. [PMID: 38721823 DOI: 10.1093/gerona/glae110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Indexed: 06/27/2024] Open
Abstract
The search for solutions to the vagaries of aging has, historically, been akin to searching at night in the bright light under street lamps by utilizing the few preexisting and well-established animal model systems. Throughout my career as a comparative biologist, I have ventured into the darkness across 4 continents and studied over 150 different animal species, many of which have evolved remarkable adaptations to survive on the harsh and rugged fitness landscape that exists outside of the laboratory setting. In this Fellows Forum, I will discuss the main focus of my research for the last 25 years and dig deeply into the biology of the preternaturally long-lived naked mole-rat that makes it an ideal model system for the characterization of successful strategies to combat aging.
Collapse
Affiliation(s)
- Rochelle Buffenstein
- Department of Biological Sciences, University of Illinois, Chicago, Illinois, USA
| | - Vince G Amoroso
- Department of Biological Sciences, University of Illinois, Chicago, Illinois, USA
| |
Collapse
|
47
|
Bała MM, Poklepović Peričić T, Žuljević MF, Bralić N, Zając J, Motaze NV, Rohwer A, Gajdzica M, Young T. Adherence to the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) of studies on evidence-based healthcare e-learning: a cross-sectional study. BMJ Evid Based Med 2024; 29:229-238. [PMID: 38862202 DOI: 10.1136/bmjebm-2023-112647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/28/2024] [Indexed: 06/13/2024]
Abstract
OBJECTIVES The objectives of this study are to assess reporting of evidence-based healthcare (EBHC) e-learning interventions using the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) checklist and explore factors associated with compliant reporting. DESIGN Methodological cross-sectional study. METHODS Based on the criteria used in an earlier systematic review, we included studies comparing EBHC e-learning and any other form of EBHC training or no EBHC training. We searched Medline, Embase, ERIC, CINAHL, CENTRAL, SCOPUS, Web of Knowledge, PsycInfo, ProQuest and Best Evidence Medical Education up to 4 January 2023. Screening of titles, abstracts, full-text articles and data extraction was done independently by two authors. For each study, we assessed adherence to each of the 17 GREET items and extracted information on possible predictors. Adequacy of reporting for each item of the GREET checklist was judged with yes (provided complete information), no (provided no information), unclear (when insufficient information was provided), or not applicable, when the item was clearly of no relevance to the intervention described (such as for item 8-details about the instructors-in the studies which used electronic, self-paced intervention, without any tutoring). Studies' adherence to the GREET checklist was presented as percentages and absolute numbers. We performed univariate analysis to assess the association of potential adherence predictors with the GREET checklist. We summarised results descriptively. RESULTS We included 40 studies, the majority of which assessed e-learning or blended learning and mostly involved medical and other healthcare students. None of the studies fully reported all the GREET items. Overall, the median number of GREET items met (received yes) per study was 8 and third quartile (Q3) of GREET items met per study was 9 (min. 4 max. 14). When we used Q3 of the number of items met as cut-off point, adherence to the GREET reporting checklist was poor with 7 out of 40 studies (17.5%) reporting items of the checklist on acceptable level (adhered to at least 10 items out of 17). None of the studies reported on all 17 GREET items. For 3 items, 80% of included studies well reported information (received yes for these items): item 1 (brief description of intervention), item 4 (evidence-based practice content) and item 6 (educational strategies). Items for which 50% of included studies reported complete information (received yes for these items) included: item 9 (modes of delivery), item 11 (schedule) and 12 (time spent on learning). The items for which 70% or more of included studies did not provide information (received no for these items) included: item 7 (incentives) and item 13 (adaptations; for both items 70% of studies received no for them), item 14 (modifications of educational interventions-95% of studies received no for this item), item 16 (any processes to determine whether the materials and the educational strategies used in the educational intervention were delivered as originally planned-93% of studies received no for this item) and 17 (intervention delivery according to schedule-100% of studies received no for this item). Studies published after September 2016 showed slight improvements in nine reporting items. In the logistic regression models, using the cut-off point of Q3 (10 points or above) the odds of acceptable adherence to GREET guidelines were 7.5 times higher if adherence to other guideline (Consolidated Standards of Reporting Trials, Strengthening the Reporting of Observational Studies in Epidemiology, etc) was reported for a given study type (p=0.039), also higher number of study authors increased the odds of adherence to GREET guidance by 18% (p=0.037). CONCLUSIONS Studies assessing educational interventions on EBHC e-learning still poorly adhere to the GREET checklist. Using other reporting guidelines increased the odds of better GREET reporting. Journals should call for the use of appropriate use of reporting guidelines of future studies on teaching EBHC to increase transparency of reporting, decrease unnecessary research duplication and facilitate uptake of research evidence or result. STUDY REGISTRATION NUMBER The Open Science Framework (https://doi.org/10.17605/OSF.IO/V86FR).
Collapse
Affiliation(s)
- Małgorzata M Bała
- Chair of Epidemiology and Preventive Medicine, Jagiellonian University Medical College, Krakow, Poland
| | - Tina Poklepović Peričić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
| | - Marija Franka Žuljević
- Department of Medical Humanities, University of Split School of Medicine, Split, Croatia
| | - Nensi Bralić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
| | - Joanna Zając
- Chair of Epidemiology and Preventive Medicine, Jagiellonian University Medical College, Krakow, Poland
| | - Nkengafac Villyen Motaze
- Medicine Usage in South Africa, Faculty of Health Sciences, North-West University, Potchefstroom, South Africa
| | - Anke Rohwer
- Centre for Evidence-based Health Care, Division of Epidemiology and Biostatistics, Department of Global Health, Stellenbosch University Faculty of Medicine and Health Sciences, Cape Town, Western Cape, South Africa
| | - Michalina Gajdzica
- Chair of Epidemiology and Preventive Medicine, Jagiellonian University Medical College, Krakow, Poland
| | - Taryn Young
- Centre for Evidence-based Health Care, Division of Epidemiology and Biostatistics, Department of Global Health, Stellenbosch University Faculty of Medicine and Health Sciences, Cape Town, Western Cape, South Africa
| |
Collapse
|
48
|
Iorio EG, Khanteymoori A, Fond KA, Keller AV, Davis LM, Schwab JM, Ferguson AR, Torres-Espin A, Watzlawick R. Effect-Size Discrepancies in Literature Versus Raw Datasets from Experimental Spinal Cord Injury Studies: A CLIMBER Meta-Analysis. Neurotrauma Rep 2024; 5:686-698. [PMID: 39071986 PMCID: PMC11271150 DOI: 10.1089/neur.2024.0038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/30/2024] Open
Abstract
Translation of spinal cord injury (SCI) therapeutics from pre-clinical animal studies into human studies is challenged by effect size variability, irreproducibility, and misalignment of evidence used by pre-clinical versus clinical literature. Clinical literature values reproducibility, with the highest grade evidence (class 1) consisting of meta-analysis demonstrating large therapeutic efficacy replicating across multiple studies. Conversely, pre-clinical literature values novelty over replication and lacks rigorous meta-analyses to assess reproducibility of effect sizes across multiple articles. Here, we applied modified clinical meta-analysis methods to pre-clinical studies, comparing effect sizes extracted from published literature to raw data on individual animals from these same studies. Literature-extracted data (LED) from numerical and graphical outcomes reported in publications were compared with individual animal data (IAD) deposited in a federally supported repository of SCI data. The animal groups from the IAD were matched with the same cohorts in the LED for a direct comparison. We applied random-effects meta-analysis to evaluate predictors of neuroconversion in LED versus IAD. We included publications with common injury models (contusive injuries) and standardized end-points (open field assessments). The extraction of data from 25 published articles yielded n = 1841 subjects, whereas IAD from these same articles included n = 2441 subjects. We observed differences in the number of experimental groups and animals per group, insufficient reporting of dropout animals, and missing information on experimental details. Meta-analysis revealed differences in effect sizes across LED versus IAD stratifications, for instance, severe injuries had the largest effect size in LED (standardized mean difference [SMD = 4.92]), but mild injuries had the largest effect size in IAD (SMD = 6.06). Publications with smaller sample sizes yielded larger effect sizes, while studies with larger sample sizes had smaller effects. The results demonstrate the feasibility of combining IAD analysis with traditional LED meta-analysis to assess effect size reproducibility in SCI.
Collapse
Affiliation(s)
- Emma G. Iorio
- Department of Neurological Surgery, University of California, San Francisco, California, USA
| | - Alireza Khanteymoori
- Department of Neurosurgery, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Kenneth A. Fond
- Department of Neurological Surgery, University of California, San Francisco, California, USA
| | - Anastasia V. Keller
- Department of Neurological Surgery, University of California, San Francisco, California, USA
| | - Lex Maliga Davis
- Department of Neurological Surgery, University of California, San Francisco, California, USA
| | - Jan M. Schwab
- Departments of Neurology and Neurosciences, The Ohio State University, Columbus, Ohio, USA
- Belford Center for Spinal Cord Injury, The Ohio State University, Columbus, Ohio, USA
| | - Adam R. Ferguson
- Department of Neurological Surgery, University of California, San Francisco, California, USA
- San Francisco Veterans Affairs Healthcare System, San Francisco, California, USA
| | - Abel Torres-Espin
- Department of Neurological Surgery, University of California, San Francisco, California, USA
- Department of Physical Therapy, University of Alberta, Edmonton, Canada
- School of Public Health Sciences, University of Waterloo, Waterloo, Canada
| | - Ralf Watzlawick
- Department of Neurosurgery, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| |
Collapse
|
49
|
Whelan BM, Brock KK, Li Z. Software from publicly funded research should be free and open source for research. Med Phys 2024; 51:4550-4553. [PMID: 38703398 DOI: 10.1002/mp.17107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 02/23/2024] [Accepted: 03/08/2024] [Indexed: 05/06/2024] Open
Affiliation(s)
- Brendan M Whelan
- University of Sydney, Image X Institute, Sydney, New South Wales, Australia
| | - Kristy K Brock
- Imaging Physics, UF MD Anderson Cancer Center, Houston, Texas, USA
| | - Zuofeng Li
- Radiation Oncology Department, Guangzhou Concord Cancer Center, Sino-Singapore Knowledge City, Guangzhou, Guangdong, China
| |
Collapse
|
50
|
Boxer E. Being positive about negatives: why publishing negative results is good for veterinary science. Vet Rec 2024; 194:434-435. [PMID: 38819920 DOI: 10.1002/vetr.4362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/01/2024]
Affiliation(s)
- Emma Boxer
- Research editor, BVA Journals, London, UK
| |
Collapse
|