1
|
Rogalla P, Fratesi J, Kandel S, Patsios D, Khalvati F, Carey S. Development and Evaluation of an Automated Protocol Recommendation System for Chest CT Using Natural Language Processing With CLEVER Terminology Word Replacement. Can Assoc Radiol J 2025; 76:257-264. [PMID: 39315514 DOI: 10.1177/08465371241280219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/25/2024] Open
Abstract
Purpose: To evaluate the clinical performance of a Protocol Recommendation System (PRS) automatic protocolling of chest CT imaging requests. Materials and Methods: 322 387 consecutive historical imaging requests for chest CT between 2017 and 2022 were extracted from a radiology information system (RIS) database containing 16 associated patient information values. Records with missing fields and protocols with <100 occurrences were removed, leaving 18 protocols for training. After freetext pre-processing and applying CLEVER terminology word replacements, the features of a bag-of-words model were used to train a multinomial logistic regression classifier. Four readers protocolled 300 clinically executed protocols (CEP) based on all clinically available information. After their selection was made, the PRS and CEP were unblinded, and the readers were asked to score their agreement (1 = severe error, 2 = moderate error, 3 = disagreement but acceptable, 4 = agreement). The ground truth was established by the readers' majority selection, a judge helped break ties. For the PRS and CEP, the accuracy and clinical acceptability (scores 3 and 4) were calculated. The readers' protocolling reliability was measured using Fleiss' Kappa. Results: Four readers agreed on 203/300 protocols, 3 on 82/300 cases, and in 15 cases, a judge was needed. PRS errors were found by the 4 readers in 1%, 2.7%, 1%, and 0.7% of the cases, respectively. The accuracy/clinical acceptability of the PRS and CEP were 84.3%/98.6% and 83.0%/99.3%, respectively. The Fleiss' Kappa for all readers and all protocols was 0.805. Conclusion: The PRS achieved similar accuracy to human performance and may help radiologists master the ever-increasing workload.
Collapse
Affiliation(s)
- Patrik Rogalla
- Joint Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| | - Jennifer Fratesi
- Joint Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| | - Sonja Kandel
- Joint Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| | - Demetris Patsios
- Joint Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| | - Farzad Khalvati
- Departments of Medical Imaging and Computer Science, University of Toronto, Toronto, ON, Canada
| | - Sean Carey
- Joint Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
2
|
Harms P, Stukker N, Koole T, Tulleken J. Medical handovers: tacit consensus on interaction. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2025:10.1007/s10459-025-10430-x. [PMID: 40227468 DOI: 10.1007/s10459-025-10430-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/07/2024] [Accepted: 03/23/2025] [Indexed: 04/15/2025]
Abstract
Recent studies on handover communication highlight the role of the incoming physician in preventing misunderstandings that contribute to medical errors. However, existing research often only provides abstract recommendations for increasing their participation, without specifying where and how this should occur. This paper applies discourse theory and methods to identify where the incoming physician's active involvement is interactionally appropriate and can be integrated naturally and effectively. Twelve handovers between six pairs of resident physicians were recorded in a simulated ICU setting at a teaching hospital and analyzed using a combination of genre theory and conversation analysis. By first identifying the "moves" that constitute the handover genre, we pinpointed places where active participation by the incoming physician is expected and facilitates effective communication. While the tasks and focus points and the questions and consultation moves clearly invite such participation, the clinical situation move requires more negotiation, as the outgoing physician maintains control over the conversational floor, making it less immediately accessible for the incoming physician to contribute. The four remaining moves exhibit a more monologic pattern, where both participants display interactional behavior signaling that active input from the incoming physician is not anticipated. Our findings suggest that medical professionals share an implicit understanding of when participation is appropriate, shaped by conventions of the handover genre itself. By reconstructing these tacit rules through genre theory and conversation analysis, we provide insights that can inform training methods, ensuring that recommendations for active participation by the incoming physician align with the structured expectations of clinical practice.
Collapse
Affiliation(s)
- Paulien Harms
- Department of Critical Care, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.
- Center for Language and Cognition Groningen (CLCG), University of Groningen, Groningen, The Netherlands.
| | - Ninke Stukker
- Center for Language and Cognition Groningen (CLCG), University of Groningen, Groningen, The Netherlands
| | - Tom Koole
- Department of Critical Care, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
- School of Human and Community Development, University of the Witwatersrand, Johannesburg, South Africa
| | - Jaap Tulleken
- Department of Critical Care, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
- Wenckebach Simulation Center for Training, Education and Research, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
3
|
Ryan JM, McNamara DA. Enhancing the quality of surgical care through improved patient handover processes. Patient Saf Surg 2025; 19:7. [PMID: 40087702 PMCID: PMC11909930 DOI: 10.1186/s13037-025-00428-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2025] [Accepted: 02/25/2025] [Indexed: 03/17/2025] Open
Abstract
Surgical handover remains a high-risk process with no gold standard for practice despite 20 years of available guidance. Variability in practice is common, and poorly performed handover poses significant, yet avoidable, risk to patients. Research in this domain is underfunded with widely heterogenous methodology, meaning that the evidence base for better handover is deficient. In this correspondence, recommendations are made to address these shortcomings, including standardised operating procedures supported by electronic health records to enable staff training and audit. Prioritisation of the sickest patients at the handover outset and two-way, verbal communication, including a "read-back" to confirm that information is both transmitted and received. Rigorous evaluation of handover interventions before use, and discontinuation of practices that add no value. Lastly, a core outcome set for surgical handover is urgently needed to improve the comparability of studies. By clearly defining best practices and demonstrating the impact of interventions on patient outcomes, surgeons will be more inclined to adopt meaningful improvements in handover processes.
Collapse
Affiliation(s)
- Jessica M Ryan
- RCSI StAR PhD Programme, School of Postgraduate Studies, 123 St. Stephen's Green, Co, Dublin, Ireland.
- The Bon Secours Hospital, Glasnevin Hill, Glasnevin, Co Dublin, Ireland.
| | - Deborah A McNamara
- Office of the President, RCSI, 123 St. Stephen's Green, Co Dublin, Ireland
- National Clinical Programme in Surgery, RCSI, 2 Proud's Lane, Co Dublin, Ireland
- Department of Surgery, Beaumont Hospital, Beaumont, Co Dublin, Ireland
| |
Collapse
|
4
|
Freund Y, Philippon AL. Handoffs in the ED: Risk factor or safety net? Acad Emerg Med 2025; 32:369-370. [PMID: 39905598 DOI: 10.1111/acem.15117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2024] [Revised: 12/12/2024] [Accepted: 12/14/2024] [Indexed: 02/06/2025]
Affiliation(s)
- Yonathan Freund
- Sorbonne Université, FHU Improving Emergency Care IMPEC, Paris, France
- Emergency Department, Hôpital Pitié-Salpêtrière, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Anne-Laure Philippon
- Sorbonne Université, FHU Improving Emergency Care IMPEC, Paris, France
- Emergency Department, Hôpital Pitié-Salpêtrière, Assistance Publique Hôpitaux de Paris, Paris, France
| |
Collapse
|
5
|
Kapuria M, Hanna J, Hall MAK, Afriyie S, Wondmeneh S, Obisesan A, Hemrajani R, Miller A. I-PASS-Based Handoff Pilot in a High-Volume Urban Hospital: Benefits and Barriers for Hospitalists. Cureus 2025; 17:e80040. [PMID: 40182339 PMCID: PMC11968091 DOI: 10.7759/cureus.80040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/04/2025] [Indexed: 04/05/2025] Open
Abstract
Background The I-PASS bundle is a standardized care handoff associated with improved outcomes that is widely used in residency training. Sustainable use of I-PASS bundle components among attending hospital medicine providers merits further study. After we implemented a handoffs pilot process including written handoffs and Epic chat message (surrogate for verbal handoff) based on the I-PASS protocol, providers reported high levels of satisfaction. However, the pilot tool was utilized infrequently, and use ceased after the pilot. Methodology We utilized qualitative methods to assess attending physicians' and Advanced Practice Providers' perceptions to understand discrepancies between perceived utility and actual use. From February to March 2022, we interviewed 13 attending hospitalist physicians (n = 11) and Advanced Practice Providers (n = 2) individually or in homogenous focus groups; we transcribed recordings for qualitative coding (interrater agreement was κ = 0.82). We coded and analyzed the textual data via the specific concerns participants shared in the interviews and focus groups. Results Participants felt that while the I-PASS-based tool was suboptimal, the pilot raised overall awareness and use of handoff processes. They recommended that feasible handoff processes provide necessary information quickly for cross-cover providers, but do not require similar details for stable patients. Most participants reported that existing electronic medical record chat functions along with notes were adequate and more efficient. They also recommended standardizing format and processes; obtaining buy-in from all patient care providers; education on efficient use of tools; and formal, explicit expectations that providers complete handoffs. Conclusions Handoffs are an important component of patient safety measures. While they perceived the I-PASS-based tool to be suboptimal in several aspects, participants felt that the handoff quality improvement pilot raised overall awareness and use of handoff processes, which they felt was important for patient safety. Implementation of I-PASS bundle components may require contextual adaptation.
Collapse
Affiliation(s)
- Malavika Kapuria
- Division of Hospital Medicine, Emory University School of Medicine, Atlanta, USA
| | - Jasmah Hanna
- Division of Hospital Medicine, Emory University School of Medicine, Atlanta, USA
| | | | - Simone Afriyie
- Department of Medicine, Emory University School of Medicine, Atlanta, USA
| | - Sarah Wondmeneh
- Department of Medicine, Emory University School of Medicine, Atlanta, USA
| | - Adekunle Obisesan
- Division of Hospital Medicine, Emory University School of Medicine, Atlanta, USA
| | | | - Amy Miller
- Hospital Medicine, Atlanta Veterans Affairs Medical Center, Atlanta, USA
| |
Collapse
|
6
|
Nuernberger M, Lang S, Maass T, Lehmann T, Brodoehl S, Lewejohann JC. The Effects of an ISOBAR-Structured Patient Handover Conversation Between Rescue Services and Emergency Department Staff: The COPTER Trial. J Am Coll Emerg Physicians Open 2025; 6:100011. [PMID: 40012652 PMCID: PMC11852710 DOI: 10.1016/j.acepjo.2024.100011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Revised: 10/11/2024] [Accepted: 10/29/2024] [Indexed: 02/28/2025] Open
Abstract
Objectives Communication errors are the main cause of adverse events in emergency medicine, underscoring the importance of patient handover conversations. This study aims to assess the impact of implementing the ISOBAR handover protocol for patient transfer between emergency medical services and emergency department (ED) personnel. Methods We conducted a single-center implementation trial to evaluate the ISOBAR handover protocol efficacy in a German university hospital ED. We observed and analyzed 651 handover conversations involving adult patients, comparing those using the ISOBAR protocol to those following standard procedure without the protocol. Direct observation of handover processes was employed during alternating interventional periods across 6 trial phases. Primary outcome measure was the "Key Information Transfer Efficiency" score (KITE), a higher score indicating a more efficient patient handover conversation. Secondary outcome measure was the retention of key information by ED personnel, indicating successfully conveyed information. Results The KITE score was significantly higher in the ISOBAR group (difference 0.12, 95% CI 0.02-0.22), showing a notable increase from baseline without ISOBAR to the final trial phase using ISOBAR (difference 0.16, 95% CI 0.02-0.34). Key information retention increased significantly: +18% for physicians (95% CI 9-28) and +19% (95% CI 10-28) for nurses. The number of questions asked after handover decreased by 29% (95% CI 5.81-41.46). The adherence to ISOBAR had no notable effect on outcome measures. Conclusion The implementation of ISOBAR can enhance information transfer during handover. However, adherence to ISOBAR was not crucial, highlighting the importance of focusing on quality of communication during patient handover.
Collapse
Affiliation(s)
- Matthias Nuernberger
- Department of Emergency Medicine, Jena University Hospital, Friedrich Schiller University, Jena, Germany
| | - Sebastian Lang
- Department for Anesthesiology and Intensive Care Medicine, Jena University Hospital, Friedrich Schiller University, Jena, Germany
| | - Tabea Maass
- Department of Emergency Medicine, Jena University Hospital, Friedrich Schiller University, Jena, Germany
| | - Thomas Lehmann
- Centre for Clinical Studies (ZKS), Jena University Hospital, Friedrich Schiller University, Jena, Germany
| | - Stefan Brodoehl
- Department of Neurology, Jena University Hospital, Friedrich Schiller University, Jena, Germany
| | - Jan-Christoph Lewejohann
- Department of Emergency Medicine, Jena University Hospital, Friedrich Schiller University, Jena, Germany
| |
Collapse
|
7
|
Simiceva A, Ryan JM, Eppich W, Kavanagh DO, McNamara DA, Morris M. Developing an educational blueprint for surgical handover curricula: a critical review of the evidence. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2025:10.1007/s10459-025-10410-1. [PMID: 39891886 DOI: 10.1007/s10459-025-10410-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Accepted: 01/19/2025] [Indexed: 02/03/2025]
Abstract
Background Currently no guidelines exist for the development of surgical handover educational curricula. This critical review synthesises the relevant literature to identify best approaches to handover education and develop an evidence-based framework for teaching and assessing surgical handover skills. Methods The following resources were critically reviewed by two independent researchers to identify key educational components; (1) all published studies primarily utilising an educational intervention to improve surgical handover up to May 2023, (2) key international guidelines and (3) reviews of all handover interventions published within the last 10 years. Results A total of eight comparative studies, two systematic reviews, and four handover guidelines were included. Findings were reported across eight domains; including educational setting, approach, format, content, resources used, assessment, student feedback, and follow-up training. A framework for developing surgical handover curricula was also reported. Conclusion The reported educational framework or 'blueprint' aims to assist educators across multiple settings to develop evidence-based surgical handover curricula for undergraduate and postgraduate learners. Future studies need to achieve higher Kirkpatrick levels to demonstrate both effectiveness and sustainability of educational interventions, ensuring safer patient care.
Collapse
Affiliation(s)
- Anastasija Simiceva
- Department of Surgical Affairs, RCSI, 121 St. Stephen's Green, Dublin, Ireland
| | - Jessica M Ryan
- Department of Surgical Affairs, RCSI, 121 St. Stephen's Green, Dublin, Ireland.
- RCSI StAR PhD Programme, St. Stephen's Green, Dublin, Ireland.
- The Bon Secours Hospital, Glasnevin, Dublin, Ireland.
| | - Walter Eppich
- Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, Australia
| | - Dara O Kavanagh
- Department of Surgical Affairs, RCSI, 121 St. Stephen's Green, Dublin, Ireland
- Department of Surgery, Tallaght University Hospital, Dublin, Ireland
| | - Deborah A McNamara
- Office of the President, RCSI, 123 St. Stephen's Green, Dublin, Ireland
- National Clinical Programme in Surgery, RCSI, Dublin, Ireland
- Department of Surgery, Beaumont Hospital, Dublin, Ireland
| | - Marie Morris
- Department of Surgical Affairs, RCSI, 121 St. Stephen's Green, Dublin, Ireland
| |
Collapse
|
8
|
Amano M, Harada Y, Shimizu T. Impact of disclosing a working diagnosis during simulated patient handoff presentation in the emergency department: correctness matters. Diagnosis (Berl) 2025; 12:61-67. [PMID: 39404256 DOI: 10.1515/dx-2024-0121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Accepted: 09/15/2024] [Indexed: 02/21/2025]
Abstract
OBJECTIVES Diagnostic errors in emergency departments (ED) are a significant concern and exacerbated by cognitive biases during patient handoffs. The timing and accuracy of disclosing working diagnoses during these handoffs potentially influence diagnostic decisions, yet empirical evidence remains limited. MATERIALS AND METHODS This parallel, quasi-experimental study involved 40 interns from Japanese teaching hospitals, randomly assigned to control or intervention groups. Each group reviewed eight audio-recorded patient handoff scenarios where working diagnoses were disclosed at the start (control) or end (intervention). Four cases presented correct diagnoses, while four featured incorrect ones. The main measure was diagnostic error rate, calculated as the proportion of incorrect post-handoff responses to total questions asked. RESULTS No significant difference in diagnostic error rates emerged between the control (39.4 %, 63/160) and intervention (38.8 %, 62/160) groups (point estimate -0.6 %; 95 % CI: -11.3-10.1 %, p=0.91). However, a substantial difference was evident between diagnostic errors after correct (20.6 %, 33/160) and incorrect (57.5 %, 92/160) working diagnoses presented (point estimate: 36.9 %; 95 % CI: 27.0-46.8 %, p<0.001). Diagnostic momentum accounted for 52 % (48/92) of errors under incorrect diagnoses. CONCLUSIONS While the timing of working diagnosis disclosure did not significantly alter diagnostic accuracy during ED handoffs, exposure to incorrect diagnoses markedly increased error rates. These findings underscore the imperative to refine diagnostic skills and reconsider ED handoff protocols to mitigate cognitive biases and optimize patient care outcomes.
Collapse
Affiliation(s)
- Masayuki Amano
- Department of Generalist Medicine, Minaminara General Medical Center, Oyodo, Nara, Japan
- Department of Diagnostic and Generalist Medicine, 365086 Dokkyo Medical University Hospital , Mibu, Tochigi, Japan
| | - Yukinori Harada
- Department of Diagnostic and Generalist Medicine, 365086 Dokkyo Medical University Hospital , Mibu, Tochigi, Japan
| | - Taro Shimizu
- Department of Diagnostic and Generalist Medicine, 365086 Dokkyo Medical University Hospital , Mibu, Tochigi, Japan
| |
Collapse
|
9
|
Howard-Williams E, Knight R, Ossman P, Younce D, Donohoe A, Marucci L, Mock C. A fiscally sound, evidenced-based solution to conquering the complexity of physician billing guidelines: A physician-centric note template. HEALTH INF MANAG J 2025:18333583241309990. [PMID: 39882972 DOI: 10.1177/18333583241309990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2025]
Abstract
Background: Effective documentation and coding in health care are crucial for patient care, safety, workflow improvement and accurate billing. Objectives: This quality improvement study aimed to enhance History and Physical (H&P) note documentation and charge capture processes to integrate coding and billing aspects, capture authentic work, preserve the H&P's integrity and align H&P-related revenue with actual performance. Method: A multidisciplinary team, including divisional leadership and specialists in documentation improvement, electronic health records, lean/six sigma methodology, a nocturnist and a senior-level physician coding auditor, initiated a quality improvement project. Educational efforts targeted approximately 50 hospitalists at a Departmental meeting in January 2023 (Department of Medicine, University of North Carolina School of Medicine), followed by the development and iterative testing of a standardised H&P note template in March 2023, officially disseminated to the entire Department in June 2023. Results: Despite limited impact from education alone, the implementation of an updated H&P template in May 2023 and department-wide distribution in June led to an immediate increase in average work relative value units (wRVU) per encounter, driven by enhanced capture of prolonged time codes and key medical decision-making phrases. The sustained correlation between template usage and increased wRVUs demonstrated a consistent, elevated plateau compared to the education phase. Conclusion: Collaboratively designed and user-informed note templates, balancing usability, efficiency and revenue-generating elements, proved more effective than education alone in integrating complex changes into clinical practice and enhancing coding and billing accuracy. Implications: Results of this study underscore the benefits of standardised documentation tools in enhancing both clinical and financial outcomes, suggesting that healthcare institutions could improve revenue capture, and documentation accuracy by adopting similar approaches.
Collapse
Affiliation(s)
| | | | - Paul Ossman
- University of North Carolina School of Medicine, USA
| | | | | | | | - Clare Mock
- University of North Carolina School of Medicine, USA
| |
Collapse
|
10
|
Dimmer A, Altit G, Beauseigle S, Guadagno E, Koclas L, Paquette K, Sant'Anna A, Shapiro A, Poenaru D, Puligandla P. Clinical Care Trajectory Assessment of Children With Congenital Diaphragmatic Hernia and Neurodevelopmental Impairment. J Pediatr Surg 2025; 60:161906. [PMID: 39368855 DOI: 10.1016/j.jpedsurg.2024.161906] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/28/2024] [Accepted: 09/03/2024] [Indexed: 10/07/2024]
Abstract
BACKGROUND Interdisciplinary long-term health surveillance identifies opportunities to mitigate CDH-related multisystem morbidity, particularly in patients with neurodevelopmental impairment (NDI). However, no studies to date have assessed the impact of these morbidities on the patient/family. Our aim was to describe the clinical trajectory of patients with CDH and NDI (CDH-NDI), and to explore the lived experience and satisfaction of families with existing support resources. METHODS A multi-phase explanatory study (REB 2023-8964) was conducted. Phase 1: Review of clinical data for CDH-NDI patients attending a longitudinal follow-up clinic; Phase 2: Satisfaction assessment of CDH-NDI families with existing hospital resources. Standard statistical analyses were performed for Phases 1 and 2, respectively. RESULTS Of 91 patients included, 27 had NDI, stratified into mild (n = 2), moderate (n = 7), and severe (n = 18) cohorts. Ventilation (16 vs. 8; p < 0.001), ICU (34 vs. 18; p < 0.001) and hospital (41 vs. 22; p < 0.001) days were significantly longer in the severe cohort. The severe cohort required significantly more unscheduled visits, particularly in the first four years of life (p < 0.05). Despite high family satisfaction with existing resources, team communication during ICU-ward transfers could be improved. Parents also desired to share experiences with other CDH families. CONCLUSION CDH children with NDI require increased support, particularly in the first four years of life. While clinic satisfaction is high, improvement of team communication and access to support resources remain high priorities for parents. LEVEL OF EVIDENCE Level II (prospectively collected data, retrospective analysis).
Collapse
Affiliation(s)
- Alexandra Dimmer
- Harvey E. Beardmore Division of Pediatric Surgery, Department of Pediatric Surgery, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
| | - Gabriel Altit
- Division of Neonatology, Department of Pediatrics, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal Quebec, Canada
| | - Sabrina Beauseigle
- Harvey E. Beardmore Division of Pediatric Surgery, Department of Pediatric Surgery, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
| | - Elena Guadagno
- Harvey E. Beardmore Division of Pediatric Surgery, Department of Pediatric Surgery, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
| | - Louise Koclas
- Division of Neonatology, Department of Pediatrics, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal Quebec, Canada
| | - Katryn Paquette
- Division of Neonatology, Department of Pediatrics, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal Quebec, Canada
| | - Ana Sant'Anna
- Division of Neonatology, Department of Pediatrics, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal Quebec, Canada
| | - Adam Shapiro
- Division of Respiratory Medicine, Department of Pediatrics, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
| | - Dan Poenaru
- Harvey E. Beardmore Division of Pediatric Surgery, Department of Pediatric Surgery, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
| | - Pramod Puligandla
- Harvey E. Beardmore Division of Pediatric Surgery, Department of Pediatric Surgery, Montreal Children's Hospital, McGill University Health Centre, McGill University, Montreal, Quebec, Canada.
| |
Collapse
|
11
|
Ha EL, Glaeser AM, Wilhalme H, Braddock C. Assessing readiness: the impact of an experiential learning entrustable professional activity-based residency preparatory course. MEDICAL EDUCATION ONLINE 2024; 29:2352217. [PMID: 38758979 PMCID: PMC11104695 DOI: 10.1080/10872981.2024.2352217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Accepted: 05/02/2024] [Indexed: 05/19/2024]
Abstract
As medical schools move to integrate the Core Entrustable Professional Activities for Entering Residency (EPAs) into curricula and address the transition from student to resident, residency preparatory courses have become more prevalent. The authors developed an experiential learning EPA-based capstone course for assessment to determine impact on learner self-assessed ratings of readiness for residency and acquisition of medical knowledge. All fourth-year students from the classes of 2018-2020 completed a required course in the spring for assessment of multiple EPAs, including managing core complaints, performing basic procedures, obtaining informed consent, and providing patient handoffs. Learners selected between three specialty-based parallel tracks - adult medicine, surgery, or pediatrics. Students completed a retrospective pre-post questionnaire to provide self-assessed ratings of residency preparedness and comfort in performing EPAs. Finally, the authors studied the impact of the course on knowledge acquisition by comparing student performance in the adult medicine track on multiple choice pre- and post-tests. Four hundred and eighty-one students were eligible for the study and 452 (94%) completed the questionnaire. For all three tracks, there was a statistically significant change in learner self-assessed ratings of preparedness for residency from pre- to post-course (moderately or very prepared: adult medicine 61.4% to 88.6% [p-value < 0.001]; surgery 56.8% to 81.1% [p-value < 0.001]; pediatrics 32.6% to 83.7% [p-value 0.02]). A similar change was noted in all tracks in learner self-assessed ratings of comfort from pre- to post-course for all studied EPAs. Of the 203 students who participated in the adult medicine track from 2019-2020, 200 (99%) completed both the pre- and post-test knowledge assessments. The mean performance improved from 65.0% to 77.5% (p-value < 0.001). An experiential capstone course for the assessment of EPAs can be effective to improve learner self-assessed ratings of readiness for residency training and acquisition of medical knowledge.
Collapse
Affiliation(s)
- Edward L. Ha
- David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | | | - Holly Wilhalme
- Department of Medicine Statistics Core, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| | - Clarence Braddock
- David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
12
|
Allen-Dicker J, Kerwin M, Wallins JS, Rao N, Mara R, Chilov M, Batra C, Chimonas S, Korenstein D. Physician inpatient handoffs-Patient and physician outcomes: A systematic review. J Hosp Med 2024. [PMID: 39733333 DOI: 10.1002/jhm.13583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/26/2024] [Revised: 11/27/2024] [Accepted: 12/09/2024] [Indexed: 12/31/2024]
Abstract
BACKGROUND Prior reviews have shown that interventions to improve inpatient handoffs are inconsistently associated with improvement in patient outcomes. This systematic review examines the effectiveness of inpatient handoff interventions on outcomes affecting patients and physicians, including objective measures when reported (PROSPERO ID: CRD42022309326). METHODS Pubmed, Embase, and Cochrane Central Register of Controlled Trials were searched on January 13th, 2022. We included experimental or quasi-experimental studies that examined handoff communication between inpatient physicians and reported patient clinical, patient experiential, physician experiential, or cost and utilization outcomes. Studies were excluded if they examined handoffs between facilities or levels of care, or only reported subjective measures of patient safety or physician experience. Risk of bias was assessed using the ROBINS-1 and RoB-2 tools. RESULTS Of the 42 included studies, six were randomized controlled trials. Most studies were conducted at academic centers (67%) and involved only residents (64%). An educational intervention was used in 52% of studies and a structural intervention was used in 43%, with 9% using both. Adverse events were significantly improved in three of 16 studies, medical errors in three of seven studies, and length of stay in three of seven studies. Four studies examined mortality, and none reported a significant improvement. Studies that used both structural and educational components reported significant improvements more frequently. CONCLUSIONS The literature is mixed on the impact of efforts to improve handoffs, though there are few randomized trials. Few studies reported patient experiential or cost/utilization outcomes, or involved hospitalist physicians, which represent potential areas for future research.
Collapse
Affiliation(s)
- Joshua Allen-Dicker
- Department of Quality and Patient Safety, New York-Presbyterian Hospital, New York, New York, USA
- Department of Medicine, Weill Cornell Medical College, New York, New York, USA
| | - Matthew Kerwin
- Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Joseph S Wallins
- Department of Medicine, Weill Cornell Medical College, New York, New York, USA
| | - Nisha Rao
- Capital Health Medical Group, New Jersey, USA
| | - Rezana Mara
- Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Marina Chilov
- Medical Library, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Chanan Batra
- Tulane School of Medicine, New Orleans, Louisiana, USA
| | - Susan Chimonas
- Department of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, New York, USA
| | - Deborah Korenstein
- Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|
13
|
Galvão Diniz C, Regne GRS, Silva DCZ, Corrêa ADR, Mata LRFD, Manzo BF. Elaboration and validity of admission and discharge checklists in Neonatal Intensive Care Units. Rev Gaucha Enferm 2024; 45:e20240132. [PMID: 39699337 DOI: 10.1590/1983-1447.2024.20240132.en] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 09/25/2024] [Indexed: 12/20/2024] Open
Abstract
OBJECTIVE To develop and validate the content of checklists for safe admission and discharge in Neonatal Intensive Care Units. METHODS A methodological study conducted between 2018 and 2020 in four stages: 1) literature review; 2) checklist construction; 3) content validity by 32 neonatal nursing specialists from different Brazilian states, predominantly from the southeastern region; 4) development of the final version of the instruments. Validity was performed using a Likert-type scale. Items with a Content Validity Index of 0.90 or higher were accepted. Descriptive statistics were used for data analysis. RESULTS The contents of two checklists were constructed and validated: one for admission, with 18 items, and another for discharge, with seven items. For the admission checklist, 41.03% of items were validated in the first round, 33.33%, in the second, and 23.08%, in the third. One item was excluded for not achieving the minimum Content Validity Index (>0.90). For the discharge checklist, all items achieved a CVI ≥ 0.90, with 64.7% validated in the first round and 35.3% in the second round. No items were excluded. CONCLUSION The content of patient safety checklists for admission and discharge in Neonatal Intensive Care Units was considered valid.
Collapse
Affiliation(s)
- Catharine Galvão Diniz
- Universidade Federal de Minas Gerais, Escola de Enfermagem, Belo Horizonte, Minas Gerais, Brasil
| | | | - Daniela Cristina Zica Silva
- Universidade Federal de Minas Gerais, Escola de Enfermagem, Belo Horizonte, Minas Gerais, Brasil
- Fundação Hospitalar do Estado de Minas Gerais - Maternidade Odete Valadares, Belo Horizonte, Minas Gerais, Brasil
| | - Allana Dos Reis Corrêa
- Universidade Federal de Minas Gerais, Escola de Enfermagem, Departamento de Enfermagem Básica, Belo Horizonte, Minas Gerais, Brasil
| | - Luciana Regina Ferreira da Mata
- Universidade Federal de Minas Gerais, Escola de Enfermagem, Departamento de Enfermagem Básica, Belo Horizonte, Minas Gerais, Brasil
- Fundação Hospitalar do Estado de Minas Gerais - Maternidade Odete Valadares, Belo Horizonte, Minas Gerais, Brasil
| | - Bruna Figueiredo Manzo
- Universidade Federal de Minas Gerais, Escola de Enfermagem, Departamento de Enfermagem Materno Infantil, Belo Horizonte, Minas Gerais, Brasil
| |
Collapse
|
14
|
Monard C, Carrere J, Abraham P, Cerro V, Polazzi S, Payet C, Rimmelé T, Duclos A. The portfolio effect: an opportunity for improving handoffs quality in ICU. BMC Health Serv Res 2024; 24:1544. [PMID: 39633382 PMCID: PMC11619199 DOI: 10.1186/s12913-024-12007-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2024] [Accepted: 11/26/2024] [Indexed: 12/07/2024] Open
Abstract
BACKGROUND Handoffs are a major determinant of patient's safety but their implementation remains heterogeneous and non-standardized. Organizational factors, including the order in which individual cases are handled within the handoff, may play a role in their quality. We aimed to confirm the existence of the portfolio effect (e.g. a decrease in duration allocated to individual cases as the global handoff progresses) in ICU's morning medical handoffs. METHODS Two research assistants observed the morning handoffs in two ICUs (ICU-1, a 20-bed trauma and surgical ICU and ICU-2 a 10-bed medical and surgical ICU) within a university hospital, over a 6-month period. They were trained to measure the duration of each case (i.e., the handoff of a single patient). Patients' socio-demographic and clinical data were extracted from electronic medical records. The effect of the case position within the global handoff on its duration was determined using a linear regression after log transformation of duration. The case position was categorized as either before or after the median position (first and second halves). Covariates clinically associated with handoff duration were included in the model (age, sex, Charlson comorbidities index, SAPS II score, number of organ supports, center (ICU-1 or ICU-2) and reason for admission). RESULTS 2485 individual cases nested in 169 morning handoffs and related to 494 patients' stays were observed. The mean (± SD) duration of the morning handoff was 60 minutes (± 12.5) in ICU-1 and 35.2 minutes (± 10.6) in ICU-2 with a mean number of cases presented of 18.9 (± 1.3) and 9.3 (± 1.0) respectively. The mean (± SD) duration of a case was 175 seconds (± 108). Trauma stays, patients severity and comorbidities, and the number of organ supports were associated with longer case handoffs. Asjusting for these covariates, cases in the second half were shorter compared to cases in the first half (RR 0.65, 95%CI (0.51 - 0.80)). CONCLUSIONS We confirmed the existence of a portfolio effect within ICU handoffs, emphasizing that interventions targeting handoffs' improvement should focus on the content and the setting. We suggest avoiding the presentation of a same patient systematically at the end of the round.
Collapse
Affiliation(s)
- Céline Monard
- Service d'anesthésie-réanimation, Hôpital Edouard Herriot, Hospices Civils de Lyon, Lyon, France.
- PI3 (Pathophysiology of Injury-Induced Immunosuppression), Université Claude Bernard Lyon 1, Hospices Civils de Lyon, Biomérieux, Lyon, EA, 7426, France.
| | - Josselin Carrere
- Service d'anesthésie-réanimation, Hôpital Edouard Herriot, Hospices Civils de Lyon, Lyon, France
| | - Paul Abraham
- Service d'anesthésie-réanimation, Hôpital Edouard Herriot, Hospices Civils de Lyon, Lyon, France
| | - Valerie Cerro
- Service d'anesthésie-réanimation, Hôpital Edouard Herriot, Hospices Civils de Lyon, Lyon, France
| | - Stephanie Polazzi
- Research on Healthcare Performance RESHAPE, INSERM U1290, Université Claude Bernard Lyon 1, Lyon, France
- Health Data Department, Hospices Civils de Lyon, Lyon, France
| | - Cécile Payet
- Research on Healthcare Performance RESHAPE, INSERM U1290, Université Claude Bernard Lyon 1, Lyon, France
- Health Data Department, Hospices Civils de Lyon, Lyon, France
| | - Thomas Rimmelé
- Service d'anesthésie-réanimation, Hôpital Edouard Herriot, Hospices Civils de Lyon, Lyon, France
- PI3 (Pathophysiology of Injury-Induced Immunosuppression), Université Claude Bernard Lyon 1, Hospices Civils de Lyon, Biomérieux, Lyon, EA, 7426, France
| | - Antoine Duclos
- Research on Healthcare Performance RESHAPE, INSERM U1290, Université Claude Bernard Lyon 1, Lyon, France
- Health Data Department, Hospices Civils de Lyon, Lyon, France
| |
Collapse
|
15
|
Wesevich A, Langan E, Fridman I, Patel-Nguyen S, Peek ME, Parente V. Biased Language in Simulated Handoffs and Clinician Recall and Attitudes. JAMA Netw Open 2024; 7:e2450172. [PMID: 39688867 DOI: 10.1001/jamanetworkopen.2024.50172] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/18/2024] Open
Abstract
Importance Poor-quality handoffs can lead to medical errors when transitioning patient care. Biased language within handoffs may contribute to errors and lead to disparities in health care delivery. Objective To compare clinical information recall accuracy and attitudes toward patients among trainees in paired cases of biased vs neutral language in simulated handoffs. Design, Setting, and Participants Surveys administered from April 29 to June 15 and from July 20 to October 10, 2023, included 3 simulated verbal handoffs, randomized between biased and neutral, and measured clinical information recall, attitudes toward patients, and key takeaways after each handoff. Participants included residents in internal medicine, pediatrics, and internal medicine-pediatrics and senior medical students at 2 academic medical centers in different geographic regions of the US. Data were analyzed from November 2023 to June 2024. Exposures Each participant received 3 handoffs that were based on real handoffs about Black patients at 1 academic center. These handoffs were each randomized to either a biased or neutral version. Biased handoffs had 1 of 3 types of bias: stereotype, blame, or doubt. The order of handoff presentation was also randomized. Internal medicine and pediatrics residents received slightly different surveys, tailored for their specialty. Internal medicine-pediatrics residents received the pediatric survey. Medical students were randomly assigned the survey type. Main Outcomes and Measures Each handoff was followed by a clinical information recall question, an adapted version of the Provider Attitudes Toward Sickle Cell Patients Scale (PASS), and 3 free-response takeaways. Results Of 748 trainees contacted, 169 participants (142 residents and 27 medical students) completed the survey (23% overall response rate), distributed across institutions, residency programs, and years of training (95 female [56%]; mean [SD] age, 28.6 [2.3] years). Participants who received handoffs with blame-based bias had less accurate information recall than those who received neutral handoffs (77% vs 93%; P = .005). Those who reported bias as a key takeaway of the handoff had lower clinical information recall accuracy than those who did not (85% vs 93%; P = .01). Participants had less positive attitudes toward patients per PASS scores after receiving biased compared with neutral handoffs (mean scores, 22.9 [3.3] vs 25.2 [2.7]; P < .001). More positive attitudes toward patients were associated with higher clinical information recall accuracy (odds ratio, 1.12; 95% CI, 1.02-1.22). Conclusions and Relevance In this survey study of residents and medical students, biased handoffs impeded accurate transfer of key clinical information and decreased empathy, potentially endangering patients and worsening health disparities. Handoff standardization is critical to addressing racial bias and improving patient safety.
Collapse
Affiliation(s)
- Austin Wesevich
- Section of Hematology/Oncology, Department of Medicine, The University of Chicago, Chicago, Illinois
| | | | - Ilona Fridman
- Center for Discovery and Innovation, Hackensack Meridian Health, Hackensack, New Jersey
- Lombardi Comprehensive Cancer Center, Georgetown University, Washington, DC
| | - Sonya Patel-Nguyen
- Division of Hospital Medicine, Department of Medicine, Duke University, Durham, North Carolina
- Division of Hospital Medicine, Department of Pediatrics, Duke University, Durham, North Carolina
| | - Monica E Peek
- Section of General Internal Medicine, Department of Medicine, The University of Chicago, Chicago, Illinois
| | - Victoria Parente
- Division of Hospital Medicine, Department of Pediatrics, Duke University, Durham, North Carolina
| |
Collapse
|
16
|
Lou SS, Lew D, Xia L, Baratta L, Eiden E, Kannampallil T. Secure Messaging Use and Wrong-Patient Ordering Errors Among Inpatient Clinicians. JAMA Netw Open 2024; 7:e2447797. [PMID: 39630450 PMCID: PMC11618466 DOI: 10.1001/jamanetworkopen.2024.47797] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 09/28/2024] [Indexed: 12/08/2024] Open
Abstract
Importance Use of secure messaging for clinician-to-clinician communication has increased exponentially over the past decade, but its association with clinician work is poorly understood. Objective To investigate the association between secure messaging use and wrong-patient ordering errors. Design, Setting, and Participants This cohort study included inpatient attending physicians, trainee physicians, and advanced practice practitioners (APPs) from 14 academic and community hospitals. Secure messaging volume was assessed over a 3-month period (February 1 to April 30, 2023). Exposure Secure messaging volume per clinician-day, measured as the count of secure messages sent and received by a clinician on a given clinician-day. Main Outcomes and Measures Retract-and-reorder events were used to identify wrong-patient ordering errors, and the presence of any retract-and-reorder event on a clinician-day was the primary outcome. Multilevel logistic regression was used to examine the association between secure messaging volume and wrong-patient ordering errors after adjusting for clinician age, sex, patient load, order volume, and clinical service. Results A total of 3239 clinicians (median [IQR] age, 37 [32-46] years; 1791 female [55.3%]; 1680 attending physicians [51.2%], 560 trainee physicians [17.3%], and 999 APPs [30.8%]) with 75 546 clinician-days were included. Median secure messaging volume was 16 (IQR, 0-61) messages per day. Retract-and-reorder events were identified on 295 clinician-days (0.4%). Clinicians with secure messaging volume at the 75th percentile had a 10% higher odds of wrong-patient ordering errors compared with those at the 25th percentile (odds ratio [OR], 1.10; 95% CI, 1.01-1.20). After stratifying by clinician role, the association between secure messaging and wrong-patient ordering errors was observed only for attending physicians (OR, 1.20; 95% CI, 1.02-1.42) and APPs (OR, 1.18; 95% CI, 1.00-1.40). Conclusions and Relevance In this cohort study of inpatient clinicians, higher daily secure messaging was associated with increased odds of wrong-patient ordering errors. Although messaging may increase cognitive load and risk for wrong-patient ordering errors, these results do not provide conclusive evidence regarding the direct impact of secure messaging on errors, as increased messaging may also reflect greater care coordination, increased patient complexity, or communication of the presence of a wrong-patient ordering error.
Collapse
Affiliation(s)
- Sunny S. Lou
- Department of Anesthesiology, Washington University School of Medicine in St Louis, St Louis, Missouri
- Institute for Informatics, Data Science and Biostatistics, Washington University School of Medicine in St Louis, St Louis, Missouri
| | - Daphne Lew
- Institute for Informatics, Data Science and Biostatistics, Washington University School of Medicine in St Louis, St Louis, Missouri
| | - Linlin Xia
- Division of Computational and Data Sciences, Washington University in St Louis, St Louis, Missouri
| | - Laura Baratta
- Institute for Informatics, Data Science and Biostatistics, Washington University School of Medicine in St Louis, St Louis, Missouri
- Roy and Diana Vagelos Division of Biology and Biomedical Sciences, Washington University School of Medicine in St Louis, St Louis, Missouri
| | - Elise Eiden
- Department of Anesthesiology, Washington University School of Medicine in St Louis, St Louis, Missouri
| | - Thomas Kannampallil
- Department of Anesthesiology, Washington University School of Medicine in St Louis, St Louis, Missouri
- Institute for Informatics, Data Science and Biostatistics, Washington University School of Medicine in St Louis, St Louis, Missouri
- Department of Computer Science and Engineering, Washington University in St Louis, St Louis, Missouri
| |
Collapse
|
17
|
Hartman V, Zhang X, Poddar R, McCarty M, Fortenko A, Sholle E, Sharma R, Campion T, Steel PAD. Developing and Evaluating Large Language Model-Generated Emergency Medicine Handoff Notes. JAMA Netw Open 2024; 7:e2448723. [PMID: 39625719 PMCID: PMC11615705 DOI: 10.1001/jamanetworkopen.2024.48723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Accepted: 10/07/2024] [Indexed: 12/06/2024] Open
Abstract
Importance An emergency medicine (EM) handoff note generated by a large language model (LLM) has the potential to reduce physician documentation burden without compromising the safety of EM-to-inpatient (IP) handoffs. Objective To develop LLM-generated EM-to-IP handoff notes and evaluate their accuracy and safety compared with physician-written notes. Design, Setting, and Participants This cohort study used EM patient medical records with acute hospital admissions that occurred in 2023 at NewYork-Presbyterian/Weill Cornell Medical Center. A customized clinical LLM pipeline was trained, tested, and evaluated to generate templated EM-to-IP handoff notes. Using both conventional automated methods (ie, recall-oriented understudy for gisting evaluation [ROUGE], bidirectional encoder representations from transformers score [BERTScore], and source chunking approach for large-scale inconsistency evaluation [SCALE]) and a novel patient safety-focused framework, LLM-generated handoff notes vs physician-written notes were compared. Data were analyzed from October 2023 to March 2024. Exposure LLM-generated EM handoff notes. Main Outcomes and Measures LLM-generated handoff notes were evaluated for (1) lexical similarity with respect to physician-written notes using ROUGE and BERTScore; (2) fidelity with respect to source notes using SCALE; and (3) readability, completeness, curation, correctness, usefulness, and implications for patient safety using a novel framework. Results In this study of 1600 EM patient records (832 [52%] female and mean [SD] age of 59.9 [18.9] years), LLM-generated handoff notes, compared with physician-written ones, had higher ROUGE (0.322 vs 0.088), BERTScore (0.859 vs 0.796), and SCALE scores (0.691 vs 0.456), indicating the LLM-generated summaries exhibited greater similarity and more detail. As reviewed by 3 board-certified EM physicians, a subsample of 50 LLM-generated summaries had a mean (SD) usefulness score of 4.04 (0.86) out of 5 (compared with 4.36 [0.71] for physician-written) and mean (SD) patient safety scores of 4.06 (0.86) out of 5 (compared with 4.50 [0.56] for physician-written). None of the LLM-generated summaries were classified as a critical patient safety risk. Conclusions and Relevance In this cohort study of 1600 EM patient medical records, LLM-generated EM-to-IP handoff notes were determined superior compared with physician-written summaries via conventional automated evaluation methods, but marginally inferior in usefulness and safety via a novel evaluation framework. This study suggests the importance of a physician-in-loop implementation design for this model and demonstrates an effective strategy to measure preimplementation patient safety of LLM models.
Collapse
Affiliation(s)
| | | | | | - Matthew McCarty
- Department of Emergency Medicine, NewYork-Presbyterian/Weill Cornell Medicine, New York
| | - Alexander Fortenko
- Department of Emergency Medicine, NewYork-Presbyterian/Weill Cornell Medicine, New York
| | - Evan Sholle
- Department of Population Health, NewYork-Presbyterian/Weill Cornell Medicine, New York
| | - Rahul Sharma
- Department of Emergency Medicine, NewYork-Presbyterian/Weill Cornell Medicine, New York
| | - Thomas Campion
- Department of Population Health, NewYork-Presbyterian/Weill Cornell Medicine, New York
- Clinical and Translational Science Center, Weill Cornell Medicine, New York, New York
| | - Peter A. D. Steel
- Department of Emergency Medicine, NewYork-Presbyterian/Weill Cornell Medicine, New York
| |
Collapse
|
18
|
Patel SM, Fuller S, Michael MM, O'Hagan EC, Lazzara EH, Riesenberg LA. Handoff Mnemonics Used in Perioperative Handoff Intervention Studies: A Systematic Review. Anesth Analg 2024:00000539-990000000-01061. [PMID: 39590557 DOI: 10.1213/ane.0000000000007261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2024]
Abstract
BACKGROUND Perioperative handoffs are known to present unique challenges to safe and effective patient care. Numerous national accrediting bodies have called for standardized, structured handoff processes. Handoff mnemonics provide a memory aid and standardized structure, as well as promote a shared mental model. We set out to identify perioperative handoff intervention studies that included a handoff mnemonic; critically assess process and patient outcome improvements that support specific mnemonics; and propose future recommendations. METHODS We conducted a systematic review of the English language perioperative handoff intervention literature designed to identify handoff mnemonic interventions. A comprehensive protocol was developed and registered (CRD42022363615). Searches were conducted using PubMed, Scopus, ERIC (EBSCO), Education Full Text (EBSCO), EMBASE (Elsevier), and Cochrane (January 1, 2010 to May 31, 2022). Pairs of trained reviewers were involved in all phases of the search and extraction process. RESULTS Thirty-seven articles with 23 unique mnemonics met the inclusion criteria. Most articles were published after 2015 (29/37; 78%). Situation, Background, Assessment, Recommendation (SBAR), and SBAR variants were used in over half of all studies (22/37; 59%), with 45% (10/22) reporting at least 1 statistically significant process improvement. Seventy percent of handoff mnemonics (26/37) were expanded into lists or checklists. Fifty-seven percent of studies (21/37) reported using an interdisciplinary/interprofessional team to develop the intervention. In 49% of all studies (18/37) at least 1 measurement tool was either previously published or the authors conducting some form of measurement tool validation. Forty-one percent of process measurement tools (11/27) had some form of validation. Although most studies used training/education as an implementation strategy (36/37; 97%), descriptions tended to be brief with few details and no study used interprofessional education. Twenty-seven percent of the identified studies (10/37) measured perception alone and 11% (4/37) measured patient outcomes. CONCLUSIONS While the evidence supporting one handoff mnemonic over others is weak, SBAR/SBAR variants have been studied more often in the perioperative environment demonstrating some process improvements. A key finding is that 70% of included studies converted their handoff mnemonic to a list or checklist. Finally, given the essential nature of effective handoffs to perioperative patient safety, it is crucial that handoff interventions are well developed, implemented, and evaluated. We propose 8 recommendations for future perioperative handoff mnemonic clinical interventions and research.
Collapse
Affiliation(s)
- Sabina M Patel
- From the Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, Daytona Beach, Florida
| | - Sarah Fuller
- Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama
| | - Meghan M Michael
- Department of Anesthesiology and Pain Management, University of Texas Southwestern, Dallas, Texas
| | - Emma C O'Hagan
- Lister Hill Library at University Hospital (UAB Libraries), University of Alabama at Birmingham, Birmingham, Alabama
| | - Elizabeth H Lazzara
- From the Human Factors and Behavioral Neurobiology, Embry-Riddle Aeronautical University, Daytona Beach, Florida
| | - Lee Ann Riesenberg
- Department of Anesthesiology and Perioperative Medicine, University of Alabama at Birmingham, Birmingham, Alabama
| |
Collapse
|
19
|
Dagi TF. Commentary: Digital Preoperative Huddle Platform Use Leads to Decreased Surgical Cost. Neurosurgery 2024; 95:e138-e139. [PMID: 38842317 DOI: 10.1227/neu.0000000000003025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2024] [Accepted: 04/19/2024] [Indexed: 06/07/2024] Open
Affiliation(s)
- T Forcht Dagi
- The Mayo Alix College of Medicine and Science, Newton Centre , Massachusetts , USA
| |
Collapse
|
20
|
Banken J, Reifarth E, Braune S. [Handover of intensive care patients]. Dtsch Med Wochenschr 2024; 149:1348-1355. [PMID: 39437827 DOI: 10.1055/a-2136-4088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2024]
Abstract
An effective patient handover is a core element of high-quality patient care. Communication during patient handover in the intensive care unit is particularly challenging due to the clinical complexity and rapid changes in patient trajectories, complex interdisciplinary and interprofessional interfaces, linguistic barriers, situational and structural disruptive factors, personnel stress factors as well as the communication and error culture of the teams. In addition to avoiding disruptive factors and creating optimal communication conditions and human resources, the use of standardized and structured handovers with the help of protocols and checklists, as recommended in the literature, plays a decisive role as part of a bundle of measures for effective and safe patient care.
Collapse
|
21
|
Marquez M, Gonzalez A, Moufarrej Y, Vijayan V. Improving Patient Handoffs and Transitions in Care Among Residents: A Chief Resident-Led Initiative. Cureus 2024; 16:e73282. [PMID: 39655111 PMCID: PMC11625514 DOI: 10.7759/cureus.73282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/07/2024] [Indexed: 12/12/2024] Open
Abstract
INTRODUCTION Effective handoff between pediatric residents is crucial to ensure continuity of care and patient safety. Omissions in information and communication breakdowns can be associated with uncertainty in clinical decision-making and adverse patient events. In our role as chief residents, we were notified of an increase in patient safety alerts due to communication failures and gaps during handoff. We aimed to identify areas for improvement and implement strategies to improve competence in handoff among pediatric residents. We also explored pediatric residents' confidence levels regarding handoff procedures and the effectiveness of our interventions in the transfer of care. METHODS Two chief residents conducted direct handoff observations of residents during the transfer of care of inpatients over six months. Residents were scored using a handoff checklist, and formative feedback was provided to each resident after the observation session. Deficits and barriers to properly executed handoff were noted and used to develop a series of handoff workshops. Pre- and post-workshop confidence in handoff skills was calculated from an average of each five-point Likert scale item (1=not at all confident, 5=very confident). RESULTS Forty pediatric residents were assessed performing inpatient handoff. We observed 38 handoff sessions. All of these involved face-to-face interactions with verbal and written communication in the I-PASS (illness severity, patient summary, action list, situation awareness and contingency planning, and synthesis by the receiver) format, allowing the receiver of the information to clarify issues and ask questions. Protocol failures were identified in 50% of the handoffs observed. This included disruptions during handoff (5%), incorrect relay of patient information (26%), prioritizing sick patients (26%), omission of care tasks (10%), and provision of contingency planning (31%). Forty residents participated in the handoff workshops. Regarding confidence in handoff before and after the workshop, 67% of residents initially reported feeling "very confident" or "fairly confident" in their patient handoff skills. After the completion of the workshops, 98% of residents reported "fairly confident" or "very confident" in their ability to perform handoff. Pre- and post-workshop surveys demonstrated self-perceived increases in confidence (P<0.001). Following the completion of the workshops, we conducted observations and found that residents properly executed handoffs, and we received no further patient safety alerts regarding communication breakdowns. CONCLUSIONS We identified several protocol failures in effective handoff among pediatric residents. Chief resident-led targeted workshops addressed these lapses, improved the effectiveness of patient handoffs, and reduced patient safety events related to breakdowns in communication. Our interventions increased confidence in handoff among pediatric residents, and these effects were sustained over time.
Collapse
Affiliation(s)
| | - Athena Gonzalez
- Medical Education, Valley Children's Healthcare, Madera, USA
| | | | - Vini Vijayan
- Pediatrics, Valley Children's Healthcare, Madera, USA
| |
Collapse
|
22
|
Samost-Williams A, Bernstein SL, Thomas AT, Piersa AP, Hawkins JE, Pian-Smith MCM. A Qualitative Study of the Work Systems and Culture Around End-of-Day Intraoperative Anesthesia Handoffs in a Tertiary Care Center. Anesth Analg 2024; 139:1056-1063. [PMID: 38009849 DOI: 10.1213/ane.0000000000006751] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
BACKGROUND Intraoperative handoffs have been implicated as a contributing factor in many perioperative adverse events. Despite conflicting data around their impact on perioperative outcomes, they remain a vulnerable point in the perioperative system with significant attention focused on improving them. This study aimed to understand the processes in place surrounding the point of information transfer in intraoperative handoffs. METHODS We used semistructured interviews with anesthesia clinicians to understand the processes and systems surrounding intraoperative handoffs. Interview data were coded deductively using the Systems Engineering Initiative for Patient Safety model as a framework, with subthemes developed inductively. RESULTS Clinicians do a significant amount of work before and after the point of information transfer to ensure a smooth handoff and safe patient care. Despite not having standardization of handoffs, most clinicians have a typical handoff organization and largely agree on content that should be included. However, there is variability based on clinician and patient characteristics, including clinician discipline and patient acuity. These handoffs are additionally impacted by the overall culture in the operating room, including the teamwork and hierarchies present among the surgical and anesthesia teams. Finally, the broader operating room logistics, including scheduling practices for surgical cases and anesthesia teams, impact the quality of intraoperative handoffs and the ability of clinicians to prepare for these handoffs. CONCLUSIONS Handoffs involve processes beyond the point of information transfer and are embedded in the systems and culture of the operating rooms. These considerations are important when seeking to improve the quality of intraoperative handoffs.
Collapse
Affiliation(s)
- Aubrey Samost-Williams
- From the Department of Anesthesia, Critical Care, and Pain Medicine,Massachusetts General Hospital
| | - Samantha L Bernstein
- School of Nursing,Massachusetts General Hospital Institute of Health Professions, Boston, Massachusetts
| | - A Taylor Thomas
- From the Department of Anesthesia, Critical Care, and Pain Medicine,Massachusetts General Hospital
| | - Anastasia P Piersa
- From the Department of Anesthesia, Critical Care, and Pain Medicine,Massachusetts General Hospital
| | - Jessica E Hawkins
- From the Department of Anesthesia, Critical Care, and Pain Medicine,Massachusetts General Hospital
| | - May C M Pian-Smith
- From the Department of Anesthesia, Critical Care, and Pain Medicine,Massachusetts General Hospital
| |
Collapse
|
23
|
Gill PJ, Kaiser SV, Ullman AJ, Cathie K, Auger KA, McNab S, McGee R, Pollock L, Roland D, Buchanan F, Mahant S. International Networks for Pediatric Inpatient Research and Excellence (INSPIRE): A global initiative in pediatric hospital medicine. J Hosp Med 2024. [PMID: 39439042 DOI: 10.1002/jhm.13528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Revised: 09/18/2024] [Accepted: 09/23/2024] [Indexed: 10/25/2024]
Affiliation(s)
- Peter J Gill
- Division of Paediatric Medicine, The Hospital for Sick Children, Toronto, Ontario, Canada
- Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada
- Institute of Health Policy, Management and Evaluation, The University of Toronto, Toronto, Ontario, Canada
- Child Health Evaluative Sciences, SickKids Research Institute, Toronto, Ontario, Canada
| | - Sunitha V Kaiser
- Department of Pediatrics, University of California, San Francisco, California, USA
- Philip R. Lee Institute for Health Policy Studies, San Francisco, California, USA
| | - Amanda J Ullman
- Children's Health Queensland Hospital and Health Service, Centre of Children's Health Research, South Brisbane, Australia
- School of Nursing, Midwifery and Social Work, The University of Queensland, St Lucia, Australia
| | - Katrina Cathie
- NIHR Southampton Clinical Research Facility and Biomedical Research Centre, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Katherine A Auger
- Division of Hospital Medicine, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, Ohio, USA
| | - Sarah McNab
- Department of Paediatrics, University of Melbourne, Parkville, Victoria, Australia
- Department of General Medicine, Royal Children's Hospital Melbourne, Parkville, Victoria, Australia
- Murdoch Children's Research Institute, Parkville, Victoria, Australia
| | - Richard McGee
- Central Coast Clinical School, Faculty of Health and Medicine, The University of Newcastle, Callaghan, New South Wales, Australia
| | - Louisa Pollock
- Department of Medical Paediatrics, Royal Hospital for Children, Glasgow, UK
| | - Damian Roland
- SAPPHIRE Group, Population Health Sciences, Leicester University, Leicester, UK
- Children's Emergency Department, Leicester Royal Infirmary, Paediatric Emergency Medicine Leicester Academic (PEMLA) Group, Leicester, UK
| | - Francine Buchanan
- Division of Paediatric Medicine, The Hospital for Sick Children, Toronto, Ontario, Canada
- Institute of Health Policy, Management and Evaluation, The University of Toronto, Toronto, Ontario, Canada
| | - Sanjay Mahant
- Division of Paediatric Medicine, The Hospital for Sick Children, Toronto, Ontario, Canada
- Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada
- Institute of Health Policy, Management and Evaluation, The University of Toronto, Toronto, Ontario, Canada
- Child Health Evaluative Sciences, SickKids Research Institute, Toronto, Ontario, Canada
| |
Collapse
|
24
|
Behling F, Adib SD, Haas P, Becker H, Oberle L, Weinbrenner E, Nasi-Kordhishti I, Roder C, Griewatz J, Tatagiba M. Not taught in medical school but needed for the clinical job - leadership, communication and career management skills for final year medical students. BMC MEDICAL EDUCATION 2024; 24:1126. [PMID: 39390423 PMCID: PMC11468378 DOI: 10.1186/s12909-024-06091-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Accepted: 09/26/2024] [Indexed: 10/12/2024]
Abstract
BACKGROUND Starting the first job as a young physician is a demanding challenge. Certain skills are important to master this transformation that go beyond the theoretical knowledge and practical skills taught in medical school. Competencies such as communication, leadership and career management skills are important to develop as a young physician but are usually not sufficiently taught in medical school in a structured and comprehensive way. METHODS We performed an online survey among final year medical students regarding how they perceive their current competency level in communication, leadership and career management skills. We also assessed how they rate the importance to acquire these competencies and the current emphasis during their medical school education regarding these topics. RESULTS Of 450 final year medical students 80 took part in the voluntary survey and 75 complete datasets were returned (16.7%). The majority of respondents rated different communication skills, leadership skills and career management skills as important or very important for their later clinical work. However, most students felt to be poorly or very poorly prepared by the current medical school curriculum, especially for certain leadership and career management skills. Overall, 90.7% of participants expressed interest in an additional educational course that covers subjects of communication, leadership and career management skills during the later stage of medical school, preferably as a hybrid in-person session that also offers synchronous online participation. CONCLUSIONS The results of the survey express the need to address communication, leadership and career management skills in the medical curriculum to be better prepare students for the demands of residency and their further course as physicians. An educational format during the final year of medical school may be suitable to address mentioned topics in the framework of clinical practical exposure.
Collapse
Affiliation(s)
- Felix Behling
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany.
- Hertie Institute for Clinical Brain Research, Tübingen, Germany.
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany.
| | - Sasan Darius Adib
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
| | - Patrick Haas
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
| | - Hannes Becker
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Tübingen, Germany
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
- Department of Neurology and Interdisciplinary Neuro-Oncology, University Hospital Tübingen, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Linda Oberle
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
| | - Eliane Weinbrenner
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
- Department of Diagnostic and Interventional Neuroradiology, University Hospital Tübingen, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Isabella Nasi-Kordhishti
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
| | - Constantin Roder
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
| | - Jan Griewatz
- Tübingen Institute for Medical Education (TIME), Eberhard Karls University Tübingen, Tübingen, Germany
| | - Marcos Tatagiba
- Department of Neurosurgery and Neurotechnology, University Hospital Tübingen, Eberhard Karls University Tübingen, Hoppe-Seyler Street 3, Tübingen, Germany
- Center for CNS Tumors, Comprehensive Cancer Center Tübingen-Stuttgart, University Hospital Tübingen, Eberhard-Karls University Tübingen, Tübingen, Germany
| |
Collapse
|
25
|
Khan A, Baird J, Mauskar S, Haskell HW, Habibi AN, Ngo T, Aldarondo A, Berry JG, Copp KL, Liu JP, Elder B, Gray KP, Hennessy K, Humphrey KE, Luff D, Mallick N, Matherson S, McGeachey AG, Melvin P, Pinkham AL, Quiñones-Pérez B, Rogers J, Singer SJ, Stoeck PA, Toomey SL, Viswanath K, Wilder JL, Schuster MA, Landrigan CP. A Coproduced Family Reporting Intervention to Improve Safety Surveillance and Reduce Disparities. Pediatrics 2024; 154:e2023065245. [PMID: 39224086 DOI: 10.1542/peds.2023-065245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 04/30/2024] [Accepted: 05/01/2024] [Indexed: 09/04/2024] Open
Abstract
OBJECTIVES Examine family safety-reporting after implementing a parent-nurse-physician-leader coproduced, health literacy-informed, family safety-reporting intervention for hospitalized families of children with medical complexity. METHODS We implemented an English and Spanish mobile family-safety-reporting tool, staff and family education, and process for sharing comments with unit leaders on a dedicated inpatient complex care service at a pediatric hospital. Families shared safety concerns via predischarge surveys (baseline and intervention) and mobile tool (intervention). Three physicians with patient safety expertise classified events. We compared safety-reporting baseline (via survey) versus intervention (via survey and/or mobile tool) with generalized estimating equations and sub-analyzed data by COVID-19-era and educational attainment. We also compared mobile tool-detected event rates with hospital voluntary incident reporting. RESULTS 232 baseline and 208 intervention parents participated (78.2% consented); 29.5% of baseline families versus 38.2% of intervention families reported safety concerns (P = .09). Adjusted odds ratio (95% CI) of families reporting safety concerns intervention versus baseline was 1.6 (1.0-2.6) overall, 2.6 (1.3-5.4) for those with < college education, and 3.1 (1.3-7.3) in the COVID-19-era subgroup. Safety concerns reported via mobile tool (34.6% of enrolled parents) included 42 medical errors, 43 nonsafety-related quality issues, 11 hazards, and 4 other. 15% of mobile tool concerns were also detected with voluntary incident reporting. CONCLUSIONS Family safety-reporting was unchanged overall after implementing a mobile reporting tool, though reporting increased among families with lower educational attainment and during the COVID-19 pandemic. The tool identified many events not otherwise captured by staff-only voluntary incident reporting. Hospitals should proactively engage families in reporting to improve safety, quality, and equity.
Collapse
Affiliation(s)
- Alisa Khan
- Division of General Pediatrics, Departments of Pediatrics and
- Pediatrics
| | - Jennifer Baird
- Institute for Nursing and Interprofessional Research, Children's Hospital Los Angeles, Los Angeles, California
| | - Sangeeta Mauskar
- Division of General Pediatrics, Departments of Pediatrics and
- Pediatrics
| | | | - Alexandra N Habibi
- Division of General Pediatrics, Departments of Pediatrics and
- New York University Grossman School of Medicine, New York, New York
| | - Tiffany Ngo
- Division of General Pediatrics, Departments of Pediatrics and
- George Mason University, Fairfax, Virginia
| | | | - Jay G Berry
- Division of General Pediatrics, Departments of Pediatrics and
- Pediatrics
| | - Katherine L Copp
- Division of General Pediatrics, Departments of Pediatrics and
- University of Minnesota School of Public Health, Minneapolis, Minnesota
| | - Jessica P Liu
- Institutional Centers for Clinical and Translational Research, Biostatistics, and Research Design Center (ICCTR BARD)
| | - Brynn Elder
- Division of General Pediatrics, Departments of Pediatrics and
| | - Kathryn P Gray
- Division of General Pediatrics, Departments of Pediatrics and
- Institutional Centers for Clinical and Translational Research, Biostatistics, and Research Design Center (ICCTR BARD)
- Pediatrics
| | | | - Kate E Humphrey
- Division of General Pediatrics, Departments of Pediatrics and
- Program for Patient Safety
- Pediatrics
| | - Donna Luff
- Anesthesia, Harvard Medical School, Boston, Massachusetts
| | - Nandini Mallick
- Division of General Pediatrics, Departments of Pediatrics and
| | | | - Amanda G McGeachey
- Maine Children's Cancer Program at MaineHealth, the Barbara Bush Children's Hospital, Scarborough, Maine
| | - Patrice Melvin
- Office of Health Equity and Inclusion, Boston Children's Hospital, Boston, Massachusetts
| | | | | | | | - Sara J Singer
- Department of Medicine, Stanford University School of Medicine, Stanford, California
- Organizational Behavior, Stanford Graduate School of Business, Stanford, California
| | - Patricia A Stoeck
- Division of General Pediatrics, Departments of Pediatrics and
- Pediatrics
| | - Sara L Toomey
- Division of General Pediatrics, Departments of Pediatrics and
- Pediatrics
| | - K Viswanath
- Department of Social and Behavioral Sciences, Harvard T. H. Chan School of Public Health, Boston, Massachusetts
- McGraw-Patterson Center for Population Sciences, Dana-Farber Cancer Institute, Boston, Massachusetts
| | - Jayme L Wilder
- Division of General Pediatrics, Departments of Pediatrics and
- Pediatrics
| | - Mark A Schuster
- Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, California
| | - Christopher P Landrigan
- Division of General Pediatrics, Departments of Pediatrics and
- Division of Sleep Medicine, and Departments of Medicine
- Pediatrics
- Division of Sleep and Circadian Disorders, Departments of Medicine and Neurology, Brigham and Women's Hospital, Boston, Massachusetts
| |
Collapse
|
26
|
Creedon JK, Marini M, Erdner K, Trexler M, Gerling M, Porter JJ, Kent C, Capraro A, Volpe D, Shah D, Paydar-Darian N, Perron C, Stack A, Hudgins JD. Improving Timely Administration of Essential Outpatient Medications in a Pediatric ED. Pediatrics 2024; 154:e2023064580. [PMID: 39238471 DOI: 10.1542/peds.2023-064580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 05/22/2024] [Accepted: 06/12/2024] [Indexed: 09/07/2024] Open
Abstract
BACKGROUND AND OBJECTIVES The complexity of pediatric patients' outpatient medication regimens is increasing, and risk for medication errors is compounded in a busy emergency department (ED). As ED length of stay (LOS) increases, timely and accurate administration of essential outpatient medications has become increasingly challenging. Our objective was to increase the frequency of ordering of essential outpatient medications for patients with ED LOS >4 hours from 56% to 80% by June 2023. METHODS We conducted a quality improvement (QI) initiative in a pediatric ED with ∼60 000 annual visits comprising a total of 91 000 annual medication orders. We defined essential outpatient medications as antiepileptic drugs, cardiovascular medications, and immunosuppressants. Our QI interventions included a combination of electronic health record interventions, a triage notification system to identify patients with essential outpatient medications, and widespread educational interventions including trainee orientation and individualized nursing education. The primary outcome measure was percentage of essential outpatient medications ordered among patients with an ED LOS >4 hours, with a secondary measure of outpatient medication safety events. RESULTS Baseline monthly ordering rate of selected medications for patients with an ED LOS >4 hours was 54%, with an increase to 66% over the study period. Refining our population yielded a rate of 81%. Outpatient medication safety events remained unchanged, with an average of 952 ED encounters between events. CONCLUSIONS A multidisciplinary QI initiative led to increased essential outpatient medication ordering for patients in a pediatric ED with no change in safety events.
Collapse
Affiliation(s)
- Jessica K Creedon
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Michelle Marini
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Kim Erdner
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Megan Trexler
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Megan Gerling
- Quality Department of Colorado Department of Public Health, Denver, Colorado
| | - John J Porter
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Caitlin Kent
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Andrew Capraro
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Diana Volpe
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Dhara Shah
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Niloufar Paydar-Darian
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Catherine Perron
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Anne Stack
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| | - Joel D Hudgins
- Division of Emergency Medicine, Boston Children's Hospital and Harvard Medical School, Boston
| |
Collapse
|
27
|
Bartman T, Joe P, Moyer L. Perioperative Quality Improvement in Children's Hospitals Neonatal Consortium NICUs. Neoreviews 2024; 25:e601-e611. [PMID: 39349409 DOI: 10.1542/neo.25-10-e601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 05/14/2024] [Accepted: 05/14/2024] [Indexed: 10/02/2024]
Abstract
Infants admitted to NICUs in children's hospitals represent a different population than those in a traditional birth hospital. The patients in a children's hospital NICU often have the most complex neonatal diagnoses and are cared for by various subspecialists. The Children's Hospitals Neonatal Consortium is a collaborative of more than 40 NICUs that collect data and perform quality improvement (QI) work across the United States and Canada. The collaborative's database provides an opportunity to benchmark clinical outcomes for this specialized population and to support the QI efforts. In this review, we summarize the success of individual collaborative QI projects focused on improving the care of the neonate in the perioperative period related to clinical team handoffs, postoperative hypothermia prevention, and improvement of postoperative pain management. The collaborative's experience can serve as a model for other national collaboratives seeking to support QI efforts.
Collapse
Affiliation(s)
- Thomas Bartman
- Nationwide Children's Hospital and The Ohio State University, Columbus, OH
| | - Priscilla Joe
- University of California San Francisco Benioff Children's Hospital Oakland, Oakland, CA
| | - Laurel Moyer
- Rady Children's Hospital and the University of California San Diego, San Diego, CA
| |
Collapse
|
28
|
Bloomhardt H, Schechter S, Fischer A, Schlosser Metitiri K, McCann T, McCarthy C, Rivera C, Lakhaney D. Communication Strategies for Transferring Medically Complex Children Out of Intensive Care. Clin Pediatr (Phila) 2024; 63:1337-1342. [PMID: 38205734 DOI: 10.1177/00099228231223098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/12/2024]
Affiliation(s)
- Hadley Bloomhardt
- Department of Psychosocial Oncology and Palliative Care, Dana-Farber Cancer Institute, Boston, MA, USA
- Boston Children's Hospital, Boston, MA, USA
| | - Sarah Schechter
- Department of Pediatrics, Vagelos College of Physicians and Surgeons, Columbia University, New York, NY, USA
- Morgan Stanley Children's Hospital, NewYork-Presbyterian, New York, NY, USA
| | - Avital Fischer
- Division of Pediatric Palliative Care, Maine Medical Center, Portland, ME, USA
| | - Katherine Schlosser Metitiri
- Department of Pediatrics, Vagelos College of Physicians and Surgeons, Columbia University, New York, NY, USA
- Morgan Stanley Children's Hospital, NewYork-Presbyterian, New York, NY, USA
| | - Teresa McCann
- Department of Pediatrics, Vagelos College of Physicians and Surgeons, Columbia University, New York, NY, USA
- Morgan Stanley Children's Hospital, NewYork-Presbyterian, New York, NY, USA
| | - Colleen McCarthy
- Morgan Stanley Children's Hospital, NewYork-Presbyterian, New York, NY, USA
| | - Cory Rivera
- Morgan Stanley Children's Hospital, NewYork-Presbyterian, New York, NY, USA
| | - Divya Lakhaney
- Department of Pediatrics, Vagelos College of Physicians and Surgeons, Columbia University, New York, NY, USA
- Morgan Stanley Children's Hospital, NewYork-Presbyterian, New York, NY, USA
| |
Collapse
|
29
|
Hostettler LD, Kline DM, Moore JB, Nightingale CL, Miller PR, Nunn AM, Carmichael SP. Evaluation of a Novel Emergency General Surgery Handover: A Prospective Feasibility Study. J Surg Res 2024; 302:715-723. [PMID: 39214063 PMCID: PMC11490366 DOI: 10.1016/j.jss.2024.07.111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 07/18/2024] [Accepted: 07/27/2024] [Indexed: 09/04/2024]
Abstract
INTRODUCTION High-quality health information handovers are critical to optimal patient care and trainee education. The purposes of this study were to assess the feasibility of implementing an emergency general surgery (EGS) morning handover and to explore its impact upon markers of clinical care. METHODS This prospective feasibility study was conducted at a single academic tertiary-care medical center following implementation of a novel EGS morning handover process. We assessed organizational perspective through a two-part anonymous survey delivered to the EGS service staff (n = 29) and collected feasibility metrics daily at the morning handover meetings. Exploratory clinical metrics of quality improvement were compared between parallel 5-month periods preimplementation and postimplementation of the handover. Data were compared by descriptive statistics. RESULTS One hundred and seventeen patients from March 1, 2022, to July 31, 2022, and 185 patients from March 1, 2023, to July 31, 2023, were identified prehandover and posthandover implementation, respectively, with an increase in time to operating room posting by 49% (95% confidence interval [CI]: 1.03-2.14) and no statistically significant change in length of stay. The average duration of the formalized EGS morning handover was 14 min (95% CI: 12:18-15:42) having an average of 12 questions asked (95% CI: 9.98-14.02) and an average attendance of 70% from essential personnel. Eighty-four percent of postimplementation survey responses indicated positive regard toward the new EGS handover. CONCLUSIONS The implementation of an EGS morning handover is feasible, necessitating further studies to define the impact of the EGS morning handover upon clinical outcomes.
Collapse
Affiliation(s)
| | - David M Kline
- Division of Public Health Sciences, Department of Biostatistics and Data Science, WFUSM, Winston-Salem, North Carolina
| | - Justin B Moore
- Division of Public Health Sciences, Department of Implementation Science, WFUSM, Winston-Salem, North Carolina; Division of Public Health Sciences, Department of Epidemiology & Prevention, WFUSM, Winston-Salem, North Carolina
| | - Chandylen L Nightingale
- Division of Public Health Sciences, Department of Social Sciences and Health Policy, WFUSM, Winston-Salem, North Carolina
| | - Preston R Miller
- Department of Surgery, Wake Forest University School of Medicine (WFUSM), Winston-Salem, North Carolina
| | - Andrew M Nunn
- Department of Surgery, Wake Forest University School of Medicine (WFUSM), Winston-Salem, North Carolina
| | - Samuel P Carmichael
- Department of Surgery, Wake Forest University School of Medicine (WFUSM), Winston-Salem, North Carolina
| |
Collapse
|
30
|
Rovati L, Privitera D, Finch AS, Litell JM, Brogan AM, Tekin A, Castillo Zambrano C, Dong Y, Gajic O, Madsen BE, Truong HH, Nikravangolsefid N, Ozkan MC, Lal A, Kilickaya O, Niven AS, Aaronson E, Abdel-Qader DH, Abraham DE, Aguilera P, Ali S, Bahreini M, Baniya A, Bellolio F, Bergs J, Bjornsson HM, Bonfanti A, Bravo J, Brown CS, Bwambale B, Capsoni N, Casalino E, Chartier LB, David SN, Dawadi S, Di Capua M, Efeoglu M, Eidinejad L, Eis D, Ekelund U, Eken C, Freund Y, Gilbert B, Giustivi D, Grossman S, Hachimi Idrissi S, Hansen K, How CK, Hruska K, Khan AG, Laugesen H, Laugsand LE, Kule L, Huong LTT, Lerga M, Macias Maroto M, Mavrinac N, Menacho Antelo W, Aksu NM, Mileta T, Mirkarimi T, Mkanyu V, Mnape N, Mufarrij A, Elgasim MEM, Adam VN, Hang TNT, Ninh NX, Nouri SZ, Ouchi K, Patibandla S, Ngoc PT, Prkačin I, Redfern E, Rendón Morales AA, Scaglioni R, Scholten L, Scott B, Shahryarpour N, Silanda O, Silva L, Sim TB, Slankamenac K, Sonis J, Sorić M, Sun Y, Tri NT, Quoc TV, Tunceri SK, Turner J, Vrablik MC, Wali M, Yin X, Zafar S, Zakayo AS, Zhou JC, Delalic D, Anchise S, Colombo M, Bettina M, et alRovati L, Privitera D, Finch AS, Litell JM, Brogan AM, Tekin A, Castillo Zambrano C, Dong Y, Gajic O, Madsen BE, Truong HH, Nikravangolsefid N, Ozkan MC, Lal A, Kilickaya O, Niven AS, Aaronson E, Abdel-Qader DH, Abraham DE, Aguilera P, Ali S, Bahreini M, Baniya A, Bellolio F, Bergs J, Bjornsson HM, Bonfanti A, Bravo J, Brown CS, Bwambale B, Capsoni N, Casalino E, Chartier LB, David SN, Dawadi S, Di Capua M, Efeoglu M, Eidinejad L, Eis D, Ekelund U, Eken C, Freund Y, Gilbert B, Giustivi D, Grossman S, Hachimi Idrissi S, Hansen K, How CK, Hruska K, Khan AG, Laugesen H, Laugsand LE, Kule L, Huong LTT, Lerga M, Macias Maroto M, Mavrinac N, Menacho Antelo W, Aksu NM, Mileta T, Mirkarimi T, Mkanyu V, Mnape N, Mufarrij A, Elgasim MEM, Adam VN, Hang TNT, Ninh NX, Nouri SZ, Ouchi K, Patibandla S, Ngoc PT, Prkačin I, Redfern E, Rendón Morales AA, Scaglioni R, Scholten L, Scott B, Shahryarpour N, Silanda O, Silva L, Sim TB, Slankamenac K, Sonis J, Sorić M, Sun Y, Tri NT, Quoc TV, Tunceri SK, Turner J, Vrablik MC, Wali M, Yin X, Zafar S, Zakayo AS, Zhou JC, Delalic D, Anchise S, Colombo M, Bettina M, Ciceri L, Fazzini F, Guerrieri R, Tombini V, Geraneo A, Mazzone A, Alario C, Bologna E, Rocca E, Parravicini G, Li Veli G, Paduanella I, Sanfilippo M, Coppola M, Rossini M, Saronni S. Development of an Emergency Department Safety Checklist through a global consensus process. Intern Emerg Med 2024. [DOI: 10.1007/s11739-024-03760-y] [Show More Authors] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Accepted: 08/27/2024] [Indexed: 01/12/2025]
Abstract
AbstractEmergency departments (EDs) are at high risk for medical errors. Checklist implementation programs have been associated with improved patient outcomes in other high-risk clinical settings and when used to address specific aspects of ED care. The aim of this study was to develop an ED Safety Checklist with broad applicability across different international ED settings. A three-round modified Delphi consensus process was conducted with a multidisciplinary and multinational panel of experts in emergency medicine and patient safety. Initial checklist items were identified through a systematic review of the literature. Each item was evaluated for inclusion in the final checklist during two rounds of web-based surveys and an online consensus meeting. Agreement for inclusion was defined a priori with a threshold of 80% combined agreement. Eighty panel members from 34 countries across all seven world regions participated in the study, with comparable representation from low- and middle-income and high-income countries. The final checklist contains 86 items divided into: (1) a general ED Safety Checklist focused on diagnostic evaluation, patient reassessment, and disposition and (2) five domain-specific ED Safety Checklists focused on handoff, invasive procedures, triage, treatment prescription, and treatment administration. The checklist includes key clinical tasks to prevent medical errors, as well as items to improve communication among ED team members and with patients and their families. This novel ED Safety Checklist defines the essential elements of high-quality ED care and has the potential to ensure their consistent implementation worldwide.
Collapse
|
31
|
Huber A, Moyano B, Blondon K. Secondary analysis of hand-offs in internal medicine using the I-PASS mnemonic. BMC MEDICAL EDUCATION 2024; 24:1046. [PMID: 39334190 PMCID: PMC11430516 DOI: 10.1186/s12909-024-05880-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Accepted: 08/08/2024] [Indexed: 09/30/2024]
Abstract
BACKGROUND Miscommunications account for up to 80% of preventable medical errors. Mnemonics like I-PASS (Illness severity, Patient summary, Actions list, Situation awareness, Synthesis) have demonstrated a positive impact on reducing error rates. Currently, physicians at our hospital do not follow a specific structure during hand-offs. We aimed to compare current hand-offs without prior training to a gold standard and the I-PASS tool in terms of content and sequence. METHODS This study is a secondary analysis of data collected during a simulation study of a Friday evening hand-off to the night resident at University Hospitals of Geneva. Thirty physicians received a hand-off of four patients and managed two other patients through nursing pages at the start of the night shift, generating six sign-outs each, totaling 177 sign-outs. A focus group of three senior doctors defined the gold standard (GS) by consensus on the essential content of each sign-out. The analysis focused on the rates of relevance (ratio of information considered relevant by the GS) and completeness (proportion of transmitted elements out of all expected elements of the GS), and the distribution and sequence of the first four I-PASS categories. RESULTS Relevance and completeness rates were 37.2% ± 0.07 and 51.9% ± 0.1, respectively, with no significant difference between residents and supervisors. There was a positive correlation between total hand-off time and relevance (residents: R2 = 0.62; supervisors: R2 = 0.67) and completeness (residents: R2 = 0.32; supervisors: R2 = 0.56). The distribution of I-PASS categories was highly skewed in both the GS (I = 2%, P = 72%, A = 17%, S = 9%) and participants (I = 6%, P = 73%, A = 14%, S = 7%), with significant differences in categories A (p = 0.046) and I (p ≤ 0.001). Sequences of I-PASS categories generally followed a P-A-S-I pattern. The first S category was frequently absent, and only one participant began by announcing the case severity as suggested by I-PASS. CONCLUSION We identified gaps between current medical sign-outs in our institution's general internal medicine division and the I-PASS structure. We recommend implementing the I-PASS mnemonic, emphasizing the "I" category at the start and the "S" category to anticipate and prevent complications. Future studies should assess the impact of this recommendation, adapt the mnemonic elements to the context, and introduce specific hand-off training for senior medical students.
Collapse
Affiliation(s)
- Aurélie Huber
- Faculty of Medicine, University of Geneva, Geneva, Switzerland.
| | - Belinda Moyano
- Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - Katherine Blondon
- Faculty of Medicine, University of Geneva, Geneva, Switzerland
- University Hospitals of Geneva, Geneva, Switzerland
| |
Collapse
|
32
|
Riesenberg LA, Davis JJ, Kaplan E, Ernstberger GC, O'Hagan EC. Handoff Education Interventions: A Scoping Review Focused on Sustaining Improvements. Am J Med Qual 2024; 39:229-243. [PMID: 39268906 DOI: 10.1097/jmq.0000000000000204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/15/2024]
Abstract
Handoffs involve the transfer of patient information and responsibility for care between health care professionals. The purpose of the current scoping review was (1) to describe handoff studies with education as part of the intervention and (2) to explore the role of handoff educational interventions in sustaining handoff improvements. This scoping review utilized previously published systematic reviews and a structured, systematic search of 5 databases (January 2006-June 2020). Articles were identified, and data were extracted by pairs of trained, independent reviewers. The search identified 74 relevant articles, most published after 2015 (70%) and conducted in the United States (76%). Almost all of the studies (99%) utilized instruction, 66% utilized skills practice, 89% utilized a memory aid, and 43% utilized reinforcement. However, few studies reported using education theory or followed accepted tenets of curriculum development. There has been a substantial increase over time in reporting actual handoff behavior change (17%-68%) and a smaller but important increase in reporting patient outcomes (11%-18%). Thirty-five percent of studies (26/74) had follow-up for 6 months or more. Twelve studies met the criteria for sustained change, which were follow-up for 6 months or more and achieving statistically significant improvements in either handoff skills/processes or patient outcomes at the conclusion of the study. All 12 studies with sustained change used multi-modal educational interventions, and reinforcement was more likely to be used in these studies than all others (75%, 9/12) versus (37%, 23/62), P = 0.015. Future handoff intervention efforts that include education should use education theory to guide development and include needs assessment and goals and measurable objectives. Educational interventions should be multi-modal and include reinforcement. Future research studies should measure actual handoff behavior change (skills/process) and patient outcomes, include follow-up for more than 6 months, and use education reporting guidelines.
Collapse
Affiliation(s)
- Lee Ann Riesenberg
- Anesthesiology and Perioperative Medicine, Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, AL
| | | | - Elle Kaplan
- Department of Anesthesiology, Brown University, Providence, RI
| | | | - Emma C O'Hagan
- Lister Hill Library at University Hospital (UAB Libraries), University of Alabama at Birmingham, Birmingham, AL
| |
Collapse
|
33
|
Studenmund C, Lyndon A, Stotts JR, Peralta-Neel C, Sharma AE, Bardach NS. What do patients and families observe about pediatric safety?: A thematic analysis of real-time narratives. J Hosp Med 2024; 19:765-776. [PMID: 38741257 DOI: 10.1002/jhm.13388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Revised: 03/04/2024] [Accepted: 04/18/2024] [Indexed: 05/16/2024]
Abstract
OBJECTIVES Data on inpatient safety are documented by hospital staff through incident reporting (IR) systems. Safety observations from families or patients are rarely captured. The Family Input for Quality and Safety (FIQS) study created a mobile health tool for pediatric patients and their families to anonymously report safety observations in real time during hospitalization. The study objectives were to describe these observations and identify domains salient to safety. METHODS In this observational study, we analyzed pediatric patient safety reports from June 2017 to April 2018. Participants were: English-speaking family members and hospitalized patients ≥13 years old. The analysis had two stages: (1) assessment of whether narratives met established safety event criteria and whether there were companion IRs; (2) thematic analysis to identify domains. RESULTS Of 248 enrolled participants, 58 submitted 120 narrative reports. Of the narratives, 68 (57%) met safety event criteria, while only 1 (0.8%) corresponded to a staff-reported IR. Twenty-five percent of narratives shared positive feedback about patient safety efforts; 75% shared constructive feedback. We identified domains particularly salient to safety: (1) patients and families as safety actors; (2) emotional safety; (3) system-centered care; and (4) shared safety domains, including medication, communication, and environment of care. Some domains capture data that is otherwise difficult to obtain (#1-3), while others fit within standard healthcare safety domains (#4). CONCLUSIONS Patients and families observe and report salient safety events that can fill gaps in IR data. Healthcare leaders should consider incorporating patient and family observations-collected with an option for anonymity and eliciting both positive and constructive comments.
Collapse
Affiliation(s)
- Christine Studenmund
- Department of Pediatrics, School of Medicine, University of California, San Francisco, California, USA
| | - Audrey Lyndon
- Rory Meyers College of Nursing, New York University, New York, New York, USA
| | - James R Stotts
- Department of Quality and Patient Safety, University of California, San Francisco, California, USA
| | - Caroline Peralta-Neel
- Department of Pediatrics, Philip R. Lee Institute for Health Policy Studies, University of California, San Francisco, California, USA
| | - Anjana E Sharma
- Department of Family & Community Medicine, University of California, San Francisco, California, USA
| | - Naomi S Bardach
- Department of Pediatrics, Philip R. Lee Institute for Health Policy Studies, University of California, San Francisco, California, USA
- Department of Pediatrics, University of California, San Francisco, California, USA
| |
Collapse
|
34
|
Franco Vega MC, Ait Aiss M, George M, Day L, Mbadugha A, Owens K, Sweeney C, Chau S, Escalante C, Bodurka DC. Enhancing Implementation of the I-PASS Handoff Tool Using a Provider Handoff Task Force at a Comprehensive Cancer Center. Jt Comm J Qual Patient Saf 2024; 50:560-568. [PMID: 38584053 DOI: 10.1016/j.jcjq.2024.03.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 03/01/2024] [Accepted: 03/05/2024] [Indexed: 04/09/2024]
Abstract
BACKGROUND Communication failures are among the most common causes of harmful medical errors. At one Comprehensive Cancer Center, patient handoffs varied among services. The authors describe the implementation and results of an organization-wide project to improve handoffs and implement an evidence-based handoff tool across all inpatient services. METHODS The research team created a task force composed of members from 22 hospital services-advanced practice providers (APPs), trainees, some faculty members, electronic health record (EHR) staff, education and training specialists, and nocturnal providers. Over two years, the task force expanded to include consulting services and Anesthesiology. Factors contributing to ineffective handoffs were identified and organized into categories. The EHR I-PASS tool was used to standardize handoff documentation. Training was provided to staff on its use, and compliance was monitored using a customized dashboard. I-PASS champions in each service were responsible for the rollout of I-PASS in their respective services. The data were reported quarterly to the Quality Assessment and Performance Improvement (QAPI) governing committee. Provider handoff perception was assessed through the biennial Institution-wide safety culture survey. RESULTS All fellows, residents, APPs, and physician assistants were trained in the use of I-PASS, either online or in person. Adherence to the I-PASS written tool improved from 41.6% in 2019 to 70.5% in 2022 (p < 0.05), with improvements seen in most services. The frequency of updating I-PASS elements and the action list in the handoff tool also increased over time. The handoff favorability score on the safety culture survey improved from 38% in 2018 to 59% in 2022. CONCLUSION The implementation approach developed by the Provider Handoff Task Force led to increased use of the I-PASS EHR tool and improved safety culture survey handoff favorability.
Collapse
|
35
|
Trehan R, Chen C, Bhalla R. Peer review for handoff education in a transition to residency course: A prospective cohort study. Health Sci Rep 2024; 7:e2292. [PMID: 39118671 PMCID: PMC11306289 DOI: 10.1002/hsr2.2292] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 07/11/2024] [Accepted: 07/27/2024] [Indexed: 08/10/2024] Open
Abstract
Background and Aims Association of American Medical Colleges (AAMC) and Accreditation Council for Graduate Medical Education (ACGME) mandate training in handoff delivery for students and residents. Communication errors, including errors during handoffs of patient care, account for over 2/3 of sentinel events. This study aims to assess the effectiveness of peer-assisted learning (PAL) in handoff education within a longitudinal framework. Methods This study involved the analysis of fourth-year medical students (n = 67) enrolled in a transition to residency program designed to reinforce skills essential for success in internal medicine residencies. We modified the I-PASS handoff rubric for a single-encounter evaluation. Before attending the transitions of care workshop, students submitted one written handoff report. During high-fidelity simulation sessions, peers evaluated the written document as well as verbal handoffs, while faculty evaluated a recorded verbal version. The primary outcome measured was improvement in handoff quality and accuracy over time and secondary outcomes compared peer- and self-evaluations to faculty assessments. Results Overall, students demonstrated a statistically significant improvement in handoff quality and accuracy across all scoring criteria after completing the peer evaluation process. Peer evaluations did not demonstrate statistically significant differences in scores for quality or accuracy questions as compared to faculty. Conclusion Peer evaluators effectively assessed handoff reports using the modified I-PASS checklist yielding outcomes similar to faculty while providing feedback. These findings provide exciting evidence that should prompt training programs to consider incorporating standardized peer review into handoff education for medical students and, potentially, residents. The detailed evaluation of individual handoff events fosters feedback skills essential for ongoing professional growth and clinical excellence.
Collapse
Affiliation(s)
- Rajiv Trehan
- Robert Wood Johnson Medical SchoolRutgers UniversityPiscatawayNew JerseyUSA
| | - Catherine Chen
- Department of Medicine, Robert Wood Johnson Medical SchoolRutgers UniversityNew BrunswickNew JerseyUSA
| | - Raman Bhalla
- Department of Medicine, Robert Wood Johnson Medical SchoolRutgers UniversityNew BrunswickNew JerseyUSA
| |
Collapse
|
36
|
Yu A, Chopra V, Mueller SK, Wray CM, Jones CD. Engineering safe care journeys: Reenvisioning interhospital transfers. J Hosp Med 2024; 19:629-634. [PMID: 38193639 DOI: 10.1002/jhm.13266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 12/08/2023] [Accepted: 12/14/2023] [Indexed: 01/10/2024]
Affiliation(s)
- Amy Yu
- Department of Medicine, Division of Hospital Medicine, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
| | - Vineet Chopra
- Department of Medicine, Division of Hospital Medicine, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
| | - Stephanie K Mueller
- Division of General Internal Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Charlie M Wray
- Department of Medicine, University of California, San Francisco, California, USA
- Section of Hospital Medicine, San Francisco Veterans Affairs Medical Center, San Francisco, California, USA
| | - Christine D Jones
- Department of Medicine, Division of Hospital Medicine, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
- Department of Medicine, Division of Geriatric Medicine, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
- Veterans Health Administration, Eastern Colorado Health Care System, Denver-Seattle Center of Innovation for Veteran-Centered and Value Driven Care, Aurora, Colorado, USA
| |
Collapse
|
37
|
Kachman MM, Brennan I, Oskvarek JJ, Waseem T, Pines JM. How artificial intelligence could transform emergency care. Am J Emerg Med 2024; 81:40-46. [PMID: 38663302 DOI: 10.1016/j.ajem.2024.04.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Revised: 04/13/2024] [Accepted: 04/15/2024] [Indexed: 06/07/2024] Open
Abstract
Artificial intelligence (AI) in healthcare is the ability of a computer to perform tasks typically associated with clinical care (e.g. medical decision-making and documentation). AI will soon be integrated into an increasing number of healthcare applications, including elements of emergency department (ED) care. Here, we describe the basics of AI, various categories of its functions (including machine learning and natural language processing) and review emerging and potential future use-cases for emergency care. For example, AI-assisted symptom checkers could help direct patients to the appropriate setting, models could assist in assigning triage levels, and ambient AI systems could document clinical encounters. AI could also help provide focused summaries of charts, summarize encounters for hand-offs, and create discharge instructions with an appropriate language and reading level. Additional use cases include medical decision making for decision rules, real-time models that predict clinical deterioration or sepsis, and efficient extraction of unstructured data for coding, billing, research, and quality initiatives. We discuss the potential transformative benefits of AI, as well as the concerns regarding its use (e.g. privacy, data accuracy, and the potential for changing the doctor-patient relationship).
Collapse
Affiliation(s)
- Marika M Kachman
- US Acute Care Solutions, Canton, OH, United States of America; Department of Emergency Medicine, Virginia Hospital Center, Arlington, VA, United States of America
| | - Irina Brennan
- US Acute Care Solutions, Canton, OH, United States of America; Department of Emergency Medicine, Inova Alexandria Hospital, Alexandria, VA, United States of America
| | - Jonathan J Oskvarek
- US Acute Care Solutions, Canton, OH, United States of America; Department of Emergency Medicine, Summa Health, Akron, OH, United States of America
| | - Tayab Waseem
- Department of Emergency Medicine, George Washington University, Washington, DC, United States of America
| | - Jesse M Pines
- US Acute Care Solutions, Canton, OH, United States of America; Department of Emergency Medicine, George Washington University, Washington, DC, United States of America.
| |
Collapse
|
38
|
Mullen JE, Reynolds MR. Implementation of Nurse Integrated Rounds Improves Interdisciplinary Communication in the Pediatric Intensive Care Unit. AACN Adv Crit Care 2024; 35:180-186. [PMID: 38848560 DOI: 10.4037/aacnacc2024707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2024]
Affiliation(s)
- Jodi E Mullen
- Jodi E. Mullen is Senior Quality Improvement Specialist, Department of Clinical Quality and Patient Safety, UF Health Shands Hospital, 3300 SW Williston Rd, Gainesville, FL 32608
| | - Melissa R Reynolds
- Melissa R. Reynolds is Registered Nurse, Department of Nursing and Patient Services, UF Health Shands Hospital, Gainesville, Florida
| |
Collapse
|
39
|
Woods J, Markovitz BP. Playing Telephone: Characterizing the Interfacility Referral Process to the PICU. Pediatr Crit Care Med 2024; 25:571-573. [PMID: 38836711 DOI: 10.1097/pcc.0000000000003504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/06/2024]
Affiliation(s)
- Jon Woods
- Both authors: Department of Pediatrics and Intermountain Primary Children's Hospital, Utah School of Medicine, Salt Lake City, UT
| | | |
Collapse
|
40
|
Lyons PG, Rojas JC, Bewley AF, Malone SM, Santhosh L. Validating the Physician Documentation Quality Instrument for Intensive Care Unit-Ward Transfer Notes. ATS Sch 2024; 5:274-285. [PMID: 39055332 PMCID: PMC11270237 DOI: 10.34197/ats-scholar.2023-0094oc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 01/09/2024] [Indexed: 07/27/2024] Open
Abstract
Background Physician communication failures during transfers of patients from the intensive care unit (ICU) to the general ward are common and can lead to adverse events. Efforts to improve written handoffs during these transfers are increasingly prominent, but no instruments have been developed to assess the quality of physician ICU-ward transfer notes. Objective To collect validity evidence for the modified nine-item Physician Documentation Quality Instrument (mPDQI-9) for assessing ICU-ward transfer note usefulness across several hospitals. Methods Twenty-four physician raters independently used the mPDQI-9 to grade 12 notes collected from three academic hospitals. A priori, we excluded the "up-to-date" and "accurate" domains, because these could not be assessed without giving the rater access to the complete patient chart. Assessments therefore used the domains "thorough," "useful," "organized," "comprehensible," "succinct," "synthesized," and "consistent." Raters scored each domain on a Likert scale ranging from 1 (low) to 5 (high). The total mPDQI-9 was the sum of these domain scores. The primary outcome was the raters' perceived clinical utility of the notes, and the primary measures of interest were criterion validity (Spearman's ρ) and interrater reliability (intraclass correlation [ICC]). Results Mean mPDQI-9 scores by note ranged from 19 (SD = 5.5) to 30 (SD = 4.2). Mean note ratings did not systematically differ by rater expertise (for interaction, P = 0.15). The proportion of raters perceiving each note as independently sufficient for patient care (the primary outcome) ranged from 33% to 100% across the set of notes. We found a moderately positive correlation between mPDQI-9 ratings and raters' overall assessments of each note's clinical utility (ρ = 0.48, P < 0.001). Interrater reliability was strong; the overall ICC was 0.89 (95% confidence interval [CI], 0.80-0.85), and ICCs were similar among reviewer groups. Finally, Cronbach's α was 0.87 (95% CI, 0.84-0.89), indicating good internal consistency. Conclusions We report moderate validity evidence for the mPDQI-9 to assess the usefulness of ICU-ward transfer notes written by internal medicine residents.
Collapse
Affiliation(s)
- Patrick G. Lyons
- Division of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, and
- Department of Medical Informatics and Clinical Epidemiology, Oregon Health and Science University, Portland, Oregon
| | - Juan C. Rojas
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Rush University, Chicago, Illinois
| | - Alice F. Bewley
- Division of Infectious Diseases, Department of Medicine, and
| | - Sara M. Malone
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine, St. Louis, Missouri; and
| | - Lekshmi Santhosh
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, University of California, San Francisco, San Francisco, California
| |
Collapse
|
41
|
Klocko DJ. Using structured communication to improve patient handoffs and reduce medical errors. JAAPA 2024; 37:42-44. [PMID: 38985115 DOI: 10.1097/01.jaa.0000000000000024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/11/2024]
Abstract
ABSTRACT Communication errors during transfer of care from one clinician to another are a major cause of medical errors. In 2006, The Joint Commission made handoff communications a national patient safety goal. In 2014, the Association of American Medical Colleges included giving and receiving a report to transfer a patient's care as one of the 13 core entrustable professional activities required for entry into residency programs. Communication is the key to successful transfer of patient care from one clinician to another during shift change. A structured method of communication used by all clinicians in high-stakes healthcare settings can ensure all vital information about a patient is given to the receiving clinician.
Collapse
Affiliation(s)
- David J Klocko
- David J. Klocko is an associate professor in the PA program at the University of Texas Southwestern Medical Center in Dallas, Tex. The author has disclosed no potential conflicts of interest, financial or otherwise
| |
Collapse
|
42
|
Reifarth E, Naendrup JH, Garcia Borrega J, Altenrath L, Shimabukuro-Vornhagen A, Eichenauer DA, Kochanek M, Böll B. [Handoffs in the intensive care unit]. Med Klin Intensivmed Notfmed 2024; 119:253-259. [PMID: 38498181 DOI: 10.1007/s00063-024-01127-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 02/09/2024] [Indexed: 03/20/2024]
Abstract
BACKGROUND Effective handoffs in the intensive care unit (ICU) are key to patient safety. PURPOSE This article aims to raise awareness of the significance of structured and thorough handoffs and highlights possible challenges as well as means for improvement. MATERIALS AND METHODS Based on the available literature, the evidence regarding handoffs in ICUs is summarized and suggestions for practical implementation are derived. RESULTS The quality of handoffs has an impact on patient safety. At the same time, communication in the intensive care setting is particularly challenging due to the complexity of cases, a disruptive work environment, and a multitude of inter- and intraprofessional interactions. Hierarchical team structures, deficiencies in feedback and error-management culture, (technical) language barriers in communication, as well as substantial physical and psychological stress may negatively influence the effectiveness of handoffs. Sets of interventions such as the implementation of checklists, mnemonics, and communication workshops contribute to a more structured and thorough handoff process and have the potential to significantly improve patient safety. CONCLUSION Effective handoffs are the cornerstone of high-quality and safe patient care but face particular challenges in ICUs. Interventional measures such as structuring handoff concepts and periodic communication trainings can help to improve handoffs and thus increase patient safety.
Collapse
Affiliation(s)
- Eyleen Reifarth
- Klinik I für Innere Medizin, Universitätsklinikum Köln, Kerpener Str. 62, 50937, Köln, Deutschland.
| | - Jan-Hendrik Naendrup
- Klinik I für Innere Medizin, Universitätsklinikum Köln, Kerpener Str. 62, 50937, Köln, Deutschland
| | - Jorge Garcia Borrega
- Klinik I für Innere Medizin, Universitätsklinikum Köln, Kerpener Str. 62, 50937, Köln, Deutschland
| | - Lisa Altenrath
- Klinik I für Innere Medizin, Universitätsklinikum Köln, Kerpener Str. 62, 50937, Köln, Deutschland
| | | | | | - Matthias Kochanek
- Klinik I für Innere Medizin, Universitätsklinikum Köln, Kerpener Str. 62, 50937, Köln, Deutschland
| | - Boris Böll
- Klinik I für Innere Medizin, Universitätsklinikum Köln, Kerpener Str. 62, 50937, Köln, Deutschland
| |
Collapse
|
43
|
Cho IY, Yun JY, Moon SH. Development and effectiveness of a metaverse reality-based family-centered handoff education program in nursing students. J Pediatr Nurs 2024; 76:176-191. [PMID: 38412709 DOI: 10.1016/j.pedn.2024.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 01/21/2024] [Accepted: 02/07/2024] [Indexed: 02/29/2024]
Abstract
PURPOSE Effective patient handoffs are vital in pediatric populations. This study aimed to develop and identify the impact of a metaverse-based handoff program using ZEPETO on nursing students' handoff competence, handoff self-efficacy, learning realism, and satisfaction. DESIGN AND METHODS This study used a non-randomized, pre-post nonequivalent group design to develop, implement, and verify a metaverse-based handoff simulation program in a nursing school in South Korea. We assigned 69 senior nursing students from a university to an experimental group or a control group. We developed a metaverse-based, handoff simulation program of family-centered care by building a pediatric intensive care unit (PICU) using ZEPETO. The program included an online lecture, a metaverse rounding discussion, and a metaverse-based handoff simulation of postoperative care for infants with congenital heart disease. We measured handoff competence, handoff self-efficacy, learning realism, and learning satisfaction pre- and post-program. RESULT(S) The experimental group showed significantly higher handoff self-efficacy than the control group (t = 3.17, p = 0.002). No significant differences were found in handoff competency, learning realism, or learning satisfaction between the groups. CONCLUSION(S) This study confirmed that a family-centered care-based handoff metaverse simulation program based on the experiential learning theory enhanced nursing students' handoff self-efficacy. The program equipped students to conduct safe and effective handoffs in real-world clinical settings by providing an immersive learning experience and emphasizing patient-centered communication. PRACTICAL IMPLICATIONS Based on these results, family-centered, handoff education programs are recommended to be developed that focus on learning realism and learning satisfaction to enhance nursing students' handoff competence.
Collapse
Affiliation(s)
- In Young Cho
- College of Nursing, Chonnam National University, 160 Baekseo-ro, Dong-gu, Gwangju 61469, South Korea
| | - Ji Yeong Yun
- Department of Nursing, Jesus University, 383 Seowon-ro, Wansangu, Jeonju-si, Jeollabukdo 54989, South Korea
| | - Sun-Hee Moon
- College of Nursing, Chonnam National University, 160 Baekseo-ro, Dong-gu, Gwangju 61469, South Korea.
| |
Collapse
|
44
|
DeVore K, Schneider K, Laures E, Harmon A, Van Heukelom P. Improving Outcomes in Patients Sent to the Emergency Department from Outpatient Providers: A Receiver-Driven Handoff Process Improvement. Jt Comm J Qual Patient Saf 2024; 50:363-370. [PMID: 38368190 DOI: 10.1016/j.jcjq.2024.01.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 01/14/2024] [Accepted: 01/16/2024] [Indexed: 02/19/2024]
Abstract
BACKGROUND Outpatient providers refer to emergency departments (EDs) due to findings requiring assessment beyond existing capabilities. However, poor communication surrounding these transitions may hinder safety and timeliness of emergency care. Receiver-driven handoff (RDH) is a process that helps ensure that all pertinent information is shared. This quality improvement project aimed to (1) improve knowledge of RDH, (2) increase satisfaction and perceptions surrounding RDH, (3) modify behaviors in relation to RDH, and (4) decrease referred patients leaving without being seen (LWBS). METHODS The Iowa Model and Implementation Framework guided this evidence-based quality improvement project. A multidisciplinary team developed and implemented a standardized RDH process consisting of screening to determine whether a patient was referred to the ED, review of electronic health record (EHR), and use of EHR documentation. Process measures were collected via questionnaire pre- and postimplementation and were analyzed quantitatively. Outcome measures were trended by a statistical process control p-chart, which was developed to demonstrate changes in the percentage of patients who were referred to the ED from the outpatient setting and LWBS. RESULTS The average response for the question "How satisfied are you with the handoff of patient information from referring clinic providers to the ED?" increased from 1.51 preintervention to 2.04 postintervention (p = 0.005). Respondents rated the information received during handoff higher postintervention (2.12 vs. 2.52, p = 0.04). Compliance with screening for referral to the ED was 84.0%. The proportion of patients LWBS after referral decreased by 6.2 percentage points (p < 0.001). CONCLUSION Using RDH in conjunction with a standardized triage screening may improve quality of information shared during this vulnerable transition and may assist in reduction of referred patients LWBS. The RDH process should be adapted into everyday workflow to ensure sustainability and effectiveness.
Collapse
|
45
|
Mahoney D, Pavitt S, Blankenburg R. We've Got a New One-Exploring the Resident-Fellow New Admission Interaction and Opportunities for Enhancing Motivation. Acad Pediatr 2024; 24:692-699. [PMID: 38215903 DOI: 10.1016/j.acap.2024.01.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 11/12/2023] [Accepted: 01/04/2024] [Indexed: 01/14/2024]
Abstract
OBJECTIVE To characterize the phases of a new admission interaction between collaborating pediatric residents and fellows; to explore trainee perspectives on motivating and demotivating qualities of that interaction; and to identify behaviors that lead to an optimal new admission interaction. METHODS The authors used modified grounded theory with experiential learning theory and self-determination theory as sensitizing concepts to conduct 6 focus groups and journey mapping at Stanford Children's Health from January to March 2021. The sessions were audio-recorded and transcribed verbatim. Two authors independently coded the transcripts and developed categories and themes using constant comparison, while a third author reviewed these findings. The qualitative data were triangulated with surveys and journey mapping data and conceptualized into a model of trainee motivation during the new admission interaction. They outlined an optimal new admission interaction using behaviors consistently described by participants as motivating. RESULTS Developing inter-trainee trust and educational buy-in is essential for both residents and fellows to feel intrinsically motivated and engaged during a new admission. Residents need to feel autonomous, competent, and related to the team in order to develop trust and buy-in. Fellows require assurance of patient safety to develop trust and a sense of self-efficacy in fostering resident growth to develop buy-in. Lack of trust or buy-in from either party leads to a cycle of trainee disengagement. CONCLUSIONS Trainee motivation and engagement with patient care can be impacted by discreet, modifiable behavior by their fellow or resident counterpart, which may help improve the quality of care delivered.
Collapse
Affiliation(s)
- David Mahoney
- Department of Pediatrics (D Mahoney), Stanford University School of Medicine, Palo Alto, Calif.
| | - Sara Pavitt
- Department of Neurology and by courtesy Department of Pediatrics (S Pavitt), Dell Medical School, Austin, Tex.
| | - Rebecca Blankenburg
- Department of Pediatrics (R Blankenburg), Stanford University School of Medicine, Palo Alto, Calif.
| |
Collapse
|
46
|
Taylor JA, McDaniel CE, Stevens CA, Jacob-Files E, Acquilano SC, Freyleue SD, Bode R, Erdem G, Felman K, Lauden S, Bruce ML, Leyenaar JK. Direct Admission Program Implementation: A Qualitative Analysis of Variation Across Health Systems. Pediatrics 2024; 153:e2023063569. [PMID: 38533563 DOI: 10.1542/peds.2023-063569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/16/2023] [Indexed: 03/28/2024] Open
Abstract
OBJECTIVES Direct admission (DA) to the hospital has the potential to improve family satisfaction and timeliness of care by bypassing the emergency department. Using the RE-AIM implementation framework, we sought to characterize variation across health systems in the reach, effectiveness, adoption, and implementation of a DA program from the perspectives of parents and multidisciplinary clinicians. METHODS As part of a stepped-wedge cluster randomized trial to compare the effectiveness of DA to admission through the emergency department, we evaluated DA rates across 69 clinics and 3 health systems and conducted semi-structured interviews with parents and clinicians. We used thematic analysis to identify themes related to the reach, effectiveness, adoption, and implementation of the DA program and applied axial coding to characterize thematic differences across sites. RESULTS Of 2599 hospitalizations, 171 (6.6%) occurred via DA, with DA rates varying 10-fold across health systems from 0.9% to 9.3%. Through the analysis of 137 interviews, including 84 with clinicians and 53 with parents, we identified similarities across health systems in themes related to perceived program effectiveness and patient and family engagement. Thematic differences across sites in the domains of program implementation and clinician adoption included variation in transfer center efficiency, trust between referring and accepting clinicians, and the culture of change within the health system. CONCLUSIONS The DA program was adopted variably, highlighting unique challenges and opportunities for implementation in different hospital systems. These findings can inform future quality improvement efforts to improve transitions to the hospital.
Collapse
Affiliation(s)
- Jordan A Taylor
- The Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire
| | - Corrie E McDaniel
- Seattle Children's Hospital, Seattle, Washington
- University of Washington, Seattle, Washington
| | | | | | - Stephanie C Acquilano
- The Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire
| | - Seneca D Freyleue
- The Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire
| | - Ryan Bode
- Nationwide Children's Hospital, Columbus, Ohio
- Department of Pediatrics, The Ohio State College of Medicine, Columbus, Ohio
| | - Guliz Erdem
- Nationwide Children's Hospital, Columbus, Ohio
- Department of Pediatrics, The Ohio State College of Medicine, Columbus, Ohio
| | - Kristyn Felman
- Department of Physical Medicine and Rehabilitation, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | - Stephanie Lauden
- Nationwide Children's Hospital, Columbus, Ohio
- Department of Pediatrics, The Ohio State College of Medicine, Columbus, Ohio
- University of Colorado, Department of Pediatrics, Denver, Colorado
| | - Martha L Bruce
- The Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire
- Dartmouth Health Children's, Lebanon, New Hampshire
| | - JoAnna K Leyenaar
- The Dartmouth Institute for Health Policy and Clinical Practice, Geisel School of Medicine at Dartmouth, Lebanon, New Hampshire
- Dartmouth Health Children's, Lebanon, New Hampshire
| |
Collapse
|
47
|
Choi JJ, Osterberg LG, Record JD. Exploring Ward Team Handoffs of Overnight Admissions: Key Lessons from Field Observations. J Gen Intern Med 2024; 39:808-814. [PMID: 38038890 PMCID: PMC11043283 DOI: 10.1007/s11606-023-08549-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 11/21/2023] [Indexed: 12/02/2023]
Abstract
BACKGROUND The diagnostic process is a dynamic, team-based activity that is an important aspect of ward rounds in teaching hospitals. However, few studies have examined how academic ward teams operate in areas such as diagnosis in the handoff of overnight admissions during ward rounds. This study draws key lessons from team interactions in the handoff process during ward rounds. OBJECTIVE To describe how ward teams operate in the handoff of patients admitted overnight during ward rounds, and to characterize the role of the bedside patient evaluation in this context. DESIGN A qualitative ethnographic approach using field observations and documentary analysis. PARTICIPANTS Attending physicians, medical residents, and medical students on general medicine services in a single teaching hospital. APPROACH Thirty-five hours of observations were undertaken over a 4-month period. We purposively approached a diverse group of attendings who cover a range of clinical teaching experience, and obtained informed consent from all ward team members and observed patients. Thirty patient handoffs were observed across 5 ward teams with 45 team members. We conducted thematic analysis of researcher field notes and electronic health record documents using social cognitive theories to characterize the dynamic interactions occurring in the real clinical environment. KEY RESULTS Teams spent less time during ward rounds on verifying history and physical examination findings, performing bedside evaluations, and discussing differential diagnoses than other aspects (e.g., reviewing patient data in conference rooms) in the team handoff process of overnight admissions. Several team-based approaches to diagnosis and bedside patient evaluations were observed, including debriefing for learning and decision-making. CONCLUSIONS This study highlights potential strengths and missed opportunities for teaching, learning, and engaging directly with patients in the ward team handoff of patients admitted overnight. These findings may inform curriculum development, faculty training, and patient safety research.
Collapse
Affiliation(s)
- Justin J Choi
- Department of Medicine, Weill Cornell Medicine, New York, NY, USA.
- School of Health Professions Education (SHE), Maastricht University, Maastricht, The Netherlands.
| | - Lars G Osterberg
- Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA
| | - Janet D Record
- Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
48
|
Festekjian A, Hall JE, Zipkin R, Schiff J, Pham PK, Mesropyan L, Araradian C, Nager AL, Chang TP. A checklist intervention for pediatric emergency department transfer of care sign-outs. Am J Emerg Med 2024; 77:215-219. [PMID: 38216365 DOI: 10.1016/j.ajem.2024.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 01/01/2024] [Accepted: 01/01/2024] [Indexed: 01/14/2024] Open
Affiliation(s)
- Ara Festekjian
- Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mailstop 113, Los Angeles, CA 90027, United States of America; Keck School of Medicine, University of Southern California, Los Angeles, CA, United States of America.
| | - Jeanine E Hall
- Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mailstop 113, Los Angeles, CA 90027, United States of America; Keck School of Medicine, University of Southern California, Los Angeles, CA, United States of America.
| | - Ronen Zipkin
- Department of Pediatrics, Division of Hospital Medicine, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mailstop 94, Los Angeles, CA 90027, United States of America; Keck School of Medicine, University of Southern California, Los Angeles, CA, United States of America.
| | - Jared Schiff
- Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mailstop 113, Los Angeles, CA 90027, United States of America; Keck School of Medicine, University of Southern California, Los Angeles, CA, United States of America.
| | - Phung K Pham
- Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mailstop 113, Los Angeles, CA 90027, United States of America
| | - Levon Mesropyan
- University of California Los Angeles, Burbank Pediatrics, 2625 W. Alameda, Suite 300, Burbank, CA 9150, United States of America.
| | - Cynthia Araradian
- Oregon Health Sciences University*, 3181 S.W. Jackson Park Road, Portland, OR 97239, United States of America.
| | - Alan L Nager
- Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mailstop 113, Los Angeles, CA 90027, United States of America; Keck School of Medicine, University of Southern California, Los Angeles, CA, United States of America.
| | - Todd P Chang
- Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, 4650 Sunset Blvd, Mailstop 113, Los Angeles, CA 90027, United States of America; Keck School of Medicine, University of Southern California, Los Angeles, CA, United States of America.
| |
Collapse
|
49
|
Cooper AZ, Jain S, Santhosh L, Carlos WG. Eye on the Prize: Patient Outcomes Research in Medical Education. ATS Sch 2024; 5:8-18. [PMID: 38585575 PMCID: PMC10995853 DOI: 10.34197/ats-scholar.2023-0046ps] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 08/18/2023] [Indexed: 04/09/2024] Open
Abstract
The overarching goal of medical education is to train clinicians who achieve and maintain competence in patient care. Although the field of medical education research has acknowledged the importance of education on clinical practices and outcomes, most research endeavors continue to focus on learner-centered outcomes, such as knowledge and attitudes. The absence of clinical and patient-centered outcomes in pulmonary and critical care medicine medical education research has been attributed to barriers at multiple levels, including financial, methodological, and practical considerations. This Perspective explores clinical outcomes relevant to pulmonary and critical care medicine educational research and offers strategies and solutions that educators can use to accomplish what many consider the "prize" of medical education research: an understanding of how our educational initiatives impact the health of patients.
Collapse
Affiliation(s)
- Avraham Z. Cooper
- Division of Pulmonary, Critical Care, and Sleep Medicine, Department of Internal Medicine, The Ohio State University, Columbus, Ohio
| | - Snigdha Jain
- Section of Pulmonary, Critical Care, and Sleep Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut
| | - Lekshmi Santhosh
- Division of Pulmonary, Critical Care, and Sleep Medicine, Department of Medicine, University of California–San Francisco, San Francisco, California; and
| | - W. Graham Carlos
- Division of Pulmonary, Critical Care, Sleep, and Occupational Medicine, Indiana University School of Medicine, Indianapolis, Indiana
| |
Collapse
|
50
|
Ryan JM, McHugh F, Simiceva A, Eppich W, Kavanagh DO, McNamara DA. Daily handover in surgery: systematic review and a novel taxonomy of interventions and outcomes. BJS Open 2024; 8:zrae011. [PMID: 38426257 PMCID: PMC10905088 DOI: 10.1093/bjsopen/zrae011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 12/17/2023] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Poor-quality handovers lead to adverse outcomes for patients; however, there is a lack of evidence to support safe surgical handovers. This systematic review aims to summarize the interventions available to improve end-of-shift surgical handover. A novel taxonomy of interventions and outcomes and a modified quality assessment tool are also described. METHODS Ovid MEDLINE®, PubMed, Embase, and Cochrane databases were searched for articles up to April 2023. Comparative studies describing interventions for daily in-hospital surgical handovers between doctors were included. Studies were grouped according to their interventions and outcomes. RESULTS In total, 6139 citations were retrieved, and 41 studies met the inclusion criteria. The total patient sample sizes in the control and intervention groups were 11 946 and 11 563 patients, respectively. Most studies were pre-/post-intervention cohort studies (92.7%), and most (73.2%) represented level V evidence. The mean quality assessment score was 53.4% (17.1). A taxonomy of handover interventions and outcomes was developed, with interventions including handover tools, process standardization measures, staff education, and the use of mnemonics. More than 25% of studies used a document as the only intervention. Overall, 55 discrete outcomes were assessed in four categories including process (n = 27), staff (n = 14), patient (n = 12) and system-level (n = 2) outcomes. Significant improvements were seen in 51.8%, 78.5%, 58.3% (n = 9761 versus 9312 patients) and 100% of these outcomes, respectively. CONCLUSIONS Most publications demonstrate that good-quality surgical handover improves outcomes and many interventions appear to be effective; however, studies are methodologically heterogeneous. These novel taxonomies and quality assessment tool will help standardize future studies.
Collapse
Affiliation(s)
- Jessica M Ryan
- RCSI SIM Centre for Simulation Education and Research, RCSI, Dublin, Ireland
- StAR MD Programme, School of Postgraduate Studies, RCSI, Dublin, Ireland
- Department of Surgery, The Bon Secours Hospital, Glasnevin, Dublin, Ireland
| | - Fiachra McHugh
- Department of Surgery, Mayo University Hospital, Mayo, Ireland
| | - Anastasija Simiceva
- RCSI SIM Centre for Simulation Education and Research, RCSI, Dublin, Ireland
| | - Walter Eppich
- RCSI SIM Centre for Simulation Education and Research, RCSI, Dublin, Ireland
| | - Dara O Kavanagh
- Department of Surgical Affairs, RCSI, Dublin, Ireland
- Department of Surgery, Tallaght University Hospital, Dublin, Ireland
| | - Deborah A McNamara
- Office of the President, RCSI, Dublin, Ireland
- National Clinical Programme in Surgery, RCSI, Dublin, Ireland
- Department of Surgery, Beaumont Hospital, Dublin, Ireland
| |
Collapse
|