Highlights
- •The use of simulation was an effective method to test the intrarater and inter-rater reliability of the Medication Administration Evaluation and Feedback Tool (MAEFT).
- •Fleiss' Kappa coefficient for intra-rater and inter-rater reliability of multiple observers using the MAEFT measured good reliability.
- •Intrarater and inter-rater reliability and accuracy of the designed MAEFT shows that it is reliable and accurate in a simulated environment.
Abstract
Background
Incorrect medication administration risks errors and patient harm. The aim of this
study was to test the reliability of the newly developed medication administration
evaluation and feedback tool.
Methods
An observational, fully crossed design using recorded scenarios in a simulated environment
was used to test reliability and agreement of an evaluation tool for nurses administering
medications.
Results
Intrarater and inter-rater reliability observed agreement overall were 84% and 82%
with Fleiss Kappa coefficient 0.72 and 0.68, respectively. Overall intrarater and
inter-rater reliability of the tool rated as good.
Conclusions
The medication administration evaluation and feedback tool is reliable in a simulated
environment.
Keywords
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Clinical Simulation In NursingAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- National Safety and Quality Health Service Standards.2nd ed. ACSQHC, Sydney2017
- Drug administration errors in hospital inpatients: a systematic review.PLoS One. 2013; 8: e68856https://doi.org/10.1371/journal.pone.0068856
- Feedback and self-regulated learning: a theoretical synthesis.Review of Educational Research. 1995; 65: 245
- Feedback and clinical practice improvement: a tool to assist workplace supervisors and students.Nurse Education in Practice. 2016; 17: 167-173https://doi.org/10.1016/j.nepr.2015.11.009
- Medication Practice Standard.2017 (Retrieved from)http://www.cno.org/en/learn-about-standards-guidelines/standards-and-guidelines/Date accessed: June 23, 2018
- A systematic review of the use of theory in randomized controlled trials of audit and feedback.Implementation Science: IS. 2013; 8: 66https://doi.org/10.1186/1748-5908-8-66
- Medication administration evaluation tool design: an expert panel review.Collegian. 2019; 26: 118-124https://doi.org/10.1016/j.colegn.2018.05.001
- Measuring agreement for multinomial data.Biometrics. 1982; 38: 1047-1051
- The role of observation and feedback in enhancing performance with medication administration.Journal of Law and Medicine. 2015; 23: 316
- Internal Medicine Services (IMS) medication administration observation & feedback.in: Paper Presented at the Royal Brisbane and Women's Hospital Symposium, Brisbane. 2015
- Statistical Methods for Rates and Proportions.3rd ed. Wiley, Hoboken2004
- Irr: various coefficients of interrater reliability and agreement. R package version 0.84.(Retrieved from)
- Use of simulation to develop a medication administration safety assessment tool.Clinical Simulation in Nursing. 2013; 9: e609-e615https://doi.org/10.1016/j.ecns.2013.04.017
- Computing inter-rater reliability for observational data: An overview and tutorial.Tutorials in Quantitative Methods for Psychology. 2012; 8: 23https://doi.org/10.20982/tqmp.08.1.p023
- Medication administration errors and mortality: Incidents reported in England and Wales between 2007 ̶ 2016.Research in Social and Administrative Pharmacy. 2018; https://doi.org/10.1016/j.sapharm.2018.11.010
- Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support.Journal of Biomedical Informatics. 2009; 42: 377-381https://doi.org/10.1016/j.jbi.2008.08.010
- The power of feedback.Review of Educational Research. 2007; 77: 81-112https://doi.org/10.3102/003465430298487
- Collaboratively planning for medicines administration competency: A survey evaluation.Journal of Nursing Management. 2011; 19: 366-376https://doi.org/10.1111/j.1365-2834.2011.01245.x
- INACSL standards of best practice: SimulationSM simulation glossary.Clinical Simulation in Nursing. 2016; 12: S39-S47https://doi.org/10.1016/j.ecns.2016.09.012
- NLN Jeffries simulation theory: brief narrative description.Nursing Education Perspective. 2015; 36: 292-293
- Identifying educator behaviours for high quality verbal feedback in health professions education: literature review and expert refinement.BMC Medical Education. 2016; 16: 96https://doi.org/10.1186/s12909-016-0613-5
- Applying educational theory in practice.BMJ. 2003; 326: 213-216https://doi.org/10.1136/bmj.326.7382.213
- Informal Adult Education: A Guide for Administrators, Leaders, and Teachers.Association Press, New York1950
- RCN concerns over proposed changes to mentor training and medicines management.Nursing Times. 2017; (Retrieved from)https://www.nursingtimes.net/news/education/rcn-concern-at-plans-for-mentorship-and-meds-management/7021297.articleDate accessed: October 10, 2017
- Standards for Medicines Management.2010 (UK. (Accessed 5 April 2018))
- New NMC standards shape the future of nursing for next generation [Press release].(Retrieved from)https://www.nmc.org.uk/news/press-releases/new-nmc-standards-shape-the-future-of-nursing-for-next-generation/Date: 2018Date accessed: December 3, 2018
- Medication resource package. RBWH intranet: royal brisbane and women's hospital (RBWH).(Retrieved from)http://hi.bns.health.qld.gov.au/nursing/education.htm#workforce_developmentDate: 2015Date accessed: March 10, 2016
- The content validity index: are you sure you know what's being reported? Critique and recommendations.Research in Nursing & Health. 2006; 29: 489-497https://doi.org/10.1002/nur.20147
- A meta-analysis of self-regulated learning in work-related training and educational attainment: what we know and where we need to go.Psychological Bulletin. 2011; 137: 421-442https://doi.org/10.1037/a0022777
- Simulation performance evaluation: Inter-rater reliability of the DARE2-patient safety rubric.Clinical Simulation in Nursing. 2014; 10: 446-454https://doi.org/10.1016/j.ecns.2014.06.005
- Simulation and adult learning.Disease-a-Month. 2011; 57: 664-678https://doi.org/10.1016/j.disamonth.2011.08.017
- Education and Training: Technical Series on Safer Primary Care. (Licence: CC BY-NC-SA 3.0 IGO.).Geneva World Health Organization, 2016 (Retrieved from)http://apps.who.int/iris/bitstream/10665/252271/1/9789241511605-eng.pdf?ua=1Date accessed: April 15, 2017
- Medication without harm: WHO's third global patient safety challenge.(Retrieved from)
- Observation for assessment of clinician performance: a narrative review.BMJ Quality & Safety. 2015; 25: 46-55https://doi.org/10.1136/bmjqs-2015-004171
Article info
Publication history
Published online: May 09, 2019
Identification
Copyright
Crown Copyright © 2019 Published by Elsevier Inc. on behalf of International Nursing Association for Clinical Simulation and Learning. All rights reserved.
