An Ergonomic Protocol for Patient Transfer That Can Be Successfully Taught Using Simulation Methods
Article Outline
Abstract
Introduction
Nursing personnel injury related to patient transfer is epidemic, and reduction of injury rates is a national priority. Hierarchical task analysis (HTA) was chosen to address this issue.
Method
HTA methods were used to create an optimum task set and protocol which consisted of Internet-based education, simulation practice, and debriefing. Participants (N = 71) were randomly assigned to teams to perform simulated transfers. Pre- to postintervention transfer success was evaluated by ergonomic experts.
Results
Each team improved significantly from pre- to postintervention (N = 19), with every protocol step demonstrating improvement (N = 10). Interrater reliability of the evaluation instrument was calculated (.43–.83).
Conclusion
Simulation was used successfully to improve transfer success. This approach shows promise in reduction of transfer-related nursing injury.
KeyWords: simulation, hierarchical task analysis, back injury, ergonomics
Introduction
Bernardo Ramazzini (1633–1714), the father of modern occupational medicine, first identified and studied workplace-related disease in the late 1600s (Ramazzini & Wright, 1940). The striking fact is that in the more than 3 centuries since Ramazzini first identified the problem of workplace-related injury, it persists, with an epidemic now seen in nurses and nurse aides. Nurse aides and nurses have the highest rate of workers' compensation claims within the health care industry and are consistently among the top 10 of nonfatal work-related injury groups among all U.S. workers. When combined, these two groups are second in total injuries among all U.S. occupations, exceeding groups such as laborers and dock workers (de Castro, 2004a, de Castro, 2004b, Edlich et al., 2001, U.S. Department of Labor, 2007, U.S. Department of Labor, 2007). This high incidence of musculoskeletal injury (MSI) in the nursing profession has been widely reported and analyzed (Blakeney, 2003, Charney, 2005, de Castro et al., 2006, Edlich et al., 2005). The National Institute of Occupational Safety and Health (2006) reports an annual prevalence rate of back pain among nurses of 40% to 50%, with up to 52% of nurses reporting having had chronic back pain of 14 or more days within the past 6 months. The National Institute of Occupational Safety and Health also reports a lifetime prevalence rate of back pain or injury among nursing personnel of 35% to 80%. These statistics are highly significant because there is an emerging national and international nursing shortage. Currently there are 2.9 million nurses in the U.S. workforce, with an average age of 48. Up to 40% of practicing nurses are projected to retire in the next 5 years, and experts predict a deficit of at least 1 million nurses by the year 2020 (American Association of Colleges of Nursing, 2006; Murray, 2002, Unruh and Fottler, 2005, Williams et al., 2006). As many as 38% of nurses suffer from back pain severe enough to require time off from work during their careers, with up to 12% leaving the profession annually because of this issue. Prevention of nursing injury would therefore have a significant impact on the emerging nursing shortage (de Castro et al., 2006, Edlich et al., 2005).
To reduce injury rates, a hospital-based training program is necessary to teach proper techniques and to monitor compliance. Development of a comprehensive, ergonomically sound program would require development of (a) a protocol that includes the optimum task set for moving patients; (b) an effective, standardized, and scalable training process; and (c) the ability to monitor program compliance in the clinical setting.
Before an effective simulation training program for patient transfer can be implemented, the ergonomic issues that constitute the transfer task must be clearly defined. The task analysis process used in ergonomic science fits well with this approach. Task analysis entails defining and describing either a job or the particular task or set of tasks within a job (Stanton, 2006). A subtype, hierarchical task analysis, has been used extensively in ergonomics research and fieldwork for more than 30 years (Stanton, 2006). As the name implies, hierarchical task analysis not only lists each step of a particular task but also analyzes and attempts to place each step in the order in which it should or could be performed (Annett et al., 2000, Shepherd, 1998, Stanton, 2006). The power of hierarchical task analysis results from its ability to facilitate description of individual or team behaviors by acknowledging that most tasks are comprised of “a sub-goal hierarchy linked by plans” (Stanton, 2006, 58). Because this approach deconstructs tasks into discrete components, it can be used not only to measure overall task completion but also to improve task performance by identifying problematic steps in the system or process.
Although nurses experience many different types of musculoskeletal loads in their work, the task of transferring patients is particularly implicated in causing injury (National Institute of Occupational Safety and Health, 2006). Currently, no standardized, universally accepted method accomplishes the overall outcome of “a safe patient transfer” while adhering to all ergonomic principles in prevention of caregiver injury. Partly, this deficiency exists because patient transfers require complex coordination of personnel and equipment and must be tailored to meet individual patient and facility needs. Additionally, moving a patient with heavy nonfixed limbs and a shifting center of gravity is not comparable to moving a static, gravity-centered load, such as a box or other solid object. Regulatory standards from the National Institute for Occupational Safety and Health tend to emphasize the “static” situation and are not designed specifically to address patient transfers. This makes the problem of preventing health care worker injury more difficult to remedy (National Institute of Occupational Safety and Health, 2006).
Didactic educational programs and single-focus interventions such as back belts have been demonstrated to be ineffective in reducing long-term injury rates (Edlich et al., 2001, Gatty et al., 2003, Karas and Conrad, 1996, Melton, 1983, Mitchell et al., 1994, Nelson et al., 2003, Taylor, 1987, Trinkoff et al., 2003, Venning, 1988, Wassell et al., 2000, Yassi et al., 2001). An emerging educational approach that shows promise in increasing retention of skills is hands-on, scenario-based simulation training using a manikin (Ackermann, 2007, Crofts et al., 2007, Morgan et al., 2002, Wayne et al., 2006). Educational approaches using simulation have been reported for training a wide range of simple to complex health care tasks (Alinier et al., 2006, Bradley, 2006, DeVita et al., 2005, Heaven et al., 2006, Hoffmann et al., 2007, Holcomb et al., 2002, Johnsson et al., 2006, Magee, 2003, Mayo et al., 2004; D. Murray, 2006; D. Murray et al., 2002, O'Donnell et al., 2005, Sarker et al., 2006, Sarker et al., 2006, Sorenson, 2002, Steadman et al., 2006, Yee et al., 2005). Notably, the Institute of Medicine has recommended the use of educational methods incorporating simulation to improve safety within the health care system (Kohn, Corrigan, & Donaldson, 1999). The advantages of using a manikin for patient transfer training are cost, standardization, and the lack of risk of injury to “live” patients during transfer training by novices.
The purpose of this report is to (a) describe development of a valid, measurable, and standardized patient transfer protocol based on an optimum task set; (b) describe development of a related simulation intervention; (c) evaluate patient transfer performance in a simulation lab; and (d) describe development of methods to score patient transfer in real time, including a mobile data collection system. Furthermore, this approach has the potential to benefit public health in that patient transfers are common, nursing personnel are frequently injured, loss of the nursing workforce is a national concern, and evidence suggests that inadequate nurse staffing is linked to adverse patient outcome (Aiken et al., 2003, Clarke and Aiken, 2006, Rogers et al., 2004).
Method
Patient Transfer Protocol Development
To develop a broadly applicable patient transfer protocol, the optimum task set for performing a patient transfer was needed. The method for deriving this task set was as follows: A panel of health care experts was recruited, including physical therapists, occupational therapists, professional nurses, hospital administrators, ergonomic experts, and an occupational medicine physician. The expert panel followed a nine-step hierarchical task analysis process (Table 1; Annett et al., 2000, Shepherd, 1998, Stanton, 2006). Through this process, a comprehensive list of all activities during a patient transfer was compiled by the panel. The equipment used and the policies and procedures referring to patient transfer were considered. Although the expert panel was clear with respect to the overall goal of an optimum patient transfer, the order and operational definitions for the overall task set required multiple revisions. In hierarchical task analysis methods, the overall goal is defined as the superordinate goal. The comprehensive task list was refined through review of the literature and clinical observation of actual patient transfers, with ongoing feedback to the panel. The ergonomic experts “field-tested” the protocol during development and were in consensus relative to the steps and order of the process. A process map was developed, and transfer activities were grouped and condensed in order to develop the optimum task set. Each main task was broken down into its component subtasks to ensure that each main task could be operationally defined.
Table 1. Nine-Step Hierarchical Task Analysis Process for Developing the Patient Transfer Protocol
| Hierarchical Task Analysis Process Step | Patient Transfer Protocol Development Steps |
|---|---|
| Define the purpose of the analysis. | We defined our purpose as “development of a flexible and broadly applicable protocol for patient transfers using optimal ergonomic principles and best evidence from the literature.” |
| Define the boundaries of the system description. | Defined as all procedures or tasks that health care providers would need to complete in order to safely transfer a patient. |
| Access a variety of information sources about the system to confirm reliability and validity of the analysis. | Sources of information included baseline clinical observations; interviews with nurses, occupational therapists, physical therapists, physicians and experts in patient safety and simulation; and extensive review of nursing and occupational health literature. |
| Describe the system goals and subgoals; define a subgoal hierarchy for the task at hand. | The system (superordinate) goal was framed as “transfer a patient according to ergonomic and patient safety principles.” Through an iterative process based on ongoing expert input and best-evidence from literature, the subgoals or steps of a patient transfer protocol were identified and then arranged in a logical order. The protocol steps were then clinically validated through observation of actual patient transfers. |
| Try to keep the number of immediate subgoals under any superordinate goal to a small number (between 3 and 10). | The hierarchical task analysis literature supports limiting subgoals to a maximum of 10. In our process, the final set of subgoals (patient transfer protocol steps) was reduced to 10 through actual clinical observation with feedback to the expert panel. |
| Link goals to subgoals and describe the conditions under which subgoals are triggered (Table 3, Table 4). | Operational definitions for each patient transfer protocol step were derived from patient care standards or best evidence from the literature. These established definitive end points in evaluation of each subgoal step and provided a trigger for evaluation of the subsequent step. |
| Stop redescribing the subgoals when you judge the analysis is fit for purpose. | The redescription process stopped when the level of description was deemed adequate in measurement of the superordinate goal of patient transfer. This was confirmed by again observing actual patient transfers after which the patient transfer protocol was judged as fit for purpose. |
| Verify the analysis with subject-matter experts. | A panel of subject matter experts (ergonomists and other clinicians and nonclinicians) was engaged in final review of both the patient transfer protocol and the operational definitions. |
| Be prepared to revise the analysis based on feedback. | Expert feedback, patient care standards. and final observations were used to finalize the patient transfer protocol prior to development of the patient transfer training materials and generation of data collection instruments based on the patient transfer protocol. |
Development of Online Support Materials
The patient transfer protocol was then used as a process map in development of an Internet-based training curriculum that supported the scenario-based simulation training program. The program was designed to be appropriate for all categories of health care professionals, including registered nurses, licensed practical nurses, nurse assistants, and any other direct care personnel (Figure 1). All course materials were designed to reinforce the patient transfer protocol steps and were posted to a proprietary learning management system Web site at the University of Pittsburgh's Winter Institute for Simulation, Education and Research. The project was approved by the University of Pittsburgh Biomedical institutional review board, and participants required a password for access to this Web site. Participants received the password after providing consent.
Development of Data Collection Tools
The investigators developed and evaluated two data collection tools that were programmed with the patient transfer protocol. The first tool was the protocol in the form of a checklist programmed into the Laerdal SimMan® software system, Version 2.3 (Figure 2). Ergonomic experts rated transfers in the simulation lab using this system. In addition, the evidence-based rationale for each main task step was programmed into the SimMan® Debriefing Viewer Program, which facilitated a structured and best-evidence–supported posttransfer debriefing.

Figure 2
Laerdal SimMan universal patient simulator interface (Version 3.2) programmed with the patient transfer protocol.
(With permission from Laerdal Inc., Stavanger, Norway.)
The second data collection tool was the Hewlett-Packard (HP) iPAQ handheld computer (view online extra Figure 3 at www.nursingsimulation.org) running the Windows Mobile 5.0 operating system. The handheld computers were programmed with the patient transfer protocol as a checklist. The programming used embedded visual BASIC to create a graphic user interface. This handheld tool was used by nonexpert raters during the study.
Simulation Intervention
Nurses (n = 48) and nursing assistants (n = 23) were recruited to participate in a 4-hour simulation intervention at the Winter Institute for Simulation, Education and Research, Pittsburgh. After consent was obtained, baseline transfer skill was determined by having teams (3–4 participants per team) perform two simulated transfers using the Tuff Kelly Transfer Manikin (Laerdal Inc., Stavanger, Norway). This manikin is specifically designed to simulate patient transfers across a variety of settings, is inexpensive, and can easily be adapted for training of this task in almost any setting. After the second transfer was performed, a structured video debriefing was conducted for each transfer event. The SimMan Debriefing Viewer Program was used to provide in-room debriefing. The SimMan log file display included evidence-based statements providing the rationale for each transfer step, as well as the rating of the expert. An embedded video link facilitated review of each transfer event and allowed expert commentary as part of the structured debriefing method. Online patient transfer protocol materials were reviewed with each team. The debriefings and online material review constituted the intervention, which lasted for 1.5 hr. Following this intervention, transfer skill was reassessed by having the same participant teams perform two different simulated patient transfers. The entire protocol took place over 3 hours.
Rater Training
Our eventual goal was to implement the simulation intervention and then conduct observational studies of actual patient transfers. Recognizing that the cost of ergonomic experts might be prohibitive, we hypothesized that nonexperts could be rapidly trained to accurately score simulated transfer events and thus eventually be prepared to score actual patient transfers. Establishing the interrater reliability between experts and nonexperts was critical to attaining this goal. Nonexpert raters (N = 7) used the handheld tools to rate pre- and postintervention transfer events concurrently with the expert raters in the simulation lab. These nonexperts had varied backgrounds, including nurse anesthesia, critical care nursing, health care finance, and health care administration. None had a background in ergonomics or body mechanics. The nonexpert raters were trained by ergonomic experts before the simulation intervention in how to use the transfer protocol, which had been programmed into the HP iPAQ handheld computers. The training included a 1-hour review of the patient transfer protocol and operational definitions for each protocol step (Table 2). Nonexperts then went to clinical units and were supervised for 4 hours of observing and rating actual patient transfers, again under the supervision of the ergonomic experts. The operational definitions were laminated on 4-by-6-inch (10-by-15-cm) cards and given to each rater for reference during patient transfer observation and rating.
Table 2. Patient Transfer Protocol Steps With Operational Definitions
| Patient Transfer Protocol Step | Operational Definitions |
|---|---|
| Identify patient & need for move. | Completed: ID the need for a specific move. ID the patient by name and verify 2 discrete patient identifiers per NPSGs Did not complete: Did not ID need for a specific move. Patient ID is not completed using 2 discrete identifiers. |
| Assess patient. | Completed: Patient condition, assist level and pain level are assessed (0-10) Did not complete: Condition, assist level, and pain level are NOT assessed. |
| Enlist help. | Completed: Enlists appropriate number of personnel given patient weight, ability to assist, and transfer device being used. Did not complete: Number of personnel recruited is not appropriate given patient weight, ability to assist, or device used. |
| Gather equipment. | Completed: Appropriate equipment is obtained (friction reducing device, chair, gurney or lift device). Did not complete: Required transfer equipment or devices are not assembled and positioned for impending move. |
| Prepare the environment. | Completed: Prepared environment by setting bed to appropriate height; lowering handrails; locking bed, gurney, or wheelchair wheels; moving room furnishings out of way; securing lines, removing arm and leg supports. Did not complete: Any of the following factors are not completed: setting bed to appropriate height; lowering handrails; locking bed, gurney, or wheelchair wheels; moving room furnishings out of way; securing lines; removing arm and leg supports. |
| Communicate with the patient. | Completed: Communicated with patient, informed patient of move, enlisted patient assistance if possible. Communicated the need for the move and all events about to occur. Did not complete: Patient is not fully informed of move requirement and timing. Patient help is not enlisted. |
| Communicate with personnel. | Completed: Informed personnel assisting with transfer of type and need for move. Gave appropriate instructions in coordinating the transfer (“Transfer on 3; 1, 2, 3”) Did not complete: Personnel are not informed of transfer type or instructions given are unclear/sketchy. |
| Perform move. | Completed: Correctly transferred patient abiding by 5 principles of body mechanics and correct use of lift devices. Did not complete Failed to adhere to correct body mechanics, correct use of lift device |
| Reassess patient. | Completed: Assessed patient comfort/pain levels (0–10) after transfer—evaluated for changes. Did not complete: Any element of patient reassessment is not completed posttransfer. |
| Reset the environment. | Completed: Returned all equipment (tray table, call bell, etc.), repositioned equipment and lines in room, reset room to condition prior to transfer, returned lift device to designated storage area, returned arm rests/leg holders to position. Did not complete: Patient equipment left out of position, room condition not reset, lift device not returned to designated storage area, arm and leg support devices not returned to position. |
Statistical Methods
The transfer team was the unit of analysis. Each group performed four scenario-based simulated transfers, two preintervention and two postintervention. Ergonomic expert raters scored each transfer according to the patient transfer protocol. Each task step of the protocol was rated as either completed or not completed for each group transfer. The operational definitions were used to help raters determine the completion status of each protocol step (Table 2). The two preintervention transfer ratings and the two postintervention transfer ratings were averaged for analysis. This average score for each team was compared using a paired samples t test (SPSS 15.0). The level of statistical significance was set a priori at α ≤ .05.
Interrater reliability was calculated as follows: Expert ratings were compared with nonexpert ratings during simulated transfer events. The expert data were entered into the SimMan platform, and the nonexpert data were entered into the HP iPAQ handheld units. Each move was named according to a specific naming protocol in order to eliminate misidentification. Expert and nonexpert ratings were compared for agreement. All patient transfer protocol steps were rated as either correct or incorrect according to the operational guidelines. The Cohen's kappa statistic, which assesses agreement of categorical data, was calculated for each patient transfer protocol step.
Results
Patient Transfer Protocol
As described, an optimum task set or protocol for doing patient transfers was developed using the hierarchical task analysis method (Table 2). This protocol was then used for programming the Laerdal SimMan software platform as well as the handheld HP iPAQ data collection units. The iterative process of expert panel analysis, live clinical observation, and ongoing redescription of transfer steps facilitated final description of a detailed patient transfer protocol map with operational definitions for each step.
Improvement in Patient Transfer
The 71 nurses and nurse aides were divided into 19 teams of 3 to 4 people each. The members of each transfer team remained consistent for all four moves. Ergonomic experts performed the rating of the transfer events. The overall rating, or score, for each team transfer event was calculated as the number of steps rated completed, divided by the total number of steps. Patient transfer protocol success increased significantly from pre- to postintervention for every team and for every protocol step (n = 10). Mean pre- to postintervention improvement by team was 52% ± 15 (range 10%–75%), with mean improvement by protocol step increasing an average of 51% ± 18 (range 11%–76%). The greatest pre- to postintervention positive change occurred in Step 1, Identifying the Patient and Move Requirement (76% positive change). The smallest pre- to postintervention positive change occurred in Step 4, Gather Equipment (11% positive change; Figure 4).
Each of the 19 teams completed two moves preintervention (Pre1, Pre2, n = 38) and two moves postintervention (Post1, Post2, n = 36). Two postintervention expert patient transfer observations were lost because of computer data storage error. As stated, preintervention and postintervention ratings were averaged for each team (Table 3). The average for the ratings of the two preintervention transfers across all 19 teams was 34% ± 12. The average for the ratings of the two postintervention transfers for the 19 teams was 86% ± 10. The improvement from pre- to postintervention was highly significant (t18 = 14.76, p < .0004; Table 3, view online extra Figure 5 at www.nursingsimulation.org).
Table 3. Pre- Versus Postintervention Success: Patient Transfer Protocol Ratings by Ergonomic Experts
| Statistic | Pre1 Rating (%) | Pre2 Rating (%) | Post1 Rating (%) | Post2 Rating (%) | Mean Pre Rating (%) | Mean Post Rating (%) | Δ (%) |
|---|---|---|---|---|---|---|---|
| M | 29 | 39 | 90 | 83 | 34 | 86 | 52 |
| Median | 20 | 40 | 90 | 90 | 30 | 90 | 55 |
| SD | 19 | 15 | 12 | 17 | 12 | 10 | 15 |
| Max | 70 | 80 | 100 | 100 | 61 | 100 | 75 |
| Min | 10 | 20 | 56 | 30 | 15 | 60 | 10 |
Interrater Reliability
The rating of simulated patient transfers was conducted concurrently by experts and nonexperts. Each transfer step within the protocol was rated as completed or not completed according to the operational definitions. For 24 of the 74 recorded transfers, two nonexperts were rating the event at the same time as the expert rater. This resulted in 98 matched transfer event ratings (expert vs. nonexpert). The measure of agreement used was the Cohen's kappa statistic. Kappa values were calculated for each step of the protocol and ranged from 0.43 to 0.83 (Table 4; Landis & Koch, 1977). The lowest kappa scores were for Step 5, Prepare the Environment, and Step 6, Communicate to the Patient, indicating a moderate level of agreement between experts and nonexperts for these steps. The highest kappa scores were seen with Step 3, Enlist Appropriate Number of Personnel, and Step 1, Identify the Patient and Move Requirement, indicating substantial to near perfect agreement between experts and nonexperts for these steps.
Table 4. Interrater Reliability for Patient Transfer Protocol by Step
| Patient Transfer Protocol Step | Kappa Value | Interpretation (Landis & Koch, 1977) | |
|---|---|---|---|
| 1 | Identify the patient and move requirement. | 0.83 | Almost perfect |
| 2 | Assess patient condition & pain level. | 0.58 | Moderate |
| 3 | Enlist appropriate number of personnel. | 0.78 | Substantial |
| 4 | Gather appropriate equipment. | 0.59 | Moderate |
| 5 | Prepare environment. | 0.45 | Moderate |
| 6 | Communicate with patient. | 0.43 | Moderate |
| 7 | Communicate with personnel. | 0.59 | Moderate |
| 8 | Perform the patient transfer. | 0.67 | Substantial |
| 9 | Reassess patient pain level and condition. | 0.62 | Substantial |
| 10 | Reset the environment. | 0.63 | Substantial |
Development of Data Collection Tools
The patient transfer protocol programmed into the Laerdal SimMan software system facilitated scoring of each team's performance. This system also supported ergonomic experts in conducting a structured and evidence supported debriefing through use of the SimMan Debriefing Viewer Program. This program generated an accurate record of events, or log file. The SimMan log file display included the ergonomic expert's rating (correct or incorrect) of each transfer step and displayed the evidence-based rationale for each transfer step. Concurrently, the HP iPAQ handheld computers programmed with the patient transfer protocol were used by nonexperts to rate team performance during the transfer events. These programmed handheld devices provided a consistent, mobile assessment tool designed for “live,” unobtrusive scoring of transfer events.
Discussion
The simulation intervention resulted in improvement in patient transfer skill for each team of providers and for each step of the patient transfer protocol (Figures 4 and view online extra Figure 5 at www.nursingsimulation.org). Core components of the intervention included preintervention transfer practice, transfer event debriefing, Internet-supported didactic content and postintervention evaluations of transfer success. During debriefing, correct as well as incorrect performance of patient transfer protocol steps was reviewed with participants. The debriefing materials incorporated evidence-based rationale for each patient transfer protocol step. Ergonomic experts then encouraged correct performance through facilitated discussion and demonstration.
The project required development and parallel testing of the patient transfer protocol instrument programmed as a checklist into two unique data collection tools. The first tool was the Laerdal SimMan software, which was used by the experts in rating transfers. This tool was used to both gather data and provide immediate participant reinforcement of completed versus not completed patient transfer skills during debriefing. This approach allowed simultaneous use of input from three sources: expert rating, the event video, and the preprogrammed evidence-based rationale for each patient transfer protocol step. The second data collection tool was the HP iPAQ handheld computer used by nonexperts. Because of its mobility, it can be used to rate participant performance in a variety of settings, including both simulation laboratory and clinical arena.
When the ratings from the two tools were matched, Cohen's kappa statistics were calculated for each protocol step. The kappa values ranged from 0.43 to 0.83, indicating moderate to near perfect agreement between expert raters (ergonomists) and nonexpert raters (health care workers with a wide variety of clinical experiences). The terms moderate, substantial and near-perfect agreement in interpretation of the kappa statistics are based on the classic interpretation by Landis and Koch (1977).
A unique aspect of this project was the use of hierarchical task analysis. Hierarchical task analysis was chosen because it is highly flexible and can be used to analyze anything from an isolated procedure to team performance to the overall function of an entire system (Stanton, 2006). In finalizing the protocol, we adhered to guidelines outlined by Annett et al., 1971, Annett et al., 2000, Shepherd (1998), and Stanton (2006). They described important principles that govern use of the hierarchical task analysis process, which can be summarized as follows (Annett et al., 2000, Shepherd, 1998, Stanton, 2006):
The important relationship between tasks and subtasks is that subtasks are included within the overall task (a hierarchical relationship). Subtasks of main tasks are typically included in the task definition but do not have to be accomplished in a specific sequence in order to be rated as completed or performed correctly (Annett et al., 2000, Stanton, 2006). When hierarchical task analysis is used, guidelines should also be developed that describe temporal and order relationship between levels of description (e.g., x followed by y followed by z or x and y in any order, followed by z two minutes later; Stanton, 2006). Because hierarchical task analysis involves description and then redescription of a system or process in terms of its goals and subgoals, the procedure can go on for any number of iterations. One of the more difficult aspects is in establishing the detail level at which to stop the analysis, as there are no specific formulas or guidelines to determine a definitive endpoint (Annett et al., 1971, Stanton, 2006).
Hierarchical task analysis methods have a number of advantages when applied in this manner: They allow a flexible, robust approach for description of a complex task and provide a clear template for evaluation of each step required to complete the task. In the case of patient transfer, deconstructing a seemingly continuous event into discrete, measurable parts allowed analysis and evaluation of a common, yet complex, health care task. It is then possible for teams to rate performance of the optimal task set in the simulation environment. Another advantage of hierarchical task analysis is the emphasis that this rigorous method places on incorporating evidence-based practice into the development of each protocol step, thereby providing a clear theoretical or practice-based foundation for evaluation of performance and process. Measuring events in a clinical setting can be both difficult and labor intensive. Evaluation of measurement reliability by comparing scores by inexperienced scorers with those by experts is important in determining whether personnel with little experience in ergonomics can be trained to accurately code transfer events in real time. Because the hierarchical task analysis process and resultant operational guidelines identified and clearly defined steps for all raters in evaluation, inexperienced scorers were able to accurately score transfer events. The development and programming of the handheld HP iPAQ data collection tool with a user-friendly software interface resulted in a data collection platform that was flexible, portable, and unobtrusive.
A valid hierarchical task analysis process is dependent on accurate descriptions of goals and subgoals. Inadequate description can lead to measurement errors and false interpretation of results. As might be expected, there was not always complete concurrence within the development team in defining transfer steps. Ultimately, the patient transfer protocol steps were selected and operationally defined on the basis of published evidence, clinical observations, and expert opinion. Analysis of the success rate for each patient transfer protocol step was valuable in two respects. First, an increase in overall success from pre- to postintervention was an indicator of the overall effectiveness of the simulation training protocol derived from the hierarchical task analysis. Second, a consistent increase in success rate across every step of the patient transfer protocol served to validate that the overall hierarchical task analysis descriptive process was done correctly; otherwise, failure rates would be likely to remain high at one or more individual steps posttraining. The step that showed only an 11% improvement (Gather Equipment) demonstrated the imperfection of a simulation setting in duplicating clinical care because the patient transfer equipment was too readily accessible in the simulation lab. This is not the case in the clinical setting, and this step will be carefully analyzed during collection of patient transfer data in the clinical environment.
Our findings are the first to report systematic use of hierarchical task analysis methods, combined with simulation, to train providers in patient transfer, a task that is commonly perceived as requiring little skill. Simulation programs in health care education have traditionally been used in training of complex tasks required in the care of critically ill patients, such as airway management skills and, cardiopulmonary resuscitation. Its value in these settings has led to its widespread application by nurses in other settings (Alinier et al., 2006, Bremner et al., 2006, Hoffmann et al., 2007, Larew et al., 2006, Parr and Sweeney, 2006, Robertson, 2006), respiratory therapists (DeVita et al., 2005, Rodehorst et al., 2005, Tuttle et al., 2007), nurse anesthetists (Coopmans et al., 2008, Hotchkiss et al., 2002, O'Donnell et al., 1998, Oswaks, 2002, Sell et al., 2007), and students training in these fields.
Viewed through the lens of hierarchical task analysis, the task of transferring a patient is quite complex and, if not performed properly, has been directly implicated in both patient and provider injury (Edlich et al., 2005). By weaving hierarchical task analysis principles into the development of this training program, we were able to build an evidence-based patient transfer protocol and demonstrate an immediate postintervention improvement in simulated transfer performance. As such, this methodology would appear to have great value in teaching and evaluating other skills used in patient care.
Limitations
Several limitations were identified within the study. A convenience sample was used, with participants recruited from patient care units specializing in care of head and spinal cord injuries. Participants were randomized to date of training and to group assignment. Because participants were not familiar with the simulation setting, an orientation to the environment and to the manikin was conducted to minimize the impact of an unfamiliar environment on performance. Despite this orientation, participants appeared initially to be reluctant to interact with the manikin as they would with a human. This may have contributed to the low preintervention ratings on the steps of Patient Identification and Communicate to the Patient. Alternatively, this could reflect actual practice patterns as correct identification of patients is a consistent focus of the Joint Commission National Patient Safety Goals (Joint Commission, 2010). Finally, not all conditions in the clinical setting could be duplicated in the simulation lab (e.g., storage area for patient transfer equipment) although participants reported that the simulation scenarios were realistic and similar to their daily practice.
Conclusion
The use of hierarchical task analysis methodology supported achievement of study aims. Hierarchical task analysis can be used as a means of analyzing a specific health care intervention (patient transfer) with deconstruction of the process into distinct components. Through a multistep process based on methods described by Annett et al., 1971, Annett et al., 2000, Stanton, 2006, and Shepherd (1998), a patient transfer protocol was derived and validated. The validation process included achieving expert consensus, referencing steps to their evidence-based rationale, and performing structured clinical observations with ongoing feedback to the expert development panel for final refinement of the protocol. The patient transfer protocol was then used to formularte a simulation intervention incorporating online curricular support materials, simulated manikin transfers, and structured debriefing. Every participant team demonstrated pre-to-postintervention improvement in transfer skill. In addition, improvement occurred in every patient transfer protocol step.
The patient transfer protocol rating checklist was programmed into two data collection tools: the Laerdal SimMan software and the HP iPAQ PC. The use of two separate data collection tools proved valuable and efficient in generating interrater reliability statistics. Interrater reliability indicated substantial agreement between ratings of experts and nonexperts. It was important to evaluate the mobility and utility of the HP iPAQ PC tool during the simulation intervention. A mobile and effective tool is needed for clinical observations that will help to establish whether patient transfer skills learned in the simulation lab can be applied and measured in clinical practice.
Acknowledgments
This project was sponsored by funding from the U.S. Air Force, administered by the U.S. Army Medical Research Acquisition Activity, Ft. Detrick, Maryland (Award # DAMD 17-03-2-0017). Work was performed at the University of Pittsburgh Winter Institute for Simulation, Education and Research (WISER) and the University of Pittsburgh Medical Center Southside Hospital Institute for Research and Rehabilitation.
Supplementary Data
References
- Ackermann, A.D. (2007). Acquisition and retention of CPR knowledge and skills for junior level baccalaureate nursing students. Unpublished PhD thesis, Duquesne University, Pittsburgh, PA.
- . Hospital nurse staffing, education, and patient mortality. LDI Issue Brief. 2003;9(2):1–4
- . Effectiveness of intermediate-fidelity simulation training technology in undergraduate nursing education. Journal of Advanced Nursing. 2006;54(3):359–369
- American Association of Colleges of Nursing (2006). Nursing Shortage Fact Sheet. Retrieved November 14, 2006, from http://www.aacn.nche.edu/media/factsheets/nursingshortage.htm.
- . A method for measuring team skills. Ergonomics. 2000;43(8):1076–1094
- Annett, J., Duncan, K.D., Stammers, R.B., & Gray, M.J. (1971). Task Analysis (London: HMSO).
- . ANA launches back injury prevention campaign Handle With Care. Imprint. 2003;50(5):46–47
- . The history of simulation in medical education and possible future directions. Medical Education. 2006;40(3):254–262
- . The use of human patient simulators: Best practices with novice nursing students. Nurse Educator. 2006;31(4):170–174
- . The need to legislate the health-care industry in the state of Washington to protect health-care workers from back injury. Journal of Long-Term Effects of Medical Implants. 2005;15(5):567–572
- . More nursing, fewer deaths. Quality & Safety in Health Care. 2006;15(1):2–3
- . CRNA performance using a handheld, computerized, decision-making aid during critical events in a simulated environment: A methodologic inquiry. AANA Journal. 2008;76(1):29–35
- . Management of shoulder dystocia: Skill retention 6 and 12 months after training. Obstetrics & Gynecology. 2007;110(5):1069–1074
- . Actively preventing injury: Avoiding back injuries and other musculoskeletal disorders among nurses. American Journal of Nursing. 2004;104(1):104
- . Handle with care: The American Nurses Association's campaign to address work-related musculoskeletal disorders. Online Journal of Issues in Nursing. 2004;9(3):3
- . Prioritizing safe patient handling: The American Nurses Association's Handle With Care Campaign. Journal of Nursing Administration. 2006;36(7-8):363–369
- . Improving medical emergency team (MET) performance using a novel curriculum and a computerized human patient simulator. Quality & Safety in Health Care. 2005;14(5):326–331
- Devastating injuries in healthcare workers: Description of the crisis and legislative solution to the epidemic of back injury from patient lifting. Journal of Long-Term Effects of Medical Implants. 2005;15(2):225–241
- . Disabling back injuries in nursing personnel. Journal of Emergency Nursing. 2001;27(2):150–155
- . The effectiveness of back pain and injury prevention programs in the workplace. Work. 2003;20(3):257–266
- . Transfer of communication skills training from workshop to workplace: The impact of clinical supervision. Patient Education & Counseling. 2006;60(3):313–325
- . The effects of human patient simulators on basic knowledge in critical care nursing with undergraduate senior baccalaureate nursing students. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare. 2007;2(2):110–114
- Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training. Journal of Trauma-Injury Infection & Critical Care. 2002;52(6):1078–1085
- . Assessing the authenticity of the human simulation experience in anesthesiology. AANA Journal. 2002;70(6):470–473
- . Evaluation of nursing students' work technique after proficiency training in patient transfer methods during undergraduate education. Nurse Education Today. 2006;26(4):322–331
- Joint Commission. (2010). National Patient Safety Goals. Retrieved July 6, 2010, from http://www.jointcommission.org/PatientSafety/NationalPatientSafetyGoals/
- . Back injury prevention interventions in the workplace: An integrative review. AAOHN Journal. 1996;44(4):189–196
- . To err is human: Building a safer health system. Washington, DC: National Academy Press; 1999;
- . The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–174
- . Innovations in clinical simulation: Application of Benner's theory in an interactive patient care simulation. Nursing Education Perspectives. 2006;27(1):16–21
- . Validation of medical modeling and simulation training devices and systems. Studies in Health Technology & Informatics. 2003;94:196–198
- . Achieving house staff competence in emergency airway management: Results of a teaching program using a computerized patient simulator. Critical Care Medicine. 2004;32(12):2422–2427
- . Back injury prevention means education. Occupational Health & Safety. 1983;52(7):20–23
- . Effectiveness and cost-effectiveness of employer-issued back belts in areas of high risk for back injury. Journal of Occupational Medicine. 1994;36(1):90–94
- . Simulation technology: A comparison of experiential and visual learning for undergraduate medical students. Anesthesiology. 2002;96(1):10–16
- . Clinical skills in acute care: A role for simulation training. Critical Care Medicine. 2006;34(1):252–253
- . An acute care skills evaluation for graduating medical students: A pilot study using clinical simulation. Medical Education. 2002;36(9):833–841
- . The nursing shortage: Past, present, and future. Journal of Nursing Administration. 2002;32(2):79–84
- National Institute of Occupational Safety and Health (NIOSH). Safe Patient Handling and Movement Principles, NIOSH Docket #072. Retrieved July 6, 2010 from http://www.cdc.gov/niosh/review/public/safe-patient/
- Safe patient handling and movement. American Journal of Nursing. 2003;103(3):32–44
- . Human simulation training in the ICU: Applicability, value, and disadvantages. Critical Care Alert. 2005;13(6):41–48
- . Planning and implementing an anesthesia crisis resource management course for student nurse anesthetists. CRNA. 1998;9(2):50–58
- Oswaks, J.S.D. (2002). The use of simulated clinical experiences to improve competency in the novice anesthesia provider. Unpublished doctoral dissertation research, The University of Tennessee Center for the Health Sciences.
- . Use of human patient simulation in an undergraduate critical care course. Critical Care Nursing Quarterly. 2006;29(3):188–198
- . De morbis artificum Bernardini Ramazzini diatriba. Chicago: University of Chicago Press; 1940;Original work published 1713
- . An obstetric simulation experience in an undergraduate nursing curriculum. Nurse Educator. 2006;31(2):74–78
- . Use of interdisciplinary simulation to understand perceptions of team members' roles. Journal of Professional Nursing. 2005;21(3):159–166
- . The working hours of hospital staff nurses and patient safety. Health Affairs. 2004;23(4):202–212
- . Development of assessing generic and specific technical skills in laparoscopic surgery. American Journal of Surgery. 2006;191(2):238–244
- . Self-appraisal hierarchical task analysis of laparoscopic surgery performed by expert surgeons. Surgical Endoscopy. 2006;20(4):636–640
- . Evaluation of a problem based (PB) simulation module on graduate nurse anesthesia student learning and attitudes toward human simulation education. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare. 2007;1(1):63
- . HTA as a framework for task analysis. Ergonomics. 1998;41(11):1537–1552
- Sorenson, J.L. (2002). The use of simulated clinical experiences to improve competency in the novice anesthesia provider. Unpublished dissertation, The University of Tennessee Center for the Health Sciences.
- . Hierarchical task analysis: Developments, applications, and extensions. Applied Ergonomics. 2006;37(1):55–79
- Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Critical Care Medicine. 2006;34(1):151–157
- . Low back injury prevention training requires traditional, new methods. Occupational Health & Safety. 1987;56(9):44
- . Workplace prevention and musculoskeletal injuries in nurses. Journal of Nursing Administration. 2003;33(3):153–158
- Utilizing simulation technology for competency skills assessment and a comparison of traditional methods of training to simulation-based training. Respiratory Care. 2007;52(3):263–270
- . Projections and trends in RN supply: What do they tell us about the nursing shortage?. Policy, Politics, & Nursing Practice. 2005;6(3):171–182
- U.S. Department of Labor. (2007a). Occupational outlook handbook: Registered nurses. Retrieved March 3, 2007, from http://www.bls.gov/oco/ocos083.htm
- U.S. Department of Labor. (2007b). Nonfatal occupational injuries and illnesses requiring days away from work, 2006. Retrieved March 3, 2007, from http://www.bls.gov/iif/oshwc/osh/case/osnr0029.pdf
- . Back injury prevention among nursing personnel: The role of education. AAOHN Journal. 1988;36(8):327–333
- . A prospective study of back belts for prevention of back pain and injury [see comment]. JAMA. 2000;284(21):2727–2732
- A longitudinal study of internal medicine residents' retention of advanced cardiac life support skills. Academic Medicine. 2006;81(10 Suppl):S9–S12
- . Inactive nurses: A source for alleviating the nursing shortage?. Journal of Nursing Administration. 2006;36(4):205–210
- A randomized controlled trial to prevent patient lift and transfer injuries of health care workers. Spine. 2001;26(16):1739–1746
- Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology. 2005;103(2):241–248
PII: S1876-1399(10)00130-1
doi:10.1016/j.ecns.2010.05.003
© 2012 International Nursing Association for Clinical Simulation and Learning. Published by Elsevier Inc. All rights reserved.




