SUPPORTING STATEMENT
Part B
TeamSTEPPS 2.0 Online Master Trainer Course
OMB CONTROL NO. 0935-0224
Version: April 6, 2017
Agency for Healthcare Research and Quality
Table of Contents
B. Collections of Information Employing Statistical Methods 3
1. Respondent Universe and Sampling Methods 3
2. Information Collection Procedures 3
The TeamSTEPPS 2.0 Online Post-Training Survey will be distributed to all individuals who have completed the TeamSTEPPS 2.0 Online Master Trainer program. It is anticipated that 3,000 participants will be trained during between 2014 and 2018. No sampling strategy will be employed, as the Agency for Healthcare Research and Quality (AHRQ) seeks to obtain feedback from everyone who has completed the program (i.e., a census survey). A 75 percent response rate or higher is anticipated based on the positive relationship established between AHRQ, the project team, and the training participants.
Some of the limitations of this study, which will also be noted in the final report, include the following:
Retrospective analysis of post-training experiences. This is not an empirical study; therefore, neither causality nor generalizability can be established;
Survey nonresponse, which can limit AHRQ’s understanding of the concerns and issues participants encountered when trying to apply TeamSTEPPS tools and concepts in their home organizations or organizations that they support; and
Inability to survey participants who have changed jobs since TeamSTEPPS 2.0 Online Master Training. The survey will be administered six months after training.
Despite the limitations in this study, the data collected via the survey will provide valuable information that will help refine the TeamSTEPPS 2.0 Online Master Training program. By understanding the factors that facilitate or inhibit the use of tools or the spread of knowledge, AHRQ will better understand the needs of preparing individuals to implement TeamSTEPPS in health care settings, and will be better prepared to address their future concerns, issues, and needs for improving patient safety.
The TeamSTEPPS 2.0 Online Post-Training Survey will be administered to all individuals who complete the TeamSTEPPS 2.0 Online Master Trainer program using the Web-based questionnaire included in Attachment A. The TeamSTEPPS 2.0 Online Post-Training Survey will be sent to all training participants via email. All correspondence to training participants is presented in Attachment B. These correspondences contain a hyperlink to enable easy access to the online questionnaire.
The TeamSTEPPS 2.0 Online Post-Training Survey will be administered six months after the completion of training. The survey will be accessible to training participants 24 hours a day, for a minimum of 30 days. On entrance into the questionnaire, respondents will view an introduction page that explains the questionnaire objectives and stresses the importance of participation. Respondents will be able to easily respond to the questionnaire items by clicking on precoded options for closed-ended items and typing in boxes for any open-ended items.
Reingold, Inc. (Reingold) is leading the TeamSTEPPS 2.0 Online Master Trainer program. Reingold’s subcontractor, IMPAQ International (IMPAQ), is leading this study. Completed responses to the questionnaires will be backed up daily onto IMPAQ’s dedicated data collection server. Data responses will be checked visually by researchers and analysts on a regular basis to assure that data are entered appropriately into the database.
Following data collection, training participant questionnaire responses will be compiled and assessed formally for data quality to produce a finalized database for statistical analyses. Incomplete response data poses a substantial threat to confident interpretation of the study results. The general approach to handling incomplete response data is to salvage as much data as possible using multiple techniques for examining patterns of missing data. Given the scope of the training participant questionnaire, IMPAQ will review questionnaire items with a substantial proportion of omitted responses. The precise cutoff percentage is typically chosen once the distribution of missing data has been established. It will be determined whether responses are missing in a manner that relates to other observable values. If data are determined to be missing in a manner that affects the interpretability of the responses, descriptive statistics and point estimates of relations among variables may be adjusted to account for missing data. This may be accomplished by using multiple imputation and full information maximum likelihood estimation techniques.
To effectively bolster the response rate, time-staggered notices of the opportunity to participate in the questionnaire will be sent via email. If at any point an invited respondent refuses to participate, he or she will not be contacted again through any means.
During the data collection period, invited respondents who have yet to respond to the training participant questionnaire will be contacted via email reminding them of the opportunity to participate and the importance of their feedback regarding the training program. The reminder notice sent via email will provide the hyperlink to access the questionnaire, the estimated time (in minutes) it will take to respond, the impending deadline for submission of their responses, and additional information regarding privacy of responses and confidentiality of personal information. The reminder notice is provided in Attachment B.
An additional, common method for gaining an acceptable response rate is to provide introductory information through advance notice from a known and respected source. For the purposes of this study, the Project Director, who will be in contact with the training participants throughout their online training, will distribute an email to all invited respondents to provide advance notice of the study and the importance of participation (see Attachment B).
A prior version of the TeamSTEPPS 2.0 Online Post-Training Survey was piloted. The pilot test involved: (1) a series of two to three cognitive laboratory interviews with AHRQ staff members and (2) a field test of the survey with a subsample of no more than nine potential respondents. The results were used to refine the questionnaire prior to field testing.
IMPAQ International, LLC will serve as the primary consultants for statistical aspects of the design and analysis of the Web-based questionnaire data. Dr. David P. Baker, Executive Vice President at IMPAQ, is the primary point of contact for statistical design and analyses. He can be reached at dbaker@impaqint.com or 443-259-5134.
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| File Title | SUPPORTING STATEMENT |
| Author | wcarroll |
| File Modified | 0000-00-00 |
| File Created | 2021-01-22 |