4 Appendix D: Post-test Evaluation Interview Protocol

Appendix D – Post-test Interview Protocol

Form Approved
OMB No. xxxx-xxxx
Exp. Date xx/xx/20

AHRQ – Building Diagnostic Safety Capacity – Calibration

Post-test Interview Protocol for Quality and Safety Personnel

MedStar Health Research Institute (MHRI) will conduct interviews of 20 clinicians during the pilot testing of the Diagnostic Safety Calibration Resource. The pilot test evaluation interviews will be conducted approximately 4-6 months after distribution of the resource and will include the same individuals who completed the pre-test interviews.

Interviews will be conducted virtually with individual participants. Each interview will last up to 60 minutes.

Recruitment Criteria

We will aim to recruit participants in the following manner:

• Clinicians (MD, DO, NP, PA) whose scope of practice includes diagnosis

• Diversity among clinicians (profession, specialty, academic affiliation) and their respective organizations (type, geographic location)

MHRI staff will work with the site coordinators to identify individuals to participate in the interviews.

Interview Goals

The goals of the interviews will be to:

• Obtain feedback on the resource materials

• Obtain feedback on the barriers and facilitators encountered for the resource

• Obtain feedback on satisfaction with the resource

• Obtain feedback on receptivity and enhancements to the resource to improve adoption

Materials

• Copies of the Diagnostic Safety Measurement Resource materials

• Informed consent documents

• Digital recorder

Location

Interviews will take place at the setting at a time convenient to the participants and may be conducted remotely via videoconference.

Informed Consent Procedures

Participants will complete the informed consent process prior to starting the interview.

Participant Stipends

None.

Each interview is expected to take no more than 60 minutes.

Public reporting burden for this collection of information is estimated to average 60 minutes per response, the estimated time required to complete the survey. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: AHRQ Reports Clearance Officer Attention: PRA, Paperwork Reduction Project (0935-0179) AHRQ, 5600 Fishers Lane, Mail Stop Number 07W41A, Rockville MD 20857

Form Approved
OMB No. xxxx-xxxx
Exp. Date xx/xx/20

AHRQ – Building Diagnostic Safety Capacity – Measurement

Post-test Interview Protocol for Quality and Safety Personnel

WELCOME AND INTRODUCTION

• Thank you for agreeing to speak with me once again!

• My name is [INSERT NAME OF INTERVIEWER] and I am here to facilitate this discussion about your experiences using the Diagnostic Safety Calibration Resource.

• TODAY/TONIGHT I will be asking you questions about your experiences with the overall Resource and any specific Resource materials you attempted to implement.

• With your permission we will also be audio recording the session. This will help make sure that I don’t miss anything that you say and can share with other people who are working on this project.

• Everything you say here will be kept confidential and included as part of our assessment of the feasibility of implementing the Resource and its materials into practice. We will not share your name or attribute any of your words directly to you.

• Do you have any questions before we begin? Ok, great. Let’s get started.

FEEDBACK ON EXPERIENCE WITH RESOURCE

1. When you first started using the Diagnostic Safety Calibration Resource on your own, what were your reactions?

   1. Did the materials seem useful? Were they easy to understand?

   2. Did you find the materials sufficiently comprehensive to guide you in using the tool?

      1. IF NO  What was missing? Are there any materials that were more helpful at this than others?

   3. Can you briefly tell me about how your experiences in using the Resource?

   4. What challenges did you encounter while using the Resource?

2. In total, about how many cases did you review while using the Resource?

   1. How did you find these cases and how did you decide to focus on the specific cases that you chose?

   2. Did you talk about using the Resource with your colleagues or anyone else? What were their reactions?

   3. How difficult was it to follow the instructions for using the Resource?

   4. Were there any times you had to stop because you were unable to follow the entire review process?

      1. IF YES  Can you tell me about that?

3. What about the format of the Resource and the resource materials? Is there a better way for us to think about presenting the materials?

   1. What about an electronic version? If you had this on a web site or app for a computer or mobile device would that help?

FEEDBACK ON YIELD OF INFORMATION FOR IMPROVING DIAGNOSTIC SAFETY

4. How did using the Resource help you to learn about your diagnostic process?

5. Were you surprised by anything that you learned?

6. Did you learn anything that led you to change how you approach similar cases in the future? Have you made any other changes in your practice as a result of using the Resource?

7. Did you learn anything that you shared with your colleagues or the organization where you practice?

8. Is there anything else you would like to share about your experiences with the materials? If not, let’s move on to learning more about your experiences with the resource overall.

IMPLEMENTATION POTENTIAL

9. What was the most helpful part of the Diagnostic Safety Calibration Resource?

10. What was your least favorite thing about the Resource?

11. What would you recommend changing about the Resource?

12. What about costs or challenges of implementing the Resource? Was that a difficulty at all for you?

1. Can you describe how much the time and/or effort it took to use the Resource?

2. Was this a barrier?

3. Are you planning on continuing to use the Resource in the future? Were there other materials within the Resource that you were more interested in or eager to adopt than others?

4. Do you believe that this is sustainable for your setting?

   1. IF YES  Can you describe what makes this approach important enough for you to continue using it?

   2. IF NO  Can you describe why you wouldn’t consider continuing to use it?

13. Do you have any tips or lessons learned from your experience with the Resource that you can share that might help another setting considering using it?

CLOSING

14. Those were all the questions I had today. Are there any questions that I should have asked that I did not?

15. Is there anything else you would like to add on any of the topics we discussed today?

Thank you for your time and participation in this interview. Your comments will be very helpful to this project!

Public reporting burden for this collection of information is estimated to average 60 minutes per response, the estimated time required to complete the survey. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to: AHRQ Reports Clearance Officer Attention: PRA, Paperwork Reduction Project (0935-0179) AHRQ, 5600 Fishers Lane, Mail Stop Number 07W41A, Rockville MD 20857

7