Appendix C: SRAENE NWS Surveys Crosswalk and Research Questions

Attachment C

Research Questions, Sources, and Item Crosswalk

This page has been left blank for double-sided copying.

Table C.1. Nationwide Study Research Questions

Research Questions

RQ1: What are grant-recipients’ and providers’ experiences with delivering SRAE curricular content? What are youth’s experiences with receiving the SRAE curricular content?

RQ2: How did grant recipients and providers interpret, understand, and address the A to F topics in the SRAE legislation?

RQ3: Are some features of implementation more strongly associated with youth outcomes than others?

RQ4: What provider characteristics are associated with a greater number of youth served and youth outcomes?

Table C.2. Sources Used in Design of Grantee Surveys Key

Full Name of Source	Acronym
SRAENE Early Implementation Study (EIS) Grantee Survey	EIS
Cross-site Study Data for Improving Implementation Evaluation among Office of Population Affairs (OPA) Teen Pregnancy Prevention (TPP) Grantees to inform National Implementations (IMAGIN)	IMAGIN

Note: The survey instruments do not contain items from all sources reviewed during the design phase.

Table C.3. Survey Instrument Crosswalk and Sources

Survey question number G= grantee survey P=Provider survey F= Facilitator survey	Item Wording	Primary Research Question	Domain	Source
GA1 PA1 FA1	G: Which curricula are your sub-recipient providers delivering/have they delivered to youth this school year? P: Which curricula does your organization deliver/has delivered to youth this school year? F: Which curricula are you delivering/have you delivered to youth this school year?	RQ1	Curricula	EIS Grantee Survey A7
GA2 PA2 FA2	G: In which of the following setting(s) do your sub-recipient providers deliver/have delivered [CURRICULUM] to youth in this school year? P: In which of the following setting(s) does your organization deliver/has your organization delivered [CURRICULUM] to youth in this school year? F: In which of the following setting(s) do you deliver/have you delivered [CURRICULUM] to youth in this school year?	RQ3	Setting	EIS Grantee Survey F9
GA2a PA2a FA2a	G: ACF is interested in learning about implementation experiences in detention centers, foster care group homes, and institutional living settings for youth. We want to confirm that programming is delivered/has been delivered this school year in [FILL SELECTED 6,7,8 FROM A2], is that correct? P: ACF is interested in learning about implementation experiences in detention centers, foster care group homes, and institutional living settings for youth. We want to confirm that programming is delivered/has been delivered this school year in [FILL SELECTED 6,7,8 FROM A2], is that correct? F: ACF is interested in learning about implementation experiences in detention centers, foster care group homes, and institutional living settings for youth. We want to confirm that programming is delivered/has been delivered this school year in [FILL SELECTED 6,7,8 FROM A2], is that correct?	RQ3	Setting	New
GA2b PA2b FA2b	G: Which of these combinations of curriculum and setting serves the largest number of youth this school year? You reported that more than one curriculum was delivered to youth currently. Thinking only about youth served in [FILL A2 RESPONSE= 6, 7, OR 8], which curriculum serves the largest number of youth? You may also deliver programming in other settings, such as schools, but please answer only about your programming in [FILL SELECTED 6,7,8 FROM A2]. P: Which of these combinations of curriculum and setting serves the largest number of youth currently? [IF A2= ONLY ONE 6, 7, OR 8 SELECTED AND A1= MORE THAN 1 SELECTED:] You reported delivering more than one curriculum to youth. Thinking only about youth served in [FILL A2 RESPONSE= 6, 7, OR 8], which curriculum serves the largest number of youth? You may also deliver programming in other settings, such as schools, but please answer only about your programming in [FILL SELECTED 6,7,8 FROM A2]. F: Which of these combinations of curriculum and setting serves the largest number of youth currently? [IF A2= ONLY ONE 6, 7, OR 8 SELECTED AND A1= MORE THAN 1 SELECTED:] You reported delivering more than one curriculum to youth. Thinking only about youth served in [FILL A2 RESPONSE= 6, 7, OR 8], which these curriculum serves the largest number of youth? You may also deliver programming in other settings, such as schools, but please answer only about your programming in [FILL SELECTED 6,7,8 FROM A2].	RQ3	Setting	New
GA3 PA3 FA3	G: Considering all the curricula that are delivered by your sub-recipients and the settings those curricula are delivered in, select the combination of curriculum and setting that served the largest number of youth this school year. P: Considering all the curricula your organization delivers and the settings those curricula are delivered in, select the combination of curriculum and setting that serves the largest number of youth this school year. F: Considering all the curricula you deliver and the settings you deliver them in, select the combination of curriculum and setting that serves the largest number of youth this school year.	RQ3	Setting	New
GA4 PA4 FA4	G: What is the age range of the youth where [CURRICULUM] in [SETTING] has been delivered this school year? P: What is the age range of the youth your organization delivers [CURRICULUM] to in [SETTING] this school year? F: What is the age range of the youth you deliver [CURRICULUM] to in [SETTING] this school year?	RQ3	Setting	New
PA5 FA5	P: Based on your experiences working in [SETTING], which of the following issues are the most prevalent or of concern for the youth served in [SETTING]? F: Which of the following issues are most prevalent or of concern among the youth you serve in the [SETTING]?	RQ1	Receptivity of target population to curricular content	New
PA6 FA6	P: To what extent are the following topics covered as part of the [CURRICULUM] curriculum delivered in [SETTING]? F: To what extent are the following topics covered as part of the [CURRICULUM] curriculum delivered in [SETTING]?	RQ1	Curricula	New
PA7 FA7	P: Thinking about the youth you serve in [SETTING], how important do you think each of the following topics you cover in [CURRICULUM] is to a youth’s decision to delay sexual initiation? F: Thinking about the youth you serve in [SETTING], how important do you think each of the following topics you cover in [CURRICULUM] is to a youth’s decision to delay sexual initiation?	RQ1	Receptivity of facilitators to curricular content	New
PA8 FA8	P: Now, thinking about the topics that are not currently covered when [CURRICULUM] is taught at [SETTING], how important do you think it is for the youth you serve to learn about those topics? F: Now, thinking about the topics that you don’t currently cover when teaching [CURRICULUM] in [SETTING], how important do you think it is for the youth you serve to learn about those topics?	RQ1	Receptivity of facilitators to curricular content	New
PA9 FA12	P: Thinking about the specific topics covered when [CURRICULUM] is taught in [SETTING], how appropriate do you think they are to cover for different age groups? F: Thinking about the specific topics you cover when teaching [CURRICULUM] in [SETTING], how appropriate do you think they are to cover for different age groups?	RQ1	Receptivity of facilitators to curricular content	New
FA9	F: Overall, how engaged do you think students are with the content of [CURRICULUM] in [SETTING] this school year?	RQ1	Receptivity of target population to curricular content	New
FA10	F: Thinking about the specific topics you cover when teaching [CURRICULUM] in [SETTING], how engaged are youth with each of them?	RQ1	Receptivity of target population to curricular content	New
FA11	F: Based on your experience, why do you think youth were not as engaged in these topics? Please describe or select Next to move to the next question.	RQ1	Receptivity of target population to curricular content	New
PA10 FA13	P: How much do you agree or disagree that the content of [CURRICULUM] matches up with the needs of the following groups of youth? F: How much do you agree or disagree that the content of [CURRICULUM] matches up with the needs of the following groups of youth?	RQ1	Receptivity of target population to curricular content	New
PA10a	P: Please explain why you [strongly agree or disagree] that [CURRICULUM] matches up with the needs of youth [fill groups from A10 = strongly agree or strongly disagree].	RQ1	Receptivity of target population to curricular content	New
PA11 FA14	P: Are there any other groups of youth not mentioned whose needs are aligned well with the [CURRICULUM] curriculum? Please describe or select Next to move to the next question. F: Are there any other groups of youth not mentioned whose needs are aligned well with the [CURRICULUM] curriculum? Please describe or select Next to move to the next question.	RQ1	Receptivity of target population to curricular content	New
PA12 FA15	P: Are there any other groups of youth not mentioned whose needs are not well aligned with the [CURRICULUM] curriculum? Please describe or select Next to move to the next question. F: Are there any other groups of youth not mentioned whose needs are not well aligned with the [CURRICULUM] curriculum? Please describe or select Next to move to the next question.	RQ1	Receptivity of target population to curricular content	New
FA16	F: Do you use any of the following strategies to engage youth when delivering [CURRICULUM] at [SETTING]?	RQ3	Program content and activities	New
FA17	F: Is there anything else you do to get youth more involved when delivering [CURRICULUM] at [SETTING]? Please describe or select Next to move to the next question.	RQ3	Program content and activities	New
GD1	G: In your opinion, how supportive or unsupportive are parents and guardians of the SRAE curriculum youth receive?	RQ1	Receptivity of schools and communities to curricular content	New
GD2 PB1 FB1	G: In your opinion, how supportive or unsupportive are staff at your organization (the grantee level) of the SRAE curriculum youth receive? P: Thinking about offering [CURRICULUM] in [SETTING], how supportive are staff at the [SETTING] about the curriculum in general? By staff, we mean all staff who interact with the youth participating in the SRAE program that are not facilitating programming. This includes individuals such as school or site administrators, school teaching staff, afterschool staff, paraprofessionals, volunteers, counselors, caseworkers, faith-based staff, and program administrators. F: Thinking about offering [CURRICULUM] in [SETTING], how supportive are the staff at [SETTING] about the curriculum in general? By staff, we mean all staff who interact with the youth participating in the SRAE program that are not facilitating programming. This includes individuals such as school or site administrators, school teaching staff, afterschool staff, paraprofessionals, volunteers, counselors, caseworkers, faith-based staff, and program administrators.	RQ1	Receptivity of schools and communities to curricular content	New
PB2 FB2	P: Did any staff at [SETTING] express a need for any of the following topics? F: Did any staff at [SETTING] express a need for any of the following topics?	RQ1	Receptivity of schools and communities to curricular content	New
PB3 FB3	P: Did any staff in [SETTING] express concerns about teaching or covering any of the following topics? F: Did any staff in [SETTING] express concerns about you teaching or covering any of the following topics?	RQ1	Receptivity of schools and communities to curricular content	New
PB4 FB4	P: Please use the space below to share anything else about how supportive the [SETTING] is to offering the [CURRICULUM] curriculum. Please describe or select Next to move to the next question. F: Please use the space below to share anything else about how supportive the [SETTING] is to offering the [CURRICULUM] curriculum. Please describe or select Next to move to the next question.	RQ1	Receptivity of schools and communities to curricular content	New
GD3	G: In your opinion, how supportive or unsupportive is the broader community of the SRAE curriculum youth receive?	RQ1	Receptivity of schools and communities to curricular content	New
GD4 PD5	[STATE GRANTEES ONLY] Thinking about the system you use to submit performance measures data to FYSB, is that data system centralized within your state office? A centralized system means that all data are entered into a main, shared system by providers.	RQ1	Data Use and Capacity	New
GD5 PD6	[STATE GRANTEES ONLY] Are your subcontractors required to submit data other than performance measures?	RQ1	Data Use and Capacity	New
PD7	[PROVIDERS] Do you collect any other types of data besides the performance measures data.	RQ1	Data Use and Capacity	New
PD8	[PROVIDERS] Do you collect other data besides the performance measures for any of the following purposes?	RQ1	Data Use and Capacity	New
PD9	[PROVIDERS] You indicated you collect other data for the purposes of [FILL D8=1]. What type of data are being collected?	RQ1	Data Use and Capacity	New
PB5 FB5	P: To what extent have the parents or guardians of the youth that received [CURRICULUM] in [SETTING] communicated directly with your organization about the curricular content? This may include emailing or calling your organization. F: To what extent have the parents or guardians of the youth that received [CURRICULUM] in [SETTING] communicated directly with you about the curricular content? This may include emailing or calling you or talking with you in-person.	RQ1	Receptivity of schools and communities to curricular content	New
PB5a FB5a	P: Does your organization try to gather feedback about [CURRICULUM] in any way? F: Does your organization try to gather feedback about [CURRICULUM] in any way?	RQ1	Receptivity of schools and communities to curricular content	New
PB6 FB6	P: How many parents or guardians of the youth receiving [CURRICULUM] in [SETTING] have expressed concerns about any of the following topics being covered? F: How many parents or guardians of the youth receiving [CURRICULUM] in [SETTING] have expressed concerns about any of the following topics being covered?	RQ1	Receptivity of schools and communities to curricular content	New
PB7 FB7	P: How many parents or guardians of the youth receiving [CURRICULUM] in [SETTING] have expressed concerns about any of the following topics being covered? F: How many parents or guardians of the youth receiving [CURRICULUM] in [SETTING] have expressed concerns about any of the following topics being covered?	RQ1	Receptivity of schools and communities to curricular content	New
PB8 FB8	P: Is there anything else you would like to share about feedback you received on [CURRICULUM] from parents and guardians? Please describe or select Next to move to the next question. F: Is there anything else you would like to share about feedback you received on [CURRICULUM] from parents and guardians? Please describe or select Next to move to the next question.	RQ1	Receptivity of schools and communities to curricular content	IMAGIN Front Line Survey D9-D12 (Revised)
PB9	P: First, tell us whether you have provided any of the following events under your SRAE grant, in addition to delivering the curricula. Next, for events you provided, tell us about broader community support for each type of event.:	RQ1	Receptivity of schools and communities to curricular content	New
PB10	P: Which event types seem to be the most impactful?	RQ1	Receptivity of schools and communities to curricular content	New
PB11	P: Thinking about the most impactful [FILL FROM B10] event you organized, [IF ONLY 1 B9A_a_e=1 (only one event type provided)]: (W)/(w)hat was the primary purpose of that event?	RQ1	Receptivity of schools and communities to curricular content	New
PB12	[Still thinking about the most impactful [FILL FROM B10] event you organized]/[IF ONLY 1 B9A_1_e=1]: What was the general level of support in the community?	RQ1	Receptivity of schools and communities to curricular content	New
FC1	F: What is your job or your position?	RQ3	Facilitation	New
FC2	F: How long have you worked in this position?	RQ3	Facilitation	New
FC3	F: Before you started your current position, which of the following fields did you work in?	RQ3	Facilitation	New
FC4	F: What is the highest level of education you have completed?	RQ3	Facilitation	New
FC5	F: Do you currently have a professional license, certification, or credential related to the work you do with youth?	RQ3	Facilitation	New
FC6	F: How many total years of experience do you have teaching sexual education curriculum? Include all years teaching topics that include sexual risk avoidance, abstinence education, and contraception.	RQ3	Facilitation	New
FC7	F: How many years of experience do you have teaching only sexual risk avoidance curriculum?	RQ3	Facilitation	New
FC8	F: What are your experiences or connections with the community where you teach [CURRICULUM] in [SETTING]?	RQ3	Facilitation	New
FC9	F: Have you been observed while teaching [CURRICULUM] in [SETTING] this school year?	RQ3	Facilitation	New
FC10	F: How often were you observed this school year while teaching [CURRICULUM] in [SETTING]?	RQ3	Facilitation	New
FC11	F: Which of the following topics have you received training on?	RQ3	Facilitation	New
FC12	What other types of training do you think would be helpful to better perform your job? Please describe or select Next to move to the next question.	RQ3	Facilitation	New
GB1 PC1	G: Thinking back to your plans at the start of your [first] SRAE grant, have you made any of the following changes from what you had originally planned? P: Thinking back to your plans at the start of your [first] SRAE grant, has your organization made any of the following changes from what you had originally planned?	RQ1	Modifications to target population, setting, mode of delivery, and/or type of facilitator, and the reason for the modification (not COVID related) Modifications made to curricular content and why (not COVID related)	New
GB2 PC2	G: What changes were made to the target population? P: What changes were made to the target population?	RQ1	Modifications to target population, setting, mode of delivery, and/or type of facilitator, and the reason for the modification (not COVID related)	New
GB3 PC3	G: What changes were made to the dosage? P: What changes were made to the dosage?	RQ1	Modifications to target population, setting, mode of delivery, and/or type of facilitator, and the reason for the modification (not COVID related)	New
GB4 PC4	G: What changes were made to the setting? P: What changes were made to the setting?	RQ1	Modifications to target population, setting, mode of delivery, and/or type of facilitator, and the reason for the modification (not COVID related)	New
GB5 PC2	G: What changes were made to the types of facilitators? P: What changes were made to the types of facilitators?	RQ1	Modifications to target population, setting, mode of delivery, and/or type of facilitator, and the reason for the modification (not COVID related)	New
GB6 PC6	G: In what ways did the content change? P: In what ways did the content change?	RQ1	Modifications made to curricular content and why (not COVID related)	New
GB6a PC6a	G: What specific changes were made to the curricular content? P: What specific changes were made to the curricular content?	RQ1	Modifications made to curricular content and why (not COVID related)	New
GB6b PC6b	G: What were the reasons you made changes to the curricular content? P: What were the reasons you made changes to the curricular content?	RQ1	Modifications made to curricular content and why (not COVID related)	New
GB6c PC6c	G: Which of the following were influential in the content change? P: Which of the following were influential in the content change?	RQ1	Modifications made to curricular content and why (not COVID related)	New
GB7 PC7	G: Next, please provide information about the changes made to specific topics under each A-F content area. First, tell us which topics you have changed. Next, for each topic where content was changed, indicate if that change was due to a medical accuracy review. P: Next, please provide information about the changes made to specific topics under each A-F content area. First, tell us which topics you have changed. Next, for each topic where content was changed, indicate if that change was due	RQ1	Modifications made to curricular content and why (not COVID related)	New
GB8 PG8	Since the beginning of your grant, have you partnered with other entities for help with any of the following?	RQ1	Partners and Referrals Topics	New
GB9 PC9	Which of the following have occurred during the current SRAE grant period with regard to your partnerships?	RQ1	Partners and Referrals Topics	New
GB10 PC10	Indicate whether your organization has made any referrals for youth for any of the following reasons. For any type of referral made, please indicate the total number of youth referred for that reason in the 2022 fiscal year.	RQ1	Partners and Referrals Topics	New
GB11 PC11	G: How much flexibility do your sub-recipient providers have to propose program changes that go beyond the ones you made so they can meet local needs? P: How much flexibility do state sub-recipients have to propose program changes to meet local needs?	RQ1	Modifications made to curricular content and why (not COVID related)	New
GC1 PD1	G: Thinking back to the start of your [first SRAE] grant, and comparing that to now, has your program changed how it covers and emphasizes each of the A–F topics overall? Please note that these criteria are only requirements for Title V grantees. P: Thinking back to the start of your [first] SRAE grant, and comparing that to now, has your organization changed how it covers and emphasizes each of the A–F topics overall?	RQ2	Interpretation and understanding of A-F topics	New
GC2 PD2	G: You indicated you covered [LOOP: FILL C2-a-f IF=1 OR 3] with [less emphasis at the start of the grant compared to now/stronger emphasis at the start of the grant compared to now]. Why did the emphasis on that topic change? P: You indicated you covered [LOOP: FILL D1a-f IF=1 OR 3] with [less emphasis at the start of the grant compared to now/stronger emphasis at the start of the grant compared to now]. Why did the emphasis on that topic change?	RQ2	Interpretation and understanding of A-F topics	New
GC3 PD3	G: Thinking back to the start of your [first] SRAE grant to now, how much has your interpretation of the A–F topics changed over time? P: Thinking back to the start of your [first] SRAE grant to now, how much has your organization’s interpretation of the A–F topics changed over time?	RQ2	Interpretation and understanding of A-F topics	New
GC3a PD3a	G: You indicated there were some changes in how you interpreted the A–F topics. What is the reason for those changes? P: You indicated there were some changes in how you or your organization interpreted the A–F topics. What is the reason for those changes?	RQ2	Interpretation and understanding of A-F topics	New
GC3b PD3b	G: Did any of the following change due to changes in your interpretation of the A-F topics? P: Did any of the following change due to changes in your interpretation of the A-F topics?	RQ2	Interpretation and understanding of A-F topics	New
GC4 PD4	G: Thinking about the time period from the start of your SRAE grant to now, how useful have the following resources been for interpreting, understanding, or addressing the A–F topics? First, tell us whether you have used each of the following resources. Next, for each resource used, report the usefulness of that resource. P: Thinking about the time period from the start of your SRAE grant to now, how useful have the following resources been for interpreting, understanding, or addressing the A–F topics? First, tell us whether you have used each of the following resources. Next, for each resource used, report the usefulness of that resource.	RQ2	Interpretation and understanding of A-F topics	New
PE1	P: Please provide contact information for all SRAE program facilitators. We will be requesting their participation in a facilitator survey.	NA	Sample information	New