Supporting Statement A
Teen Pregnancy Prevention Performance Measures Collection for FY2023
OMB Control No. 0937-xxxx
May 2023
Office of Population Affairs
U.S. Department of Health and Human Services
1101 Wootton Parkway, Suite 200
Rockville, MD 20852
Contact Person: Tara Rice, tara.rice@hhs.gov, 240-453-8123
A. Justification
Circumstances Making the Collection of Information Necessary
The Office of Population Affairs (OPA) is requesting a new collection for performance measures data from TPP2023 Teen Pregnancy Prevention (TPP) Program grantees. OPA requests a three-year clearance.
The Teen Pregnancy Prevention (TPP) program is a national, evidence-based program that provides funding to implement effective programs and develop, test, and evaluate innovative approaches to prevent teen pregnancy across the United States. The TPP program was established in 2010 with a Congressional mandate to fund medically accurate and age-appropriate programs to reduce teen pregnancy. With an annual budget of approximately $101 million, the TPP program focuses on reaching populations with the greatest need with the goal of improving the health of adolescents and reducing unintended teen pregnancy and sexually transmitted infections (STIs). Funding for the TPP Program is authorized under the authority of Division A, Title II of the Further Consolidated Appropriations Act, 2020 (Public Law No. 116-94). See Attachment A for legislation.
In FY 2023, OPA anticipates awarding new 5-year cooperative agreements under three funding announcements (Exhibit 1).
TPP grantees work to replicate evidence-based teen pregnancy prevention programs in communities with the greatest need; increase capacity in communities to serve vulnerable youth, including homeless youth, parenting youth and those in juvenile detention and foster care; fill gaps in the knowledge of what works to prevent teen pregnancy; and test new, innovative approaches to combating teen pregnancy. OPA supports two types of grants through the TPP program (1) projects that replicate TPP program models that have been shown to be effective through rigorous evaluation (Tier 1) and (2) research and demonstration projects that develop and test additional models and innovative strategies to prevent teen pregnancy (Tier 2). Since its inception, the TPP program has served more than 1.5 million young people across 41 states, Washington D.C., Puerto Rico, and the Marshall Islands. In addition, the program has trained more than 23,500 professionals and established partnerships with more than 19,700 community-based organizations across the United States.
Performance measures have consistently been a requirement of the TPP grant program since its inception. Many of the measures that are included in this information collection request previously received OMB clearance (0990-0392 and 0990-0438) for the FY2010, FY2015, FY2018, FY2019, and FY2020 cohorts of TPP grantees; these measures have been successfully used over the past 12 years with the initial 5 cohorts of TPP grantees. The TPP2023 measures reflect changing priorities within the TPP program, such as increased emphasis on innovation.
Exhibit 1: TPP Projects to be Funded in FY 2023
New TPP Project Funding Opportunity in FY 2023 |
Anticipated Total Annual Funding |
Estimated # of Awards |
Estimated Annual Award Amount |
Rigorous Impact Evaluation |
Advancing
Equity in Adolescent Health through Evidence-Based Teen Pregnancy
Prevention Programs and Services |
$68.625 million |
70 |
$350,000 - $2,000,000 |
No |
Teen Pregnancy Prevention Tier 2 Rigorous Evaluation Cooperative Agreements |
$11.475 million |
16 |
$500,00 -$1,000,000 |
Yes |
Adolescent Sexual Health Innovation Network (Tier 2) |
$11.475 million |
10 |
$1,000,000 - $2,000,000 |
No |
Purpose and Use of Information Collection
The TPP program is authorized under Division A, Title II of the Further Consolidated Appropriations Act, 2020 (P.L. 116-84). The performance measure collection is critical to OPA because it provides the agency with data to both effectively manage the TPP program, and to comply with accountability and federal performance requirements described in the 1993 Government Performance and Results Act (P.L. 103-62) and updated in the 2010 GPRA Modernization Act (P.L. 111–352). See Attachment B for 2010 GPRA Modernization Act. Moreover, collecting and reporting on data for performance measures are funding requirements for the grants, as stated in the funding opportunity announcements.
A summary of the performance measures to be reported to OPA are summarized in Exhibit 2. The specific questions that grantees will answer to address these measures are found in the information collection forms.
Exhibit 2: Performance Measures for the FY2023 TPP Cohort
Measure |
Definition |
Data Source |
Participant characteristics and program locations |
|
|
Reach |
|
Grantee/Sub-awardee
Administrative
Records Section Data Tracker |
Dosage |
|
|
Mean attendance
Participants receiving 75% or more of the program |
|
Grantee/Sub-awardee
Administrative Records
Section Data Tracker
|
Fidelity and quality |
|
|
Fidelity
Observer-reported overall quality |
|
Administrative Records
Section Data Tracker
Fidelity Process Report Form
Program Quality Observation Form
|
Staffing and training |
|
|
Number of project staff trained
Number of trainings provided |
|
Grantee/Sub-awardee
Administrative Records
|
Partners and sites |
|
|
Number of formal partners |
The number of partners with formal written agreements at the start of the grant year and at the end of the grant year |
Grantee/Sub-awardee
Administrative Records
|
Dissemination |
|
|
Number of manuscripts |
The number of grantee-submitted manuscripts |
Grantee/Sub-awardee
Administrative Records
|
Number of blogs/online articles |
The number of blogs or online articles published about grantee’s program |
Grantee/Sub-awardee
Administrative Records
|
Number of presentations |
The number of presentations by the grantee at the national, state, local, or other level |
Grantee/Sub-awardee
Administrative Records
|
The data collection activities will provide information to OPA leadership and federal project officers to help them to more effectively manage the TPP program. We anticipate that the aggregate data will be made available to Congress (reach, dosage, training and partners), and the public at large (all measures) to assess program performance. Use of these data is vital for ensuring on-going improvement of the TPP program and through dissemination efforts, broader understanding and support of programs designed to prevent teen pregnancy.
3. Use of Improved Information Technology and Burden Reduction
Grantees will enter performance measure data into a multi-use, cloud-based reporting system, either by using point and click entry or uploading data files. See Attachment C for screenshots of the reporting system. The cloud-based system can reduce burden for respondents by programming specific items for each cohort of grantees, so that grantees only have to look at questions or upload data that are relevant for them. Programming automatically performs necessary calculations and validates responses. For point and click entry, a branching mode of presentation allows respondents to go directly to the sections they need, without having to go through the system in a linear progression. The system also produces a data set of measures across all grantees using relevant filters (e.g., for Tier 1 grantees only), which saves time on preparation of the data for analysis. Data are also available for grantees to export into Excel files to customize reports. OPA shall provide grantees with training and technical assistance on data submission, including webinars, a support desk for individual questions, and a written user’s manual.
4. Efforts to Identify Duplication and Use of Similar Information
The FY2023 TPP performance measures data collection will be the only data collection that will provide information on the performance of the TPP program for grantees funded in FY2023. Most of the performance measures are information that would be collected by grantees as part of their routine administrative records (e.g., numbers of publications, numbers of participants served, and attendance at program sessions). Please see Exhibit 2 for data sources for each performance measure.
OMB approved the majority of the measures in this collection previously, in OS 0990-0392, “Office of Adolescent Health and Administration for Children, Youth and Families Teen Pregnancy Prevention Performance Measure Collection” and OS 0990-0438 “FY2020 Performance Measures Teen Pregnancy Prevention Grantees.
SOGI measures have been included within the demographics items; these metrics are based on the measures approved for OPA’s FPAR 2.0 data collection for Title X Family Planning Grantees (0990-0479, Expires 9/30/2024).
5. Impact on Small Businesses or Other Small Entities
The only respondents are the TPP grantees; some small organizations may receive grants and therefore may collect this data. The information requested has been held to the absolute minimum required.
6. Consequences of Collecting the Information Less Frequently
GPRAMA requires that government agencies report on their performance measures annually. Therefore, it is essential that grantees report on these performance measures at least annually to OPA. In addition, collection and reporting of performance measure data is a requirement of all TPP grantees as stated in the Notice of Funding Opportunity (NOFO).
Since the inception of the TPP program, the program office has collected TPP performance measures semi-annually, and OMB has previously approved this frequency of data collection (OMB control numbers 0990-0392 and 0990-0438). OPA, to better monitor the complex TPP grant projects collects the data twice each year. The semi-annual data collection allows federal staff monitoring grants to provide data-driven feedback to grantees. In addition, the mid-year aggregate data allows staff to assess the performance of the grant program as a whole and to plan for technical assistance and training needs of grantees.
7. Special Circumstances Relating to the Guidelines of 5 CFR 1320.5
The Information Collection Request fully complies with regulation 5 CFR 1320.5.
8. Comments in Response to the Federal Register Notice/Outside Consultation
A 60-day notice was published in the Federal Register, Vol. 88, No. 49, page 15729, on Tuesday, March 14, 2023. No public comments were received.
In 2022, OPA consulted with staff of WRMA and Mathematica, which were the contractors responsible for helping develop the TPP performance measures data reporting system. Additional measures in FY2023 were developed in consultation with staff within OPA.
Most of the performance measures that are part of this clearance package have been successfully used during the past 10 years in previous TPP data collections for the Office of Adolescent Health and Administration for Children, Youth and Families Teen Pregnancy Prevention Performance Measure Collection. Those measures were developed by consulting with a panel consisting of experts in the fields of performance measurement, teen pregnancy prevention, and evidence-based practice, and ongoing feedback from grantees and federal project officers.
WRMA and Mathematica Contractors
Gila Shusterman, Director
WRMA, Inc., a TriMetrix Company
12300
Twinbrook Parkway, Suite 305
Rockville,
MD 20852
(301) 881-2590
x 623
Sunil Leelaram, Director
WRMA, Inc., a TriMetrix Company
12300
Twinbrook Parkway, Suite 305
Rockville,
MD 20852
(301) 881-2590
x 222
Imogen Fua, Senior Research Manager
WRMA, Inc., a TriMetrix Company
12300 Twinbrook Parkway, Suite 305
Rockville, MD 20852
301 881 2590 x 272
ifua@wrma.com
Kelly Kerstetter, Senior Business Analyst
WRMA, Inc., a TriMetrix Company
12300 Twinbrook Parkway, Suite 305
Rockville MD 20852
(301) 881-2590 x 439 kkerstetter@wrma.com
Zachary Eckstein, Research Manager
WRMA, Inc., a TriMetrix Company
12300
Twinbrook Parkway, Suite 305
Rockville,
MD 20852
(301) 881-2590
Lauren Murphy, Researcher
Mathematica
P.O. Box
2393
Princeton, NJ 08543-2393
Phone:
609-275-2201
lmurphy@mathematica.org
www.mathematica.org
Federal Staff
Jaclyn Ruiz, Office of Population Affairs
1101 Wootton Parkway, Suite 200
Rockville, MD 20852
Lizzy Laferriere, Office of Population Affairs
1101 Wootton Parkway, Suite 200
Rockville, MD 20852
9. Explanation of any Payment/Gift to Respondents
There are no payments to staff of grantee organizations completing the performance measure reporting forms.
10. Assurance of Confidentiality Provided to Respondents
Data will be kept private to the extent allowed by law. All participant performance measures data reported to OPA by grantees are de-identified and aggregated to the level of a section (group or cohort receiving programming together). No personal identifiers will be used in the reporting of any data to OPA.
The Web-based reporting system has been designed to ensure the security of the data obtained. Individual users designated by the grantees will be assigned user names and passwords, in addition to multifactor authentication methods, that will grant them access to the performance measures website. See Attachment F for screenshot of login page to system. There, users will have the opportunity to provide data that will be stored in a secure database (Microsoft Azure Government platform, FedRAMP approved, Authority to Operate (ATO) granted on May 21, 2020, renewal May 2023), utilizing a relational table structure, facilitating expedient data retrieval and analysis. The grant-specific data users submit on the performance measures website, will be accessible only to the grantee user, federal staff, and administrators assigned to this project. Screenshots are included in the supplemental materials.
The TPP performance measures have consistently been exempt from Institutional Review Board (IRB). OPA will submit the TPP2023 measures to IRB after OMB approves the collection and before data are collected.
11. Justification for Sensitive Questions
Grantees report on the demographics, such as race/ethnicity, gender identity, and sexual orientation of the program participants served. Collecting race and ethnicity is usual practice for HHS data collections. These data will be reported to OPA at the group level. No personal identifying information will be collected from individual participants. Additionally, individual program participants have the option not to give any information that they are uncomfortable sharing with the grantee.
12. Estimates of Annualized Hour and Cost Burden
The total annual burden is estimated to be 1431 hours for grantees to collect, summarize, and report the data for the performance measures (Exhibit 3). Estimates were based on data collection timing for similar measures collected from FY2015 and FY2020 TPP grantees, as the majority of items in this collection are either unchanged from the previous approved version or have minor changes.
Exhibit 3: Annualized Burden Hour Table
Forms (If necessary) |
Respondents (If necessary) |
Number of Respondents |
Number of Responses per Respondents |
Average Burden per Response |
Total Burden Hours |
TPP Tier 1 & Tier 2 Rigorous Impact grantees |
TPP Tier 1 & Tier 2 Rigorous Impact grantees |
86
|
2 |
8 |
1376 |
Supportive Services |
Tier 1 Grantees |
70 |
2 |
15/60 |
35 |
Tier 2 Innovation Network |
Tier 2 Innovation Network Grantees |
10 |
2 |
1 |
20 |
Total |
|
|
332 |
|
1,431
|
All data will be reported by the grantees and their implementing sub-awardees twice a year (see Exhibit 5 for schedule). Grantees will collect most of these data for their own administrative purposes and are expected have their own systems in place to track the data. Thus, the only additional burden to grantees for reporting the performance measures is the time it takes them to assemble the necessary data and enter it into the reporting forms. Respondents can either upload spreadsheets into the web-based system or enter the data directly into the system using a point and click method. The burden may be significantly less for grantees who manage their data using contractor-designed data collection tools. See Attachments for these data collection tools. There is no burden to program participants.
The estimated 1-year annualized cost to respondents is $42,930 as shown in Exhibit 4. Salaries of the grantee staff collecting data, entering data, and summarizing and reporting data may vary across agencies. In consultation with the Occupational Employment and Wages, May 2021 of the US Bureau of Labor Statistics, we estimate an average hourly rate of health education specialists at $30
Exhibit 4. Estimated 1-Year Annualized Cost to Respondents
Type of Respondent |
Total Burden Hours |
Hourly Wage Rate |
Total Respondent Costs |
Grantee staff (Health Education Specialists) |
1431 |
$30 |
$42,930 |
Total |
|
|
$42,930 |
13. Estimates of other Total Annual Cost Burden to Respondents or Record keepers/Capital Costs
There are no capital costs associated with this study.
14. Annualized Cost to Federal Government
The annual cost to the federal government is $550,000 per year. The cost includes the estimated cost of coordination with OPA, IRB and OMB applications, development of the data reporting system for the new cohort of grantees, on-going maintenance of the data reporting system, training and technical assistance to the grantees and federal staff in the use of the data reporting system, and data validation, analysis and reporting by the contractor staff.
15. Explanation for Program Changes or Adjustments
This is a new information collection.
16. Plans for Tabulation and Publication and Project Time Schedule
Data collection with the revised measures would begin as soon as OMB approval was granted. Assuming that OMB approval for this collection is granted by the fall of 2023, the FY 2023 cohort of TPP grantees will first collect and report data in Winter 2024. The anticipated schedule is included below (Exhibit 5); no data collection using the FY2023 revised measures would begin prior to OMB approval). The FY2023 grantee cohort will continue to collect and report data according to the anticipated schedule below until summer 2026 at the semi-annual reporting periods (30 days after each reporting period, anticipated to be January 31 and July 30). The performance measures contractor will then analyze the data and prepare a written report, summarizing findings. Data will be aggregated across all projects, as well as broken down by type of grantee (i.e., Tier 1, Tier 2 Rigorous Impact and Tier 2 Innovation Hubs). The annual reports would be published on the OPA website using aggregate-level data.
The anticipated schedule for these FY2023 grants assumes a July 2023 award date for all three TPP FOAs; this schedule may need to be adjusted if any grants are awarded later than July 2023.
Grant Year:
Reporting period:
6-month period #1: July 1 – December 31, Deadline: January 31
6-month period #2: January 1 – June 30; Deadline July 30
Exhibit 5: Anticipated Reporting Schedule for TPP FY2023 Performance Measures
Grant Year |
Semi-Annual Period |
Data Reported to OPA |
FY2023 (year 1) |
July 1 – December 31. 2023 |
January 31, 2024 |
|
January 1 – June 30, 2024 |
July 30, 2024 |
FY2024 (year 2) |
July 1 – December 31, 2024 |
January 31, 2025 |
|
January 1 – June 30, 2025 |
July 30, 2025 |
FY2025 (year 3) |
July 1 – December 31, 2025 |
January 31, 2026 |
|
January 1 – June 30, 2026 |
July 30, 2026 |
17. Reason(s) Display of Expiration Date is Inappropriate
The expiration date for OMB will be displayed on all data collection instruments.
18. Exceptions to Certification for Paperwork Reduction Act Submissions
There are no exceptions to the certification.
List of Attachments
Attachment A: Title II of the Further Consolidated Appropriations Act, 2020 (Public Law No. 116-94).
Attachment B: 2010 GPRA Modernization Act
Attachment C: Screenshots of reporting system
Attachment E: 60 Day Federal Notice
Attachment F: Screenshot of login and multifactor authentication pages
Attachment H: Program Quality Observation Form
Attachment I: Fidelity Process Report Form
Attachment J: Optional : Section Data Tool
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| File Title | Supporting Statement for |
| Author | wallace |
| File Modified | 0000-00-00 |
| File Created | 2025-05-19 |