Instrument 1 - FaMLE Impact Report Template

Final Impact Evaluation Report Text Template

for Healthy Marriage and Responsible Fatherhood Grantees

According to the Paperwork Reduction Act of 1995, an agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a valid OMB control number. The valid OMB control number for this collection is 0970-0356; this number is valid through 6/30/2021.  Public reporting burden for this collection of information is estimated to average 30 hours, including the time for reviewing instructions, gathering and maintaining the data needed, reviewing the collection of information, and revising it. This collection of information is voluntary for individuals, but the information is required from Grantees.

[Feel free to add graphic or logo]

Impact Evaluation of
[Intervention Name] in
[Geographic Area]

Final Impact Evaluation Report for

[Grantee Organization]

[Date]

Prepared by

[Evaluation authors, and each author’s affiliation]

Recommended Citation:

[In this space, please specify the citation for this report.]

Acknowledgements:

[In this space, please list contributors to this evaluation report including reviewers and editors that you would like to acknowledge; feel free to acknowledge any persons critical in making the evaluation possible, the program implementation possible, etc.]

Disclosure:

[In this space, please disclose any conflict of interest, financial or otherwise]

This publication was prepared under Grant Number [Insert Grant Number] from the Office of Family Assistance (OFA) within the Administration for Children and Families (ACF), U. S. Department of Health & Human Services (HHS). The views expressed in this report are those of the authors and do not necessarily represent the views or policies of HHS, ACF, or OFA.

Structured Abstract: “The Evaluation of [Intervention Name] in [Geographic Area]”

Objective. [text here].

Study design. [text here].

Results. [text here].

Conclusion. [text here].

IMPACT Evaluation of [intervention name] in [geographic area]

I. Introduction

A. Introduction and study overview

[Copy and paste text/Start writing here.]

B. Primary research question(s)

[Copy and paste text/Start writing here.]

C. Secondary research question(s)

[Copy and paste text/Start writing here.]

II. Intervention and counterfactual conditions

[Provide an overview of the section here.]

A. Description of program as intended

[Copy and paste text/Start writing here.]

[Tables II.1 and II.2 here]

B. Description of counterfactual condition as intended

[Copy and paste text/Start writing here.]

C. Research Questions about the intervention and counterfactual conditions as implemented

[Copy and paste text/Start writing here.]

III. Study design

[Provide an overview of the section here.]

A. Sample formation and research design

[Copy and paste text/Start writing here.]

B. Data collection

[Copy and paste text/Start writing here.]

1. Implementation analysis

[Copy and paste text/Start writing here.]

2. Impact analysis

[Copy and paste text/Start writing here.]

IV. Analysis methods

A. Analytic sample

[Copy and paste text/Start writing here.]

[Tables IV.1a or IV.1b here.]

B. Outcome measures

[Copy and paste text/Start writing here.]

[Tables IV.2 and IV.3 here.]

C. Baseline equivalence and sample characteristics

[Copy and paste text/Start writing here.]

[Tables IV.4 here.]

V. Findings and Estimation Approach

A. Implementation evaluation

Key findings

[Insert text here]

[Copy and paste text/Start writing here.]

B. Primary impact evaluation

Key findings

[Insert text here]

[Copy and paste text/Start writing here.]

[Copy and paste Tables V.1 and V.2 here.]

C. Sensitivity analyses

Key findings

[Insert text here]

[Copy and paste text/Start writing here.]

[Tables V.3 here.]

D. Additional analyses (if applicable – if not, delete this section)

Key findings

[Insert text here]

[Copy and paste text/Start writing here.]

[Copy and paste Table V.4 here]

VI. Discussion

[Copy and paste text/Start writing here.]

VII. References

[Copy and paste text/Start writing here.]

VIII. Appendices

1. Logic Model (or Theory of Change) for the program

2. Data and Study Sample. First, provide details about data collection for the implementation study (see Table B.1 in the table shells document). Italicized text in the table are examples for expository purposes. The purpose of this table is to enable the reader to understand the data collected for the implementation analysis. Consider adding benchmarks for sufficient attendance or quality. Second, provide detailed descriptions of methods used to analyze the implementation data. Third, describe the data sources for the impact study (See Table B.2 in the templates document). Finally, include the final CONSORT diagram, which is referenced in Section IV.A of your report (see page 10 of the instructions document).

3. Attrition Rates and Baseline Equivalence of the RCT Design. For studies that were originally an RCT but had to construct equivalent groups using a QED, describe the original RCT design, attrition rates, and baseline equivalence (see Appendix C in the table templates document). For QEDs and RCTs that had to construct equivalent groups, please describe the approach to constructing equivalent groups in this appendix.

4. Data Preparation. Methods used to clean and prepare data (including descriptions of how missing and inconsistent data were handled)

5. Impact Estimation. Include model specifications (equations) used in the assessment of baseline equivalence and program impacts.

6. Sensitivity Analyses and Alternative Model Specifications

7. Additional Analyses. Include additional impact analyses, exploratory analyses, alternate approaches to missing data, subgroup and moderator analyses, mediated analyses.