Final Descriptive Evaluation Report Tables Template for Healthy Marriage and Responsible Fatherhood Grantees
According to the Paperwork
Reduction Act of 1995, an
agency may not conduct or sponsor, and a person is not
required to respond
to, a collection of information unless it displays a valid OMB
control number. The valid OMB control number for this collection is
0970-0356; this number is valid through 6/30/2021. Public
reporting burden for this collection of information is estimated to
average 10 hours, including the time for reviewing instructions,
gathering and maintaining the data needed, reviewing the collection
of information, and revising it. This collection of information is
voluntary for individuals, but the information is required from
Grantees.
NOTE: In all tables and figures in this template, example information is included in italics. Please use as a guide and remove before completing tables/figures. Please use a regular font for information in the tables.
Table l.1. Description of intended intervention components and target populations
Component |
Curriculum and content |
Dosage and schedule |
Delivery |
Target Population |
Relationship skills workshops |
Healthy relationships curriculum: Understanding partner’s perspectives; avoiding destructive conflict; and communicating effectively |
20 hours, with 2-hour sessions occurring twice a week, or 4-hour sessions occurring every Saturday |
Group lessons provided at the intervention’s facilities by two trained facilitators in every session |
Low-income married couples |
Economic stability workshops |
Resume preparation; interview and communication skills; appropriate work attire; financial literacy |
Monthly 2-hour workshops |
Workshops are provided by one facilitator |
Individual members of the couple who need job search assistance |
Table I.2. Staff training and development to support intervention components
Component |
Education and initial training of staff |
Ongoing training of staff |
Relationship skills workshops |
Facilitators are male and female and hold at least a bachelor’s degree and received four days of initial training. |
Facilitators receive a half-day of semi-annual refresher training in the intervention’s curricula from study staff. |
Economic stability workshops |
Facilitators are male and female and hold at least a bachelor’s degree and received two days of initial training. |
Facilitators receive a half-day of semi-annual refresher training in the intervention’s curricula from study staff. |
Table II.1. Characteristics of participants in implementation/process study
|
Focus group participants |
Another sample used for the study -label here |
Age |
|
|
Female (%) |
|
|
Race/ethnicity (%) |
|
|
Hispanic |
|
|
Non-Hispanic White |
|
|
Non-Hispanic Black |
|
|
Non-Hispanic Asian |
|
|
Relationship status (%) |
|
|
Married or partnered |
|
|
Single |
|
|
|
|
|
Other important characteristics |
|
|
|
|
|
|
|
|
|
|
|
Sample size |
|
|
Source: [Insert]
Notes: [Define any variables that are constructed or need a definition for clarity. Provide any other information needed to understand the table.]
Note: Please add columns for different samples used for different research questions in the process/implementation study. For example, one column could list characteristics of focus group participants; another could list characteristics of individuals responding to feedback surveys.
Table II.2. Data used to address process/implementation research questions
Implementation element |
Research question |
Data source |
Timing/frequency of data collection |
Party responsible for data collection |
Fidelity |
Were all intended intervention components offered and for the expected duration? |
Workshop sessions in nFORM |
All sessions delivered |
Intervention staff |
Fidelity |
What content did the clients receive? |
Fidelity tracking log or protocol; attendance logs; session observations |
Every session for fidelity tracking and attendance logs; two times a year for session observations |
Intervention staff for fidelity tracking and attendance logs; study staff for session observations |
Fidelity |
Who delivered services to clients? |
Staff applications; hiring records; training logs |
One time X months after start of implementation; annually |
Intervention staff |
Fidelity |
What were the unplanned adaptations to key intervention components? |
Adaptation request; work plan; 6-month progress report; annual progress report |
Annually; ad hoc |
Intervention staff; study staff |
Dosage |
How often did clients participate in the intervention on average? |
Workshop sessions and individual service contacts in nFORM; attendance logs |
All sessions delivered |
Intervention staff |
Quality |
What was the quality of staff–participant interactions? |
Observations of interaction quality, using protocol developed by study staff |
X percent of sessions selected at random for observation |
Study staff |
Engagement |
How engaged were clients in the intervention? |
Observations of engagement, possibly using an engagement assessment tool; ratings from facilitator fidelity logs; engagement ratings from participant satisfaction surveys |
Y percent of sessions selected at random for observation |
Study staff |
Context |
What other HM/RF programming was available to study participants? |
Interviews with staff from partnering agencies in the community; survey items on baseline and follow-up assessments; websites of other agencies in the community providing HM/RF programming |
Once a year; ad hoc |
Study staff |
Context |
What external events affected implementation? |
Interviews with community/county representatives; list of site/school closures |
Once a year; ad hoc |
Study staff |
Note: [Anything important to note about the information above]
Table II.3. Measures used to address process/implementation research questions
Implementation element |
Research question |
Measures |
Fidelity |
Were all intended intervention components offered and for the expected duration? |
|
Fidelity |
What content did the clients receive? |
|
Fidelity |
Who delivered services to clients? |
|
Fidelity |
What were the unplanned adaptations to key intervention components? |
|
Dosage |
How often did clients participate in the intervention on average? |
|
Quality |
What was the quality of staff–participant interactions? |
|
Engagement |
How engaged were clients in the intervention? |
|
Context |
What other HM/RF programming was available to study participants? |
|
Context |
What external events affected implementation? |
|
Notes: [Anything important to note about the information above]
Table III.1. Sources of data used to address outcomes study research questions
Data source |
Timing of data collection |
Mode of data collection |
Start and end date of data collection |
Intervention participants |
At the first workshop (1 month after enrollment) |
In-person online survey |
September 2016 through March 2019 |
Notes: [Anything important to note about the information above]
Table III.2. Outcomes study analytic sample
Number of individuals |
Number of individuals |
Number of couples (if applicable) |
Enrolled in the program |
|
|
Completed a baseline survey |
|
|
Completed post-program survey (accounts for item non-response and any other analysis restrictions) |
|
|
Attrition rate (%) |
|
|
Completed [another follow-up] survey (accounts for item non-response and any other analysis restrictions) |
|
|
Attrition rate (%) |
|
|
Source: [Insert]
Notes: [Anything important to note about the information above]
Note: The last sample size row of this table should be the final analytic sample.
Table III.3. Characteristics of participants in the outcomes study at baseline
|
Average at baseline |
Another sample used for the study – if applicable (label here or delete this column) |
Age |
|
|
Female (%) |
|
|
Race/ethnicity (%) |
|
|
Hispanic |
|
|
Non-Hispanic White |
|
|
Non-Hispanic Black |
|
|
Non-Hispanic Asian |
|
|
Relationship status (%) |
|
|
Married or partnered |
|
|
Single |
|
|
Outcome measure 1 (range: 1 to 5) |
|
|
Outcome measure 2 |
|
|
|
|
|
|
|
|
Sample size |
|
|
Source: [Insert]
Notes: [Define any variables that are constructed or need a definition for clarity. Provide any other information needed to understand the table.]
NOTE: Include key characteristics such as income, education level, ex-offender status, or others relevant to your target population.
Table III.4. Outcome measures used to answer the outcomes study research questions
Outcome name |
Description of the outcome measure |
Source of the measure |
Timing of measure |
Marital status |
The outcome measure is a yes/no response taken directly from the question in the survey, “Are you currently married?” |
nFORM exit survey |
A post-test (immediately after the intervention ends) |
Level of affection |
The outcome measure is a scale (value range 1 to 5) calculated from both partners’ responses as the average of five survey items measuring support, intimacy, commitment, trust, and friendship.
Cronbach’s alpha:: [enter number] |
Local follow-up survey |
3 months after the intervention ends |
Table III.5. Sample table to demonstrate changes in outcome measures from baseline to follow-up
Outcome |
Sample size |
Mean outcome at baseline |
Mean outcome at follow-up |
Difference in means |
p-value of the difference |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
*Significantly different from zero at the .10 level, two-tailed [or one-tailed] test.
**Significantly different from zero at the .05 level, two-tailed [or one-tailed] test.
***Significantly different from zero at the .01 level, two-tailed [or one-tailed] test.
Source: [Insert]
Notes: [Anything important to note about the information above]
Note: this table can be adapted to show differences between subgroups, for example, those receiving weekend workshops and those receiving once per week workshops.
Table III.6. Sample table to show the probability of receiving a service for participants with different characteristics
|
(1) |
Characteristic 1 |
coefficient from regression |
|
(standard error of coefficient) |
Characteristic 2 |
coefficient from regression |
|
(standard error of coefficient) |
|
|
Sample size |
|
*Significantly different from zero at the .10 level, two-tailed [or one-tailed] test.
**Significantly different from zero at the .05 level, two-tailed [or one-tailed] test.
***Significantly different from zero at the .01 level, two-tailed [or one-tailed] test.
Source: [Insert]
Notes: [Anything important to note about the information above]
Appendix C: Example table templates to summarize additional outcomes study findings from quantitative analyses (if applicable)
Table C.1. Sample table to demonstrate changes in outcome measures from baseline to follow-up
Outcome |
Sample size |
Mean outcome at baseline |
Mean outcome at follow-up |
Difference in means |
p-value of the difference |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
*Significantly different from zero at the .10 level, two-tailed [or one-tailed] test.
**Significantly different from zero at the .05 level, two-tailed [or one-tailed] test.
***Significantly different from zero at the .01 level, two-tailed [or one-tailed] test.
Source: [Insert]
Notes: [Anything important to note about the information above]
Table C.2. Sample table to show the probability of receiving a service for participants with different characteristics
|
(1) |
Characteristic 1 |
coefficient from regression |
|
(standard error of coefficient) |
Characteristic 2 |
coefficient from regression |
|
(standard error of coefficient) |
|
|
Sample size |
|
*Significantly different from zero at the .10 level, two-tailed [or one-tailed] test.
**Significantly different from zero at the .05 level, two-tailed [or one-tailed] test.
***Significantly different from zero at the .01 level, two-tailed [or one-tailed] test.
Source: [Insert]
Notes: [Anything important to note about the information above]
Appendix D: Attrition Analyses
Table D.1. Summary statistics of key baseline measures and baseline differences for the analytic sample compared with enrollees who did not complete follow-up data collection, for individuals/couples [survey follow-up period]
Baseline measure |
Mean for the analytic sample (standard deviation) |
Mean for individuals (or couples) enrolled in the study but not in the analytic sample (standard deviation) |
Difference (p-value of difference) |
Female (%) |
|
|
|
Race/ethnicity (%) |
|
|
|
Hispanic |
|
|
|
Non-Hispanic White |
|
|
|
Non-Hispanic Black |
|
|
|
Non-Hispanic Asian |
|
|
|
Socioeconomic status |
|
|
|
Outcome measure 1 (range: 1 to 5) |
|
|
|
Outcome measure 2 |
|
|
|
Sample size |
|
|
|
Notes: p-values are included in parentheses. The analytic sample includes [note how you defined this group]. [Anything else important to note about the information above]
Reminder from instructions: Please present an equivalence table for each analytic sample being used to answer the primary research questions.
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | William Garrett |
File Modified | 0000-00-00 |
File Created | 2023-10-29 |