PACT Appendix K - Calculations for Burden 10-4-13

Parents and Children Together (PACT) Evaluation

APPENDIX K

CALCULATIONS FOR BURDEN REQUESTED

Fuller explanations of calculations for reporting burden for the data collection instruments included in this ICR are presented in this Appendix.

For cost calculations in all of the following tables, we estimate the average hourly wage for staff at the grantee organizations is the average hourly wage of “social and community service managers” taken from the U.S. Bureau of Labor Statistics, National Compensation Survey, 2010 ($27.86). The average hourly wage of program applicants is estimated from the average hourly earnings ($4.92) of study participants in the Building Strong Families Study (Wood et al. 2010). These average hourly earnings are lower than minimum wage because many study participants were not working. We expect that to also be the case for PACT study participants.

Previously Approved Burden

Tables 1, 2, and 3 summarizes burden and costs for previously approved instruments. The burden and costs for all these instruments are annualized over three years, meaning the total number of respondents over the three year period has been divided by three to determine the annual number of respondents.

Table 1. PREVIOUSLY APPROVED AND ONGOING – Estimates of Burden and Costs for the PACT Evaluation

Activity/Respondent	Annual Number of Respondentsa	Number of Responses per Respondent		Average Burden per Response (hours)	Total Annual Burden Hoursa	Average Hourly Wage	Total Annualized Cost
SITE SELECTION
(1) Selecting study grantees1 Discussions/ program and partner organization staff	50	1		1	50	$29.34	$1,467
IMPACT
Responsible Fatherhood Grantee Impact Evaluation
(2) Introductory script2
a) Program staff	30	70.2		0.167	351	$27.86	$9,779
b) Program applicants	2,105	1		0.167	351	$4.92	$1,726
(3) Baseline survey2
Study participants	2,000b	1		0.5	1,000	$4.92	$4,920
Healthy Marriage Grantee Impact Evaluation
(4) Introductory Script3
(a) Program Staff	30		70.2	0.167	351	$27.86	$9,779
(b) Program Applicants	4,210		1	0.167	703	$4.92	$3,454
(5) Baseline survey3
Study participants	4,000 c		1	0.5	2,000	$4.92	$9,840
Responsible Fatherhood Grantee Implementation Evaluation
(6) RF study MIS2
Program staff	30		2,533	0.03	2,533	$27.86	$70,569
Healthy Marriage Grantee Implementation Evaluation
(7) HM Study MIS3
Program staff	30		3,400	0.03333	3,400	$27.86	$94,724
Total					10,739		$206,258

^a Burden estimates are annualized over three years.

^b Note that the 2,000 “study participants” are part of the 2,105 “program applicants,” as the study participants will all begin as program applicants. (Five percent of program applicants are not expected to agree to participate in the study and complete the baseline survey, thus there are 5 percent more program applicants than study participants.) The 2,000 study participants do not represent 2,000 individuals in addition to the 2,105 program applicants.

^c Note that the 4,000 “study participants” are part of the 4,210 “program applicants,” as the study participants will all begin as program applicants. (Five percent of program applicants are not expected to agree to participate in the study, thus there are 5% more program applicants than study participants.) The 4,000 study participants do not represent 4,000 individuals in addition to the 4,210 program applicants.

¹ Approved April 20, 2012.

² Approved October 31, 2012.

³ Approved July 8, 2013.

Table 2. Estimates of Additional Burden and Costs for the Impact Portion of the PACT Evaluation

Instrument Respondent	Annual Number of Respondentsa	Number of Responses per Respondent	Average Burden per Response (hours)	Total Annual Burden Hoursa	Average Hourly Wage	Total Annualized Cost
IMPACT
Responsible Fatherhood and Healthy Marriage Grantee Implementation Evaluation – Additional Implementation Data Collection Instruments
(8) Semi-structured interview topic guide1
Program staff	250	2	1.033	517	$27.86		$14,404
(9) On-line survey1
Program staff	250	2	0.5	250	$27.86		$6,965
(10) Telephone interviews (with staff at referral organizations)1
Program staff at referral organizations	50	1	0.5	25	$27.86		$697
(11) On-line Working Alliance Inventory1
1) Program staff	50	20	0.167	167	$27.86		$4,653
2) Program Participants	1,000	1	0.167	167	$4.92		$822
(12) Focus group guide1
Program participants	600	1	1.5	900	$4.92		$4,428
(13) Telephone interviews1
Program participants (program dropouts)	150	1	0.25	38	$4.92		$187
Responsible Fatherhood Grantee Qualitative Evaluation
(14) Guide for in-person, in-depth interviews1
Study participants	32	3	2	192	$4.92		$945
(15) Check-in call guide1
Study participants	32	4	0.167	21	$4.92		$103
Total				2,277			$33,204

^a All burden estimates are annualized over three years.

¹ Approved August 27, 2013

Implementation Evaluation – Additional Implementation Data Collection Instruments (Responsible Fatherhood and Healthy Marriage Grantee Evaluation).

(8) Semi-structured interview topic guide (for program staff). We plan to visit up to 30 sites. In each site, we expect to interview up to 25 staff. Hence, in total, annualized over three years, there will be 250 respondents/year (30 sites x 25 staff ÷ 3 years = 250 staff/year). Grantee visits to conduct discussions with staff will occur twice over the three-year study period (once in the first year and once in the second). We expect each interview to last an average of 62 minutes. Hence, the annualized burden estimate for the staff interviews is 517 hours (250 staff/year x 2 visits x 62 minutes = 62,000 minutes/year; 620,000 minutes/year ÷ 60 minutes = 517 hours/year).

(9) On-line survey (for program staff). The staff survey will be administered to up to 25 program staff in each of up to 30 grantees, for a total annualized number of 250 respondents/year (30 sites x 25 staff ÷ 3 years = 250 staff/year). The survey will be administered twice. Each survey will last approximately 30 minutes, for a total annualized burden estimate of 250 hours (250 staff/year x 2 survey administrations x 30 minutes = 15,000 minutes/year; 15,000 minutes/year ÷ 60 minutes = 250 hours/year).

(10) Telephone interview guide (for program staff at referral organizations). Telephone interviews will occur with up to 5 referral organizations for each of up to 30 grantees for a total annualized number of 50 respondents (5 referral organizations x 30 grantees ÷ 3 years = 50 referral organizations/year). Each telephone interview will last approximately 30 minutes, for a total annualized burden estimate across the three study years of 25 hours (50 referral organizations/year x 30 minutes = 1,500 minutes/year; 1,500 minutes/year ÷ 60 minutes = 25 hours/year).

(11) On-line Working Alliance Inventory (for program staff and participants). We expect up to 5 case manager staff in each of up to 30 grantees will complete the inventory for a total annualized number of 50 staff (5 case manager staff x 30 grantees ÷ 3 years = 50 staff/year). We expect up to 100 participants will complete the inventory in each of up to 30 grantees for a total annualized number of 1,000 participant respondents (100 participants x 30 grantees ÷ 3 years = 1,000 participants/year). Each case manager staff will be expected to complete an inventory once for each of up to 20 participants. Each participant will complete the instrument once. It will require about 10 minutes per respondent to complete, for a total annualized burden of 167 hours for case manager staff (50 case manager staff/year x 20 participants x 10 minutes = 10,000 minutes/year; 10,000 minutes/year ÷ 60 minutes = 167 hours/year) and 167 hours for participants (1,000 participants/year x 1 case manager staff x 10 minutes = 10,000 minutes/year; 10,000 minutes/year ÷ 60 minutes = 167 hours/year).

(12) Focus group discussion guide (for program participants). In each of up to 30 sites, two focus groups will be conducted in each of the two rounds of site visits. We will recruit up to 15 participants for each focus group (no participant will attend multiple focus groups). Hence, we expect that there will be up to 1,800 participants in focus groups (30 sites x 15 participants x 2 focus groups x 2 rounds of site visits = 1,800 participants) or, annualized, 600 respondents/year (1,800 participants ÷ 3 years = 600 participants/year). We expect each focus group to last about 90 minutes. The annualized burden estimate for the focus groups is 900 hours (600 participants/year x 90 minutes = 54,000 minutes/year; 54,000 minutes/year ÷ 60 minutes = 900 hours/year).

(13) Telephone interview guide (for program dropouts). The telephone interviews with program dropouts are planned to occur in the second year, with 15 program dropouts in each of up to 30 grantees – for an annualized total of 150 program dropouts/year (15 program dropouts x 30 grantees ÷ 3 years = 150 program dropouts/year). We expect each telephone call to last 15 minutes, for an annualized burden estimate of 38 hours/year (150 program dropouts/year x 15 minutes = 2,250 minutes/year; 2,250 minutes/year ÷ 60 minutes = 38 hours/year).

Qualitative (Responsible Fatherhood Grantee Evaluation)

(14) In-person, in-depth interview guide (for program dropouts). We expect to interview approximately 95 fathers across the RF grantees for a total annualized number of 32 participants (95 participant fathers ÷ 3 years = 32 participants/year). Each father will be interviewed three times. Interviews with the respondents will each last approximately 2 hours. Hence, the total annualized burden will be 192 hours (32 participants/year x 3 interviews x 2 hours = 192 hours).

(15) Telephone check-in guide (for program participants). Following on the first and second (14) in-person, in-depth interviews, we expect to hold check-in calls with the same approximate 95 fathers across the RF grantees for a total annualized number of 32 participants (95 participant fathers ÷ 3 years = 32 participants/year). Twice between the first and second in-person interviews, and then twice again between the second and third interviews, a 10-minute check-in call will be made. Hence, the total annualized burden will be 21 hours/year (32 participants/year x 4 calls x 10 minutes = 1,280 minutes/year; 1.280 minutes/year ÷60 minutes = 21 hours).

Implementation/Qualitative Only Evaluation: Hispanic RF Sub-study

Table 3 summarizes burden and costs for newly requested instruments associated with the Hispanic RF implementation/qualitative only sub-study. The burden and costs for all these instruments are annualized over three years, meaning the total number of respondents over the three year period has been divided by three to determine the annual number of respondents.

Table 3. Estimates of Burden and Costs for the Hispanic RF Implementation/Qualitative Only Sub-study of the PACT Evaluation

Instrument Respondent	Annual Number of Respondentsa	Number of Responses per Respondent	Average Burden per Response (hours)	Total Annual Burden Hoursa	Average Hourly Wage	Total Annualized Cost
IMPLEMENTATION/QUALITATIVE ONLY
Responsible Fatherhood Grantee Implementation Evaluation – Grantees with a Focus on Hispanic Populations
(16) Semi-structured interview topic guide1
Program staff	42	1	1.5	63	$27.86		$1,755
(17) Focus group guide1
Program participants	20	1	1.5	30	$4.92		$248
(18) Questionnaires1
Program participants in focus groups	20	1	0.333	7	$4.92		$34
Total				100			$2,037

^a All burden estimates are annualized over three years.

¹ Approved August 27, 2013

(16) Semi-structured interview topic guide (for program staff). (This instrument differs from the (8) semi-structured interview topic guide in that it focuses heavily on program features related to Hispanic culture.) Individuals or small groups of staff will participate in each discussion, with a total of up to 25 staff in each of the 5 grantees for a total annualized number of 42 staff/year (25 staff x 5 grantees ÷ 3 years = 42 staff/year). We expect each discussion to last an average of 90 minutes. The annualized burden estimate for the semi-structured interviews is 63 (42 staff/year x 90 minutes = 3,780 minutes/year; 3,780 minutes/year ÷ 60 minutes = 63 hours/year).

(17) Focus group discussion guide (for program participants). One focus group with up to 12 participants will be conducted in each of the 5 sites, for an annualized total of 20 participants/year (12 participants x 5 sites ÷ 3 years = 20 participants/year). Each focus group will last up to 90 minutes. The total annualized burden for the focus groups is 30 hours/year (20 participants/year x 90 minutes = 1,800 minutes/year; 1,800 minutes/year ÷ 60 minutes = 30 hours).

(18) Questionnaires (for program participants). All the focus group participants will be asked to complete a questionnaire (as just discussed, there will be an annualized number of 20 participants/year). Questionnaires are estimated to take 20 minutes to complete. Hence, the total annualized burden for these questionnaires is 6.7 hours (20 participants/year x 20 minutes = 400 minutes/year; 400 minutes/year ÷ 60 minutes = 6.7 hours).

Current Request

Table 4 summarizes burden and costs for the two newly requested instruments associated with the impact study—the two follow-up surveys. The burden and costs for all these instruments are annualized over three years, meaning the total number of respondents over the three year period has been divided by three to determine the annual number of respondents and calculate annual burden estimates.

Table 4. CURRENT REQUEST – Estimates of Burden and Costs for the RF and HM Follow-up Surveys

Instrument Respondent	Annual Number of Respondentsa	Number of Responses per Respondent	Average Burden per Response (hours)	Total Annual Burden Hoursa	Average Hourly Wage	Total Annualized Cost
IMPACT
Responsible Fatherhood Grantee Evaluation
(19) RF Follow-up survey
Study participants	1,600	1	0.75	1,200	$4.92		$5,904
(20) HM Follow-up survey
Study participants	3,200	1	0.75	2,400	$4.92		$11,808
Total				3,600			$17,712

^a All burden estimates are annualized over three years.

(19) Follow-up Survey for Participants of RF Impact Study. Follow-up interviews will be attempted with all members of the RF impact study. As shown in Table 1, we anticipate 6,000 fathers to complete a baseline survey and hence be included in the study sample. Annualized over three years, interviews will be attempted with 2,000 men. We expect a response rate of 80 percent. Hence, interviews will be completed with 1,600 men (annualized over three years). We expect each interview to last an average of 45 minutes. Hence the total annualized burden estimate is 1,200 hours (1,600 interviews x 0.75).

(20) Follow-up Survey for Participants of HM Impact Study. Follow-up interviews will be attempted with all members of the HM impact study. As shown in Table 1, we anticipate 6,000 couples or 12,000 people to be included in the study sample. Annualized over three years, interviews will be attempted with 4,000 people. We expect a response rate of 80 percent. Hence, interviews will be completed with 3,200 people (annualized over three years). We expect each interview to last an average of 45 minutes. Hence the total annualized burden estimate is 2,400 hours (3,200 interviews x 0.75).

Combined Total Burden

Table 5 summarizes the total estimated reporting burden and costs for the previously approved and currently requested burden. If the current request is approved, 16,716 hours and $258,861 would be approved for the PACT study.

Table 5. Estimate of Burden and Cost for the PACT Evaluation – TOTAL Burden Request

Data Collection	Total Annual Burden Hoursa	Total Annualized Cost
Previously Approved and Ongoing	13,116	$241,149
Current Request – Impact Evaluation	3,600	$17,712
Total	16,716	$258,861

^a Burden estimates are annualized over three years.