Supporting Statement for OMB Clearance Request
Appendix J: HPOG-Impact 15-month Control Group Member Follow-Up Survey
National Implementation Evaluation of the Health Profession Opportunity Grants (HPOG) to Serve TANF Recipients and Other Low-Income Individuals and HPOG Impact Study
0970-0394
Submitted by:
Office of Planning,
Research & Evaluation
Administration for Children & Families
U.S. Department of
Health
and Human Services
Federal Project Officers:
Molly Irwin and Mary Mueggenborg
Appendix J: HPOG-Impact 15-month Control Group Member Follow-Up Survey
Introduction
Hello, my name is [ ]. May I please speak with _____?
Thank you for taking the time to talk with me today. I work for a company called Abt SRBI. Abt SRBI is an independent research company and we are helping the Administration for Children and Families (ACF) in the U.S. Department of Health and Human Services (HHS) with its evaluation of the Health Profession Opportunity Grants (HPOG) program. You agreed to be part of the study around [RAD] (when you signed a consent form to let researchers collect information from you).
We need to talk with people who got into the program and those who did not. Your participation in this study will help policymakers and program operators better understand how to help people attain educational credentials and find and keep jobs in the healthcare field. This interview will include questions on your education activities, your use of services, and your overall well-being.
The questions will take about 35 minutes to complete, and when we are done, you will receive $30, in appreciation for your time. Before we begin the survey, I would like to assure you that all of your responses on this survey will be kept private; your name will not appear in any written reports we produce. Your responses to these questions are completely voluntary. That means you may choose not to answer any question, or you may stop the interview if you wish, but we hope you don’t. Your responses to these questions will in no way affect your participation in any programs or your receipt of any kinds of public benefits or services. The information you provide will be kept private and only used for this study.
According to the Paperwork Reduction Act (PRA), an agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB control number for this collection is 0970-0394 and it expires xx/xx/xxxx. If you have comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, please send them to [Contact Name]; [Contact Address]; Attn: OMB-PRA (0970-0397).Do you have any questions before we begin?
Let’s begin now.
Screener/Verification:
First I just need to verify that I am speaking with the correct person.
What is your date of birth?
What are the last 4 digits of your Social Security Number?
Topic |
Source |
ISIS Item |
Notes on Coordination |
Type and amount of vocational and academic training and degrees/certification received since random assignment |
|||
Since [RAD], have you taken any classes or been in an instructional program of any kind anywhere, even for a short time? This may have been offered by a community organization, college, high school, employer, or somewhere else.
|
ISIS follow-up |
No change |
|
|
Adapted from ISIS follow-up |
Did you go to one school or organization, or did you go to more than one place?
(No change to answer choices) IF Yes: How many places did you go?
|
To make clear that the prior question’s classes are what we are asking about.
ISIS and HPOG coding will be compatible |
|
Adapted from ISIS follow-up |
What type of place is this? [Asked per vendor]
(No change to answer choices) |
We ask this question once in reference to individual’s entire experience since RAD. HPOG-Impact respondents will note all that apply. ISIS asks this question more than once in reference to each of up to three training vendors where individuals are currently enrolled or have been enrolled since RAD. In order to make the ISIS responses comparable to the non-location-specific version of the questions, for the subsequent questions about respondents’ experiences, we will aggregate across locations to identify simply whether or not an individual enrolled/participated in the particular education/ training/service under question. For example, if an ISIS respondent answers “Yes” to something about Location 1, “No” about Location 2 and “Don’t Know” about Location 3, we would code that as “Yes”: the respondent had that experience in at least one location. A “No,” “No,” “Don’t Know” set of responses would “sum” to “No.” |
|
Adapted from ISIS follow-up |
Now I’m going to mention some different types of instruction. For each one, please tell me if it is a type that you are taking or have taken at [PLACE 1] since [RAD]. I’m interested in any classes you have taken, even if you only went for a short time.
|
Exchanged “different types of instruction” for “different types of classes” which we think is more precise.
We ask this question once in reference to individual’s entire (non-location-specific) experience since RAD. ISIS asks this question more than once in reference to each training vendor. Will sum across ISIS location-specific responses (see note re: #3).
|
IF BASIC SKILLS |
|||
|
Adapted from ISIS follow-up |
Are you currently taking these classes (or between terms), did you complete them, or did you stop without completing the classes?
|
Modified questions to fit our overall (non-location-specific) experience format. We added the number of classes question because that is an outcome of interest. See note re: #3 on summing across locations.
|
|
Adapted from ISIS follow-up |
||
|
Adapted from ISIS follow-up |
||
IF ESL |
|||
|
Adapted from ISIS follow-up |
Are you currently taking these classes (or between terms), did you complete them, or did you stop without completing the classes?
|
Modified questions to fit our overall experience format. We added the number of classes question because that is an output of interest. See note re: #3 on summing across locations.
|
|
Adapted from ISIS follow-up |
||
|
Adapted from ISIS follow-up |
||
IF Other (school/work/life) Skills |
|||
______
|
Adapted from ISIS follow-up |
Now I’d like to ask about the classes you took in other skills, such as how to succeed at school, work, or other areas of life. Here I’m interested in any classes you took of this type, whether or not they were for college credit. How many other skills courses have you taken (including those you may not have completed) since [RAD]? ______
|
We originally adapted the ISIS text to include this question regarding the number of other classes because that is an output of interest. ISIS then added this new question to its follow-up survey for non-HPOG sites for consistency. Now both the HPOG and ISIS follow-up surveys include the new question. |
|
ISIS follow-up |
No change |
|
|
ISIS follow-up |
No change |
|
|
Adapted from ISIS follow-up |
ISIS does not ask for “other courses” |
|
|
Adapted from ISIS follow-up |
ISIS does not ask for “other courses” |
|
|
ISIS follow-up |
|
We ask this question once in reference to individual’s entire experience since RAD. ISIS asks this question more than once in reference to each training vendor. See note re: #3 on summing across locations. |
|
Adapted from ISIS follow-up |
I’m going to read a list of subjects that instruction like this sometimes covers. For each one, please tell me whether it received a great deal of attention, some attention, or no attention in the classes you took:
(No change in answer choices)
|
Exchanged “instruction” for “other skills classes” which we think is more precise.
|
IF REGULAR COLLEGE CREDIT |
|||
|
Adapted from ISIS follow-up |
Regardless of whether you finished them, about how many classes have you ever enrolled in at [PLACE 1] since [RAD]? |
See rationale and note re: #3 on summing across locations.
|
|
Adapted from ISIS follow-up |
Have you earned any regular college credits so far at [PLACE 1] since [RAD]? How many credits have you earned?
(No change to answer choices) |
See rationale and note re: #3 on summing across locations. |
|
Adapted from ISIS follow-up |
About when did you start going to [PLACE 1]? Please give me the month and year you started. [Asked per vendor] |
See rationale and note re: #3 on summing across locations. |
|
Adapted from ISIS follow-up |
Are you currently taking classes for college credit? (Answer “yes” if you are on a spring, summer, or holiday break.)
What [is/was] your main goal in taking college classes at [PLACE 1]?
Did you complete the courses needed to reach the goal you just mentioned? IF NO: Are you still enrolled or between terms? IF NO: Did you stop without completing the program?
IF STOPPED WITHOUT COMPLETING: What was the main reason that you stopped attending the classes? (No change in answer choices) |
Modified questions to fit our overall experience format. |
|
Adapted from ISIS follow-up |
||
IF OCCUPATIONAL TRAINING (not for college credit) |
|||
|
Adapted from ISIS follow-up |
ISIS does not ask for “occupational training” |
We added the number of classes question because that is an outcome of interest. |
|
Adapted from ISIS follow-up |
About when did you start going to [PLACE 1]? Please give me the month and year you started. [Asked per vendor] |
Modified questions to fit our overall experience format. |
|
Adapted from ISIS follow-up |
Are you currently receiving this training, did you complete the training, or did you stop without completing training?
CURRENTLY RECEIVING THIS TRAINING COMPLETED THE TRAINING STOPPED WITHOUT COMPLETING REFUSED DON’T KNOW
IF STOPPED WITHOUT COMPLETING: What was the main reason that you stopped attending the training? (No change in answer choices)
|
|
|
Adapted from ISIS follow-up |
||
Academic and industry-recognized credentials earned since random assignment |
|||
|
Adapted from ISIS follow-up |
Now I’m going to ask you questions about your overall training experience since [RAD]. [Are/were] you taking classes to prepare for work in a particular occupation? YES NO REFUSED DON’T KNOW
Is this occupation in the field of healthcare? YES NO REFUSED DON’T KNOW
I am going to read you a list of types of healthcare occupations. Please tell me which type you were preparing for when you took those classes: Administrative (such as Medical Records and Health Information Technicians) Technical (such as Medical and Clinical Laboratory Technicians) Direct personal care (such as Home Health Aids or Certified Nursing Assistants) Other, Please specify ________________ |
We ask this question once in reference to individual’s entire experience since RAD. ISIS asks this question for college credit courses.
We also originally adapted the ISIS text to include the healthcare specification to fit HPOG. ISIS then included this question in its survey for HPOG sites for consistency. Now both the HPOG and ISIS/HPOG follow-up surveys include the new healthcare question. |
|
Adapted from ISIS follow-up |
What [is/was] your main goal in taking college classes at [PLACE 1]? Would you say it [is/was](CHOOSE ONE): [Only asked for “college credit classes”]
Did you take/are you taking this training to prepare you to earn a certificate, license or credential? |
We ask this question once in reference to individual’s entire experience since RAD. ISIS asks separate questions for college credit courses and occupational training.
The ISIS college credit answer choices “To earn a certificate requiring less than a full year’s worth of credit,” “To earn a certificate requiring a full year or more’s worth of credit (but less than an Associate’s Degree)” and a “Yes” response to the ISIS occupational training question will be coded to equal our “To earn a certificate, license, or credential” answer. |
|
Adapted from ISIS follow-up |
[IF MAIN GOAL IN TAKING COLLEGE CLASSES WAS TO EARN A DIPLOMA/CERTIFICATE OR HIGHER]: What is the name of the diploma/certificate or degree you earned?
[IF RECEIVED/ EXPECT TO RECEIVE A DIPLOMA OR CERTIFICATE AFTER COMPLETE OCCUPATIONAL TRAINING: What is the name of the diploma/or certificate you earned?
|
We ask this question once in reference to individual’s entire experience since RAD. ISIS asks separate questions for regular college credit and occupational training.
|
|
ISIS follow-up |
What is the highest degree or level of education that you have completed?
|
|
Knowledge of/access to financial resources necessary for continued education |
|
|
|
|
Adapted from ISIS follow-up |
First, at [PLACE 1], have you needed to find outside money to help pay for some or all of the direct costs of education and training – that is, things like tuition and fees – or were these costs already handled for you? [Asked at the vendor level]
Change to answer choice: NEEDED TO FIND OUTSIDE MONEY |
Modified to clarify definition of “outside money.” See also note re: #3. |
|
Adapted from ISIS follow-up |
IF ‘NEEDED TO FIND OUTSIDE MONEY’: Now I’m going to read a list of sources of income that can help pay for either living expenses or direct school costs. For each, please let me know if it has helped to pay for either training or living expenses while you have attended [PLACE 1].
IF ‘COSTS ALREADY HANDLED’ ONLY ASK FOR LIVING EXPENSES: Now I’m going to read a list of sources of income that can help pay for living expenses. For each, please let me know if it has helped to pay for living expenses while you have attended [PLACE 1].
Next, did income from a spouse, parent or other family member help to pay for:
Did you receive a Pell Grant or other government grant or scholarship—not counting loans that you have to pay back—to help pay for:
Did you receive a grant or scholarship from any non-government source---not counting loans that you do not have to pay back—to help pay for:
Finally, did you receive any loans to help pay for:
|
Truncated ISIS question because we are only interested to know if individuals used outside money to pay for the direct and indirect costs of training as well as the type of outside money. We do not need to know the type of expense the outside money covered.
Also, we ask this question once in reference to individual’s entire experience since RAD. ISIS asks this question more than once in reference to each training vendor. See note re: #3.
A “Yes” response to at least one of the expense types for each ISIS outside income source question will be coded as a “Yes” response to our outside income source question. |
|
ISIS follow-up |
No change |
|
Type and amount of social services received since random assignment |
|
|
|
|
Adapted from ISIS follow-up |
While going to [PLACE 1] have you received SERVICE FROM BELOW] from any source? [WHERE YES: About how many times did you receive [SERVICE FROM BELOW]? [Asked at the vendor level]
|
We ask this question once in reference to individual’s entire experience since RAD. ISIS asks this question more than once in reference to each training vendor. See note re: #3.
We added additional services of interest. |
|
Adapted from ISIS follow-up |
While going to [PLACE 1], did you received help assistance from a program, school, or other organization to paying for:: [Asked per vendor]
(No changes to answer choices) |
We ask this question once in reference to individual’s entire experience since RAD. ISIS asks this question more than once in reference to each training vendor. See note re: #3. Otherwise, any revision to language was coordinated between HPOG & ISIS.
|
|
Adapted from ISIS follow-up |
While at [PLACE 1], have you been offered any of the following opportunities for direct experiences with occupations related to your studies or career goals? [Asked at the vendor level]
(No changes to answer choices) |
We ask this question once in reference to individual’s entire experience since RAD. ISIS asks this question more than once in reference to each training vendor. See note re: #3. |
|
Newly developed |
|
|
Aspirations/expectations re: education |
|
|
|
|
ISIS Follow-Up |
No change |
|
|
ISIS Follow-Up |
No change |
|
|
ISIS follow-up |
No change |
|
|
ISIS follow-up |
No change |
|
Healthcare and employment experience |
|||
|
Adapted from ISIS follow-up |
Are you currently working at a job for pay?
IF YES: How many hours per week on average are you currently working? (include all jobs)
Did you work before?
IF “YES” WORKING OR WORKED BEFORE: About how much do/did you typically earn per hour before taxes in your current or most recent job? (Answer for your main job if more than one)
IF “YES” WORKING OR WORKED BEFORE: At your current/last job, does/did your employer offer health insurance (regardless of whether you take/took it from them)?
IF YES INSURANCE: Did you receive insurance through your employer? IF NO: Did you receive insurance from another source? What kind of work [do you do/did you do in your last job], that is, what [is/was] your occupation?
What [is/was] your [current/most recent] job title? What [are/were] your usual activities or duties at this job? (For example, typing, keeping account books, filing, selling cars, operating printing press, taking blood samples) .ASK IF NOT OBVIOUS FROM E4: Is this occupation in the field of healthcare? YES NO REFUSED DON’T KNOW I am going to read you a list of types of healthcare occupations. Please tell me which type best describes your [current/most recent] job: Administrative (such as Medical Records and Health Information Technicians) Technical (such as Medical and Clinical Laboratory Technicians) Direct personal care (such as Home Health Aids or Certified Nursing Assistants) Other, Please specify: ________________ |
We originally adapted the ISIS text to include the healthcare-specific questions because these are outcomes of interest. ISIS then added these questions for non-HPOG sites for consistency. Now both the HPOG and ISIS surveys include the new healthcare specific questions.
|
Aspirations/expectations re: employment |
|
|
|
|
ISIS follow-up |
No change |
|
|
Supplemental Baseline |
|
|
How much do you agree that you:
|
Adapted from the U.S. Department of Labor’s Green Jobs-Health Care Evaluation |
|
|
|
Supplemental Baseline |
|
|
|
(from: http://nces.ed.gov/surveys/els2002/pdf/EarlyGrad_followup1.pdf - partial item)
|
|
|
Knowledge of career opportunities in healthcare |
|
|
|
|
Newly developed |
|
|
a. If yes, would you say you know the kind of careers that are available in healthcare in your local area?
|
|
|
|
|
Newly developed |
|
|
Barriers to employment |
|
|
|
|
Adapted from ISIS follow-up (and supplemental baseline) |
ISIS answer choices: Child care arrangements? Transportation? Alcohol or drug use? An illness or health condition? Spending time with friends? Argument with a family member? Physical threats/violence from a family member? |
We did not include several answer choices. A “Yes” response to these answer choices for ISIS will be coded to equal the “other” answer choice for our question in order to allow us to use data from both the ISIS and HPOG versions of the survey. |
|
Newly developed |
|
|
|
Newly developed |
|
|
Perceived self-efficacy and motivation |
|
|
|
|
Supplemental Baseline
|
|
|
Income, participant and total household |
|||
|
HPOG ISO, PRS baseline |
|
|
|
Adapted from HPOG ISO, PRS baseline |
|
Adaptation involves adding more income categories in order to capture greater distinctions above poverty (the maximum PRS category is “$35,000 or over,” and the U.S. median income is ~50K). The new categories mirror the PRS answer options for household income. There is no strict need for the categories to be the same. We will work with Abt SRBI to ensure that the format works well in pre-testing and may modify as needed.
|
|
HPOG ISO, PRS baseline |
|
|
|
Adapted from ISIS follow-up |
Besides you, which of the following live in your household at least half the time? (CHECK ALL THAT APPLY)
|
ISIS uses <=19 because in some states child support continues for 19-year-olds. This is not relevant to HPOG, especially in a distinction made about other individuals in the household. We would prefer to know whether there are other children/adults in the household and believe that using the conventional age-of-majority threshold is relevant. If we would choose to combine data from these two categories, we expect very minor measurement error. |
|
ISIS follow-up |
No change |
|
|
ISIS follow-up |
No change |
|
|
Adapted from ISIS follow-up |
How many persons aged 19 or younger live with you at least half the time? (Include biological, adopted, foster, step, and any other children.) |
See note re: #60. |
|
ISIS follow-up |
No change |
|
Benefit receipt (type and amount, participant and total household) |
|
|
|
|
Supplemental Baseline |
In [PRIOR MONTH], did you personally have income or benefits from any of the following sources? (For each yes, about how much was it per month?)
Was there any other source of income you received last month that we haven’t talked about?
What was that other income? |
We originally added this question to our survey and ISIS then added an adapted version of this question to its survey. We then modified our wording to match the ISIS version. |
|
Supplemental Baseline |
Now, let’s go through the same list of income sources for other household members who live with you in your household at least two nights a week last month. In [PRIOR MONTH], In the past month, did any of your other household members have income or benefits from any of the following sources? (For each yes, about how much was it per month?)
Was there any other source of income received by other people in your household that we haven’t talked about?
What was that other income? |
ISIS added this question. We modified our wording to match ISIS. |
[If No TANF in last month or since RAD]: Have you ever received TANF benefits?
|
Adapted from Green Jobs |
|
Will need to have Abt SRBI structure this for optimal flow. |
Contact Information |
|||
Your first name: Your last name: |
ISIS follow-up |
|
|
IF YES:
|
ISIS follow-up |
|
|
|
ISIS follow-up |
|
|
|
ISIS follow-up |
|
|
|
ISIS follow-up |
|
|
When you applied for [PROGRAM NAME] you said that [CONTACT #1] was a person who would always know where you are and how to reach you. Is [CONTACT#1] still a person who does not live with you and will always know how to contact you?
IF YES:
|
Adapted from ISIS follow-up |
Thank you very much for your time today. To help us be able to get back in touch with you in the future, we would like to review the names, telephone numbers and addresses of the two people you provided when you applied for [PROGRAM NAME] who will always know how to reach you. This information will be kept strictly confidential and will only be used if we are unable to contact you. |
|
IF NO: REPEAT 80a
Thank you very much for your time today. |
Adapted from ISIS follow-up |
|
|
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | Jennifer Lewis |
File Modified | 0000-00-00 |
File Created | 2021-01-24 |