HPOG-ISIS Questions by Research Obj 7 26 13

HPOG/ISIS Questions by Research Objective

Research Questions

HPOG & ISIS 15 mo. Survey

HPOG Grantee Survey

HPOG Stakeholder/ Network Survey*

HPOG Employer Survey*

HPOG Management and Staff Survey

ISIS Case Managers/ Advisors Survey

ISIS Managers/ Supervisors Survey

ISIS Instructional Staff Survey

ISIS Program Leadership and Staff Interview Guides

HPOG Implementation Interview Guides

ISIS Participant Interview Guides

ISIS Cost-Benefit Study

NDNH

HPOG PRS

HPOG NIE Study - The evaluation will involve multiple tasks that will assess implementation, system change, and outcomes and provide valuable information about the operations of these federally funded programs in improving education and employment opportunities for low‐income individuals

How are health profession training programs being implemented across the HPOG grantee sites?

X

X

X

X

X

X

X

What changes to the service delivery system are associated with HPOG program implementation?

X

X

X

X

X

What participant-level outputs (e.g., enrollment, retention, course completions, accreditation/ certification) and outcomes (e.g., job entry, employment retention and advancement, earnings) occur?

X

X

X

X

What key components appear necessary or contribute to the success of these programs?

X

X

X

X

X

X

X

HPOG Impact Study - The HPOG Impact Study is being designed to assess the effectiveness of the HPOG grant program. Additionally, it will demonstrate how variations in program services affect program impacts. The literature on promising and innovative Career Pathway programs, especially in health care, is quite limited. As such, the HPOG Impact Study will fill a void in the sectoral training and career pathways literature both about program effectiveness and about which types of programs or program components are most effective. this study will not examine site-specific impact, but rather will examine the effectiveness of program components across studies.

What impacts do HPOG programs as a group have on the outcomes of participants and their families?

X

X

X

To what extent do these impacts vary by subgroups of interest?

X

X

X

Which locally-adopted program components influence average impacts?

X

X

X

X

X

X

To what extent does participation in a particular HPOG component (or components) change the impact experienced by individual trainees?

X

X

X

X

X

X

ISIS - The ISIS project is OPRE's multi-site, random assignment evaluation of promising strategies for increasing employment and self-sufficiency among low-income individuals and families. Nine selected partner organizations, including three HPOG sites, are included in a random assignment evaluation that will assess program-specific impacts. An implementation and cost-benefit analyses will also be performed.

What services are provided under each intervention?

X

X

X

X

X

X

What are the characteristics of the populations served?

X

X

X

How are services for the target population implemented?

X

X

X

X

What are the issues and challenges associated with implementing and operating the service packages and policy approaches studied?

X

X

X

X

How do services for the treatment group compare to the services available to the control group?

X

X

X

X

X

X

What is the potential for scaling up and sustainability?

X

X

X

X

What are the net impacts of career pathway programs on educational outcomes (program completion, attainment of credentials and degrees) and economic outcomes (earnings, employment levels, and wage progression)?

X

X

X

Do impacts vary by subgroups?

X

X

X

What services appear to mediate effects?

X

X

X

What intermediate outcomes appear to mediate effects?

X

X

X

What are the costs of career pathway programs in the study? Do the estimated benefits of providing services outweigh the costs of these programs?

X

*Employer and stakeholder/network surveys for the ISIS study will be submitted to OMB for approval as part of a future clearance request.