Form SSA KII Service Pr SSA KII Service Pr SSA KII Service Provider Version

Substance Abuse Mental Health Services Administration

SSA KII—Service Provider

OMB No: XXXXX

Expiration Date: XXXX

Public Burden Statement: An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number.  The OMB control number for this project is XXXX-XXXX.  Public reporting burden for this collection of information is estimated to average 60 minutes per respondent, per year, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information.  Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to SAMHSA Reports Clearance Officer, 1 Choke Cherry Road, Room 2-1057, Rockville, Maryland, 20857.

Community Support Evaluation: Supported Employment

Scalability/sustainability assessment key informant interview

Service provider Version (year 2)

Introduction

Thank you for agreeing to participate. We are going to begin by talking a bit about you and your organization. After that, I’d like to talk about the outcomes of the Supported Employment project, and its infrastructure. We are also going to talk about both the scalability and the sustainability of the SE project. While I have separate questions to ask about scale-up and sustainability, I understand that these topics are closely related and you may need to talk about them simultaneously in some cases.

1. To start off, I’d like to know a bit about you. How would you describe your role within your state/local mental health system?

   1. How long have you worked in this role?

   2. What are your key responsibilities overall?

   3. What are your key responsibilities related to the SE project?

   4. How has your role changed over the final two years of the SE grant?

2. What kind of employment programming, if any, did your state/agency offer prior to receiving this grant?

   1. In what ways, if any, was the previous programming similar to the principles of the Individual Placement and Support (IPS) Supported Employment (SE) model?

      1. Eligibility by consumer choice/non-exclusivity

      2. Employment services coordinated with mental health treatment

      3. Competitive employment focused

      4. Provision of personalized benefits counseling

      5. Rapid commencement of job search

      6. Unlimited follow-along support

      7. Emphasis on consumer preference

3. How would you describe the state of the workforce and job availability prior to receiving the grant?

Outcomes

Now I’d like to talk about the outcomes of the program.

4. What changes in outcomes have you seen since implementing the SE project, if any?

   1. [Insert list of intended outcomes from grantee’s proposal to be used as probes if necessary]

   2. What outcomes have changed? How have they changed?

   3. How has the SAMHSA SE project affected these outcomes?

   4. What other factors may have played a role in this change?

5. How successful have the state’s efforts to develop a statewide SE workforce been?

   1. What evidence do you have/see for this?

   2. What improvements would you like to make in the future?

6. How successful have the state’s efforts to improve service integration been?

   1. What evidence do you have/see for this?

   2. What activities have had the most impact on service integration?

   3. What improvements would you like to make in the future?

   4. [Insert relevant probes based on data from Year 2 as needed]

Infrastructure, Planning, and Development

Let’s talk a bit more about infrastructure and planning.

7. Broadly speaking, what staffing changes have taken place at the local level in relation to the SE project?

   1. Can you provide examples of the types of staff roles and expertise that were increased across local organizations?

8. Other than the SE Coordinating Committee, who are the key stakeholders for the SE project in your state?

   1. What are their roles?

   2. In what ways do they support SE management and/or implementation?

9. What existing funding sources have been leveraged to support SE in your state at the state, organizational, and individual level?

   1. In what ways, if any, has the SE project made it easier for employment services to be funded?

   2. What challenges, if any, has the SE project created for funding employment services?

10. How are resources allocated for the SE project?

    1. What stakeholders are involved in decisions about resource allocation?

Scalability

Moving beyond infrastructure, let’s talk a bit about scalability, or the capacity of the SE project to increase in size and reach.

11. How has the scale of SE in your state changed since receiving the grant?

    1. Has there been an increase in the number of clients served? If so, please describe.

    2. Has there been an increase in the number of employers you are able to partner with? If so, please describe.

    3. What facilitators have improved the scalability of SE?

    4. What barriers have inhibited the scalability of SE?

12. [If scaled up] What challenges have you/your agency experienced in the course of scaling up services?

13. Based on your experience, what challenges do you anticipate may occur as SE programming is scaled up across the state?

14. Broadly speaking, how has receiving this grant changed local programming?

    1. How, if at all, have the changes looked different across the implementation sites?

    2. How, if at all, has the SE project changed local programming at any other local community behavioral health agencies besides the implementation sites?

Sustainability

For the final section of our interview, I’d like to ask you a few questions about sustaining the SE program going forward.

15. How sustainable is the state’s current approach to SE?

    1. What factors currently affect the sustainability of SE?

    2. How do you expect the sustainability of SE to change over the next two years?

16. What efforts, if any, are currently underway to increase the sustainability of SE?

    1. Is your agency/organization making changes to any of the following factors to increase SE sustainability?

       1. Funding

       2. Policies

       3. Workforce development

       4. Monitoring and Evaluation

    2. What challenges are you currently facing in these activities?

17. What additional activities, if any, are planned to increase the sustainability of SE?

    1. Does your agency/organization have plans in place to make changes to any of the following factors to increase SE sustainability?

       1. Funding

       2. Policies

       3. Workforce development

       4. Monitoring and Evaluation

    2. What factors would enable you to engage in these activities?

    3. What challenges might prevent you from engaging in these activities?

18. Please tell me about how funding sources may affect the sustainability of SE.

    1. Does your agency/organization have plans to devote current funding sources to future implementation of SE? If so, please describe.

    2. Does your agency/organization have plans to secure additional funding for future implementation of SE? If so, please describe

19. What additional infrastructure components impact sustainability of SE in your state?

    1. Would sustainability be increased by support in any of the following areas? How?

       1. Funding

       2. Policies

       3. Workforce development

       4. Monitoring and Evaluation

    2. Do you expect to receive this kind of support? Why or why not?

Conclusion

As we conclude, I have a few final questions.

20. If you could change anything about your SE program since receiving this grant, what would you change?

    1. Would these changes affect the scalability of SE? How?

    2. Would these changes affect the sustainability of SE? How?

21. [Time permitting] What advice would you give to a new state that is just starting to scale up SE?

22. Do you have anything else you would like to add about the SE project that we have not covered?

Thank you for taking the time to speak with me today. Please do not hesitate to contact me if you have further insights you would like to add or questions about this study.

OMB No: XXXXX

Expiration Date: XXXX

Public Burden Statement: An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number.  The OMB control number for this project is XXXX-XXXX.  Public reporting burden for this collection of information is estimated to average 60 minutes per respondent, per year, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information.  Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden, to SAMHSA Reports Clearance Officer, 1 Choke Cherry Road, Room 2-1057, Rockville, Maryland, 20857.

Community Support Evaluation: Supported employment

Scalability and sustainability assessment key informant interview service provider Version (year 4)

Introduction

Thank you for agreeing to participate. We are going to begin by talking a bit about you and your organization. After that, I’d like to talk about the outcomes of the Supported Employment project, and its infrastructure. We are also going to talk about both the scalability and the sustainability of the SE project. While I have separate questions to ask about scale-up and sustainability, I understand that these topics are closely related and you may need to talk about them simultaneously in some cases.

1. To start off, I’d like to know a bit about you. How would you describe your role within your state/local mental health system?

   1. How long have you worked in this role?

   2. What are your key responsibilities overall?

   3. What are your key responsibilities related to the SE project?

   4. How has your role changed over the final two years of the SE grant?

Outcomes

Now I’d like to talk about the outcomes of the program.

2. What changes in outcomes have you seen since implementing the SE project, if any?

   1. [Insert list of intended outcomes from grantee’s proposal to be used as probes if necessary]

   2. What outcomes have changed? How have they changed?

   3. How has the SAMHSA SE project affected these outcomes?

   4. What other factors may have played a role in this change?

3. How successful have the state’s efforts to develop a statewide SE workforce been?

   1. What evidence do you have/see for this?

   2. What improvements would you like to make in the future?

   3. [Insert relevant probes based on data from Year 2 as needed]

4. How successful have the state’s efforts to improve service integration been?

   1. What evidence do you have/see for this?

   2. What activities have had the most impact on service integration?

   3. What improvements would you like to make in the future?

   4. [Insert relevant probes based on data from Year 2 as needed]

Infrastructure, Planning, and Development

Let’s talk a bit more about infrastructure and planning.

5. Broadly speaking, what staffing changes have taken place at the local level in relation to the SE project?

   1. Can you provide examples of the types of staff roles and expertise that were increased across local organizations?

6. Other than the SECC, who are the key stakeholders for the SE project in your state?

   1. What are their roles?

   2. In what ways do they support SE management and/or implementation?

7. What existing funding sources have been leveraged to support SE in your state at the state, organizational, and individual level?

   1. In what ways, if any, has the SE project made it easier for employment services to be funded?

   2. What challenges, if any, has the SE project created for funding employment services?

   3. Has SE in the state lost any outside funding throughout the time it has been implemented? If so, why did those funders stop supporting the project?

   4. What efforts are you implementing to secure funding after the grant?

8. How are resources allocated for the SE project?

   1. What stakeholders are involved in decisions about resource allocation?

Scalability

Moving beyond infrastructure, let’s talk a bit about scalability, or the capacity of the SE project to increase in size and reach.

9. How has the scale of SE in your state changed since receiving the grant?

   1. Has there been an increase in the number of clients served? If so, please describe.

   2. Has there been an increase in the number of employers you are able to partner with? If so, please describe.

   3. What facilitators have improved the scalability of SE?

   4. What barriers have inhibited the scalability of SE?

10. [If scaled up] What challenges have you/your agency experienced in the course of scaling up services?

11. Based on your experience, what challenges do you anticipate may occur as SE programming is scaled up across the state?

12. Broadly speaking, how has receiving this grant changed local programming?

    1. How, if at all, have the changes looked different across the implementation sites?

    2. How, if at all, has the SE project changed local programming at any other local community behavioral health agencies besides the implementation sites?

13. What state/agency policies have changed as a result of the SE project (both legislative and non-legislative)?

    1. How have these policies changed?

    2. How have these policy changes impacted the implementation and scale-up of SE?

    3. How will these policy changes affect the sustainability of SE?

    4. Are there any policies you hoped would change that have remained the same? If so, please describe.

Sustainability

For the final section of our interview, I’d like to ask you a few questions about sustaining the SE program going forward.

14. How sustainable is the state’s current approach to SE?

    1. What factors currently affect the sustainability of SE?

    2. What changes do you anticipate to the sustainability of SE once the grant has concluded?

    3. [Insert relevant probes based on data from Year 2 as needed]

15. What efforts, if any, are currently underway to increase the sustainability of SE?

    1. Is your agency/organization making changes to any of the following factors to increase SE sustainability?

       1. Funding

       2. Policies

       3. Workforce development

       4. Monitoring and Evaluation

    2. What challenges are you currently facing in these activities?

16. What additional activities, if any, are planned to increase the sustainability of SE?

    1. Does your agency/organization have plans in place to make changes to any of the following factors to increase SE sustainability?

       1. Funding

       2. Policies

       3. Workforce development

       4. Monitoring and Evaluation

    2. What factors would enable you to engage in these activities?

    3. What challenges might prevent you from engaging in these activities?

17. Please tell me about how funding sources may affect the sustainability of SE.

    1. Does your agency/organization have plans to devote current funding sources to future implementation of SE? If so, please describe.

    2. Does your agency/organization have plans to secure additional funding for future implementation of SE? If so, please describe

18. What additional infrastructure components impact sustainability of SE in your state?

    1. Would sustainability be increased by support in any of the following areas? How?

       1. Funding

       2. Policies

       3. Workforce development

       4. Monitoring and Evaluation

    2. Do you expect to receive this kind of support? Why or why not?

Conclusion

As we conclude, I have a few final questions.

19. [If continuing SE] In what ways will SE in the future look different from what was implemented under the grant?

    1. Will the scale of SE change? If so, how?

    2. Will the changes in the future affect the sustainability of SE? If so, how?

20. If you could change anything about your SE program since receiving this grant, what would you change?

    1. Would these changes affect the scalability of SE? How?

    2. Would these changes affect the sustainability of SE? How?

21. [Time permitting] What advice would you give to a new state that is just starting to scale up SE?

22. Do you have anything else you would like to add about the SE project that we have not covered?

Thank you for taking the time to speak with me today. Please do not hesitate to contact me if you have further insights you would like to add or questions about this study.

11