Instrument 1_JCAMP Feedback Survey 060223 clean

OMB Control # xxxx-xxxx and Expiration Date: xx/xx/xxxx

JCAMP Feedback Survey

The survey asks you about your experiences implementing the Judicial, Court, and Attorney Measures of Performance (JCAMP).

The survey should take 15 minutes to complete. Your participation in the survey is voluntary. You may refuse to take part in the research or exit the survey at any time without penalty or loss of otherwise entitled benefits. You may decline to answer any question you do not wish to answer for any reason. There are no foreseeable risks involved in participating in the survey. Your alternative is to not participate. You will receive no direct benefits from participating in this research study. However, your responses will help us learn how to improve JCAMP implementation support.

Your survey responses will be sent to a link on the Qualtrics survey platform where data will be stored in a password protected electronic format. People overseeing the study such as the IRB may review records. Survey responses you provide may be associated with the name of your state and included in a report shared within the Children’s Bureau and the Administration for Children and Families (ACF) and may be shared in public reports, articles, and presentations. Information from this study may be securely shared with qualified researchers to help guide future research and support program improvement.

Your responses to this survey will remain private.

If you have questions or concerns, or complaints about the survey or study, or to report a research-related problem, you may contact Co-Principal Investigators Dr. Alicia Summers and Dr. Sophia Gatowski.

Co-Principal Investigator

Alicia Summers, Ph.D.

Data Savvy Consulting

682 Talus Way, Reno, NV 89503

(775) 686-8545

Co-Principal Investigator

Sophia Gatowski, Ph.D.

Systems Change Solutions Inc.

2-6988 177 Street, Surrey, BC., Canada, V3S 2K1

(604) 807-4617

This research is being overseen by WCG IRB. An IRB is a group of people who perform independent review of research studies. You may talk to them at 855-818-2289 or researchquestions@wcgirb.com if:

• You have questions, concerns, or complaints that are not being answered by the research team.

• You are not getting answers from the research team.

• You cannot reach the research team.

• You want to talk to someone else about the research.

• You have questions about your rights as a research subject.

The Paperwork Reduction Act Statement: The described collection of information is voluntary and will be used to help us understand JCAMP implementation. Public reporting burden for this collection of information is estimated to average 15 minutes per response, including the time for reviewing instructions, gathering and maintaining the data needed, and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB control number. The OMB number and expiration date for the described collection are OMB #: xxxx-xxxx, Exp: xx/xx/20xx. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to Dr. Alicia Summers; alicia.d.summers@gmail.com and Dr. Sophia Gatwoski; sgatowski@ymail.com.

Please select “agree” or “disagree” below. You may print a copy of this consent form for your records. Clicking on the “Agree” button indicates that:

• You have read the above information;

• You voluntarily agree to participate;

• You are 18 years of age or older

☐Agree ☐Disagree

Thank you in advance for your participation and input!

Consider your use of JCAMP to measure performance in your state or tribe….

What would you want other sites starting the JCAMP process to know?

Progress

Please indicate your current progress on each of the following performance measurement activities:

Activity	None	Planning/ strategizing	Activity started	Activity fully implemented or completed	N/A*
Forming a performance measurement team	❑	❑	❑	❑	❑
Selecting and prioritizing variables/measures	❑	❑	❑	❑	❑
Developing a plan to collect performance measurement data	❑	❑	❑	❑	❑
Getting data (e.g., sampling, data collection procedures)	❑	❑	❑	❑	❑
Using data (e.g., analysis, reporting, Continuous Quality Improvement)	❑	❑	❑	❑	❑
Sustaining performance measurement efforts	❑	❑	❑	❑	❑
*Select N/A if the activity is not relevant to the CIP or Tribe’s performance measurement plan.

Capacity

Please rate your understanding of and/or ability in the following performance measurement activities both before and during/after using the JCAMP materials, on a scale of 1 to 5 (1=Low, 5=High)

Please rate your understanding/ability prior to using JCAMP	Activity	Please rate your understanding/ability during or after using JCAMP
1 2 3 4 5	Forming a performance measurement team	1 2 3 4 5
1 2 3 4 5	Selecting and prioritizing variables/measures	1 2 3 4 5
1 2 3 4 5	Developing a plan to collect performance measurement data	1 2 3 4 5
1 2 3 4 5	Getting data (e.g., sampling, data collection procedures)	1 2 3 4 5
1 2 3 4 5	Using data (e.g., analysis, reporting, Continuous Quality Improvement)	1 2 3 4 5
1 2 3 4 5	Sustaining performance measurement efforts	1 2 3 4 5

*Select N/A if the activity is not relevant to the CIP’s or Tribe’s performance measurement plan. In a few words, what were your biggest challenges (if any) in the following steps of the JCAMP process.
Step	Challenge
Forming a performance measurement team
Selecting and prioritizing variables/measures
Developing a plan to collect performance measurement data
Getting data (e.g., sampling, data collection procedures)
Using data (e.g., analysis, reporting, Continuous Quality Improvement)
Sustaining performance measurement efforts

In a few words, what were your biggest successes in the following steps of the JCAMP process.

Step	Success
Forming a performance measurement team
Selecting and prioritizing variables/measures
Developing a plan to collect performance measurement data
Getting data (e.g., sampling, data collection procedures)
Using data (e.g., analysis, reporting, Continuous Quality Improvement)
Sustaining performance measurement efforts

Satisfaction

Please indicate your level of agreement with the following statements about the JCAMP process.

	Strongly Disagree	2	3	Neither	5	6	Strongly Agree
The JCAMP materials provide the tools I need to assess progress on CIP goals and outcomes identified as the focus for JCAMP work.	1	2	3	N	5	6	7
The JCAMP materials are appropriate for my/my CIP team’s level of experience and knowledge.	1	2	3	N	5	6	7
The format and layout of the JCAMP materials are accessible and easy to navigate.	1	2	3	N	5	6	7
I have access to technical assistance to support JCAMP implementation if/when needed.	1	2	3	N	5	6	7
Regular technical assistance sessions are critical to implement JCAMP effectively.	1	2	3	N	5	6	7
Regular meetings with CBCC support are useful.	1	2	3	N	5	6	7
I have access to CBCC subject matter experts.	1	2	3	N	5	6	7
Implementing JCAMP has been helpful to my CIP team’s performance measurement effort.	1	2	3	N	5	6	7
Implementing JCAMP has increased my knowledge about CIP performance measurement activities.	1	2	3	N	5	6	7
10. Implementing JCAMP has increased my practical skills for conducting CIP evaluation activities.	1	2	3	N	5	6	7
11. As a result of the information I learned from implementing JCAMP, I am more effective in evaluating my CIP.	1	2	3	N	5	6	7
I am confident that I can apply what I have learned from implementing JCAMP to other program evaluation activities in my state.	1	2	3	N	5	6	7
Overall, I am satisfied with our JCAMP implementation experience.	1	2	3	N	5	6	7

In what ways did you/your CIP use JCAMP implementation to improve upon your CIP work?

In what ways could JCAMP materials be more accessible or user-friendly for you and your CIP team?

In what ways could JCAMP materials better assist your CIP team’s performance measurement effort?

Given your current resources, how likely are you to continue collecting these same data in the future?

❑ Very likely

❑ Somewhat likely

❑ Somewhat unlikely

❑ Very unlikely

❑ Unsure

Please explain:

Thinking about sustainability, what would you need to continue implementing JCAMP on your own?

Did you use eJCAMP to help you implement the JCAMP materials?

❑ Yes ❑ No

Please rate your level of agreement with the following statements:

	Strongly Disagree	2	3	Neither	5	6	Strongly Agree
I am satisfied with the overall experience of using eJCAMP.	1	2	3	N	5	6	7
eJCAMP added value to the process of working with the JCAMP written materials.	1	2	3	N	5	6	7
The instructions for identifying our team’s data capacity were clear.	1	2	3	N	5	6	7
Navigating the data capacity section was intuitive.
It was clear how to update and revise our original submission.
The instructions for identifying our team’s measurement priorities were easy to understand.
eJCAMP helped our team identify our priorities.
Our team’s prioritized projects were represented in a clear way.
eJCAMP suggested appropriate data collection tools for each measure.
The data collection instruments generated by eJCAMP were useful.

If you disagreed with any of the statements above, please describe why.

Did you have access to the user management module?

❑ Yes ❑ No

If yes, how could the management module be improved?

Please use the following space to make any additional comments about your experience with JCAMP and/or eJCAMP.

Please use the following space to make any additional comments about your experience with JCAMP and/or eJCAMP.

Thank you for taking the time to participate! Your response has been recorded.