PD provider We Grow Together website: user pop-up questions

ATTACHMENT 5
WEBSITE USER POP-UP QUESTIONS

This page has been left blank for double sided copying.

OMB No.: 0970-XXXX
Expiration Date: XX/XX/XXXX

A Study of We Grow Together:
The Q-CCIIT Professional Development
System

Website user pop-up questions
January 25, 2018

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such
collection displays a valid OMB control number. The valid OMB control number for this information collection is 0970-XXXX and
the expiration date is XX/XX/XXXX. The time required to complete this collection of information is estimated to average 30 minutes,
including the time to review instructions, search existing data resources, gather the data needed and complete and review the
collection of information. Send comments regarding the burden estimate or any other aspect of this collection of information,
including suggestions for reducing this burden, to Mathematica Policy Research, 1100 1st Street, NE, 12th Floor, Washington,
D.C., Attention: Tim Bruursema, and reference the OMB Control Number 0970-XXXX.

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

CONTENTS

Section

Page

INTRODUCTION ................................................................................................................... 1
SI. SURVEY INSTRUCTIONS ............................................................................................... 1
A. LEARNING PREFERENCES AND VALIDATION OF DATA COLLECTION
ACTIVITIES ..................................................................................................................... 2
B. WEBSITE POP-UP QUESTIONS..................................................................................... 4
FOR CAREGIVERS ................................................................................................... 4
FOR PD PROVIDERS ................................................................................................ 9

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

INTRODUCTION
This measure lists questions that are used to collect data on website users and on
how caregivers and professional development (PD) providers are implementing the webbased We Grow Together system.
The website will have pop-up questions asking caregivers and PD providers about their
learning preferences, validating completion of the classroom observation and background survey,
how long they spent reviewing tools outside of the website, how much time the caregivers spent
using tools in the classroom, how long and how often the caregiver and PD provider met, how
often they video-recorded themselves using the materials, and how often they reflected on the
content of the videos.

SI. SURVEY INSTRUCTIONS
CAREGIVER AND PD PROVIDER
INCLUDE INTRODUCTION ABOVE, STATEMENT BELOW AND OMB STATEMENT AT FIRST
LOGIN AND EVERY 30 DAYS AFTER FIRST LOGIN

Thank you for taking the time to complete these questions.
•

There are no right or wrong answers.

•

Your responses to these questions will help us better understand your preferences and
use of We Grow Together resources, so that we can recommend specific resources that
might fit better with your preferences and try to improve your experience of the We Grow
Together system.

•

To answer a question, click the box to choose your response.

•

To continue to the next webpage, press the "Next" or "Continue" button.

•

Your participation is voluntary. Your answers are important to us, but you do not have
to answer questions you do not wish to answer. Choosing not to respond to these
questions will not affect your access to the We Grow Together resources.

•

All information you share will remain private to the extent permitted by law. No one
from your program will see or hear your individual responses, and your name will never
be associated with or identified in study reports. The information we get will be used
for research and educational purposes to make We Grow Together better.
Please click one of the buttons below to begin or exit the survey.

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such
collection displays a valid OMB control number. The valid OMB control number for this information collection is 0970-XXXX and
the expiration date is XX/XX/XXXX. The time required to complete this collection of information is estimated to average [10 minutes
for caregivers, 6 minutes for PD providers], including the time to review instructions, search existing data resources, gather the
data needed and complete and review the collection of information. Send comments regarding the burden estimate or any other
aspect of this collection of information, including suggestions for reducing this burden, to Mathematica Policy Research, 1100 1st
Street, NE, 12th Floor, Washington, DC 20002, Attention: Tim Bruursema and reference the OMB Control Number 0970-XXXX.

Prepared by Mathematica Policy Research

1

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

A. LEARNING PREFERENCES AND VALIDATION OF DATA COLLECTION
CAREGIVER
WEBSITE POP-UP QUESTION AT FIRST LOGIN. ASK ONE TIME.
A.1.

Please indicate if you agree or disagree with the following statements about learning new
ways to support children’s development.
STRONGLY
AGREE

AGREE

NEITHER
AGREE NOR
DISAGREE

DISAGREE

STRONGLY
DISAGREE

a. I prefer to learn by watching.

5



4



3



2



1



b. I prefer to learn by doing.

5



4



3



2



1



c.

5



4



3



2



1



d. I prefer to read what and why
it is important.

5



4



3



2



1



e. I like to figure things out on
my own.

5



4



3



2



1



f.

5



4



3



2



1



g. I prefer when someone tells
me what part I am doing
wrong.

5



4



3



2



1



h. I prefer when someone tells
me what part I am doing
correctly.

5



4



3



2



1



I need everyone on my team
to work on the skill and with
me.

5



4



3



2



1



j.

I prefer to get good at the skill
before introducing it to others.

5



4



3



2



1



k.

I prefer that the PD Provider
tell my caregiving team and
supervisor why this is an
important practice to learn.

5



4



3



2



1



I prefer to explain the practice
to the team myself.

5



4



3



2



1



i.

l.

I prefer to learn by listening.

I like step by step directions.

Prepared by Mathematica Policy Research

2

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK ONE TIME 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
A.2.

Did a Q-CCIIT observer conduct an in-person observation without disrupting your setting?
Select one only
 Yes ........................................................................................................................ 1
 No ......................................................................................................................... 2
 An in-person Q-CCIIT observation was not done in my setting ........................... 3

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK ONE TIME 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
A.3.

How did you complete this project’s Background Survey?
Select one only
 Online ................................................................................................................... 1
 On paper ............................................................................................................... 2
 I have not completed the Background Survey...................................................... 3

Prepared by Mathematica Policy Research

3

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

B. WEBSITE POP-UP QUESTIONS ON USE OF WE GROW TOGETHER
[INTRO TO POP-UP QUESTIONS ASKED EVERY 30 DAYS AT LOGIN] Thank you for visiting the
We Grow Together website. Before you enter the website, we have a few questions about the
professional development activities you have engaged in in the last 30 days. We appreciate your
taking the time to answer these questions.
•

Your participation is voluntary. Your answers are important to us, but you do not have to answer
questions you do not wish to answer. Choosing not to respond to these questions will not affect
your access to the We Grow Together resources.

•

All information you share will remain private to the extent permitted by law. No one from your
program will see or hear your individual responses, and your name will never be associated with
or identified in study reports. The information we get will be used for research and educational
purposes to make We Grow Together better.

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless
such collection displays a valid OMB control number. The valid OMB control number for this information collection is 0970XXXX and the expiration date is XX/XX/XXXX. The time required to complete this collection of information is estimated to
average 10 minutes, including the time to review instructions, search existing data resources, gather the data needed and
complete and review the collection of information. Send comments regarding the burden estimate or any other aspect of this
collection of information, including suggestions for reducing this burden, to Mathematica Policy Research, 1100 1st Street,
NE, 12th Floor, Washington, D.C., Attention: Tim Bruursema, and reference the OMB Control Number 0970-XXXX.

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
B.1.

In the last 30 days, how often did you hear from your PD provider about your practice
(including by phone, texts, email, videoconference, or in person)?
Select one only
 None ..................................................................................................................... 1
 One time ............................................................................................................... 2
 Two times ............................................................................................................. 3
 Three times ........................................................................................................... 4
 Four times ............................................................................................................. 5
 Five times ............................................................................................................. 6
 More than five times ............................................................................................. 7

Prepared by Mathematica Policy Research

4

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN. IF B.1 RESPONSE DOES NOT EQUAL 1, ASK B.2.
B.2.

In the last 30 days, what were the methods that the PD provider used to communicate with
you?
Select all that apply
 In person ............................................................................................................... 1
 Video chats (for example, FaceTime or Skype) ................................................... 2
 Telephone call ...................................................................................................... 3
 Online chats .......................................................................................................... 4
 Email ..................................................................................................................... 5
 Text messages ..................................................................................................... 6
 We did not communicate in the last 30 days ........................................................ 7
 Other (specify) ...................................................................................................... 99
Specify

Prepared by Mathematica Policy Research

(STRING 250)

5

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN. IF B.1 RESPONSE DOES NOT EQUAL 1, ASK B.3.
B.3.

In the last 30 days, when you talked to your PD provider, how long was your longest
discussion? Please give your answer in hours and minutes. Your best estimate is fine.

•
HOURS MINUTES
(0–8)

(0–59)

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN. IF B.1 RESPONSE DOES NOT EQUAL 1, ASK B.4.
B.4.

In the last 30 days, when you talked to your PD provider, how long was your shortest
discussion? Please give your answer in hours and minutes. Your best estimate is fine.

HOURS
(0–8)

MINUTES
(0–59)

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
B.5.

In the last 30 days, how often did you speak with your supervisor/director about the work
you are doing that is related to the We Grow Together?
Select one only
 None ..................................................................................................................... 1
 One time ............................................................................................................... 2
 Two times ............................................................................................................. 3
 Three times ........................................................................................................... 4
 Four times ............................................................................................................. 5
 Five times ............................................................................................................. 6
 More than five times ............................................................................................. 7
 I do not have a supervisor/director ....................................................................... 8

Prepared by Mathematica Policy Research

6

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
Now, think about your time working on the We Grow Together activities.
B.6.

On average, in the last seven days, what was the total amount of time you spent working
on We Grow Together activities inside the classroom (for example, practicing the skills in
your action plan)?
Please do not include the time you spent meeting with your PD provider.
Select one only
 None ..................................................................................................................... 1
 Less than 30 minutes ........................................................................................... 2
 30 minutes to less than 60 minutes ...................................................................... 3
 60 minutes to less than 90 minutes ...................................................................... 4
 90 minutes to less than 120 minutes .................................................................... 5
 120 minutes or longer ............................................................................................ 6

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
B.7.

On average, in the last seven days, what was the total amount of time you spent on the
We Grow Together website (for example, looking at web resources, watching online
videos)?
Select one only
 None ..................................................................................................................... 1
 Less than 30 minutes ........................................................................................... 2
 30 minutes to less than 60 minutes ...................................................................... 3
 60 minutes to less than 90 minutes ...................................................................... 4
 90 minutes to less than 120 minutes .................................................................... 5
 120 minutes or longer ........................................................................................... 6

Prepared by Mathematica Policy Research

7

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
B.8.

On average, in the last seven days, what was the total amount of time you spent working
on We Grow Together activities outside the classroom (for example, reviewing paper
copies of the tools, making posters, and reflecting on your own videos)?
Please do not include the time you spent meeting with your PD provider or on the We Grow
Together website.
Select one only
 None ..................................................................................................................... 1
 Less than 30 minutes ........................................................................................... 2
 30 minutes to less than 60 minutes ...................................................................... 3
 60 minutes to less than 90 minutes ...................................................................... 4
 90 minutes to less than 120 minutes .................................................................... 5
 120 minutes or longer ........................................................................................... 6

CAREGIVER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
B.9.

In the last 30 days, how often did you reflect on a video you recorded of yourself
interacting with children?
Select one only
 None ..................................................................................................................... 1
 One time ............................................................................................................... 2
 Two times ............................................................................................................. 3
 Three times ........................................................................................................... 4
 Four times ............................................................................................................. 5
 Five times ............................................................................................................. 6
 More than five times ............................................................................................. 7

Prepared by Mathematica Policy Research

8

WE GROW TOGETHER

ATTACHMENT 5. WEBSITE USER POP-UP QUESTIONS

PD PROVIDER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
Now, think about your time working with the caregiver on the We Grow Together activities.
B.10.

On average, in the last seven days, what was the total amount of time you spent working
with the caregiver on We Grow Together activities inside the classroom (for example,
“coaching on the fly,” step-by-step guidance, observing the caregiver, or providing
feedback to the caregiver)?
If you work with more than one caregiver, please think about the caregiver you worked with
most recently in the last seven days.
Select one only
 None ..................................................................................................................... 1
 Less than 30 minutes ........................................................................................... 2
 30 minutes to less than 60 minutes ...................................................................... 3
 60 minutes to less than 90 minutes ...................................................................... 4
 90 minutes to less than 120 minutes .................................................................... 5
 120 minutes or longer ........................................................................................... 6

PD PROVIDER
WEBSITE POP-UP QUESTION AT LOGIN. ASK EVERY 30 DAYS FROM DATE OF ORIGINAL
LOGIN.
B.11.

On average, in the last seven days, what was the total amount of time you spent working
with the caregiver on We Grow Together activities outside the classroom (for example, a
reflection and discussion with the caregiver without children present, sharing resources,
creating reminders or nudges, texting, emails, phone calls, videoconferencing)?
If you work with more than one caregiver, please think about the caregiver you worked with
most recently in the last seven days.
Select one only
 None ..................................................................................................................... 1
 Less than 30 minutes ........................................................................................... 2
 30 minutes to less than 60 minutes ...................................................................... 3
 60 minutes to less than 90 minutes ...................................................................... 4
 90 minutes to less than 120 minutes .................................................................... 5
 120 minutes or longer ........................................................................................... 6

Prepared by Mathematica Policy Research

9