NAEP Assessment of Educaitonal Progress (NAEP) Questionnaire Items for Core, Reading, Writing, and Mathematics - Cognitive Interviews

The following script does not have to be read verbatim. You, as the interviewer, should be familiar enough with the script to introduce the participant to the cognitive interview process in a conversational manner. The text in italics is suggested content for you to become thoroughly familiar with in advance. You should project a warm and reassuring manner toward the participant in order to develop a friendly rapport and should use conversational language throughout the interview.

After answering questions and giving further explanation, begin the interview with the first item.

Student Welcome Script:

Hello, my name is <name >.

Thank you for agreeing to participate in our study. Your help is very important to us. Let me tell you a bit more about what we are going to do today.

I have some questions that students in many different schools across the country will be asked to answer about themselves and their families. The questions will be part of the National Assessment of Educational Progress (NAEP).

Some of the questions may be difficult to understand or answer. Our goal is to make these questions better so that other students can easily understand them. That is why we need your feedback.

We want you to help us find out which questions are easy to understand and which are difficult to understand. There are no right or wrong answers. Your feedback will help the National Center for Education Statistics (NCES), which is part of the United States Department of Education, make these questions clearer for students like you. In the next hour we will try to get through as many questions as possible.

This interview is being audio recorded so that researchers can review the recordings later. No one else will hear the recording. Participant responses are voluntary and will be used only for research purposes. They will not be disclosed or used, in identifiable form, for any other purpose except as required by law [Education Sciences Reform Act of 2002 (ESRA 2002) 20 U.S.C. § 9573].

Do you have any questions?

If, for any reason, the participant is no longer interested in participating, thank the participant for his/her time and end the interview.

Teacher Welcome Script

Hello, my name is <name>.

Thank you for coming here today to help us.

I have some questions that teachers in many different schools will be asked to answer about themselves, their instructional practices, and their schools. The questions will be part of the National Assessment of Educational Progress (NAEP). Some of the questions may not be easy to understand or answer. There are no wrong answers, but please try to answer the questions to the best of your ability. Your feedback will help the National Center for Education Statistics (NCES), part of the United States Department of Education, make these questions clearer for teachers like you. In the next hour we will try to get through as many questions as possible.

This interview is being audio recorded so that researchers can review the recordings later. Participant responses are voluntary, will be used only for research purposes, and will not be disclosed or used, in identifiable form, for any other purpose except as required by law [Education Sciences Reform Act of 2002 (ESRA 2002) 20 U.S.C. § 9573].

Do you have any questions?

If, for any reason, the participant is no longer interested in participating, thank the participant for his/her time and end the interview.

School Administrator Welcome Script

Hello, my name is <name >.

Thank you for coming here today to help us.

I have some questions that school administrators in many different schools will be asked to answer about their school policies and characteristics. The questions will be part of the National Assessment of Educational Progress (NAEP). Some of the questions may not be easy to understand or answer. There are no wrong answers, but please try to answer the questions to the best of your ability. Your feedback will help the National Center for Education Statistics (NCES), part of the United States Department of Education, make these questions clearer for school administrators like you. In the next hour we will try to get through as many questions as possible.

Do you have any questions?

If, for any reason, the participant is no longer interested in participating, thank the participant for his/her time and end the interview.

II. ITEMS AND PROBES¹

After the participant is welcomed and the purpose of the study is explained, the cognitive interview starts.

Please ask the participant to read each item first and provide his/her response. Then, start with the generic probes for each item, followed by the specific probes. The probes that are generic are included for all items. The probes that are item specific apply only to particular aspects of a given item. Note that some follow-up probes are conditional based on previous participant responses.

In the tables below each item are suggested probes for each question, written in italics, which you should be thoroughly familiar with in advance.

All participant responses should be captured. The note taker should also record approximate participant response times for reading and answering each item.

The maximum duration of each cognitive interview will be no more than 90 minutes².

Generic Probes for Discrete Items

No.	Probe
1	Ask the participant to read the question (preferably to him/herself) and ask him/her to select an answer. Once he/she has read and answered the question, ask the following probes: Can you tell me, in your own words, what the question is asking?
2	Why did you select this choice? How did you know what answer to select?
3	Did you find any part of the question confusing? Were there any words that you didn’t know? If yes: Which part did you find confusing? Why? What could we do to make the question easier to understand?
4	Overall, how easy or difficult was it to answer this question? Would you say choosing an answer to this question was very easy, easy, difficult, or very difficult?

Generic Probes for Matrix Items

No.	Probe
1	Ask the participant to read the question stem (preferably to him/herself). Please note, the participant should only read the stem and not the options (i.e., sub-items). Once he/she has read the question stem, ask the following probe: Can you tell me, in your own words, what you think this question is asking you to do?
2	The interviewer should then ask the participant to read each option/sub-item and to describe each option/sub-item and his/her response to that option/sub-item. The probes in this cell should be asked for each option/sub-item. a) Can you tell me, in your own words, what [option a., b., c., etc.] means to you? b) Why did you select this choice? How did you know what answer to select?
3	Did you find any part of the question confusing? Were there any words that you didn’t know? If yes: Which part did you find confusing? Why? What could we do to make the question easier to understand?
4	Overall, how easy or difficult was it to answer this question? Would you say choosing an answer to this question was very easy, easy, difficult, or very difficult?

Generic Probes for Free Response Items

No.	Probe
1	Ask the participant to read the question (preferably to him/herself) and ask him/her to write in his/her answer. Once he/she has read and answered the question ask the following probes: Can you tell me, in your own words, what the question is asking?
2	Why did you give this answer? How did you know to give this answer?
3	Did you find any part of the question confusing? Were there any words that you didn’t know? If yes: Which part did you find confusing? Why? What could we do to make the question easier to understand?
4	Overall, how easy or difficult was it to answer this question? Would you say choosing an answer to this question was very easy, easy, difficult, or very difficult?

Reading Cognitive Interview Items and Probes

Student Items – Grade 4 and 8 (Cross Grade)

[Grade 4 & 8 Reading: Student #1]

TechUse_4 For school this year, how often do you use the following to read a story, article, or book? Select one answer choice on each row.
	Never	Once or twice this year	Once or twice a month	At least once a week
Desktop Computer	A	B	C	D	TechUse_4_01
Laptop Computer	A	B	C	D	TechUse_4_02
Tablet Computer	A	B	C	D	TechUse_4_03

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In this question, what does the word “article” mean to you?	Specific	Required
3	How do you refer to this [show picture of a tablet], as a tablet or tablet computer?*	Specific	Required

* Please note we will use the picture of the tablet that is part of the directions block of the 2015 Computer Familiarity Study.

[Grade 4 & 8 Reading: Student #2]

BookRes_1a

How often do you borrow books from your school or local library?

Never or almost never
A few times a year
Once or twice a month
At least once a week

Alternative stem: n/a

Alternative versions of answer choices: Never or hardly ever/Once every few weeks/About once a week/Two or three times a week/Every day or almost every day OR Never/Once or twice a month/Once or twice a week/Every day or almost every day

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 4 & 8 Reading: Student #3]

BookRes_1b

In this school year, how often have you borrowed reading materials (such as books or magazines) from your school library or media resource center?

Never or almost never
A few times a year
Once or twice a month
At least once a week

Alternative stem: n/a

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required
2	In this question, what does the phrase "media resource center" mean to you? Can you give me examples of things you might find in a "media resource center"?	Specific	Required

[Grade 4 & 8 Reading: Student #4a]

ReaInt_1 How much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I read only if I have to.	A	B	C	D	E	ReaInt_1_01
Reading is one of my favorite activities.	A	B	C	D	E	ReaInt_1_02
I like talking about books with other people.	A	B	C	D	E	ReaInt_1_03
I find it difficult to finish books.	A	B	C	D	E	ReaInt_1_04
I feel happy if I receive a book as a present.	A	B	C	D	E	ReaInt_1_05
For me, reading is not important.	A	B	C	D	E	ReaInt_1_06
I enjoy going to a bookstore or a library.	A	B	C	D	E	ReaInt_1_07
I read only to get information that I need.	A	B	C	D	E	ReaInt_1_08
I can’t sit still and read for more than a few minutes.	A	B	C	D	E	ReaInt_1_09
I like to express my opinions about books I have read.	A	B	C	D	E	ReaInt_1_10
I like to exchange books with my friends.	A	B	C	D	E	ReaInt_1_11

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option g, did you consider online bookstores and online libraries when answering this item?	Specific	Required
3	In option i, what does the phrase "a few minutes" mean to you?	Specific	Required
4	In option k, what does the phrase “exchange books” mean to you? If the student has trouble explaining what the phrase “exchange books” means or gives an inaccurate description ask the following probes: What does the phrase “trade books” mean to you? Which phrase is easier for you to understand, “exchange books” or “trade books”?	Specific	Required

[Grade 4 & 8 Reading: Student #4b]

ReaInt_1 How much do you agree with each of the following statements? Select one answer choice on each row.
	Strongly disagree	Disagree	Somewhat disagree	Somewhat agree	Agree	Strongly agree
I read only if I have to.	A	B	C	D	E	F	ReaInt_1_01
Reading is one of my favorite activities.	A	B	C	D	E	F	ReaInt_1_02
I like talking about books with other people.	A	B	C	D	E	F	ReaInt_1_03
I find it difficult to finish books.	A	B	C	D	E	F	ReaInt_1_04
I feel happy if I receive a book as a present.	A	B	C	D	E	F	ReaInt_1_05
For me, reading is not important.	A	B	C	D	E	F	ReaInt_1_06
I enjoy going to a bookstore or a library.	A	B	C	D	E	F	ReaInt_1_07
I read only to get information that I need.	A	B	C	D	E	F	ReaInt_1_08
I can't sit still and read for more than a few minutes.	A	B	C	D	E	F	ReaInt_1_09
I like to express my opinions about books I have read.	A	B	C	D	E	F	ReaInt_1_10
I like to exchange books with my friends.	A	B	C	D	E	F	ReaInt_1_11

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option g, did you consider online bookstores and online libraries when answering this item?	Specific	Required
3	In option i, what does the phrase "a few minutes" mean to you?	Specific	Required
4	In option k, what does the phrase “exchange books” mean to you? If the student has trouble explaining what the phrase “exchange books” means or gives an inaccurate description ask the following probes: What does the phrase “trade books” mean to you? Which phrase is easier for you to understand, “exchange books” or “trade books”?	Specific	Required

[Grade 4 & 8 Reading: Student #5]

Debrief_01

How easy or difficult was this test?

Very difficult
Difficult
Somewhat difficult
Somewhat easy
Easy
Very easy

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 4 & 8 Reading: Student #6a]

Debrief_02a

What percentage of items do you think you answered correctly on this test?

10%
20%
30%
40%
50%
60%
70%
80%
90%
100%

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required
2	When answering this question, how did you figure out the percentage of items you answered correctly on this test? Was it very easy, easy, difficult, or very difficult to figure out the percentage of items you answered correctly on this test?	Specific	Required

[Grade 4 & 8 Reading: Student #6b]

Debrief_02b

How many items do you think you answered correctly on this test?

Less than half
Half
More than half
Almost all

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 4 & 8 Reading: Student #7]

Debrief_03

How similar were the questions on this test to the questions on your reading quizzes and tests?

Not at all similar
Not similar
Somewhat similar
Similar
Very similar

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 4 & 8 Reading: Student #8]

Debrief_04 How much do you agree with each of the following statements? Select one answer choice on each row.
	Strongly disagree	Disagree	Somewhat disagree	Somewhat agree	Agree	Strongly agree
Taking this test was fun.	A	B	C	D	E	F	Debrief_04_01
I applied a lot of effort to succeed on this test.	A	B	C	D	E	F	Debrief_04_02
Taking this test was stressful.	A	B	C	D	E	F	Debrief_04_03
Taking this test was challenging.	A	B	C	D	E	F	Debrief_04_04
I liked taking this test.	A	B	C	D	E	F	Debrief_04_05
I felt time pressure when taking this test.	A	B	C	D	E	F	Debrief_04_06

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Student #9]

TimeRea_1

How much time do you spend reading outside of school on a normal school day?

Less than 30 minutes
30 minutes up to 1 hour
From 1 hour up to 2 hours
2 hours or more

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required
2	Can you give me examples of things you might read outside of school?	Specific	Required

[Grade 4 & 8 Reading: Student #10]

TechUse_1

On a typical school day, about how many hours do you use a computer (desktop, laptop, or tablet) to do your English/language arts schoolwork, including homework?

None
Less than an hour
1-2 hours
3-4 hours
More than 4 hours

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required
2	What does the phrase "English/language arts schoolwork" mean to you? What are some examples of "English/language arts schoolwork"?	Specific	Required

[Grade 4 & 8 Reading: Student #11]

TechUse_2 Were you taught any of the following at school? Select one answer choice on each row.
	Yes	No
How to search for information on the Internet	A	B	TechUse_2_01
How to look up the meaning of a word using a computer	A	B	TechUse_2_02
How to look up online resources to practice things in reading that you were having trouble learning	A	B	TechUse_2_03

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	Can you tell me, in your own words, what option c is asking?	Specific	Required
3	In option c, what does the phrase "online resources" mean to you?	Specific	Required

[Grade 4 & 8 Reading: Student #12]

TechUse_3 Which of the following are true about the ways in which you and your teachers use computers or other digital devices in your English/language arts class? Select one answer choice on each row.
	Yes	No
There are laptop, desktop, or tablet computers that I can use for my English/language arts schoolwork.	A	B	TechUse_3_01
There is Wi-Fi or some other Internet connection that I can use for my English/language arts schoolwork.	A	B	TechUse_3_02
My English/language arts teacher uses computers or other digital devices when teaching my class.	A	B	TechUse_3_03
My English/language arts teacher requires us to use computers or other digital devices to complete assignments.	A	B	TechUse_3_04

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	What devices did you include when you thought about the word “computer”?	Specific	Required
3	Are there times when you can use a computer but, choose not to?	Specific	Required
4	If student answers "no" to option A ask the following: Are there computer labs that can be used?	Conditional	Required
5	In option b, what does the word "Wi-Fi" mean to you?	Specific	Required

[Grade 4 & 8 Reading: Student #13]

OutSch_1 In this school year, have you done the following things outside of the classroom? Select one answer choice on each row.
	Yes	No
I talked about books (print or online) with other people.	A	B	OutSch_1_01
I was part of a book club.	A	B	OutSch_1_02
I participated in a spelling bee competition.	A	B	OutSch_1_03
I participated in a summer reading program.	A	B	OutSch_1_04
I went to my local library to borrow books (print or online).	A	B	OutSch_1_05
I read text messages.	A	B	OutSch_1_07
I read blogs, forums, or social media.	A	B	OutSch_1_08
I read emails.	A	B	OutSch_1_09
I attended help sessions after school to improve my reading.	A	B	OutSch_1_10
I helped friends with reading homework.	A	B	OutSch_1_11

Alternative stem: In this school year, how often have you done the following things outside of the classroom? Select one answer choice on each row.

Alternative response options: Never or rarely/ Sometimes/Often/Always or almost always OR Never/ A few times / Once every few weeks/ About once a week / More than once a week

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option g, what does the word "blog" mean to you?	Specific	Required
3	In option g, what does the word "forum" mean to you?	Specific	Required
4	In option g, what does the phrase "social media" mean to you? Can you provide examples of "social media"?	Specific	Required
5	For option j, If the student answers “yes” ask the following probe: Can you give me examples of how you helped your friends with reading homework?	Conditional	Required

[Grade 4 & 8 Reading: Student #14]

Please note: The item below is a follow-up item for students that responded "Yes" to OutSch_1_04.

OutSch_2

Was the summer reading program you participated in required by your school?

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 4 & 8 Reading: Student #15]

Grit_1 Thinking about your English/language arts class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I finished whatever I began in reading.	A	B	C	D	E	Grit_1_01
I stayed committed to my reading goals, even if they took a long time to complete.	A	B	C	D	E	Grit _1_04
I kept working hard even when I felt like quitting.	A	B	C	D	E	Grit _1_05
I continued working on what I set out to do, even if it took a long time to complete.	A	B	C	D	E	Grit _1_06
I kept trying to improve myself, even if it took a long time to get there.	A	B	C	D	E	Grit _1_07
I came to class prepared.	A	B	C	D	E	Grit _1_08
I remembered and followed directions for my reading assignments.	A	B	C	D	E	Grit _1_09
I started working on assignments right away rather than waiting until the last minute.	A	B	C	D	E	Grit _1_10
I paid attention and resisted distractions.	A	B	C	D	E	Grit _1_11
I worked independently with focus on reading assignments.	A	B	C	D	E	Grit _1_12
I stayed on task without reminders from my teacher.	A	B	C	D	E	Grit _1_13
I paid attention in class even when I was bored.	A	B	C	D	E	Grit _1_14

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option b, what does the phrase "stayed committed" mean to you?	Specific	Required
3	In option k, what does the phrase "stayed on task" mean to you?	Specific	Required

[Grade 4 & 8 Reading: Student #16]

Curi_1 Thinking about your English/language arts class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I wanted to explore new reading texts.	A	B	C	D	E	Curi_1_01
I asked questions to help me learn reading skills better.	A	B	C	D	E	Curi _1_02
I showed interest in learning reading skills.	A	B	C	D	E	Curi _1_03
I was curious to learn more reading skills.	A	B	C	D	E	Curi _1_04
I looked for opportunities to improve my reading skills.	A	B	C	D	E	Curi _1_05

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Student #17]

LeaAct_1 In this school year, how often were you involved in the following reading activities? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Reading emails	A	B	C	D	LeaAct__01
Chatting online	A	B	C	D	LeaAct__02
Reading online news	A	B	C	D	LeaAct__03
Use an online dictionary or encyclopedia	A	B	C	D	LeaAct__04
Searching online information to learn about a particular topic	A	B	C	D	LeaAct__05
Taking part in online group discussions or forums	A	B	C	D	LeaAct__06
Searching for information online (for example, schedules, events, tips, recipes)	A	B	C	D	LeaAct__07
Text messaging	A	B	C	D	LeaAct__08

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option c, what does the word "news" mean to you?	Specific	Required

[Grade 4 & 8 Reading: Student #18]

InfForRea_1 How often do you read these things outside of the school day (print or online)? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Stories or novels	A	B	C	D	InfForRea_1_01
Poems	A	B	C	D	InfForRea_1_02
Plays	A	B	C	D	InfForRea_1_03
Autobiographies	A	B	C	D	InfForRea_1_04
Comic books	A	B	C	D	InfForRea_1_05
Magazines	A	B	C	D	InfForRea_1_06
Blogs or personal web pages	A	B	C	D	InfForRea_1_07
E-mails	A	B	C	D	InfForRea_1_08
Text messages	A	B	C	D	InfForRea_1_09

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Student #19a]

AchGoal_1 Thinking about you English/language arts class, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I want to show others that I am good at my English/language arts schoolwork.	A	B	C	D	E	AchGoal_1_02
I want to show others that my schoolwork is easy for me.	A	B	C	D	E	AchGoal_1_03
I want to look smart in comparison to the other students in my class.	A	B	C	D	E	AchGoal_1_04
In this class I want to learn as much as I can.	A	B	C	D	E	AchGoal_1_07
I want to master new reading skills this year.	A	B	C	D	E	AchGoal_1_08
It is important to me that I understand my schoolwork.	A	B	C	D	E	AchGoal_1_09
It is important to me that I improve my reading skills this year.	A	B	C	D	E	AchGoal_1_10
In this class I want to get a better grade than most of the other students.	A	B	C	D	E	AchGoal_1_11
It is important for me to do better than other students.	A	B	C	D	E	AchGoal_1_13
I want to master the material presented in this class.	A	B	C	D	E	AchGoal_1_14
It is important for me to understand everything I learn in this class.	A	B	C	D	E	AchGoal_1_16

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option a, what does the phrase "show others that I am good at" mean to you?	Specific	Required
3	In option c, what does the phrase "look smart" mean to you?	Specific	Required
4	In option e, what does the phrase "new reading skills" mean to you?	Specific	Required
5	In option h, what does the phrase "most of the other students" mean to you?	Specific	Required
6	Do you think "class work" and "schoolwork" are the same? If yes: How are they the same? If no: How are they different?	Specific	Required

[Grade 4 & 8 Reading: Student #19b]

AchGoal_1 Thinking about you English/language arts class, how much do you agree with each of the following statements? Select one answer choice on each row.
	Strongly disagree	Disagree	Somewhat disagree	Somewhat agree	Agree	Strongly agree
I want to show others that I am good at my English/language arts schoolwork.	A	B	C	D	E	F	AchGoal_1_02
I want to show others that my schoolwork is easy for me.	A	B	C	D	E	F	AchGoal_1_03
I want to look smart in comparison to the other students in my class.	A	B	C	D	E	F	AchGoal_1_04
In this class I want to learn as much as I can.	A	B	C	D	E	F	AchGoal_1_07
I want to master new reading skills this year.	A	B	C	D	E	F	AchGoal_1_08
It is important to me that I understand my schoolwork.	A	B	C	D	E	F	AchGoal_1_09
It is important to me that I improve my reading skills this year.	A	B	C	D	E	F	AchGoal_1_10
In this class I want to get a better grade than most of the other students.	A	B	C	D	E	F	AchGoal_1_11
It is important for me to do better than other students.	A	B	C	D	E	F	AchGoal_1_13
I want to master the material presented in this class.	A	B	C	D	E	F	AchGoal_1_14
It is important for me to understand everything I learn in this class.	A	B	C	D	E	F	AchGoal_1_16

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option a, what does the phrase "show others that I am good at" mean to you?	Specific	Required
3	In option c, what does the phrase "look smart" mean to you?	Specific	Required
4	In option e, what does the phrase "new reading skills" mean to you?	Specific	Required
5	In option h, what does the phrase "most of the other students" mean to you?	Specific	Required
6	Do you think "class work" and "schoolwork" are the same? If yes: How are they the same? If no: How are they different?	Specific	Required

Student Items – Grade 4

[Grade 4 Reading: Student #1]

VE659013

How often do you receive help from a tutor, family member, or friend with English/language arts outside of school or after school?

Never or hardly ever
Once or twice a month
Once or twice a week
Every day or almost every day

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 4 Reading: Student #2]

SelfEff_1 Do you think you would be able to do each of the following? Select one answer choice on each row.
	I definitely can’t	I probably can’t	Maybe	I probably can	I definitely can
Figure out the meaning of a word you don't know by using other words in the text	A	B	C	D	E	SelfEff_1_01
Explain the meaning of something you have read to your teacher	A	B	C	D	E	SelfEff_1_02
Understand the feelings of characters in a story	A	B	C	D	E	SelfEff_1_03
Figure out the main idea of a text	A	B	C	D	E	SelfEff_1_04_a
Tell your teacher your ideas about something you have read	A	B	C	D	E	SelfEff_1_05
Understand figures of speech (for example, similes and metaphors)	A	B	C	D	E	SelfEff_1_07
Find text in a reading passage to help you answer a question on a test	A	B	C	D	E	SelfEff_1_13
Recognize when you don't understand something you are reading	A	B	C	D	E	SelfEff_1_14
Recognize the difference between fact and opinion in a text	A	B	C	D	E	SelfEff_1_15

Alternative Stem: How confident do you feel that you could do each of the following? Select one answer choice on each row.

Alternative versions of answer choices: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option a, what does the word "text" mean to you?	Specific	Required
3	In option b, what does the phrase "something you have read" mean to you? Can you provide examples of things you might read?	Specific	Required

[Grade 4 Reading: Student #3]

NFCM_1 Thinking about your English/language arts class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
Thinking about reading is not my idea of fun.	A	B	C	D	E	NFCM _1_02
I like reading things that challenge my thinking abilities.	A	B	C	D	E	NFCM _1_03
I don't like thinking really hard about something I have read.	A	B	C	D	E	NFCM _1_04
I like thinking hard about something I have read.	A	B	C	D	E	NFCM _1_05

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option b, what does the phrase “thinking abilities” mean to you?	Specific	Required

Student Items – Grade 8

[Grade 8 Reading: Student #1]

VF174671

How often do you receive help from a tutor, family member, or friend with English/language arts outside of school or after school?

Never or hardly ever
Once or twice a month
Once or twice a week
Every day or almost every day

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 8 Reading: Student #2]

VC504022 In your English/language arts class this year, when reading a story, article, or other passage, how often does your teacher ask you to do the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Summarize the passage	A	B	C	D	VC504023
Interpret the meaning of the passage	A	B	C	D	VC504024
Question the motives or feelings of the characters	A	B	C	D	VC504025
Identify the main themes or main ideas of the passage	A	B	C	D	VE589611
Analyze two or more texts on the same topic and identify which texts are accurate and which are not	A	B	C	D	StuActInClas_05

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option c, what does the word “motives” mean to you?	Specific	Required

[Grade 8 Reading: Student #3]

VF009272

In your English/language arts class this year, when reading a story, article, or other passage, how often does your teacher ask you to do the following? Select one answer choice on each row.

Never or hardly ever

Once or twice a month

Once or twice a week

I don’t know.

Evaluate the main evidence in a persuasive/ argument passage

VF009274_versionb

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 8 Reading: Student #4]

SelfEff_1 Do you think you would be able to do each of the following? Select one answer choice on each row.
	I definitely can’t	I probably can’t	Maybe	I probably can	I definitely can
Figure out the meaning of a word you don't know by using other words in the text	A	B	C	D	E	SelfEff_1_01
Explain the meaning of something you have read to your teacher	A	B	C	D	E	SelfEff_1_02
Understand the feelings of characters in a story	A	B	C	D	E	SelfEff_1_03
Figure out the main theme of a text	A	B	C	D	E	SelfEff_1_04_b
Tell your teacher your ideas about something you have read	A	B	C	D	E	SelfEff_1_05
Understand figures of speech (for example, similes and metaphors)	A	B	C	D	E	SelfEff_1_07
Recognize when punctuation is used for effect (for example, "I'm hungry!")	A	B	C	D	E	SelfEff_1_08
Understand how specific word choices affect the meaning of a sentence (for example, "my friend was happy" versus "my friend was ecstatic")	A	B	C	D	E	SelfEff_1_10
Judge the reliability of sources (for example, how a website might be biased or inaccurate)	A	B	C	D	E	SelfEff_1_11
Credit others for their ideas (for example, citing sources, using endnotes and footnotes in reports)	A	B	C	D	E	SelfEff_1_12
Find text in a reading passage to help you answer a question on a test	A	B	C	D	E	SelfEff_1_13
Recognize when you don't understand something you are reading	A	B	C	D	E	SelfEff_1_14
Recognize the difference between fact and opinion in a text	A	B	C	D	E	SelfEff_1_15
Analyze the author’s organization of information in a passage	A	B	C	D	E	SelfEff_1_16
Critique the author’s craft or technique	A	B	C	D	E	SelfEff_1_17
Evaluate the evidence presented in a text	A	B	C	D	E	SelfEff_1_18
Identify the author's perspective in a persuasive text	A	B	C	D	E	SelfEff_1_19

Alternative stem: How confident do you feel that you could do each of the following? Select one circle in each row.

Alternative versions of answer choices: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option a, what does the word "text" mean to you?	Specific	Required
3	In option b, what does the phrase "something you have read" mean to you? Can you provide examples of things you might read?	Specific	Required
4	In option q, what does the phrase "persuasive text" mean to you?	Specific	Required
5	The following probe should be asked of every participant only once, and the timing should alternate. That is for one participant this probe should be asked after the participant has answered 1/4 of the sub-items; for the next three participants this probe should be asked after the participants have answered 1/2, 3/4, and all of the sub-items. Can you tell me what the question at the beginning asked you to do?	Specific	Required

[Grade 8 Reading: Student #5]

NFCM_1 Thinking about your English/language arts class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I prefer complex reading texts.	A	B	C	D	E	NFCM _1_01
Thinking about reading is not my idea of fun.	A	B	C	D	E	NFCM _1_02
I like reading things that challenge my thinking abilities.	A	B	C	D	E	NFCM _1_03
I don't like thinking really hard about something I have read.	A	B	C	D	E	NFCM _1_04
I like thinking hard about something I have read.	A	B	C	D	E	NFCM _1_05
I like reading assignments that require little effort.	A	B	C	D	E	NFCM _1_06
Learning new ways to think in English/language arts class doesn’t excite me very much.	A	B	C	D	E	NFCM _1_07

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option b, what does the phrase “thinking abilities” mean to you?	Specific	Required

Teacher – Grade 4 and 8 (Cross Grade)

[Grade 4 & 8 Reading: Teacher #1]

VF017603

How many students are in this class? Enter the number of students.

_____________

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for free response items, see page 4	General	Required

[Grade 4 & 8 Reading: Teacher #2]

CompRes_1 At your school, does your student have any of the following? Select one answer choice on each row.
	Yes	No
A laptop or desktop computer that is only for the student	A	B	CompRes_1_01
A laptop or desktop computer that is shared between other students	A	B	CompRes_1_02
A tablet computer that is only for the student	A	B	CompRes_1_03
A tablet computer that is shared between other students	A	B	CompRes_1_04
Wi-Fi or some other Internet connection	A	B	CompRes_1_05

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Teacher #3]

VC310622 This school year, to what extent have you emphasized the following cognitive processes when teaching informational and literary texts in class? Select one answer choice on each row.
	Not at all	Small extent	Moderate extent	Large extent
Locate and recall (e.g., identify main ideas, or focus on specific elements of a story)	A	B	C	D	VC310623
Integrate and interpret (e.g., make comparisons, explain character motivation, or examine relations of ideas across the text)	A	B	C	D	VC310625
Critique and evaluate (e.g., evaluate text critically from many perspectives, or evaluate overall text quality)	A	B	C	D	VC310627

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Teacher #4]

LimRes_1 In your view, to what extent do the following limit how you teach this class? Select one answer choice on each row.
	Not applicable	Not at all	Same	A lot
Students lacking prerequisite knowledge or skills	A	B	C	D	LimRes_1_01
Students with special needs (e.g., physical disabilities, mental or emotional/psychological impairment)	A	B	C	D	LimRes_1_04
Disruptive students	A	B	C	D	LimRes_1_05
Uninterested students	A	B	C	D	LimRes_1_06

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	Are there any other reasons, not mentioned in this item, that limit how you teach this class?	Specific	Required

[Grade 4 & 8 Reading: Teacher #5]

LimRes_2 In your school, how severe is each problem? Select one answer choice on each row.
	Not a problem	Minor problem	Moderate problem	Serious problem
The school building needs significant repair.	A	B	C	D	LimRes_2_01
Classrooms are overcrowded.	A	B	C	D	LimRes_2_02
Teachers have too many teaching hours.	A	B	C	D	LimRes_2_03
Teachers do not have adequate workspace (e.g., for preparation, collaboration, or meeting with students).	A	B	C	D	LimRes_2_04
Teachers do not have adequate instructional materials and supplies.	A	B	C	D	LimRes_2_05

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	When answering option a, did you consider or include your classroom?	Specific	Required

[Grade 4 & 8 Reading: Teacher #6]

Train_1 As part of your formal education and/or training, to what extent did you study the following areas? Select one answer choice on each row.
	Not at all	Overview or Introduction to topic	It was an area of emphasis
English	A	B	C	Train_1_01
Pedagogy/teaching reading	A	B	C	Train_1_02
Educational psychology	A	B	C	Train_1_03
Remedial reading	A	B	C	Train_1_04
Reading theory	A	B	C	Train_1_05
Special education	A	B	C	Train_1_06
Second language learning	A	B	C	Train_1_07
Assessment methods in reading	A	B	C	Train_1_08

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	When answering this item what kinds of formal education did you consider?	Specific	Required
3	When answering this item what kinds of training did you consider?	Specific	Required
4	For option g, if participant answers B or C ask the following probe: If you taught a student who already spoke two languages, would you still use the phrase “second language learning” or would you use some other phrase? If the participant says they would use another phrase, ask the following: What other phrase would you use?	Conditional	Required

[Grade 4 & 8 Reading: Teacher #7]

Curi_1 Thinking about your English/language arts class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I was eager to explore new reading texts.	A	B	C	D	E	Curi _1_01
I collaborated with other teachers to help me improve my reading lessons.	A	B	C	D	E	Curi _1_02
I showed interest in teaching reading skills.	A	B	C	D	E	Curi _1_03
I was eager to find new reading material to incorporate into my lessons.	A	B	C	D	E	Curi _1_04
I looked for opportunities to extend my teaching skills.	A	B	C	D	E	Curi _1_05
I was curious about my students understanding of reading skills.	A	B	C	D	E	Curi _1_06
I was curious about how my students think about reading skills.	A	B	C	D	E	Curi _1_07

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Teacher #8]

SelfEff_3 Do you think you would be able to do each of the following? Select one answer choice on each row.
	I definitely can’t	I probably can’t	Maybe	I probably can	I definitely can
Prepare lessons that are appropriate for students with varying reading abilities	A	B	C	D	E	SelfEff_3_01
Select relevant and challenging reading materials for students	A	B	C	D	E	SelfEff_3_02
Provide students with concrete and actionable feedback	A	B	C	D	E	SelfEff_3_03
Provide support to students who are struggling with reading	A	B	C	D	E	SelfEff_3_04
Help students understand the meaning of challenging reading texts	A	B	C	D	E	SelfEff_3_05
Help students make connections between their thinking and the reading material	A	B	C	D	E	SelfEff_3_06

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Teacher #9]

Assess_1_1 How often do you do use each of the following to assess student progress in English/language arts? Select one answer choice on each row.
	Never or hardly ever	A few times a year	Once or twice a month	Once or twice a week	Every day or almost every day
Multiple-choice tests	A	B	C	D	E	Assess_1_1_01
Short written responses (e.g., a phrase or sentence)	A	B	C	D	E	Assess_1 _1_02
Long written responses (e.g., several sentences or paragraphs)	A	B	C	D	E	Assess_1 _1_03
Group projects or presentations	A	B	C	D	E	Assess_1 _1_05
Individual projects or presentations	A	B	C	D	E	Assess_1 _1_06
Observation checklists	A	B	C	D	E	Assess_1_1_07
Exit cards or exit slips	A	B	C	D	E	Assess_1_1_08

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	Are there other types of assessments that you use to assess student progress?	Specific	Required
3	In option g, what does the phrase "exit cards or exit slips" mean to you?	Specific	Required

[Grade 4 & 8 Reading: Teacher #10]

Assess_2 How often do you use assessments to do each of the following? Select one answer choice on each row.
	Never or hardly ever	A few times a year	Once or twice a month	Once or twice a week	Every day or almost every day
Determine the student's current level of performance	A	B	C	D	E	Assess_2_1_01
Set goals for specific progress the student would like to make	A	B	C	D	E	Assess_2_1_02
Monitor progress the student has made toward goals previously set	A	B	C	D	E	Assess_2_1_03
Adjust your teaching strategies to meet the student's current learning needs and to reflect the student's future goals	A	B	C	D	E	Assess_2_1_04

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	What does the word "assessments" mean to you?	Specific	Required

[Grade 4 & 8 Reading: Teacher #11]

Attri_1 Suppose that your students did badly on a quiz you gave this week. How likely are you to consider each of the following reasons in this situation? Select one answer choice on each row.
	Not at all likely	Unlikely	Somewhat likely	Likely	Very likely
The topic is new and my students are still learning.	A	B	C	D	E	Attri_1_01
This is a challenging topic and my students may need more time to learn the concepts.	A	B	C	D	E	Attri_1_02
I have little support from my school to teach the material.	A	B	C	D	E	Attri_1_03
I have little support from my district to teach the material.	A	B	C	D	E	Attri_1_04
I may not have explained the concepts well this week.	A	B	C	D	E	Attri_1_05
Sometimes my students are unlucky.	A	B	C	D	E	Attri_1_07
My students did not study enough.	A	B	C	D	E	Attri_1_08

Alternative Stem: n/a

Alternative versions of answer choices: 1 = Least likely reason / 2 = Second likely reason / 3 = Likely reason

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Teacher #12]

Attri_2 Suppose you start reading a new book in your English/language arts class and your students find it difficult to understand at first. How likely are you to consider each of the following reasons in this situation? Select one answer choice on each row.
	Not at all likely	Unlikely	Somewhat likely	Likely	Very likely
I selected a challenging book.	A	B	C	D	E	Attri_2_01
My students were not fully paying attention when reading.	A	B	C	D	E	Attri_2_02
The words are challenging.	A	B	C	D	E	Attri_2_03

Alternative Stem: n/a

Alternative versions of answer choices: 1 = Least likely reason / 2 = Second likely reason / 3 = Likely reason

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 & 8 Reading: Teacher #13]

Attri_3 Suppose your students really did well on their last English/language arts test. How likely are you to consider each of the following reasons in this situation? Select one answer choice on each row.
	Not at all likely	Unlikely	Somewhat likely	Likely	Very likely
They were lucky.	A	B	C	D	E	Attri_3_01
They studied and were prepared.	A	B	C	D	E	Attri_2_02
They put a lot of effort.	A	B	C	D	E	Attri_3_03
They always do well on English/language arts tests.	A	B	C	D	E	Attri_3_04
I taught the concepts well.	A	B	C	D	E	Attri_3_05

Alternative Stem: n/a

Alternative versions of answer choices: 1 = Least likely reason / 2 = Second likely reason / 3 = Likely reason

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	Can you tell me, in your own words, what option a is asking?	Specific	Required

[Grade 4 & 8 Reading: Teacher #14]

VE658908

Excluding preparation for class, how often do you use a computer (desktop, laptop, or tablet) or other technological resources (e.g., smartboard) in school for English/language arts instruction and/or English/language arts activities?

Never or hardly ever
Once or twice a month
Once or twice a week
Almost everyday

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

Teacher – Grade 4

[Grade 4 Reading: Teacher #1a]

VB608498

In a typical week, about how much time in total do you spend with this class on English/language arts instruction? Language arts refers to reading, writing, literature, and related topics.

Less than 3 hours
3–6 hours
7–9 hours
10–13 hours
14 or more hours

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required
2	As part of generic probe 2 (see page 3), if the teacher selected answer choice E ask the following: Can you recall approximately how many hours you spend in a typical week?	Conditional	Required

[Grade 4 Reading: Teacher #1b]

VB608498

In a typical week, about how much time in total do you spend with this class on English/language arts instruction? Language arts refers to reading, writing, literature, and related topics. Enter the hours and minutes.

_________ hours and _________ minutes per week

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for free response items, see page 4	General	Required

[Grade 4 Reading: Teacher #2]

VC976533 In your fourth-grade English/language arts class this year, how often do your students use a desktop computer to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976534
Increase reading fluency and comprehension	A	B	C	D	VC976535
Practice spelling and grammar	A	B	C	D	VC976536
Access reading-related websites	A	B	C	D	VC976539
Conduct research for reading projects	A	B	C	D	VC976540

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option d, what does the phrase "reading-related websites" mean to you? Can you provide examples of "reading-related websites"?	Specific	Required
3	Do you consider “reading fluency” and “reading comprehension” similar activities? If yes: How are they similar? If no: How are they different?	Specific	Required

[Grade 4 Reading: Teacher #3]

VC976533_1_0 In your fourth-grade English/language arts class this year, how often do your students use a laptop computer to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976534_1_1
Increase reading fluency and comprehension	A	B	C	D	VC976535_1_2
Practice spelling and grammar	A	B	C	D	VC976536_1_3
Access reading-related websites	A	B	C	D	VC976539_1_4
Conduct research for reading projects	A	B	C	D	VC976540_1_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 Reading: Teacher #4]

VC976533_2_0 In your fourth-grade English/language arts class this year, how often do your students use a tablet computer to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976534_2_1
Increase reading fluency and comprehension	A	B	C	D	VC976535_2_2
Practice spelling and grammar	A	B	C	D	VC976536_2_3
Access reading-related websites	A	B	C	D	VC976539_2_4
Conduct research for reading projects	A	B	C	D	VC976540_2_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 Reading: Teacher #5]

VC976533_3_0 In your fourth-grade English/language arts class this year, how often do your students use other digital devices (e.g., a smartboard) to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976534_3_1
Increase reading fluency and comprehension	A	B	C	D	VC976535_3_2
Practice spelling and grammar	A	B	C	D	VC976536_3_3
Access reading-related websites	A	B	C	D	VC976539_3_4
Conduct research for reading projects	A	B	C	D	VC976540_3_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	What does the phrase "digital devices" mean to you?	Specific	Required

[Grade 4 Reading: Teacher #6]

SelfEff_2 Do you think you would be able to support students in learning each of the following? Select one answer choice on each row.
	I definitely can’t	I probably can’t	Maybe	I probably can	I definitely can
Figure out the meaning of a word they don't know by using other words in the text	A	B	C	D	E	SelfEff_2_01
Explain the meaning of something they have read to their teacher	A	B	C	D	E	SelfEff_2_02
Understand the feelings of characters in a story	A	B	C	D	E	SelfEff_2_03
Figure out the main idea of a text	A	B	C	D	E	SelfEff_2_04_a
Express their ideas about something they have read	A	B	C	D	E	SelfEff_2_05
Understand figures of speech (e.g., similes and metaphors)	A	B	C	D	E	SelfEff_2_07
Find text in a reading passage to help them answer a question on a test	A	B	C	D	E	SelfEff_2_13
Recognize when they don't understand something they are reading	A	B	C	D	E	SelfEff_2_14
Recognize the difference between fact and opinion in a text	A	B	C	D	E	SelfEff_2_15

Alternative Stem: How confident do you feel you can support students in learning the following? Select one answer choice on each row.

Alternative versions of answer choices: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option a, what does the word "text" mean to you?	Specific	Required
3	In option b, what does the phrase "something they have read" mean to you? Can you provide examples of things students might read?	Specific	Required

[Grade 4 Reading: Teacher #7]

PriOnlRes_1 When you have English/language arts instruction and/or do English/language arts activities with the students, how do you use the following resources? Select one answer choice on each row.
	Not used	Supplement	Basis for instruction
Hardback Textbooks	A	B	C	PriOnlRes_1_01
Electronic Textbooks	A	B	C	PriOnlRes_1_02
Reading series (e.g., basal readers, graded readers)	A	B	C	PriOnlRes_1_03
Workbooks or worksheets	A	B	C	PriOnlRes_1_04
A variety of children's books (e.g., novels, collections of stories, nonfiction)	A	B	C	PriOnlRes_1_05a
Materials from different curricular areas	A	B	C	PriOnlRes_1_06
Children's newspapers and/or magazines	A	B	C	PriOnlRes_1_07a
Computer software for reading instruction	A	B	C	PriOnlRes_1_08
Reading-related websites	A	B	C	PriOnlRes_1_09
Reading-related apps	A	B	C	PriOnlRes_1_10
Reference materials (e.g., encyclopedia, dictionary)	A	B	C	PriOnlRes_1_11
Reading-related educational games	A	B	C	PriOnlRes_1_12

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 Reading: Teacher #8]

VC976477 When reading a story with your students, how often do you ask your students to do the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Summarize the passage	A	B	C	D	VC976480
Interpret the meaning of the passage	A	B	C	D	VC976481
Question the motives or feelings of the characters	A	B	C	D	VC976482
Identify the main themes or main ideas of the passage	A	B	C	D	VC976484
Analyze two or more texts on the same topic and identify which texts are accurate and which are not	A	B	C	D	ActInClas_05

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

Teacher – Grade 8

[Grade 8 Reading: Teacher #1a]

VB345730

In a typical week, about how much time in total do you spend with one of your eighth-grade English/language arts classes?

Less than 3 hours
3–6 hours
7–9 hours
10–13 hours
14 or more hours

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required
2	As part of generic probe 2 (see page 3), if the teacher selected answer choice E ask the following: Can you recall approximately how many hours you spend on a typical week?	Conditional	Required

[Grade 8 Reading: Teacher #1b]

VB345730

In a typical week, about how much time in total do you spend with one of your eighth-grade English/language arts classes? Enter the hours and minutes.

_________ hours and _________ minutes per week

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for discrete items, see page 3	General	Required

[Grade 8 Reading: Teacher #2]

VC976477 When reading a story with your students, how often do you ask your students to do the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Summarize the passage	A	B	C	D	VC976480
Interpret the meaning of the passage	A	B	C	D	VC976481
Question the motives or feelings of the characters	A	B	C	D	VC976482
Identify the main themes or main ideas of the passage	A	B	C	D	VC976484
Analyze two or more texts on the same topic and identify which texts are accurate and which are not	A	B	C	D	ActInClas_05
Evaluate the main evidence in a persuasive/argument passage	A	B	C	D	VE658924
Analyze the author’s organization of information in a passage	A	B	C	D	VE658925
Critique the author’s craft or technique	A	B	C	D	VE658926

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 8 Reading: Teacher #3]

VC976571 In your eighth-grade English/language arts class this year, how often do your students use a desktop computer to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976572
Increase reading fluency and comprehension	A	B	C	D	VC976573
Access reading-related websites	A	B	C	D	VC976577
Conduct research for reading projects	A	B	C	D	VC976578

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option d, what does the phrase "reading-related websites" mean to you? Can you provide examples of "reading-related websites"?	Specific	Required
3	Do you consider “reading fluency” and “reading comprehension” similar activities? If yes: How are they similar? If no: How are they different?	Specific	Required

[Grade 8 Reading: Teacher #4]

VC976571_1_0 In your eighth-grade English/language arts class this year, how often do your students use a laptop computer to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976572_1_1
Increase reading fluency and comprehension	A	B	C	D	VC976573_1_2
Access reading-related websites	A	B	C	D	VC976577_1_4
Conduct research for reading projects	A	B	C	D	VC976578_1_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 8 Reading: Teacher #5]

VC976571_2_0 In your eighth-grade English/language arts class this year, how often do your students use a tablet computer to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976572_2_1
Increase reading fluency and comprehension	A	B	C	D	VC976573_2_2
Access reading-related websites	A	B	C	D	VC976577_2_4
Conduct research for reading projects	A	B	C	D	VC976578_2_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 8 Reading: Teacher #6]

VC976571_3_0 In your eighth-grade English/language arts class this year, how often do your students use other digital devices (e.g., a smartboard) to do each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	Once or twice a week	Every day or almost every day
Build and practice vocabulary	A	B	C	D	VC976572_3_1
Increase reading fluency and comprehension	A	B	C	D	VC976573_3_2
Access reading-related websites	A	B	C	D	VC976577_3_4
Conduct research for reading projects	A	B	C	D	VC976578_3_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	What does the phrase "digital devices" mean to you?	Specific	Required

[Grade 8 Reading: Teacher #7]

SelfEff_2 Do you think you would be able to support students in learning each of the following? Select one answer choice on each row.
	I definitely can’t	I probably can’t	Maybe	I probably can	I definitely can
Figure out the meaning of a word they don't know by using other words in the text	A	B	C	D	E	SelfEff_2_01
Explain the meaning of something they have read to their teacher	A	B	C	D	E	SelfEff_2_02
Understand the feelings of characters in a story	A	B	C	D	E	SelfEff_2_03
Figure out the main theme of a text	A	B	C	D	E	SelfEff_2_04_b
Express their ideas about something they have read	A	B	C	D	E	SelfEff_2_05
Understand figures of speech (e.g., similes and metaphors)	A	B	C	D	E	SelfEff_2_07
Recognize when punctuation is used for effect (e.g., "I'm hungry!")	A	B	C	D	E	SelfEff_2_08
Understand how specific word choices affect the meaning of a sentence (e.g., "my friend was happy" versus "my friend was ecstatic")	A	B	C	D	E	SelfEff_2_10
Judge the reliability of sources (e.g., how a website might be biased or inaccurate)	A	B	C	D	E	SelfEff_2_11
Credit others for their ideas (e.g., citing sources, using endnotes and footnotes in reports)	A	B	C	D	E	SelfEff_2_12
Find text in a reading passage to help them answer a question on a test	A	B	C	D	E	SelfEff_2_13
Recognize when they don't understand something they are reading	A	B	C	D	E	SelfEff_2_14
Recognize the difference between fact and opinion in a text	A	B	C	D	E	SelfEff_2_15
Analyze the author’s organization of information in a passage	A	B	C	D	E	SelfEff_2_16
Critique the author’s craft or technique	A	B	C	D	E	SelfEff_2_17
Evaluate the evidence presented in a text	A	B	C	D	E	SelfEff_2_18
Identify the author's perspective in a persuasive text	A	B	C	D	E	SelfEff_2_19

Alternative Stem: How confident do you feel you can support students in learning the following? Select one answer choice on each row.

Alternative versions of answer choices: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option a, what does the word "text" mean to you?	Specific	Required
3	In option b, what does the phrase "something they have read" mean to you? Can you provide examples of things students might read?	Specific	Required

[Grade 8 Reading: Teacher #8]

PriOnlRes_1 When you have English/language arts instruction and/or do English/language arts activities with the students, how do you use the following resources? Select one answer choice on each row.
	Not used	Supplement	Basis for instruction
Hardback Textbooks	A	B	C	PriOnlRes_1_01
Electronic Textbooks	A	B	C	PriOnlRes_1_02
Reading series (e.g., basal readers, graded readers)	A	B	C	PriOnlRes_1_03
Workbooks or worksheets	A	B	C	PriOnlRes_1_04
A variety of books (e.g., novels, collections of stories, nonfiction)	A	B	C	PriOnlRes_1_05b
Materials from different curricular areas	A	B	C	PriOnlRes_1_06
Newspapers and/or magazines	A	B	C	PriOnlRes_1_07b
Computer software for reading instruction	A	B	C	PriOnlRes_1_08
Reading-related websites	A	B	C	PriOnlRes_1_09
Reading-related apps	A	B	C	PriOnlRes_1_10
Reference materials (e.g., encyclopedia, dictionary)	A	B	C	PriOnlRes_1_11
Reading-related educational games	A	B	C	PriOnlRes_1_12

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

School – Grade 4 and 8 (Cross Grade)

[Grade 4 & 8 Reading: School #1]

VB380370 During the last two years, to what extent have professional development activities offered to teachers in your school focused on the following? Select one answer choice on each row.
	Not at all	Small extent	Moderate extent	Large extent
Use of English/language arts across the curriculum	A	B	C	D	VB380371
Interpreting and analyzing literature	A	B	C	D	VB380372
Interpreting and analyzing informational texts	A	B	C	D	VE634273
Understanding the cognitive process of an individual when they are reading or writing	A	B	C	D	VB380373
Use of scoring guides to evaluate student work	A	B	C	D	VE634274
Instructional strategies for teaching English/language arts	A	B	C	D	VB380374

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	What does the phrase "scoring guides" mean to you?	Specific	Required
3	What does the phrase "in your school" mean to you?	Specific	Required

[Grade 4 & 8 Reading: School #2]

ReaRes_1 How much is your school's capacity to provide instruction affected by a shortage or inadequacy of the following? Select one answer choice on each row.
	Not at all	A little	Some	A lot
Teachers with a specialization in reading	A	B	C	D	ReaRes_1_01
Computer software for reading instruction	A	B	C	D	ReaRes_1_02
Library books	A	B	C	D	ReaRes_1_03
Audio-visual resources for reading instruction	A	B	C	D	ReaRes_1_04

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

School – Grade 4

[Grade 4 Reading: School #1]

VE659100 To what extent are each of the following a responsibility of the reading specialist(s) available to fourth-grade students at your school? Select one answer choice on each row.
	Not at all	Small extent	Moderate extent	Large extent
Provide one-on-one help to students on various reading topics	A	B	C	D	VE658962
Provide one-on-one help to students at various achievement levels	A	B	C	D	VE659111

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

[Grade 4 Reading: School #2]

VC190984

To what extent is your school’s English/language arts program structured according to the following resources? Select one answer choice on each row.

Not at all

Small extent

Moderate extent

Large extent

Commercially developed programs

VC190995

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required
2	In option a, what does the phrase "commercially developed programs" mean to you? Can you provide examples of what "commercially developed programs"?	Specific	Required

School – Grade 8

[Grade 8 Reading: School #1]

VE659230 To what extent are each of the following a responsibility of the reading specialist(s) available to eighth-grade students at your school? Select one answer choice on each row.
	Not at all	Small extent	Moderate extent	Large extent
Provide one-on-one help to students on various reading topics	A	B	C	D	VF009700
Provide one-on-one help to students at various achievement levels	A	B	C	D	VF009703

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	For generic probes for matrix items, see page 4	General	Required

Mathematics Cognitive Interview Items and Probes

Student Items – Grades 4 and 8 (Cross Grades)

[Grades 4 and 8 Mathematics: Student #1]

In this school year, how often did you use a computer, tablet, or other digital device (excluding hand-held calculators) for math at school?

Never or hardly ever
Once every few weeks
About once a week
Two or three times a week
Every day or almost every day

VB525162

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	What does other digital device mean to you?	Specific	Required
3	What types of problems do you think of when you hear the word “math”?	Specific	Required
4	What types of problems do you think of when you hear the word “mathematics”?	Specific	Required

[Grades 4 and 8 Mathematics: Student #3]

Calc2_0 This school year, how often did you use the following digital devices to work on math problems including homework? Select one answer choice on each row.
	Never or hardly ever	Once every few weeks	About once a week	Two or three times a week	Every day or almost everyday
Hand-held calculator	A	B	C	D	E	Calc2_1
Desktop computer	A	B	C	D	E	Calc2_2
Laptop computer	A	B	C	D	E	Calc2_3
Tablet computer	A	B	C	D	E	Calc2_4
Smartphone	A	B	C	D	E	Calc2_5
Other device: (Please specify) _______	A	B	C	D	E	Calc2_6

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	[For option f]Which digital device were you thinking of?	Specific	Required
3	What does the word "Smartphone" mean to you?	Specific	Required

[Grades 4 and 8 Mathematics: Student #4]

TechUse5_0 In this school year, how often did the following things happen in your math class? Select one answer choice on each row.
	Never or hardly ever	Once every few weeks	About once a week	Two or three times a week	Every day or almost everyday
My teacher used computers or tablets to show us how to work through math problems.	A	B	C	D	E	TechUse5_1
I used Wi-Fi or some other Internet connection for my math work.	A	B	C	D	E	TechUse5_2
My teacher used computers when teaching math to my class.	A	B	C	D	E	TechUse5_3
My teacher required us to use computers, tablets, or other digital devices to complete math assignments.	A	B	C	D	E	TechUse5_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	[For option b]What does the term “Wi-Fi” mean to you?	Specific	Required
3	[For option c] Which devices did you include when you thought about the word “computer”?	Specific	Required
4	[For each option] How did you calculate the number of times a computer, tablet, or other digital device was used?	Specific	Required

[Grades 4 and 8 Mathematics: Student #5]

TechUse6_0 In this school year, how often have you used a computer, tablet, or other digital device (excluding hand-held calculators) for each of the following? Select one answer choice on each row.
	Never or hardly ever	Once or twice a month	About once a week	Two or three times a week	Every day or almost every day
Complete your math assignment	A	B	C	D	E	TechUse6_1
Look online for resources for help with your math assignment	A	B	C	D	E	TechUse6_2
Take an online practice test	A	B	C	D	E	TechUse6_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	[For all options] How did you calculate the number of times you used a computer, tablet, or other digital device to do this?	Specific	Required
3	What does the word “resources” mean to you?	Specific	Required

[Grades 4 and 8 Mathematics: Student #6]

Interest1_0 How much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I enjoy doing math.	A	B	C	D	E	Interest1_1
I look forward to my math class.	A	B	C	D	E	Interest1_2
I am interested in the things I learned in math.	A	B	C	D	E	Interest1_4
I think making an effort in math is worthwhile.	A	B	C	D	E	Interest1_6
I think math will help me in my daily life.	A	B	C	D	E	Interest1_8
I think it is important to do well in math.	A	B	C	D	E	Interest1_9

Alternate Item Stem: How much do you agree that each of the following statements describe a person like you? Select one answer choice on each row.

Alternate Response Options: Strongly disagree / Disagree / Somewhat disagree / Somewhat agree / Agree / Strongly agree

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	Which answer option is the easiest for you to answer?	Specific	Required
3	What types of math problems do you think of when you hear the word “mathematics”?	Specific	Required
4	What types of math problems do you think of when you hear the word “math”?	Specific	Required
5	[For option d] Would it be helpful to have examples?	Specific	Required
6	What does the term “putting in effort” mean to you?	Specific	Required
7	[For option d] What does the word “worthwhile” mean to you?	Specific	Required

[Grades 4 and 8 Mathematics: Student #7]

In this school year, how often have you used math on a daily basis outside of the classroom?

Never or hardly ever
A few times a year
Once or twice a month
Once or twice a week
Every day or almost every day

Outschool4_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	What does the term “outside of the classroom" mean to you?	Specific	Required
3	What does the term "used math" mean to you?	Specific	Required
4	What does the term "daily basis" mean to you?	Specific	Required
5	Can you give an example of using math on a daily basis outside of school?	Specific	Required

[Grades 4 and 8 Mathematics: Student #8]

Over the past seven days, have you helped your friends with their math homework?

Outschool1_20

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	If yes, how did you help your friends? Can you give an example?	General	Required

[Grades 4 and 8 Mathematics: Student #9]

("Ask this question if the student answered 'yes' to 'Outschool1_20')

Over the past seven days, how many days did you help your friends with their math homework? Enter the number of days.

_________

Outschool1_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	Would this question be easier to answer if you were given a specific number of days to refer to such as, one day or two days?	Specific	Required

[Grades 4 and 8 Mathematics: Student #10]

Over the past seven days, how many days did you participate in a math study group? Enter the number of days.

__________

Outschoo1_10

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	Would this question be easier to answer if you were given a specific number of days to refer to, such as one day or two days?	Specific	Required
3	What does the term “study group” mean to you?	Specific	Required

[Grades 4 and 8 Mathematics: Student #11]

Have you ever participated in a summer program for math?

Outschool2_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	What does the term “a summer program for math” mean to you?	Specific	Required

[Grades 4 and 8 Mathematics: Student #12]

(Ask this question if the student answered 'yes' to 'Outschool2_0'")

This past summer did you participate in a summer program for math?

Outschool3_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	[If yes] What program did you attend?	General	Required

[Grades 4 and 8 Mathematics: Student #13]

AchGoal1_0 Thinking about your math class this year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I want other students to think I am good at math.	A	B	C	D	E	AchGoal1_1
I want to show others that math schoolwork is easy for me.	A	B	C	D	E	AchGoal1_2
I want to look smart compared to other students in my math class.	A	B	C	D	E	AchGoal1_4
I want to master a lot of new skills in my math class.	A	B	C	D	E	AchGoal1_7
I want to improve my math skills this year.	A	B	C	D	E	AchGoal1_10
I want to get better grades than the other students in my math class.	A	B	C	D	E	AchGoal1_11
I want to learn as much as possible in my math class.	A	B	C	D	E	AchGoal1_15
I want to understand as much as I can in my math class.	A	B	C	D	E	AchGoal1_16

Alternate Item Stem: Thinking about your math class this year, how much do you agree with each of the following statements? Select one answer choice on each row.

Alternate Response Options: Strongly disagree / Disagree / Somewhat disagree / Somewhat agree / Agree / Strongly agree

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	[For option c]What does the term “look smart” mean to you?	Specific	Required
3	[For option d] What does the word "master" mean to you?	Specific	Required

[Grades 4 and 8 Mathematics: Student #14]

Grit1_0 Thinking about your math class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I finished whatever I began in math.	A	B	C	D	E	Grit 1_1
I stayed committed to my math goals, even if they took a long time to complete.	A	B	C	D	E	Grit1_4
I kept working even when I felt like quitting in my math class.	A	B	C	D	E	Grit1_5
I continued working on what I set out to do, even if it took a long time to complete.	A	B	C	D	E	Grit1_6
I kept trying to improve myself in math, even if it took a long time to get there.	A	B	C	D	E	Grit1_7
I came to math class prepared.	A	B	C	D	E	Grit1_8
I remembered and followed directions for my math assignments.	A	B	C	D	E	Grit1_9

Item Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	(Grade 8 Only)[For options a-d] If these options asked you about your English class, would you answer in the same way?	Specific	Required
3	[If no to if these options asked you about your English class…”]How would you answer differently?	Specific	Required
4	(Grade 8 Only) [For options a-d ] If these options asked you about your science class, would you answer in the same way?	Specific	Required
5	[If no to “if these items asked you about your science class…”] How would you answer differently?	Specific	Required
6	What does the term "long time" in option b mean to you?	Specific	Required

[Grades 4 and 8 Mathematics: Student #14]

Grit2_0 Thinking about your math class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I started working on my math assignments right away rather than waiting until the last minute.	A	B	C	D	E	Grit1_10
I paid attention and resisted distractions during math class.	A	B	C	D	E	Grit1_11
I worked independently with focus on math assignments.	A	B	C	D	E	Grit1_12
I stayed on task without reminders from my math teacher.	A	B	C	D	E	Grit1_13
I paid attention in my math class even when I was bored.	A	B	C	D	E	Grit1_14

Item Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	In option c, what does the term "with focus" mean to you?	Specific	Required
3	In option d, what does the term "stayed on task" mean to you"	Specific	Required

[Grades 4 and 8 Mathematics: Student #15]

Curiosity0_0 Thinking about your math class this school year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I wanted to explore new math concepts.	A	B	C	D	E	Curiosity1_0
I asked questions so that I could better learn math concepts.	A	B	C	D	E	Curiosity1_1
I showed interest in learning how to solve math problems.	A	B	C	D	E	Curiosity1_2
I was curious to learn to solve different types of math problems.	A	B	C	D	E	Curiosity1_3
I looked for opportunities to improve my math skills.	A	B	C	D	E	Curiosity1_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	[For Grade 4 only] What does the word "concepts" in option a mean to you?	Specific	Required

Student Items – Grade 4 Specific

[Grade 4, Mathematics: Student #1]

Calc1_1 In your math class this year, how often have you used the following types of calculators? Select one answer choice on each row.
	Never or almost never	Rarely	Sometimes	Often	Always or almost always
Basic four-function calculator	A	B	C	D	E	Calc1_2
Calculator app on a Smartphone	A	B	C	D	E	Calc1_4
Calculator on a tablet computer	A	B	C	D	E	Calc1_5
Calculator on a desktop or laptop computer	A	B	C	D	E	Calc1_6
I preferred not to use a calculator.	A	B	C	D	E	Calc1_7

Item-Specific Probe:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

[Grade 4 Mathematics: Student #2]

Interest2_0 In your math class this year, how much do you enjoy solving the following types of math problems? Select one answer choice on each row.
	Not at all	Not very much	Somewhat	Mostly	Very much
Addition, subtraction, multiplication, and division	A	B	C	D	E	Interest2_1
Working with geometric figures like rectangles and squares	A	B	C	D	E	Interest2_6
Finding the area and parameter of different shapes	A	B	C	D	E	Interest2_7
Looking at patterns, graphs, and charts	A	B	C	D	E	Interest2_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	Are there other math activities that you enjoy?	Specific	Required

[Grade 4 Mathematics: Student #3]

SelfEff1_0 Thinking about math, do you think that you would be able to do each of the following with a calculator? Do not actually solve the problems. Select one answer choice on each row.
	I definitely can’t	I probably can't	Maybe	I probably can	I definitely can
Solve 4 x 50 x 9 =?	A	B	C	D	E	SelfEff1_1
Solve 301 – 75 =?	A	B	C	D	E	SelfEff1_5
Solve 65 x 21 =?	A	B	C	D	E	SelfEff1_7
Solve 125 ÷ 6 =?	A	B	C	D	E	SelfEff1_8
Solve 24 + 14 =?	A	B	C	D	E	SelfEff1_9

Alternate Item Stem: How confident do you feel that you could do each of the following with a calculator? Do not try to solve them. Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	When answering this question, did you try to solve any of the problems?	Specific	Required
3	[Looking at both versions of the question] Which option is easiest for you to answer?	Specific	Required

[Grade 4 Mathematics: Student #4]

SelfEff2_0 Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row.
	I definitely can’t	I probably can't	Maybe	I probably can	I definitely can
Solve 4 x 50 x 9 =?	A	B	C	D	E	SelfEff2_1
Solve 1,000,000 – 513,462 =?	A	B	C	D	E	SelfEff2_3
Solve 301 – 75 =?	A	B	C	D	E	SelfEff2_4
Solve 65 x 21 =?	A	B	C	D	E	SelfEff2_6
Solve 125 ÷ 6 =?	A	B	C	D	E	SelfEff2_7

Alternate Item Stem: How confident do you feel that you could do each of the following without a calculator? Do not try to solve them. Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	After looking at this question, did you think you were supposed to use a calculator?	Specific	Required

[Grade 4 Mathematics: Student #4]

SelfEff2_0 Thinking about math, Do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row.
	I definitely can’t	I probably can't	Maybe	I probably can	I definitely can
Estimate the weight of 5 apples using pounds (lbs)	A	B	C	D	E	SelfEff3_17
Divide 42 stickers by 6 students	A	B	C	D	E	SelfEff3_18
Find the amount of carpet needed to cover a rectangular floor if you know its length and width	A	B	C	D	E	SelfEff3_15
When to take a turkey out of the oven if, the time is 10:00 a.m. and it takes 3 hours and 45 minutes to cook	A	B	C	D	E	SelfEff3_16

Alternate Item Stem: How confident do you feel that you could do each of the following without a calculator? Do not try to solve them. Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	After looking at this question, did you think you were supposed to use a calculator?	Specific	Required

[Grade 4, Mathematics: Student #5]

SelfEff4_0 Thinking about math, do you think you would be able to do each of the following? Select one answer choice on each row.
	I definitely can’t	I probably can't	Maybe	I probably can	I definitely can
Determine what the problem is asking and the best way to solve it	A	B	C	D	E	SelfEff4_1
Read problems carefully to see what I know and what I need to know	A	B	C	D	E	SelfEff4_2
Use different steps to solve the same problem	A	B	C	D	E	SelfEff4_3
Talk about the steps I used to solve a problem	A	B	C	D	E	SelfEff4_4
Use different tools like a ruler or calculator to solve problems	A	B	C	D	E	SelfEff4_5
Use charts, lists, or drawings to solve math problems	A	B	C	D	E	SelfEff4_6

Alternate Item Stem: How confident do you feel that you could do each of the following? Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

[Grade 4 Mathematics: Student #6]

Outschool1_0 During the school year, how often did you participate in the following activities outside of the classroom? Select one answer choice on each row.
	Never or hardly ever	Once every few weeks	About once a week	Two or three times a week	Every day or almost every day
Talk about math problems with your friends	A	B	C	D	E	Outschool1_1
Play chess	A	B	C	D	E	Outschool1_6
Participate in a math club	A	B	C	D	E	Outschool1_8
Use online forums to look for help with your math homework	A	B	C	D	E	Outschool1_11
Use online games or apps to solve math problems	A	B	C	D	E	Outschool1_12
Measure ingredients when cooking or baking at home	A	B	C	D	E	Outschool1_14
Attend tutoring with other students	A	B	C	D	E	Outschool1_15
Attend extra-help sessions after school	A	B	C	D	E	Outschool1_16
Play an instrument and read music	A	B	C	D	E	Outschool1_17
Go to websites for help with your math homework	A	B	C	D	E	Outschool1_18

Alternate Response Options: Never or almost never / Rarely / Sometimes / Often / Always or Almost Always

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	Can you give an example of using math on a daily basis outside of school?	Specific	Required
3	[For option e] Would this question be easier to answer if you were given examples?	Specific	Required
4	Can you think of any online games that you or your friends play to help with your math skills?	Specific	Required
5	[For option g] Can you give an example of what “tutoring with other students” would be at your school?	Specific	Required
6	Can you think of other out of school math activities that you don't see listed here?	Specific	Required
7	What does the term "online forums" mean to you?	Specific	Required

[Grade 4, Mathematics: Student #7]

NFCM1_0 Thinking about your math class this year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
Thinking about math is my idea of fun.	A	B	C	D	E	NFCM1_2
I like math problems that challenge my thinking abilities.	A	B	C	D	E	NFCM1_3
I try to avoid situations where I will have to think about math in depth.	A	B	C	D	E	NFCM1_4
I enjoy thinking about new solutions to math problems.	A	B	C	D	E	NFCM1_7
I like to solve puzzles with numbers and equations.	A	B	C	D	E	NFCM1_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

Student Items – Grade 8 Specific

[Grade 8, Mathematics: Student #1]

What math classes are you taking this year? Select one or more answer choices.

Integrated or sequential math
Eighth-grade math
General eighth-grade math
Algebra I course
First year of a two-year algebra course
Second year of a two-year algebra course
Algebra I (one-year course)
Algebra II
Geometry
Other

VB543277

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	What does the term “algebra II” mean to you?	Specific	Required
3	What does the term “integrated math” mean to you?	Specific	Required

[Grade 8, Mathematics: Student #1]

Calc1_1 In your math class this year, how often have you used the following types of calculators? Select one answer choice on each row.
	Never or almost never	Rarely	Sometimes	Often	Always or almost always
Basic four-function calculator	A	B	C	D	E	Calc1_2
Graphing calculator	A	B	C	D	E	Calc1_3
Calculator app on a Smartphone	A	B	C	D	E	Calc1_4
Calculator on a tablet computer	A	B	C	D	E	Calc1_5
Calculator on a desktop or laptop computer	A	B	C	D	E	Calc1_6
I preferred not to use a calculator.	A	B	C	D	E	Calc1_7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

[Grade 8, Mathematics: Student #2]

Interest2_0 In your math class this year, how much do you enjoy solving the following types of math problems? Select one answer choice on each row.
	Not at all	Not very much	Somewhat	Mostly	Very much
Addition, subtraction, multiplication, and division	A	B	C	D	E	Interest2_1
Finding areas of shapes and figures	A	B	C	D	E	Interest2_2
Solving odds and probabilities problems	A	B	C	D	E	Interest2_3
Solving equations or simplifying expressions	A	B	C	D	E	Interest2_4
Constructing and building different types of graphs (e.g., bar graph, line graph, or box and whisker plots)	A	B	C	D	E	Interest2_5
Working with geometric figures like rectangles and squares	A	B	C	D	E	Interest2_6
Finding the area and parameter of different shapes	A	B	C	D	E	Interest2_7
Looking at patterns, graphs, and charts	A	B	C	D	E	Interest2_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	Are there other math activities that you enjoy?	Specific	Required

[Grade 8, Mathematics: Student #3]

SelfEff1_0 Thinking about math, do you think that you would be able to do each of the following with a calculator? Do not actually solve the problems. Select one answer choice on each row.
	I definitely can’t	I probably can’t	Maybe	I probably can	I definitely can
Solve 4 x 50 x 9 =?	A	B	C	D	E	SelfEff1_1
Solve 1,000,000 – 513,462 =?	A	B	C	D	E	SelfEff1_4
Solve 301 – 75 =?	A	B	C	D	E	SelfEff1_5
Solve 65 x 21 =?	A	B	C	D	E	SelfEff1_7
Solve 125 ÷ 6 =?	A	B	C	D	E	SelfEff1_8
Solve 24 + 14 =?	A	B	C	D	E	SelfEff1_9
Solve 3x + 5 = 17	A	B	C	D	E	SelfEff1_14

Alternate Item Stem: How confident do you feel that you could do each of the following with a calculator? Do not try to solve them. Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	[Looking at both versions] Which option is easiest for you to answer?	Specific	Required
2	See page 3 for matrix generic probes.	Specific	Required
3	When answering this question, did you try to solve any of the problems?	Specific	Required

[Grade 8, Mathematics: Student #4]

SelfEff2_0 Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row.
	I definitely can’t	I probably can't	Maybe	I probably can	I definitely can
Solve 4 x 50 x 9 = ?	A	B	C	D	E	SelfEff2_1
Solve 1,000,000 – 513,462 = ?	A	B	C	D	E	SelfEff2_3
Solve 301 – 75 = ?	A	B	C	D	E	SelfEff2_4
Solve 65 x 21 = ?	A	B	C	D	E	SelfEff2_6
Solve 125 ÷ 6 = ?	A	B	C	D	E	SelfEff2_7
Solve 3x + 5 = 17	A	B	C	D	E	SelfEff1_14
Solve for h if, h = 73 + 2.5 (400)	A	B	C	D	E	SelfEff2_12
Solve 3 x (__ + 5) = 30	A	B	C	D	E	SelfEff2_13

Alternate Item Stem: How confident do you feel that you could do each of the following without a calculator? Do not try to solve them. Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	After looking at this question did you think you were supposed to use a calculator?	Specific	Required

[Grade 8, Mathematics: Student #5]

SelfEff2_0 Thinking about math, do you think that you would be able to do each of the following? Do not actually solve the problems. Select one answer choice on each row.
	I definitely can’t	I probably can't	Maybe	I probably can	I definitely can
Estimate the weight of 5 apples using pounds (lbs)	A	B	C	D	E	SelfEff3_17
Divide 42 stickers by 6 students	A	B	C	D	E	SelfEff3_18
Calculate how many square feet of tile you need to cover your classroom floor	A	B	C	D	E	SelfEff3_1
Find the actual distance between two places on a map with a 1:10,000 scale	A	B	C	D	E	SelfEff3_4
Calculate the gas mileage of a car	A	B	C	D	E	SelfEff3_6
Determine a 20% tip of a $67 restaurant dinner bill	A	B	C	D	E	SelfEff3_9
Estimate the area of your classroom floor using square feet	A	B	C	D	E	SelfEff3_11
Describe the properties shared by every isosceles right triangle	A	B	C	D	E	SelfEff3_12
Find the amount of carpet needed to cover a rectangular floor if you know its length and width	A	B	C	D	E	SelfEff3_15
Know when to take a turkey out of the oven if, the time is 10:00 a.m. and it takes 3 hours and 45 minutes to cook	A	B	C	D	E	SelfEff3_16

Alternate Item Stem: How confident do you feel that you could do each of the following without a calculator? Do not try to solve them. Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	After looking at this question did you think you were supposed to use a calculator?	Specific	Required

[Grade 8, Mathematics: Student #5]

SelfEff4_0 Thinking about math, do you think you would be able to do each of the following? Select one answer choice on each row.
	I definitely can’t	I probably can’t	Maybe	I probably can	I definitely can
Determine what the problem is asking and the best way to solve it	A	B	C	D	E	SelfEff4_1
Read problems carefully to see what I know and what I need to know	A	B	C	D	E	SelfEff4_2
Relate what I have learned in math class to the real world	A	B	C	D	E	SelfEff4_10
Use the correct math terms when describing and solving math problems	A	B	C	D	E	SelfEff4_7
Look at patterns in tables and graphs to describe relationships	A	B	C	D	E	SelfEff4_8
Discover patterns and make statements about them	A	B	C	D	E	SelfEff4_9
Create equations	A	B	C	D	E	SelfEff4_11

Alternate Item Stem: How confident do you feel that you could do each of the following? Select one answer choice on each row.

Alternate Response Options: Not at all confident / Not very confident / Confident / Very confident

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

[Grade 8, Mathematics: Student #6]

Outschool1_0 During this school year, how often did participate in the following activities outside of the classroom? Select one answer choice on each row.
	Never or hardly ever	Once every few weeks	About once a week	Two or three times a week	Every day or almost every day
Talk about math problems with your friends	A	B	C	D	E	Outschool1_1
Work on math homework outside of the classroom	A	B	C	D	E	Outschool1_2
Play chess	A	B	C	D	E	Outschool1_6
Program computers	A	B	C	D	E	Outschool1_7
Participate in a math club	A	B	C	D	E	Outschool1_8
Use online forums to look for help with your math homework	A	B	C	D	E	Outschool1_11
Use online games or apps to solve math problems	A	B	C	D	E	Outschool1_12
Measure ingredients when cooking or baking at home	A	B	C	D	E	Outschool1_14
Attend tutoring with other students	A	B	C	D	E	Outschool1_15
Attend extra-help sessions after school	A	B	C	D	E	Outschool1_16
Play an instrument and read music	A	B	C	D	E	Outschool1_17
Go to websites for help with your math homework	A	B	C	D	E	Outschool1_18

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	Can you give an example of using math on a daily basis outside of school?	Specific	Required
3	[For option g] Would this question be easier to answer if you were given examples?	Specific	Required
4	Can you think of any online games that you or your friends play to help with your math skills?	Specific	Required
5	[For option i] Can you give an example of what “tutoring with other students” would be at your school?	Specific	Required
6	Can you think of other out of school math activities that you don't see listed here?	Specific	Required
7	What does the term "online forums" mean to you?	Specific	Required

[Grade 8, Mathematics: Student #7]

NFCM1_0 Thinking about your math class this year how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
In math class, I prefer complex problems to simple problems.	A	B	C	D	E	NFCM1_1
Thinking about math is my idea of fun.	A	B	C	D	E	NFCM1_2
I like math problems that challenge my thinking abilities.	A	B	C	D	E	NFCM1_3
I try to avoid situations where I will have to think about math in depth	A	B	C	D	E	NFCM1_4
I like to think about challenging math questions	A	B	C	D	E	NFCM1_5
I like math tasks that require little thought once I have learned them.	A	B	C	D	E	NFCM1_6
I enjoy thinking about new solutions to math problems.	A	B	C	D	E	NFCM1_7
Learning new ways to think in math class excites me.	A	B	C	D	E	NFCM1_8
I like to solve puzzles with numbers and equations.	A	B	C	D	E	NFCM1_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

Teacher Items – Grades 4 and 8 (Cross Grades)

[Grades 4 and 8 Mathematics: Teacher #1]

HE001130 How often do you use each of the following to assess student progress in mathematics? Select one answer choice on each row.
	Never or hardly ever	Once or twice a year	Once or twice a month	Once or twice a week
Multiple-choice tests	A	B	C	D	HE001131
Problem sets	A	B	C	D	HE001132
Short written responses (e.g., a phrase or sentence)	A	B	C	D	HE001133
Long written responses (e.g., several sentences or paragraphs)	A	B	C	D	Instr1_0
Project-based assignments	A	B	C	D	Inst1_2
Collaboration on group assignments	A	B	C	D	Inst1_3
District or state mandated tests	A	B	C	D	Assess1_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	If your state uses common core standards, would you include them in your answer?	General	Required

[Grades 4 and 8 Mathematics: Teacher #2]

FrmAsses2_0 In your mathematics class this year, how often do you use assessments to do each of the following? Select one answer choice on each row.
	Never or hardly ever	A few times a year	Once or twice a month	Once or twice a week	Every day or almost every day
Discuss the student’s current level of performance with him or her	A	B	C	D	E	FrmAsses2_1
Set goals for specific progress that your students would like to make	A	B	C	D	E	FrmAsses2_2
Discuss the progress your students have made toward individually set goals	A	B	C	D	E	FrmAsses2_3
Determine how to adjust your teaching strategies to meet the current learning needs of individual students	A	B	C	D	E	FrmAsses2_4
Determine how to adjust your teaching strategies to reflect your goals for the classroom	A	B	C	D	E	FrmAsses2_5
Discuss class progress with school administrators	A	B	C	D	E	FrmAsses2_6
Discuss class progress with other colleagues	A	B	C	D	E	FrmAsses2_7
Compare your school’s mathematics progress with that of other schools in your district or state	A	B	C	D	E	FrmAsses2_8

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	Specific	Required

[Grades 4 and 8 Mathematics: Teacher #3]

VC976197 In your mathematics class this year, how often did your students use a computer, tablet, or other digital device to do each of the following? Select one answer choice on each row.
	Never or hardly ever	A few times a year	Once or twice a month	Once or twice a week	Every day or almost every day
Practice or review mathematics topics	A	B	C	D	E	VC976199
Extend mathematics learning with enrichment activities	A	B	C	D	E	VC976201
Research mathematics topics on the Internet	A	B	C	D	E	Revised/VC976202

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

[Grades 4 and 8 Mathematics: Teacher #4]

VC976303 In your mathematics class this year, how often did you do each of the following with individual students to evaluate their progress in mathematics? Select one answer choice on each row.
	Never or hardly ever	A few times a year	Once or twice a month	Once or twice a week	Every day or almost every day
Discuss the student’s current level of performance	A	B	C	D	E	VC976304
Set goals for specific progress the student would like to make	A	B	C	D	E	VC976305
Discuss progress the student has made toward goals previously set	A	B	C	D	E	VC976306
Determine how to adjust your teaching strategies to meet the student’s current learning needs	A	B	C	D	E	VC976307
Determine how to adjust your teaching strategies to meet the student’s goals	A	B	C	D	E	Inst2_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	Does the phrasing in the leading question make sense to you?	Specific	Required
3	[If no, to question 2] What phrasing do you think would work better?	Specific	Required

[Grades 4 and 8 Mathematics: Teacher #5]

NewOrg1_0 Where do your instructional materials come from? Select one answer choice on each row.
	Yes	No
Text books provided by your district or school	A	B	NewOrg1_1
Materials provided by your district	A	B	NewOrg1_2
Materials found on the Internet	A	B	NewOrg1_3
Other materials: (Please specify) ____________	A	B	NewOrg1_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	What does the word “materials” mean to you?	Specific	Required
3	[If yes, to option d] Where else do you get instructional materials from?	Specific	Required

[Grades 4 and 8 Mathematics: Teacher #6]

TeachAttr9_0 Suppose your students really did well on their last mathematics test. How likely are the following to be reasons for the student’s success? Select one answer choice on each row.
	Not at all likely	Not likely	Somewhat likely	Likely	Very likely
Students studied and were prepared.	A	B	C	D	E	TeachAttr9_2
Students put in a lot of effort.	A	B	C	D	E	TeachAttr9_3
Students always do well on tests.	A	B	C	D	E	TeachAttr9_4
I taught the concepts well.	A	B	C	D	E	TeachAttr9_5
The students guessed well on the quiz.	A	B	C	D	E	TeachAttr9_7
Sometimes students are just lucky.	A	B	C	D	E	TeachAttr9_8
Many of the students are just good at math.	A	B	C	D	E	TeachAttr9_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	What might be other reasons why students would do really well that are not listed here?	Specific	Required
3	In general, how do you feel about teaching mathematics after looking at his question?	Specific	Required

[Grades 4 and 8 Mathematics: Teacher #7]

TeachCur1_0 During your mathematics class this year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I was eager to explore new concepts in mathematics with my students.	A	B	C	D	D	TeachCur1_1
I collaborated with other teachers to improve my mathematics lessons.	A	B	C	D	D	TeachCur1_2
I took an active interest in learning new mathematics concepts to share with my students.	A	B	C	D	D	TeachCur1_3
I was curious to learn more mathematics concepts to incorporate into my lessons.	A	B	C	D	D	TeachCur1_4
I looked for opportunities to extend my approach to teaching mathematics.	A	B	C	D	D	TeachCur1_5
I was curious about my students understanding of mathematical concepts.	A	B	C	D	D	TeachCur1_6
I was curious about the ways my students think about mathematical concepts.	A	B	C	D	D	TeachCur1_7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

[Grades 4 and 8 Mathematics: Teacher #8]

In your mathematics class this year, how often did you incorporate new technology into mathematics instruction?

Never or hardly ever
A few times a year
Once or twice a month
Once or twice a week
Every day or almost every day

NewTech1_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	In this context, what does the word “new” mean to you?	Specific	Required
3	In this context, what does the term “new technology” mean to you?	Specific	Required
4	When you think of the term "new technology,” are you thinking of technology that is new to you, or new to students and new as an instructional tool?	Specific	Required

[Grades 4 and 8 Mathematics: Teacher #9]

In your mathematics class this year, how often did you encourage your students to participate in mathematics activities outside of school?

Never or hardly ever
A few times a year
Once or twice a month
Once or twice a week
Every day or almost every day

OutSchool6_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	When answering this question, were you thinking of specific activities?	Specific	Required
3	[If yes to, “when answering this question…”] Which activities did you think of?	Specific	Required

[Grades 4 and 8 Mathematics: Teacher #10]

In your mathematics class this year, how often did you provide opportunities for your students to participate in mathematics activities outside of school?

Never or hardly ever
A few times a year
Once or twice a month
Once or twice a week
Every day or almost every day

OutSchool7_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	When answering this question, were you thinking of specific activities?	Specific	Required
3	[If yes, to “when answering this question…”] Which activities did you think of?	General	Required

Teacher Items – Grade 4 Specific

[Grade 4 Mathematics: Teacher #1]

TeachEff1_0 Thinking about your fourth-grade mathematics classes this year, how much emphasis did you place on the following? Select one answer choice on each row.
	Little to no emphasis	Not much emphasis	Some emphasis	A lot of emphasis
How to determine what the problem is asking and the best way to solve it	A	B	C	D	TeachEff3_0
How to use alternate methods to solve problems when the first method does not work	A	B	C	D	TeachEff3_1
Ways to explain ones thinking and make connections between models and equations	A	B	C	D	TeachEff3_2
How to make assumptions and approximations	A	B	C	D	TeachEff3_3
How to represent a problem situation with numbers, words, pictures, or charts	A	B	C	D	TeachEff3_4
Understanding of tools for problem solving and limitations of use	A	B	C	D	TeachEff3_6
How to use clear and precise language when students are discussing their problem solving and reasoning	A	B	C	D	TeachEff3_7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[Present participant with both versions of item] Of the two response options, which is easiest to answer?	Specific	Required
3	After reading through this question, do you feel evaluated in any way?	General	Required

Teacher Items – Grade 8 Specific

[Grade 8 Mathematics: Teacher #1]

TeachEff4_0 Thinking about your eighth-grade mathematics classes this year, how much emphasis did you place on the following when teaching mathematics? Select one answer choice on each row.
	Little to no emphasis	Not much emphasis	Some emphasis	A lot of emphasis
How to make assumptions and approximations	A	B	C	D	TeachEff3_3
Ways to use models to explain calculations	A	B	C	D	TeachEff3_8
How to represent a problem situation in multiple ways including numbers, words, pictures, and charts.	A	B	C	D	TeachEff3_9
How to evaluate a problem-solving process	A	B	C	D	TeachEff3_10
How to create equations	A	B	C	D	TeachEff3_11
Ways for students to relate what they know to the real world and make sense of it mathematically	A	B	C	D	TeachEff3_12
How to use appropriate terminology when referring to the number system, functions, geometric figures, and data displays	A	B	C	D	TeachEff3_13
Ways to examine patterns in tables and graphs to generate equations and describe relationships	A	B	C	D	TeachEff3_14

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[Present participant with both versions of item] Of the two response options, which is easiest to answer?	Specific	Required
3	After reading through this question, do feel evaluated in any way?	General	Required

School Items – Grades 4 and 8 (Cross Grades)

[Grades 4 and 8 Mathematics: School #1]

OutSchoolS3_0 In this school year, did your school provide the following out of school activities? Select one answer choice on each row.
	Yes	No
Opportunities for students to discuss math work and math homework with their teachers	A	B	OutSchoolS3_1
Peer tutoring	A	B	OutSchoolS3_2
Math competitions	A	B	OutSchoolS3_3
Chess clubs	A	B	OutSchoolS3_4
Computer programming classes	A	B	OutSchoolS3_5
Mathematics clubs	A	B	OutSchoolS3_6
Mathematics study groups	A	B	OutSchoolS3_7
Teacher led tutoring sessions for groups of students	A	B	OutSchoolS3_8
Teacher led extra help sessions	A	B	OutSchoolS3_9
Family mathematics night	A	B	OutSchoolS3_10

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes	General	Required
2	[For option j] Are there other activities for families that you can think of?	Specific	Required

[Grades 4 and 8 Mathematics: School #3]

To what extent does your school provide up to date technology resources for mathematics teaching and learning?

Not at all
Small extent
Moderate extent
Large extent

SchoolTech1_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required

School Items – Grade 4 Specific

[Grade 4 Mathematics: School #1]

In your school, are fourth-grade students from different classes typically grouped for mathematics instruction by achievement levels (so that some instruction groups are higher in average mathematics achievement levels than others)?

VB525182

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	Is this information that you would expect 4th grade teachers to know?	Specific	Required

[Grade 4 Mathematics: School #2]

VE013351 Approximately what percentage of your school’s classrooms has the following technological resources for fourth-grade mathematics instruction? Select one answer choice on each row.
	0%	1–25%	26–50%	51–75%	76–99%	100%
Cable/satellite/closed-circuit television	A	B	C	D	E	F	VE013352
Videodisc player/VCR/DVD player	A	B	C	D	E	F	VE013353
Digital/video camera	A	B	C	D	E	F	VE013354
Video conferencing equipment	A	B	C	D	E	F	VE013355
Scanner for images or text	A	B	C	D	E	F	VE013356
Device for projecting images directly from a computer	A	B	C	D	E	F	VE013357
Computer	A	B	C	D	E	F	VE013359
Internet	A	B	C	D	E	F	VE013360
Printer	A	B	C	D	E	F	VE013362
Handheld devices (e.g., personal digital assistants)	A	B	C	D	E	F	VE509167
Interactive white board	A	B	C	D	E	F	Res1_1
Document reader	A	B	C	D	E	F	Res1_3
Document camera	A	B	C	D	E	F	Res1_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	Keeping in mind current practices, is this question wording the best wording to use?	Specific	Required
3	Are there any technological resources that you would include in this question?	Specific	Required
4	Are there any technological resources that you would exclude in this question?	Specific	Required

[Grade 4 Mathematics: School #3]

In your school, how often are fourth-grade students’ mathematics placements evaluated?

Once a year
Once a marking period (semester, trimester)
More than once a marking period
Students are not grouped by achievement level.

VB525183

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required

[Grade 4 Mathematics: School #4]

VE659419 In this school year, to what extent are each of the following a responsibility of the mathematics resource teacher(s) available to fourth-grade students at your school? Select one answer choice on each row.
	Not at all	Small extent	Moderate extent	Large extent
Provide mathematics remediation/intervention to individual students	A	B	C	D	VE659422
Provide mathematics remediation/intervention to groups of students	A	B	C	D	VE659423
Provide mathematics enrichment to individual students	A	B	C	D	VE659424
Provide mathematics enrichment to groups of students	A	B	C	D	VE659425
Provide extra help sessions for students during regular school hours	A	B	C	D	ResInst1_0
Provide after-school tutoring for students	A	B	C	D	ResInst1_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required

School Items – Grade 8 Specific

[Grade 8 Mathematics: School #1]

In your school, what percentage of eighth-grade students in your school enrolls in more than one mathematics class in a year (including summer school two-block classes) for remediation or to catch up a grade level? Do not include students who receive additional mathematics instruction as part of special education or because of IEP provisions.

0-10%
11-20%
21-30%
31-40%
41-50%
More than 50%

VB525194

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required

[Grade 8 Mathematics: School #2]

In your school, are eighth-grade students typically assigned to mathematics classes by achievement levels (so that some instruction groups are higher in average mathematics achievement levels than others)?

VE013898

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete item generic probes.	General	Required
2	Keeping in mind current practices, is this question wording the best wording to use?	Specific	Required

[Grade 8 Mathematics: School #3]

VE013906 Approximately what percentage of your school’s classrooms has the following technological resources for eighth-grade mathematics instruction? Select one answer choice on each row.
	0%	1–25%	26–50%	51–75%	76–99%	100%
Cable/satellite/closed-circuit television	A	B	C	D	E	F	VE013908
Videodisc player/VCR/DVD player	A	B	C	D	E	F	VE013909
Digital/video camera	A	B	C	D	E	F	VE013910
Video conferencing equipment	A	B	C	D	E	F	VE013914
Scanner for images or text	A	B	C	D	E	F	VE013916
Device for projecting images directly from a computer	A	B	C	D	E	F	VE013917
Computer	A	B	C	D	E	F	VE013919
Internet	A	B	C	D	E	F	VE013922
Printer	A	B	C	D	E	F	VE013923
Handheld devices (e.g., personal digital assistants)	A	B	C	D	E	F	VE509176
Interactive white board	A	B	C	D	E	F	TechRes1_2
Document reader	A	B	C	D	E	F	TechRes1_4
Document camera	A	B	C	D	E	F	TechRes1_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	Keeping in mind current practices, is this question wording the best wording to use?	Specific	Required
3	Are there any technological resources that you would include in this question?	Specific	Required
4	Are there any technological resources that you would not include in this question?	Specific	Required

[Grade 8 Mathematics: School #4]

In this school year, what percentage of students has gone to other schools (neighboring middle school, high school, or college) to receive mathematics instruction?

0-10%
11-20%
21-30%
31-40%
41-50%
More than 50%

OutsideMath1_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for discrete generic probes.	General	Required
2	How do you feel about answering a question like this?	Specific	Required
3	When answering this question, which students did you think of when calculating your answer? Did you consider a specific grade or did you count all students?	Specific	Required

[Grade 8 Mathematics: School #5]

OutSideMath2_0 Below are some sentences about students who may have to go to other schools for mathematics instruction. Please indicate which statements apply to your students. Select one answer choice on each row.
	Yes	No
There are students in my school who take high school classes for mathematics	A	B	Outsidemath2_1
My school provides credit for students who take high school or college mathematics classes	A	B	Outsidemath2_2
My school provides credit for mathematics classes taken by students outside of your school	A	B	Outsidemath2_3
Students at my school who take high school mathematics classes also take the same tests as high school students taking the same course	A	B	Outsidemath2_4
Algebra I courses offered in my school contain the same material as algebra I courses offered at the high school level	A	B	Outsidemath2_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required
2	If yes, what are the requirements that have been specified for students to receive credit for the classes they have taken?	Specific	Required

[Grade 8 Mathematics: School #6]

This year, how many teachers are teaching mathematics in your school? Enter the number of teachers.

_______

Res2_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response generic probes.	General	Required

[Grade 8 Mathematics: School #6]

VE659430 In this school year, to what extent are each of the following a responsibility of the mathematics resource teachers(s) available to eighth-grade students at your school? Select one answer choice on each row.
	Not at all	Small extent	Moderate extent	Large extent
Provide mathematics remediation/intervention to individual students	A	B	C	D	VE659436
Provide mathematics remediation/intervention to groups of students	A	B	C	D	VE659434
Provide mathematics enrichment to individual students	A	B	C	D	VE659435
Provide mathematics enrichment to groups of students	A	B	C	D	VE659433
Provide extra help sessions for students during regular school hours	A	B	C	D	ResInst1_0
Provide after-school tutoring for students	A	B	C	D	ResInst1_1

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix generic probes.	General	Required

Writing Cognitive Interview Items and Probes

Student Items – Grades 8 and 12 (Cross-grade)

[Grades 8 & 12 Writing: Student # 1]

Item-specific probes:

No	Probe	Type of Probe	Required/Conditional
1	For sub-item a: How would you describe "a strict time limit"?	Specific	Required
2	For sub-item b: How would you describe "one session"?	Specific	Required
3-6	For sub-items e, g, h, i: Can you give me an example of a recent assignment of that kind?	Specific	Required

[Grades 8 & 12 Writing: Student #2]

Item-specific probes:

No.

Probe

Type of Probe

Required/Conditional

How would you describe "longer writing assignment"?

Specific

Required

For sub-item h: Do you think there is a difference between "spell-check" and "grammar-check" in word processing software?

If yes: How would you describe the difference between "spell-check" and "grammar-check”?

Specific

Required

[Grades 8 & 12 Writing: Student # 3a]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	What does the word "practiced" mean to you here? Would you interpret this question differently if it said "How often have you learned each of the following?" Would that change make the question easier to answer or more difficult?	Specific	Required
2	b. How would you describe what "complex sentences” are?	Specific	Required
3	c. How would you describe "new vocabulary"?	Specific	Required
4	e. Can you give me an example for the software you used? How would you describe "word processing software"?	Specific	Required
5	f. How would you describe "expressing ideas effectively"?	Specific	Required
6	g. How would you describe "organizing ideas in writing"?	Specific	Required
7	h. How would you describe "audience"? Can you give me examples of audiences you wrote for?	Specific	Required
8	i. How would you describe "purposes"? Can you give me examples of purposes you wrote for?	Specific	Required

[Grades 8 & 12 Writing: Student # 3b]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	What does the word "practiced" mean to you here? Would you interpret this question differently if it said "How often have you learned each of the following?" Would that change make the question easier to answer or more difficult?	Specific	Required
2	a. How would you describe "different forms of texts"? Can you give me examples of different forms of texts you have written?	Specific	Required
3	b. How would you describe "planning writing"? Can you give me examples of times when you have practiced planning writing?	Specific	Required
4	c. How would you describe "evaluating writing"? Can you give me examples of times when you have practiced evaluating writing?	Specific	Required
5	d. How would you describe "using sources correctly"? Can you give me examples of times when you have practiced using sources correctly?	Specific	Required
6	g. Can you give me examples how you have used details to develop ideas in writing?	Specific	Required
7	h. How would you describe "tone"? How would you describe "voice"? Can you give me examples how you have used voice and tone in writing?	Specific	Required

[Grades 8 & 12 Writing: Student #4]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	a. What does the word "pencil" mean to you here? Would you include writing done on paper with a pen, or would you only include writing done with a pencil?	Specific	Required
2	c. Can you give me examples of what you consider a tablet?	Specific	Required

[Grades 8 & 12 Writing: Student #5]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Would you include activities done for your homework when answering this question?	Specific	Required
2	b. Do you know about how much you have written outside of school this past week? If yes, what would be the easiest way for you to measure how much? For example, number of words? Something else?	Specific	Required

[Grades 8 & 12 Writing: Student #6]

Item-specific probes:

No.	Probe	Type of Probe	Required/ Conditional
1	Would you include activities done for your homework when answering this question?	Specific	Required
2	a. How would you describe "forums or social networks"? Can you give me examples of what you consider a forum or social network?	Specific	Required
3	d. How would you describe "practiced my keyboarding skills"? Would you include activities such as typing a paper at home when answering this question?	Specific	Required
4	e. How would you describe "wrote journal entries"? Would you include activities such as typed journal entries when answering this question?	Specific	Required
5	g. How would you describe "writing competitions"?	Specific	Required
6	i. How would you describe "practiced writing on my own"?	Specific	Required
7	j. How would you describe "other writing activities outside of school"?	Specific	Required

[Grades 8 & 12 Writing: Student #7]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	d. How would you describe "the activity of writing"?	Specific	Required

[Grades 8 & 12 Writing: Student #8]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	i. How would you describe "to clarify their ideas"?	Specific	Required

[Grades 8 & 12 Writing: Student # 9]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe the difference between "Maybe" and "I probably can"?	Specific	Required
2	How would you describe the difference between "Maybe" and "I probably can't"?	Specific	Required
3	How would you describe the difference between "probably" and "definitely"?	Specific	Required
4	b. When answering this question did you consider whether spell check is available to you?	Specific	Required
5	d. How would you describe "the structure of sentences"?	Specific	Required
6	f. How would you describe "different voices and tones"?	Specific	Required
7	g. How would you describe "academic vocabulary"?	Specific	Required
8	i. How would you describe "different audiences"?	Specific	Required

[Grades 8 & 12 Writing: Student #10]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	b. How would you describe "a virtual keyboard on a touch screen"?	Specific	Required
2	c. How would you describe "a stylus"?	Specific	Required
3	g. Were you thinking only about a thesaurus in word processing software or also about a dictionary when answering this question?	Specific	Required
4	i. Were you thinking only about a computer keyboard or also about using a mouse to cut, copy, and paste text?	Specific	Required

[Grades 8 & 12 Writing: Student # 11]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	c. How would you describe "topic sentence"?	Specific	Required
2	g. How would you describe a "class period"?	Specific	Required

[Grades 8 & 12 Writing: Student #12]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	a. How would you describe what "something" means here?	Specific	Required
2	b. How would you describe what "something" means here?	Specific	Required
3	f. How would you describe what "persuasive" means here?	Specific	Required
4	g. How would you describe "synthesize the points expressed "?	Specific	Required

[Grades 8 & 12 Writing: Student #13]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grades 8 & 12 Writing: Student #14]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Do you think the words "I want" are necessary at the beginning of each question? Do you have suggestions how the wording could be changed?	Specific	Required

[Grades 8 & 12 Writing: Student #15]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	--	Specific	Required

[Grades 8 & 12 Writing: Student #16]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	[compare with question #15] Which of the two questions is easier to answer? Why?	Specific	Required

[Grades 8 & 12 Writing: Student #17]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	--	Specific	Required

[Grades 8 & 12 Writing: Student #18]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	--	Specific	Required

[Grades 8 & 12 Writing: Student #19]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe the difference between "Very often" and "Always or almost always"?	Specific	Required
2	a. Which response would you choose if you use a computer about half of the time?	Specific	Required
3	b. What kinds of computers do you count there? Do you include writing done on a tablet or other digital device?	Specific	Required
4	d. Can you think of different words to describe "complete your writing"?	Specific	Required

[Grades 8 & 12 Writing: Student #20]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Do you think the same about a text that is one page on a computer and one page on paper?	Specific	Required
2	b. Can you give me an example of a recent writing assignment you got for social studies homework?	Specific	Required
3	c. Can you give me an example of a recent writing assignment you got for science homework?	Specific	Required
4	d. Can you give me an example of a recent writing assignment you got for mathematics homework?	Specific	Required

[Grades 8 & 12 Writing: Student #21]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe the difference between "Somewhat agree" and "Agree"?	Specific	Required
2	How would you describe the difference between "Disagree" and "Somewhat disagree"?	Specific	Required

Teacher Items – Grade 8

[Grade 8 Writing: Teacher # 1]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1-4	Sub-items e, g, h, i: Can you give me an example of a recent assignment of that kind?	Specific	Required

[Grade 8 Writing: Teacher # 2]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Sub-item b: How would you describe what "complex sentences" are?	Specific	Required

[Grade 8 Writing: Teacher # 3]

Item-specific probes:

No.

Probe

Type of Probe

Required/Conditional

d. How would you describe “demonstrated for the class”?

Would you include activities such as talking to the class or talking individually with a student when answering this question? Are there any other activities you might include?

Specific

Required

[Grade 8 Writing: Teacher # 4]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	f. If teachers answer B-E ask the following probe: How long do your “timed assessments” last? Are the assessments you give a standard time or do they vary?	Specific	Required

[Grade 8 Writing: Teacher # 5]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 6]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 7]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe the difference between "A little" and "Some"?	Specific	Required
2	How would you define the difference between "Some" and "Quite a bit"?	Specific	Required
3	How would you define the difference between "Quite a bit" and "Very much"?	Specific	Required
4	Can you think of different response options that would make it easier for you to answer this question?	Specific	Required

[Grade 8 Writing: Teacher # 8]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you define the difference between "Some" and "A lot"?	Specific	Required
2	What would you say is the difference, if any, between “A lot” and “Very much”?	Specific	Required
3	Compared to the previous question, which response options can you relate to better?	Specific	Required
4	e. Do you think there is a difference between "spell-check" and "grammar-check" in a word processing software? If yes: How would you describe the difference between "spell-check" and "grammar-check" in a word processing software?	Specific	Required

[Grade 8 Writing: Teacher # 9]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Compared to the previous question, which question wording can you relate to better? Do you see a difference between "have you spent" and "have you devoted" and if yes, how would you describe the difference?	Specific	Required

[Grade 8 Writing: Teacher # 10]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Compared to the previous question, which response choices wording can you relate to better? Why?	Specific	Required

[Grade 8 Writing: Teacher # 11]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 12]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe the difference between "Small extent" and "Moderate extent"?	Specific	Required
2	How would you describe the difference between "Moderate extent" and "Large extent"?	Specific	Required
3	Can you think of response options that would make it easier to express the extent to which you use each of the following technological resources? For example, would you find it easier to answer how often you use each of these resources?	Specific	Required
4	Sub-item e: What do you think about when you hear "interactive web space"? Can you think of an alternative word for what is described in the example?	Specific	Required

[Grade 8 Writing: Teacher # 13]

Item-specific probes:

No.

Probe

Type of Probe

Required/Conditional

Do you think the four response categories provide enough possibilities for variation in your response?

If no: Can you think of better response categories for this item that would make it easier to answer?

Specific

Required

[Grade 8 Writing: Teacher # 14]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 15]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Compared to the previous question, which question do you think is easier to answer? Why?	Specific	Required

[Grade 8 Writing: Teacher # 16]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 17]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Compared to the previous question, which question do you think is easier to answer? Why?	Specific	Required

[Grade 8 Writing: Teacher # 18]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Item 18b: How would you answer if you don't remember the exact number?	Specific	Required

[Grade 8 Writing: Teacher # 19]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 20]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 21]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe the difference between "Very often" and "Always or almost always"?	Specific	Required
2	Do you think the question would be clearer if option C would be "Often" instead of "Very often"?	Specific	Required

[Grade 8 Writing: Teacher # 22]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	a. What does the phrase "Hunt and peck typing" mean to you? Do you think this item would be clearer if any of the following terms would be used instead: "Search and peck typing", "Eagle Finger typing", "Two-finger typing"?	Specific	Required
2	Items 2 and 3: Which of these two questions do you find easier to answer? Why?	Specific	Required

[Grade 8 Writing: Teacher # 23]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Items 5 and 6: Which of these two questions do you find easier to answer? Why?	Specific	Required

[Grade 8 Writing: Teacher # 24]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Item 2: How would you describe "Basic skills"?	Specific	Required
2	Item 2: How would you describe "Intermediate skills"?	Specific	Required
3	Item 2: How would you describe "Advanced skills"?	Specific	Required

[Grade 8 Writing: Teacher #25]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 26]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grade 8 Writing: Teacher # 27]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Do you feel that you have the necessary information to answer this question? Do you think your school's administrator could better answer this question?	Specific	Required
2	How do you interpret the answer choice "There is no specific expectation around this in my school"?	Specific	Required
3	Compared to the previous question, which question do you think is easier to answer? Why?	Specific	Required

School Administrator Items – Grades 8 & 12 (Cross-grade)

[Grades 8 and 12 Writing: School Administrator # 1]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 2]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 3]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe the difference between "Small extent" and "Moderate extent"?	Specific	Required
2	How would you describe the difference between "Moderate extent" and "Large extent"?	Specific	Required
3	Can you think of response options that would make it easier to express the extent to which students are asked to write in other content areas than English/language arts in your school?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 4]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Do you feel that you have the necessary information to answer this question? Do you think teachers in your school could better answer this question?	Specific	Required
2	How do you interpret the answer choice "There is no specific expectation around this in my school"?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 5]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Would you find it easier to choose out of pre-defined ranges (such as, 10-20 percent, 20-30 percent, etc.)?	Specific	Required
2	Do you feel that you have the necessary information to answer this question? Which answer choice would you select if you don't have the necessary information?	Specific	Required
3	Do you think teachers in your school could better answer this question?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 6]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Are there other programs your school or district is offering that cannot be clearly classified as remediation or enrichment? If yes: How would you describe these programs?	Specific	Required
2	Sub-item a: If yes: Can you give me an example for a remediation program your school offers? What is the approximate proportion of students in your school that participate in these programs? How are students selected?	Specific	Required
3	Sub-item b: If yes: Can you give me an example for an enrichment program your school offers? What is the approximate proportion of students in your school that participate in these programs? How are students selected?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 7]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 8]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	---	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 9]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Would you find it easier to choose out of pre-defined ranges (such as, 10-20 percent, 20-30 percent, etc.)?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 10]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	What does the phrase "Hunt and peck typing" mean to you?	Specific	Required
2	Do you think this item would be clearer if any of the following terms would be used instead: "Search and peck typing", "Eagle Finger typing", "Two-finger typing"?	Specific	Required
3	How would you answer this question if you have never explicitly expressed this expectation to teachers?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 11]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Do you feel that you have the necessary information to answer this question? Do you think teachers in your school could better answer this question?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 12]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	In comparison to previous question: Which of these two questions do you find easier to answer? Why?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 13]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	How would you describe "Basic skills"?	Specific	Required
2	How would you describe "Intermediate skills"?	Specific	Required
3	How would you describe "Advanced skills"?	Specific	Required
4	Do you feel that you have the necessary information to answer this question? Do you think teachers in your school could better answer this question?	Specific	Required

[Grades 8 and 12 Writing: School Administrator # 14]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	Do you feel that you have the necessary information to answer this question? Do you think teachers in your school could better answer this question?	Required	Required

[Grades 8 and 12 Writing: School Administrator # 15]

Item-specific probes:

No.	Probe	Type of Probe	Required/Conditional
1	In comparison to previous question: Which of these two questions do you find easier to answer? Why?	Specific	Required

Core Cognitive Interview Items and Probes

Student Items – Grades 4, 8, and 12 (Cross Grade)

[Grades 4, 8, 12 Core: Student # 1]

About how many books are there in your home?

Few (0-10)
Enough to fill one shelf (11-25)
Enough to fill one bookcase (26-100)
Enough to fill several bookcases (more than 100)

VB331335

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	When answering this question did you count digital books?	Specific	Required

[Grades 4, 8, 12 Core: Student #2]

How many digital books do you own? Enter the number of books.

_________

Wealth2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response item generic probes.	General	Required
2	What would you consider to be few digital books?	Specific	Required
3	What would you consider to be a lot of digital books for a student to own?	Specific	Required
4	When counting digital books, did you count digital books that belong to people other than yourself?	Specific	Required
5	Do you think this question would have been easier to answer if the term "eBooks" had been used instead of "digital books”?	Specific	Required

[Grade 4, 8, 12 Core: Student #3]

VF098664 Do you have any of the following in your home? Select one answer choice on each row.
	Yes	No
Access to the Internet	A	B	Wealth02
High-speed Internet connection	A	B	Wealth2_1
Your own bedroom	A	B	Wealth2_5
A desktop or laptop computer that you share with others	A	B	Wealth2_8
A desktop or laptop computer that is only for your use	A	B	Wealth2_9
A tablet computer that you share with others	A	B	Wealth2_10
A tablet computer that is only for your use	A	B	Wealth2_11
A smartphone that is only for your use	A	B	Wealth2_12
A gaming system that you use	A	B	Wealth2_13

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	What does the term "for your use" mean to you?	Specific	Required
3	What devices do you think of when you hear the phrase “tablet computer”?	Specific	Required
4	[Grade 4 only] Do you own a smartphone?	Specific	Required
5	In option b, what does the term "high-speed Internet” mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #4]

Including yourself, how many people live in your home? Enter the number of people.

_______

Home2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response item generic probes	General	Required
2	What does the phrase "live in your home" in this question mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #5]

How many adults (people older than 18) live with you in your home? Enter the number of adults.

______

Home3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response item generic probes.	General	Required
2	[Grade 12 only] Would you include yourself in the count if you are older than 18?	Specific	Required

[Grades 4, 8, 12 Core: Student #6]

Please note: This question will directly follow the previous one (Home3). Please also note in TBA delivery there will be a space for as many people as the student indicates lives in their home.

How would you describe each of the adults that live in your home? You can write things like, for example, “Dad”, “Mom”, or “Grandma”.

______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________

Home4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response item generic probes.	General	Required
2	What does the word "describe" in this question mean to you? Can you think of a better word than "describe" in this question?	Specific	Required
3	Were the examples helpful in answering the question? Could you think of different examples that would help make this question clearer?	Specific	Required

[Grades 4, 8, 12 Core: Student #7]

How many kids (people younger than 18) live with you in your home? Enter the number of kids.

______

Home5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response item generic probes.	General	Required
2	Would you include yourself in the count?	Specific	Required

[Grades 4, 8, 12 Core: Student #8]

Please note: This question will directly follow the previous one (Home5). Please also note in TBA delivery there will be a space for as many people as the student indicates lives in their home.

How would you describe each of the kids that live in your home? You can write things like, for example, “My older brother”, “My younger sister”, or “My stepsister”.

______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________
______________________________________________________________________

Home6

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response item generic probes.	General	Required
2	Were the examples helpful in answering the question? Could you think of different examples that would help make this question clearer?	Specific	Required

[Grades 4, 8, 12 Core: Student #9]

VF095730 Do any of the following people live in your home? Select one answer choice on each row.
	Yes	No
Mother	A	B	Home1_14
Stepmother	A	B	Home1_15
Foster mother or other female guardian	A	B	Home1_16
Father	A	B	Home1_17
Stepfather	A	B	Home1_18
Foster father or other male guardian	A	B	Home1_19
Sibling(s) (brothers or sisters)	A	B	Home1_7
Cousin(s)	A	B	Home1_8
Aunt(s) or uncle(s)	A	B	Home1_9
Grandparent(s)	A	B	Home1_10
Friends	A	B	Home1_11
Other people who share a living space with us (Please specify): __________________________________ _________________________________	A	B	Home1_12

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[if yes to l] Who are the other people that live in your home?	Specific	Required
3	[4th grade only] What does the term "other people" in this question mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #10 (mother)]

What is your mother doing? Select all that apply.

Goes to work at a job to earn money
Does a job at home to earn money
Takes care of the home and family
Studies to get a degree at a college or university
Other (Please specify): _______________
I don't know.

ParOcc2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	For generic probes, see page 2	General	Required
2	Looking at option B, what do you think it means for a person to do a job at home to earn money?	Specific	Required
3	What do you think it means for a person to stay at home during the day to take care of their children? Do you think this is a full-time job?	Specific	Required

[Grades 4, 8, 12 Core: Student #10 (father)]

What is your father doing? Select all that apply.

Goes to work at a job to earn money
Does a job at home to earn money
Takes care of the home and family
Studies to get a degree at a college or university
Other (Please specify): _______________
I don't know.

ParOcc2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	For generic probes, see page 2	General	Required

[Grades 4, 8, 12 Core: Student #11]

Which of the following best describes where you are living?

A single family home
A townhouse
An apartment or condominium
A trailer or mobile home
A community home or shelter
Other (Please specify): _________

Home7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What do you think is the difference between an apartment and a condominium?	Specific	Required

[Grades 4, 8, 12 Core: Student #12]

How many bedrooms are in your home? Enter the number of bedrooms.

________

Home9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for free response item generic probes.	General	Required
2	When you counted "bedrooms" in your home, what did you count? Talk me through how you counted them.	Specific	Required
3	Are there rooms in your home that could be counted as a bedroom, but are used for something else such as a computer room or office?	Specific	Required

[Grades 4, 8, 12 Core: Student #13]

Extras1 In this school year, have you participated in any of these activities outside of school? Select one answer choice on each row.
	Yes	No
A birthday party or celebration for yourself	A	B	Extras1_1
Going to the movies	A	B	Extras1_2
Going on vacation for longer than a weekend	A	B	Extras1_3
Going on vacation to a foreign country	A	B	Extras1_4
Going to a museum	A	B	Extras1_5
Attending private lessons to learn a musical instrument	A	B	Extras1_7
Attending private lessons to learn a foreign language	A	B	Extras1_8
Eating out in a restaurant other than a fast-food restaurant	A	B	Extras1_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[For all options]If yes, how often?	Specific	Required
3	Where would families go if they went on vacation for longer than a weekend?	Specific	Required
4	What types of places do you think of when you hear the word "restaurant”?	Specific	Required
5	What types of places do you think of when you hear the term “fast-food restaurant”?	Specific	Required
6	What kinds of trips do you think of when you hear the word “vacation”?	Specific	Required

[Grades 4, 8, 12 Core: Student #14]

FamSupp1 How often do the following things happen at home? Select one answer choice on each row.
	Never or hardly ever	Once every few weeks	About once a week	Two or three times a week	Every day
People at home ask what I am learning in school.	A	B	C	D	E	FamSupp1_1
I talk about things I have studied in school with someone in my family.	A	B	C	D	E	FamSupp1_2
People at home make sure that I set aside time for my homework.	A	B	C	D	E	FamSupp1_3
People at home check if I do my homework.	A	B	C	D	E	FamSupp1_4
People talk to each other in a language other than English.	A	B	C	D	E	FamSupp1_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[For option d] What does the term "check" mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #15]

Subjective2

Imagine that this ladder pictures how American society is set up. At the top are the people that have the most money and at the bottom are the people who have the least money.

Now, think about your family. Where do you think they would be on this ladder?

0-1-2-3-4-5-6-7-8-9-10

Shape2 Shape1

Least Money

Most Money

Subjective2_1

On which step of the ladder do you think you will stand when you are an adult?

0-1-2-3-4-5-6-7-8-9-10

Shape4 Shape3

Least Money

Most Money

Subjective2_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	In this item, who do you consider to be your “family”?	Specific	Required
3	What does the term "when you are an adult" mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #16]

In this school year, did your school assign you a laptop computer that is just for your use?

No
Yes, but I cannot take it home with me.
Yes, and I can take it home with me.

Techn_St_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the phrase "just for your use" mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #17]

In this school year, how often did you use your laptop computer during your classes at school?

Never
In some classes
About half of the classes
More than half of the classes
All or almost all classes

Techn_St_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8, 12 Core: Student #18]

In this school year, did your school assign you a tablet computer that is just for your use?

No
Yes, but I cannot take it home with me.
Yes, and I can take it home with me.

Techn_St_3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8, 12 Core: Student #19]

In this school year, how often did you use your tablet computer in your classes?

Never
In some classes
About half of the classes
More than half of the classes
All or almost all classes

Techn_St_4

Item-Specific Probes:

No.

Probe

Type of Probe

Required/Conditional

See page 2 for discrete item generic probes.

General

Required

[Grades 4, 8, 12 Core: Student #20]

Is there a wireless Internet connection at your school that you can use for classwork?

No
Yes, in some places at school.
Yes, everywhere or almost everywhere in the school.

Techn_St_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the phrase “in some places at school” mean to you?	Specific	Required
3	What does the phrase “everywhere or almost everywhere in the school” mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #21]

In this school year, how often did you use the wireless Internet connection for your classwork?

Never
In some classes
About half of the classes
More than half of the classes
All or almost all classes

Techn_St_6

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8, 12 Core: Student #22]

Which best describes the way you type on a computer keyboard?

I don’t know how to type using a computer keyboard.
I have to search for where the letter keys are.
I know where most of the letter keys are.
I can type without looking at the computer keyboard.
I type using a way other than both hands.

Techn_St_7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8, 12 Core: Student #23]

Techn_St_10_0 Did you learn how to type on a computer keyboard in any of the following ways? Select one answer choice on each row.
	Yes	No
I learned how to type during my regular classes in school.	A	B	Techn_St_10_1
I attended a course offered by my school outside of regular classes.	A	B	Techn_St_10_2
I attended a private keyboarding course outside of school.	A	B	Techn_St_10_3
I took an online course or used computer software to learn how to type.	A	B	Techn_St_10_4
I have not learned how to type on a computer keyboard.	A	B	Techn_St_10_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	Can you think of other ways how to learn typing on a computer keyboard that are missing here?	Specific	Required

[Grades 4, 8, 12 Core: Student #24]

Grit_1 Thinking about school this year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I finished whatever I began.	A	B	C	D	E	Grit_1_1
I tried very hard even after experiencing failure.	A	B	C	D	E	Grit_1_3
I stayed committed to my goals, even if they took a long time to complete.	A	B	C	D	E	Grit_1_4
I kept working hard even when I felt like quitting.	A	B	C	D	E	Grit_1_5
I continued working on what I set out to do, even if it took a long time to complete.	A	B	C	D	E	Grit_1_6
I kept trying to improve myself, even if it took a long time to get there.	A	B	C	D	E	Grit_1_7

Alternative stem:

How much does each of the following statements apply to you? Select one answer choice on each row.

Alternative Response Options: Not at all / Not much / Somewhat / Mostly / Very much

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	For matrix item generic probes, see page 3	General	Required
2	What does "experiencing failure" mean to you?	Specific	Required
3	[Looking at both versions of the question] Which version of this question is easier for you to answer?	Specific	Required

[Grades 4, 8, 12 Core: Student #25]

Grit_1 Thinking about school this year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I came to class prepared.	A	B	C	D	E	Grit_1_8
I remembered and followed directions.	A	B	C	D	E	Grit_1_9
I started working on assignments right away rather than waiting until the last minute.	A	B	C	D	E	Grit_1_10
I paid attention and resisted distractions.	A	B	C	D	E	Grit_1_11
I worked independently with focus.	A	B	C	D	E	Grit_1_12
I stayed on task without reminders from my teacher.	A	B	C	D	E	Grit_1_13
I paid attention in class even when I was bored.	A	B	C	D	E	Grit_1_14

Alternative stem:

How much does each of the following statements apply to you? Select one answer choice on each row.

Alternative Response Options: Not at all / Not much / Somewhat / Mostly / Very much

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	What does the word "prepared" mean to you?	Specific	Required
3	[For 4th graders only] What does the word “focus" mean to you?	Specific	Required
4	[Looking at both versions of the question] Which version of this question is easier for you to answer?	Specific	Required

[Grades 4, 8, 12 Core: Student #26]

Please read the descriptions of the following three <eighth-grade students> referred to here as student 1, student 2, and student 3. After you read each description, you will be asked to answer a question about each student based on the information provided.

Student 1 is always focused and works effectively for long periods of time even when others have stopped. This student is committed to finish every task started, no matter how difficult the task becomes.

Based on this information how persistent and resilient is student 1?

Not at all persistent and resilient
Not persistent and resilient
Somewhat persistent and resilient
Mostly persistent and resilient
Very persistent and resilient

Grit_4_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the word “committed” mean to you?	Specific	Required
3	What does the phrase "persistent and resilient" mean to you?	Specific	Required
4	Do you think being “persistent” and being “resilient” mean the same or something different? Which of the two words describes this student better?	Specific	Required
5	Did you think of this student as a girl or a boy?	Specific	Required

[Grades 4, 8, 12 Core: Student #27]

Student 2 is mostly focused and willing to work for long periods of time if needed. This student is determined to complete every task started as long as it doesn't take up too much time.

Based on this information how persistent and resilient is student 2?

Not at all persistent and resilient
Not persistent and resilient
Somewhat persistent and resilient
Mostly persistent and resilient
Very persistent and resilient

Grit_4_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the word “determined” mean to you?	Specific	Required
3	Did you think of this student as a girl or a boy?	Specific	Required

[Grades 4, 8, 12 Core: Student #28]

Student 3 finds it difficult to stay focused and work independently on tasks for long periods of time. This student is easily distracted by other commitments and often leaves tasks unfinished.

Based on this information how persistent and resilient is student 3?

Not at all persistent and resilient
Not persistent and resilient
Somewhat persistent and resilient
Mostly persistent and resilient
Very persistent and resilient

Grit_4_3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the word “commitments” mean to you?	Specific	Required
3	Did you think of this student as a girl or a boy?	Specific	Required
4	[This probe refers to all three vignettes] Do you think the last three questions would be easier or more difficult to answer if real names were used instead of student 1, student 2, and student 3?	Specific	Required
5	[This probe refers to all three vignettes] Looking at the descriptions of the three students, can you think of other ways how you would describe a student who is very persistent and resilient?	Specific	Required

[Grades 4, 8, 12 Core: Student #29]

How persistent and resilient are you?

Not at all persistent and resilient
Not persistent and resilient
Somewhat persistent and resilient
Mostly persistent and resilient
Very persistent and resilient

Grit_4_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	How much did you think about the other student descriptions when you answered this question?	Specific	Required

[Grades 4, 8, 12 Core: Student #29]

Which of the three students described would you say is most similar to you?

Student 1
Student 2
Student 3
I don’t know.

Grit_4_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	How easy or difficult was it to remember the difference between student 1, student 2, and student 3?	Specific	Required
3	Was there a part of the student descriptions that seemed more important than other parts when you chose your answer?	Specific	Required

[Grades 4, 8, 12 Core: Student #30]

Curiosity_1 Thinking about school this year, how much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I was eager to explore new things.	A	B	C	D	E	Curiosity_1_1
I asked questions to help me learn better.	A	B	C	D	E	Curiosity_1_2
I took an active interest in learning.	A	B	C	D	E	Curiosity_1_3
I was curious to learn more.	A	B	C	D	E	Curiosity_1_4
I looked for opportunities to extend my knowledge.	A	B	C	D	E	Curiosity_1_5

Alternative stem:

N/A

Alternative Response Options:

N/A

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[For option a, ask students who select the response options somewhat like me to very much like me] Can you provide examples of times when you were eager to explore new things?	Specific	Required
2	What does the phrase "extend my knowledge" mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #31]

Student 1 often asks questions in class to get a deeper understanding of the material. This student wants to investigate new topics, and is highly motivated to learn more in all subjects.

Based on this information, how curious and eager to learn is student 1?

Not at all curious and eager to learn
Not very curious and eager to learn
Somewhat curious and eager to learn
Mostly curious and eager to learn
Very much curious and eager to learn

DesForLearn_1_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	What does the phrase "curious and eager" mean to you?	Specific	Required
3	Do you think being “curious” and being “eager to learn” means the same or something different? Which of the two words describes this student better?	Specific	Required
5	Did you think of this student as a girl or a boy?	Specific	Required

[Grades 4, 8, 12 Core: Student #32]

Student 2 sometimes enjoys exploring new topics, but does not actively seek them out. This student occasionally asks questions to get a deeper understanding of the material.

Based on this information, how curious and eager to learn is student 2?

Not at all curious and eager to learn
Not very curious and eager to learn
Somewhat curious and eager to learn
Mostly curious and eager to learn
Very much curious and eager to learn

DesForLearn_1_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	Did you think of this student as a girl or a boy?	Specific	Required

[Grades 4, 8, 12 Core: Student #33]

Student 3 never asks questions in class to get a deeper understanding of the material. This student rarely expresses interest in class material, and avoids investigating or exploring new topics.

Based on this information, how curious and eager to learn is student 3?

Not at all curious and eager to learn
Not very curious and eager to learn
Somewhat curious and eager to learn
Mostly curious and eager to learn
Very much curious and eager to learn

DesForLearn_1_3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	Did you think of this student as a girl or a boy?	Specific	Required
3	[This probe refers to all three vignettes] Do you think the last three questions would be easier or more difficult to answer if real names were used instead of student 1, student 2, and student 3?	Specific	Required
4	[This probe refers to all three vignettes] Looking at the descriptions of the three students, can you think of other ways how you would describe a student who is very curious and eager to learn?	Specific	Required

[Grades 4, 8, 12 Core: Student #34]

How curious and eager to learn are you?

Not at all curious and eager to learn
Not very curious and eager to learn
Somewhat curious and eager to learn
Mostly curious and eager to learn
Very much curious and eager to learn

DesForLearn_1_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	How much did you think about the other student descriptions when you answered this question?	Specific	Required

[Grades 4, 8, 12 Core: Student #35]

Which of the three students described is most similar to you?

Student 1 often asks questions in class to get a deeper understanding of the material. This student is eager to investigate new topics, and is highly motivated to learn more in all subjects.
Student 2 sometimes enjoys exploring new topics, but does not actively seek them out. This student occasionally asks questions to get a deeper understanding of the material.
Student 3 never asks questions in class to get a deeper understanding of the material. This student rarely expresses interest in class material, and avoids investigating or exploring new topics.
I don't know.

DesForLearn_1_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Did you read the student descriptions or did you answer the question based on your memory of the three students described earlier?	Specific	Required
3	Was there a part of the student descriptions that seemed more important than other parts when you chose your answer?	Specific	Required

[Grade 4, 8, 12 Core: Student #36]

GrowthMind_1 The following statements are about peoples’ intelligence. How much do you agree with each of the following statements? Select one answer choice on each row.
	Strongly disagree	Disagree	Somewhat disagree	Somewhat agree	Agree	Strongly agree
You have a certain amount of intelligence, and you really can't do much to change it.	A	B	C	D	E	F	GrowthMind_1_1
Your intelligence is something about you that you can't change very much.	A	B	C	D	E	F	GrowthMind_1_2
You can learn new things, but you can't really change your basic intelligence.	A	B	C	D	E	F	GrowthMind_1_3
You have a certain amount of intelligence, but you can change it if you apply yourself.	A	B	C	D	E	F	GrowthMind_1_4
Your intelligence is something about you that you can change during your life.	A	B	C	D	E	F	GrowthMind_1_5
As you are learning new things, your intelligence can grow.	A	B	C	D	E	F	GrowthMind_1_6

Alternative stem:

N/A

Alternative Response Options:

N/A

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	What does the term "intelligence" mean to you?	Specific	Required

[Grades 4, 8, 12 Core: Student #37]

Thinking about your grades in school, which of the following do you think is more important to get good grades?

How intelligent you are
How much effort you apply
Both about the same
I don't know.

GrowthMind_1_7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8, 12 Core: Student #38]

SchoolClim1_0 In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row.
	Almost never	Less than half of the time	About half of the time	Most of the time	Almost always
I felt like an outsider (or left out of things) at school.	A	B	C	D	E	SchoolClim1_1
I felt like I belong at school.	A	B	C	D	E	SchoolClim1_3
I felt that I was treated fairly by my teachers.	A	B	C	D	E	SchoolClim1_4
I felt that teachers encouraged me to do my best.	A	B	C	D	E	SchoolClim1_5
I worried about crime and violence at my school.	A	B	C	D	E	SchoolClim1_6
I felt excited about something I learned in my classes.	A	B	C	D	E	SchoolClim1_7
I felt awkward and out of place at school.	A	B	C	D	E	SchoolClim1_8
I felt happy at school.	A	B	C	D	E	SchoolClim1_9

Alternative Response Options:

Never or almost never / Rarely / Sometimes / Often / Always or almost always

Never or almost never / Rarely / Sometimes / Most of the time / Always or almost always

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[Looking at all three answer options ] Which answer option is easiest to answer with this question?	Specific	Required

[Grades 4, 8, 12 Core: Student #39]

SchoolClim1_0 In this school year, how often have you felt any of the following ways about your school? Select one answer choice on each row.
	Almost never	Less than half of the time	About half of the time	Most of the time	Almost always
I looked forward to going to school in the morning.	A	B	C	D	E	SchoolClim1_10
I felt lonely at school.	A	B	C	D	E	SchoolClim1_11
I did not feel safe on my way to and from school.	A	B	C	D	E	SchoolClim1_12
I felt that I learned something that I can use in my daily life.	A	B	C	D	E	SchoolClim1_13
I felt that I learned something that will help me in the future.	A	B	C	D	E	SchoolClim1_14
I felt that I would like to go to a different school if I could.	A	B	C	D	E		SchoolClim1_15
Things are ideal in my school.	A	B	C	D	E		Belong_1_8
I am satisfied with my school.	A	B	C	D	E		Belong_1_9
I have given up on school.	A	B	C	D	E		Belong_1_10
I am proud to go to this school.	A	B	C	D	E		Belong_1_12

Alternative Response Options:

Never or almost never / Rarely / Sometimes / Often / Always or almost always

Never or almost never / Rarely / Sometimes / Most of the time / Always or almost always

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[For option g] What does the word “ideal” mean to you?	Specific	Required
3	[Looking at all three answer options ] Which answer option is easiest to answer with this question?	Specific	Required

[Grades 4, 8, 12 Core: Student #39]

Bullying_1 In this school year, have other students from your school done any of the following things to you? Select one answer choice on each row.
	It hasn’t happened to me	Only once or twice this year	2 or 3 times a month	About once a week	Several times a week
Made fun of me or called me names	A	B	C	D	E	Bullying_1_1
Left me out of their games or activities	A	B	C	D	E	Bullying_1_2
Spread lies about me	A	B	C	D	E	Bullying_1_3
Stole something from me	A	B	C	D	E	Bullying_1_4
Hit or hurt me (for example, shoving, hitting, kicking)	A	B	C	D	E	Bullying_1_5
Made me do things I didn’t want to do	A	B	C	D	E	Bullying_1_6
Threatened me	A	B	C	D	E	Bullying_1_7
Shared embarrassing information about me online	A	B	C	D	E	Bullying_1_8
Posted mean or hurtful messages about me on the Internet.	A	B	C	D	E	Bullying_1_11
Took embarrassing pictures or videos of me	A	B	C	D	E	Bullying_1_13

Alternative Response Options: Yes / No; if "Yes": How often? Follow-up question (open response)

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[For options a, c, and g] Did you think about cyber-bullying when answering this question?	Specific	Required
3	[For options i, j] What does the term "online" mean to you? What is the difference, if any, between "online" and "on the Internet"?	Specific	Required
4	[Looking at both answer options] Which answer option is easier for you to answer?	Specific	Required
5	[For alternative response option only] If yes: How often?	Specific	Required

[Grades 4, 8, 12 Core: Student #40]

TeacherExp_St_1 Thinking about the teachers in your school, how much does each of the following statements describe your school? Select one circle in each row.
	Not at all	Mostly not	Somewhat	Mostly yes	Very much
Teachers in this school encourage students to take school seriously.	A	B	C	D	E	TeacherExp_St_1_2
Teachers in this school believe that all students can get good grades.	A	B	C	D	E	TeacherExp_St_1_3
Teachers in this school have high expectations for students.	A	B	C	D	E	TeacherExp_St_1_4
Teachers in this school encourage students to compete with each other.	A	B	C	D	E	TeacherExp_St_1_5
Teachers in this school challenge us to achieve more than we thought we could.	A	B	C	D	E	TeacherExp_St_1_6
Teachers in this school encourage us that we can master difficult material if we apply enough effort.	A	B	C	D	E	TeacherExp_St_1_7

Alternative Response Options:

Never or almost never / Once or twice a month / Once or twice a week / Every day or almost every day

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[Looking at both response options] Which option is easier for you to answer?	Specific	Required

Student Items – Grades 8 and 12 (Cross Grade)

[Grades 8, 12 Core: Student #1]

Grit_2 How much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
New ideas and projects sometimes distract me from previous ones.	A	B	C	D	E	Grit_2_1
Setbacks (delays and obstacles) don’t discourage me. I bounce back from disappointments faster than most people.	A	B	C	D	E	Grit_2_2
I am a hard worker.	A	B	C	D	E	Grit_2_4
I often set a goal but later choose to pursue (follow) a different one.	A	B	C	D	E	Grit_2_5
I finish whatever I begin.	A	B	C	D	E	Grit_2_7
I am diligent (hard working and careful).	A	B	C	D	E	Grit_2_8

Alternative Response Options: Almost never / Very rarely / Rarely / Sometimes / Often / Very often / Almost always

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	When answering each of these questions, did you think especially about how you see yourself at school or did you think about how you see yourself in general?	Specific	Required
3	[Looking at both answer options] Which answer options are easier for you to answer?	Specific	Required

[Grades 8, 12 Core: Student #2]

Grit_3 How much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
At school, new ideas and projects sometimes distract me from previous ones.	A	B	C	D	E	Grit_3_1
At school, setbacks (delays and obstacles) don’t discourage me. I bounce back from disappointments faster than most people.	A	B	C	D	E	Grit_3_2
At school, I am a hard worker.	A	B	C	D	E	Grit_3_4
At school, I often set a goal but later choose to pursue (follow) a different one.	A	B	C	D	E	Grit_3_5
At school, I have difficulty maintaining (keeping) my focus on projects that take more than a few months to complete.	A	B	C	D	E	Grit_3_6
At school, I finish whatever I begin.	A	B	C	D	E	Grit_3_7
At school, I am diligent (hard working and careful).	A	B	C	D	E	Grit_3_8

Alternative Response Options: Almost never / Very rarely / Rarely / Sometimes / Often / Very often / Almost always

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	When answering each of these questions, did you think especially about how you see yourself at school or did you think about how you see yourself in general?	Specific	Required
3	[Looking at both answer options] Which answer options are easier for you to answer?	Specific	Required

[Grades 8, 12 Core: Student #3]

NFC_1 How much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
I prefer complex to simple problems.	A	B	C	D	E	NFC_1_1
I like activities that challenge my thinking abilities.	A	B	C	D	E	NFC_1_3
I try to avoid situations where I will have to think in depth about something.	A	B	C	D	E	NFC_1_4
I find satisfaction in thinking hard and for long hours.	A	B	C	D	E	NFC_1_5
I like tasks that require little thought once I’ve learned them.	A	B	C	D	E	NFC_1_6
I enjoy thinking about new solutions to problems.	A	B	C	D	E	NFC_1_7
Learning new ways to think doesn’t excite me very much.	A	B	C	D	E	NFC_1_8
I like to think of my life as a puzzle that I must solve.	A	B	C	D	E	NFC_1_9
I don't find thinking abstractly very enjoyable.	A	B	C	D	E	NFC_1_10
I don't care how things work as long as they do.	A	B	C	D	E	NFC_1_11

Alternative stem:

How much does each of the following statements apply to you? Select one answer choice on each row.

Alternative Response Options:

Not at all / Not much / Somewhat / Mostly / Very much

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	When answering each of these questions, did you think especially about how you see yourself at school or did you think about how you see yourself in general?	Specific	Required
3	[Looking at both questions] Which version of this question is easier for you to answer?	Specific	Required

[Grades 8, 12 Core: Student #4]

NFC_2 How much does each of the following statements describe a person like you? Select one answer choice on each row.
	Not at all like me	Not much like me	Somewhat like me	Mostly like me	Very much like me
At school, I prefer complex to simple problems.	A	B	C	D	E	NFC_2_1
At school, thinking is not my idea of fun.	A	B	C	D	E	NFC_2_2
At school, I like activities that challenge my thinking abilities.	A	B	C	D	E	NFC_2_3
At school, I find satisfaction in thinking hard for long hours.	A	B	C	D	E	NFC_2_5
At school, I like tasks that require little thought once I’ve learned them.	A	B	C	D	E	NFC_2_6
At school, I enjoy thinking about new solutions to problems.	A	B	C	D	E	NFC_2_7
At school, I like to think of my life as a puzzle that I must solve.	A	B	C	D	E	NFC_2_9
At school, I don't find thinking abstractly very enjoyable.	A	B	C	D	E	NFC_2_10
At school, I don't care how things work as long as they do.	A	B	C	D	E	NFC_2_11

Alternative stem:

How much does each of the following statements apply to you? Select one answer choice on each row.

Alternative Response Options:

Not at all / Not much / Somewhat / Mostly / Very much

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[For option h] What does the word “abstractly” mean to you?	Specific	Required
3	When answering each of these questions, did you think especially about how you see yourself at school or did you think about how you see yourself in general?	Specific	Required
4	[Looking at both questions] Which question is easier for you to answer?	Specific	Required

Teacher Items – Grades 4 and 8 (Cross Grade)

[Grades 4, 8 Core: Teacher #1]

In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all that apply.

Desktop computers
Laptop computers
Tablet computers
Other digital devices (Please specify): _______________.

Techn_T_1_0

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8 Core: Teacher #2]

[Present this question only if teachers indicated that desktop computers are available in question #1]

Where are desktop computers available for student use?

In some classrooms
In all classrooms
In separate computer rooms only
Other (Please specify): _________

Techn_T_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Looking at the response options, what did you consider to be a “classroom” when you chose your answer?	Specific	Required

[Grades 4, 8 Core: Teacher #3]

[Present this question only if teachers indicated that desktop computers are available in question #1]

What is the average age of the desktop computers in your school?

Less than 1 year
1-2 years
3-5 years
6-10 years
11 or more years
I don’t know.

Techn_T_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Looking at the response options provided, how easy or difficult was it to provide the age of the desktop computers in your school?	Specific	Required
3	Do “new” computers typically arrive at your school brand new and out of a box or do they arrived used and second-hand?	Specific	Required

[Grades 4, 8 Core: Teacher #4]

[Present this question only if teachers indicated that desktop computers are available in question #1]

What is the technical condition of the desktop computers in your school?

All computers are functional and operate quickly.
All computers are functional, but some run more slowly than others.
All computers are functional, but all or almost all run slowly.
Some of the computers do no operate and cannot be used.
Most of the computers do not operate and cannot be used.
I don’t know.

Techn_T_3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the phrase “do not operate” mean to you? Is there better wording that can be used?	Specific	Required
3	What would you consider to be a “functional computer”?	Specific	Required

[Grades 4, 8 Core: Teacher #5]

[Present this question only if teachers indicated that desktop computers are available in question #1]

Where are laptop computers available for student use?

In some classrooms
In all classrooms
In separate computer rooms only
Other (Please specify): _________

Techn_T_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8 Core: Teacher #6]

[Present this question only if teachers indicated that laptop computers are available in question #1]

What is the average age of the laptop computers in your school?

Less than 1 year
1-2 years
3-5 years
6-10 years
11 or more years
I don’t know.

Techn_T_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

Grades 4, 8 Core: Teacher #7]

[Present this question only if teachers indicated that laptop computers are available in question #1]

What is the technical condition of the laptop computers in your school?

All computers are functional and operate quickly.
All computers are functional but, some run slower than others.
All computers are functional, but all or almost all run slowly.
Some of the computers do not operate and cannot be used.
Most of the computers do not operate and cannot be used.
I don't know.

Techn_T_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8 Core: Teacher #8]

[Present this question only if teachers indicated that tablet computers are available in question #1]

Where are tablet computers available for student use?

In some classrooms
In all classrooms
In separate computer rooms only
Other (Please specify): _________

Techn_T_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8 Core: Teacher #9]

[Present this question only if teachers indicated that tablet computers are available in question #1]

What is the average age of the tablet computers in your school?

Less than 1 year
1-2 years
3-5 years
6 or more years
I don’t know.

Techn_T_6

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8: Core Teacher #10]

[Present this question only if teachers indicated that tablet computers are available in question #1]

What is the technical condition of the tablet computers in your school?

All computers are functional and operate quickly.
All computers are functional, but some run slower than others.
All computers are functional, but all or almost all run slowly.
Some of the computers do not operate and cannot be used.
Most of the computers do not operate and cannot be used.
I don't know.

Techn_T_7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What operations should a tablet computer be able to do for you to consider the tablet "functional" ?	Specific	Required

[Grades 4, 8 Core: Teacher #11]

In this school year, did your school assign each student a laptop computer that can be used for schoolwork?

No
Yes, but students cannot take it home.
Yes, and students can take it home.

Techn_T_8

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8: Core Teacher #12]

In this school year, did your school assign each student a tablet computer that can be used for schoolwork?

No
Yes, but students cannot take it home.
Yes, and students can take it home.

Techn_T_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8: Core Teacher #13]

Is there a wireless Internet connection in your school that students can use for schoolwork?

No
Yes, in some areas of the school.
Yes, everywhere or almost everywhere in the school.

Techn_T_10

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does “everywhere” in option c mean to you?	Specific	Required
3	Looking at response options b and c, do these response options make sense to you? Is there wording that can be used here to make them clearer or more specific?	Specific	Required

[Grades 4, 8: Core Teacher #14]

In this school year, did your school provide you with a laptop computer to use for teaching and class preparation?

No
Yes, but I cannot take it home.
Yes, and I can take it home.

Techn_T_11

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8: Core Teacher #15]

In this school year, did your school provide you with a tablet computer to use for teaching and class preparation?

No
Yes, but I cannot take it home.
Yes, and I can take it home.

Techn_T_12

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8: Core Teacher #16]

Does your school offer technical support to teachers for computers and other digital technology in the school?

No
Yes, but availability is very limited.
Yes, and support is available when needed.

Techn_T_13

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8 Core: Teacher #17]

[This item is only administered to teachers who indicated that technical support is offered in the previous item]

During the past year, have you used the technical support?

No
Once
Twice
Several times

Techn_T_14

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8: Core Teacher #18]

In this school year, did your school offer training for teachers on how to use computers (e.g., software, hardware, or the Internet)?

Techn_T_15

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Does your school provide you with training for other digital devices or technology hardware used in your school?	Specific	Required
3	Does your school provide you with other training related to technology that is not listed here?	Specific	Required
4	[If yes to “does your school provide you with other training”] What is the other training that your school provides?	Specific	Required

[Grades 4, 8: Core Teacher #19]

[This item is only administered to teachers who indicated that training is offered in the previous item]

In this school year, have you participated in computer training?

No
Once
Twice
Several times

Techn_T_16

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grades 4, 8 Core: Teacher #20]

GrowthMind_T_1 The following statements are about peoples’ intelligence. To what extent do you agree with each of the following statements? Select one answer choice on each row.
	Strongly disagree	Disagree	Somewhat disagree	Somewhat agree	Agree	Strongly agree
You have a certain amount of intelligence, and you really can’t do much to change it.	A	B	C	D	E	F	GrowthMind_T_1_1
Your intelligence is something about you that you can't change very much.	A	B	C	D	E	F	GrowthMind_T_1_2
You can learn new things, but you can't really change your basic intelligence.	A	B	C	D	E	F	GrowthMind_T_1_3
You have a certain amount of intelligence, but you can change it if you apply yourself.	A	B	C	D	E	F	GrowthMind_T_1_4
Your intelligence is something about you that you can change during your life.	A	B	C	D	E	F	GrowthMind_T_1_5
As you are learning new things, your intelligence can grow as well.	A	B	C	D	E	F	GrowthMind_T_1_6

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	What does the term “intelligence” mean to you?	Specific	Required

[Grades 4, 8: Teacher #21]

Based on your experience as a teacher, which of the following do you consider more critical for student success in school?

Students' general intelligence
Students' level of effort applied
Both about the same
I don't know.

GrowthMind_T_2_0

Alternate Response Options: How intelligent a student is / How much effort a student applies / Both about the same / I don't know.

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Are there other factors that are not included in the answer options that should be?

[Grades 4, 8 Core: Teacher #22]

TeacherSat_1 How frequently do you feel the following way about being a teacher? Select one answer choice on each row.
	Almost never	Very rarely	Sometimes	Often	Very often	Almost always
I am content with my profession as a teacher.	A	B	C	D	E	F	TeacherSat_1_1
I am satisfied with being a teacher at this school.	A	B	C	D	E	F	TeacherSat_1_2
I find my work full of meaning and purpose.	A	B	C	D	E	F	TeacherSat_1_3
I am enthusiastic about my job.	A	B	C	D	E	F	TeacherSat_1_4
My work inspires me.	A	B	C	D	E	F	TeacherSat_1_5
I am proud of the work I do.	A	B	C	D	E	F	TeacherSat_1_6
I am frustrated as a teacher.	A	B	C	D	E	F	TeacherSat_1_7
I am supported by the teachers at my school.	A	B	C	D	E	F	TeacherSat_1_8
I am going to continue teaching for as long as I can.	A	B	C	D	E	F	TeacherSat_1_9

Alternate Item: How much does each the following statements apply to you? Select one answer choice on each row.

Alternate Response Options: Not at all / Not much / Somewhat / Mostly / Very much

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	[Looking at option i] Would you answer differently if this option was stated as “I am going to continue teaching for as long as I can because I enjoy teaching“?	Specific	Required
3	[Looking at both versions of the question] Which option is easier for you to answer?	Specific	Required

[Grades 4, 8: Teacher #23]

In comparison to a year ago, are you now more or less satisfied with being a teacher at this school?

I was not at this school a year ago.
Less satisfied than last year
About the same
More satisfied than last year

TeacherSat_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	How would you answer this question if you planned to transition out of your current school?	Specific	Required
3	[Follow-up to probe 2] Are there any response options you think we should include?	Specific	Required

[Grades 4, 8: Teacher #24]

A year from now, do you expect to be more or less satisfied with being a teacher at this school?

Less satisfied than this year
About the same
More satisfied than this year
I do not plan to be a teacher at this school next year.

TeacherSat_3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	How would you answer this question if you planned to transition out of your current school?	Specific	Required
3	[Follow-up to probe 2] Are there any response options you think we should include?	Specific	Required

[Grades 4, 8: Teacher #25]

TALIS_2 On average, how often do you do the following in this school? Select one answer choice on each row.
	Never	Once a year or less	2-4 times a year	5-10 times a year	1-3 times a month	Once a week or more
Teach jointly in the same class	A	B	C	D	E	F	TALIS_2_1
Observe other teachers' classes and provide feedback	A	B	C	D	E	F	TALIS_2_2
Engage in joint activities across different classes and age groups (e.g., projects)	A	B	C	D	E	F	TALIS_2_3
Exchange teaching materials with colleagues	A	B	C	D	E	F	TALIS_2_4
Engage in discussions about the learning development of specific students	A	B	C	D	E	F	TALIS_2_5
Work with other teachers in my school to ensure common standards in evaluations for assessing student progress	A	B	C	D	E	F	TALIS_2_6
Attend team conferences	A	B	C	D	E	F	TALIS_2_7
Take part in collaborative professional learning	A	B	C	D	E	F	TALIS_2_8

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required

[Grades 4, 8: Teacher #26]

TALIS_3 In your teaching, how important do you consider each of the following? Select one answer choice on each row.
	Not important at all	Not important	Somewhat important	Important	Very important
Get students to believe they can do well in schoolwork	A	B	C	D	E	TALIS_3_1
Help my students to value learning	A	B	C	D	E	TALIS_3_2
Craft good questions for my students	A	B	C	D	E	TALIS_3_3
Maintain order in the classroom	A	B	C	D	E	TALIS_3_4
Motivate students who show low interest in schoolwork	A	B	C	D	E	TALIS_3_5
Make my expectations about student behavior clear	A	B	C	D	E	TALIS_3_6
Help students to think critically	A	B	C	D	E	TALIS_3_7
Get students to follow classroom rules	A	B	C	D	E	TALIS_3_8
Calm a student who is disruptive or noisy	A	B	C	D	E	TALIS_3_9
Use a variety of assessment strategies	A	B	C	D	E	TALIS_3_10
Provide an alternative explanation or example when students are confused	A	B	C	D	E	TALIS_3_11
Implement alternative instructional strategies in my classroom	A	B	C	D	E	TALIS_3_12
Facilitate students' own inquiry	A	B	C	D	E	TALIS_3_13
Teach students to find solutions to problems on their own	A	B	C	D	E	TALIS_3_14
Allow students to think of solutions to practical problems themselves before showing them how they are solved	A	B	C	D	E	TALIS_3_15
Teach students to improve their thinking and reasoning processes	A	B	C	D	E	TALIS_3_16
Teach students specific curriculum content	A	B	C	D	E	TALIS_3_17

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
	[For each of the options] Do you consider this aspect of teaching to be important? [For respondents that answer “yes”] Why? [For respondents that answer “no”] Why not?	Specific	Required

School Items – Grades 4, 8, and 12

[Grade 4, 8, and 12: Core School #1]

In your school, are there laptop computers that students can use for schoolwork?

No
Yes, in some classrooms.
Yes, in all classrooms.

Techn_Sc_1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required
3	Looking at the response options, do the ones presented here make sense to you for this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #2]

In your school, are there tablet computers that students can use for schoolwork?

No
Yes, in some classrooms.
Yes, in all classrooms.

Techn_Sc_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required
3	Which rooms did you include and/or count when answering this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #3]

Does your school assign each student a laptop computer that can be used for schoolwork?

No
Yes, but students cannot take it home.
Yes, and students can take it home.

Techn_Sc_3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #4]

Does your school assign each student a tablet computer that can be used for schoolwork?

No
Yes, but students cannot take it home.
Yes, and students can take it home.

Techn_Sc_4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #5]

In your school, is there a wireless Internet connection that students can use for schoolwork?

No
Yes, in some areas of the school.
Yes, everywhere or almost everywhere in the school.

Techn_Sc_5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required
3	What does the term "in some areas" mean to you in this question?	Specific	Required
4	What does the word "everywhere" mean to you in this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #6]

This school year, did your school provide teachers with laptop computers for teaching and class preparation?

No
Yes, some teachers.
Yes, all teachers.

Techn_Sc_6

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #7]

This school year, did your school provide teachers with tablet computers for teaching and class preparation?

No
Yes, some teachers.
Yes, all teachers.

Techn_Sc_7

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #8]

This school year, did your school offer technical support to teachers for computers and tablet computers used in this school?

No
Yes, we have technical support staff in the school.
Yes, we are partnering with a provider outside of the school.

Techn_Sc_8

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the term “technical support” mean to you?	Specific	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #9]

Does your school offer computer training for teachers (e.g., software, hardware, or the Internet)?

No
Yes, and training is mandatory.
Yes, but training is not mandatory.

Techn_Sc_9

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Is there other training that your school offers to teachers, such as, training for tablets, other digital devices, or technology?	Specific	Required
3	Do you think teachers would be better able to answer this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #10]

Does your school offer computer training for students (e.g., software, hardware, or the Internet)?

No
Yes, teachers are encouraged to incorporate training during class time.
Yes, there are opportunities for students outside of their regular classes.

Techn_Sc_10

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Do you think teachers would be better able to answer this question?	Specific	Required

[Grade 4, 8, and 12 Core: School #11]

SchoolClim1_0 On average, how often do teachers do the following in this school? Select one answer choice on each row.
	Never	Once a year or less	2-4 times a year	5-10 times a year	1-3 times a month	Once a week or more
Teach jointly in the same class	A	B	C	D	E	F	SchoolClim1_1
Observe other teachers' classes and provide feedback	A	B	C	D	E	F	SchoolClim1_2
Engage in joint activities across different classes and age groups (e.g., projects)	A	B	C	D	E	F	SchoolClim1_3
Exchange teaching materials with colleagues	A	B	C	D	E	F	SchoolClim1_4
Engage in discussions about the learning development of specific students	A	B	C	D	E	F	SchoolClim1_5
Work with other teachers in my school to ensure common standards in evaluations for assessing student progress	A	B	C	D	E	F	SchoolClim1_6
Attend team conferences	A	B	C	D	E	F	SchoolClim1_7
Take part in collaborative professional learning	A	B	C	D	E	F	SchoolClim1_8

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 3 for matrix item generic probes.	General	Required
2	When you thought of your answers, how did you account for differences between grades?	Specific	Required
3	When you thought of your answers, how did you account for differences between departments?	Specific	Required

[Grade 4, 8, and 12 Core: School #12]

Does your school provide computers that students can use for schoolwork?

No
Yes, in some classrooms.
Yes, in all classrooms.

TechSc1

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Looking at the response options, what did you consider to be a "classroom" when you chose your answer?	Specific	Required

[Grade 4, 8, and 12 Core: School #13]

(Ask this question if “yes” to TechSc1)

In this school year, which of the following types of computers or other digital devices are available in your school for student use? Select all that apply.

Desktop computers
Laptop computers
Tablet computers
Other digital devices (Please specify): _________

TechSc2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grade 4, 8, and 12 Core: School #14]

(Ask this question if “yes” to TechSc1)

In your school, where are desktop computers available for student use?

In some classrooms
In all classrooms
In separate computer rooms only

TechSc3

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grade 4, 8, and 12 Core: School #15]

(Ask this question if “yes” to TechSc1)

In your school, what is the total number of desktop computers available for students? Enter the number of computers.

________________

TechSc4

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required

[Grade 4, 8, and 12 Core: School #16]

(Ask this question if “yes” to TechSc1)

What is the average age of the desktop computers in your school?

Less than 1 year
1-2 years
3-5 years
6-10 years
11 or more years
I don’t know.

TechSc5

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Is there a different set of age ranges that you think would be more appropriate? [If yes] What would you suggest?	Specific	Required

[Grade 4, 8, and 12 Core: School #17]

(Ask this question if “yes” to TechSc1)

What is the technical condition of these desktop computers in your school?

All computers are functional and operate quickly.
All computers are functional, but some run more slowly than others.
All computers are functional, but all or almost all run slowly.
Some of the computers do no operate and cannot be used.
Most of the computers do not operate and cannot be used.
I don't know.

TechSc6

Item-Specific Probes:

No.	Probe	Type of Probe	Required/Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the word "operate" in this context mean to you? Is there a phrase or word that you think would make the response options clearer and easier to answer?	Specific	Required

[Grade 4, 8, and 12 Core: School #18]

(Ask this question if “yes” to TechSc1)

In your school, where are laptop computers available for student use?

In some classrooms
In all classrooms
In separate computer rooms only
Students can borrow laptop computers for specific school projects.
Each student is assigned a laptop computer.

TechSc7

Item-Specific Probes:

No.

Probe

Type of Probe

Required/Conditional

See page 2 for discrete item generic probes.

General

Required

[Grade 4, 8, and 12 Core: School #19]

What is the total number of laptop computers available for students in your school? Enter the number of laptop computers.

________________

TechSc8

Item-Specific Probes:

No.

Probe

Type of Probe

Required/Conditional

See page 2 for discrete item generic probes.

General

Required

[Grade 4, 8, and 12 Core: School #20]

What is the average age of the laptop computers in your school?

Less than 1 year
1-2 years
3-5 years
6-10 years
11 or more years
I don’t know.

TechSc9

Item-Specific Probes:

No.

Probe

Type of Probe

Required/ Conditional

See page 2 for discrete item generic probes.

General

Required

Is there a different set of age ranges that you think would be more appropriate? [If yes] What would you suggest?

[Grade 4, 8, and 12 Core: School #21]

What is the technical condition of the laptop computers in your school?

All computers are functional and operate quickly.
All computers are functional, but some run more slowly than others.
All computers are functional, but all or almost all run slowly.
Some of the computers do no operate and cannot be used.
Most of the computers do not operate and cannot be used.
I don't know.

TechSc10

Item-Specific Probes:

No.

Probe

Type of Probe

Required/ Conditional

See page 2 for discrete item generic probes.

General

Required

What does the word "operate" in this context mean to you? Is there a phrase or word that you think would make the response options clearer and easier to answer?

General

Required

[Grade 4, 8, and 12 Core: School #22]

In your school, where are tablet computers available for students to work?

In some classrooms
In all classrooms
In separate computer rooms only
Students can borrow tablet computers for specific school projects.
Each student is assigned a tablet computer.

TechSc11

Item-Specific Probes:

No.

Probe

Type of Probe

Required/Conditional

See page 2 for discrete item generic probes.

General

Required

[Grade 4, 8, and 12 Core: School #23]

What is the total number of tablet computers available for students in your school? Enter the number of tablet computers.

________________

TechSc12

Item-Specific Probes:

No.

Probe

Type of Probe

Required/ Conditional

See page 2 for discrete item generic probes.

General

Required

[Grade 4, 8, and 12 Core: School #24]

What is the average age of the tablet computers in your school?

Less than 1 year
1-2 years
3-5 years
6 or more years
I don’t know.

TechSc13

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	Is there a different set of age ranges that you think would be more appropriate? [If yes] What would you suggest?	General	Required

[Grade 4, 8, and 12 Core: School #25]

What is the technical condition of the tablet computers in your school?

All computers are functional and operate quickly.
All computers are functional but some run slower than others.
All computers are functional but all or almost all run slowly.
Some of the computers do no operate and cannot be used.
Most of the computers do not operate and cannot be used.
I don't know.

TechSc14

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	See page 2 for discrete item generic probes.	General	Required
2	What does the word "operate" in this context mean to you? Is there a phrase or word that you think would make the response options clearer and easier to answer?	General	Required

[Grade 4, 8, and 12 Core: School #26]

Please note this item will only be answered by private/religious school administrators.

PriSch_1 Please identify the organizations to which your school belongs. Select one answer choice on each row.
	Yes	No
American Association of Christian Schools	A	B	PriSch_1_01
Association of Christian Schools International	A	B	PriSch_1_02
Christian Schools International	A	B	PriSch_1_03
National Association of Episcopal Schools	A	B	PriSch_1_04
National Association of Independent Schools	A	B	PriSch_1_05
National Catholic Educational Association	A	B	PriSch_1_06
National Society of Hebrew Day Schools	A	B	PriSch_1_07
The Association of Boarding Schools	A	B	PriSch_1_08
None of the above	A	B	PriSch_1_09

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	See page 2 for matrix item generic probes.	General	Required

[Grade 4, 8, and 12 Core: School #27]

Please note this item will only be answered by private/religious school administrators.

Please identify the organization listed below to which your school is most closely affiliated. Select all that apply.

American Association of Christian Schools
Association of Christian Schools International
Christian Schools International
National Association of Episcopal Schools
National Association of Independent Schools
National Catholic Educational Association
National Society of Hebrew Day Schools
The Association of Boarding Schools
None of the above

PriSch_2

Item-Specific Probes:

No.	Probe	Type of Probe	Required/ Conditional
1	See page 2 for matrix item generic probes.	General	Required
2	In comparison to previous question: Which of these two questions do you find easier to answer? Why?	Specific	Required

Teacher and School Debriefing Probes

Debriefing probe for Core:

No.

Probe

Type of Probe

Required/Conditional

Ask the following probe at the end of each teacher and school administrator cognitive interview:

Is there anything else that you think we should have asked <teachers/principals> that we did not?

General

Required

Debriefing probe for all other subjects:

No.

Probe

Type of Probe

Required/Conditional

Ask the following probe at the end of each teacher and school administrator cognitive interview:

Is there anything else about <English/language arts/ mathematics/writing> that you think we should have asked <teachers/principals> that we did not?

General

Required

General Debriefing and Thank You (for all student, teacher, and school administrator participants)

Before we finish, I’d like to hear [any/other] thoughts you have about what you’ve been doing.

Is there anything else you would like to tell me about working on the survey questions?

Is there anything that you think could make [this/these] survey question(s) clearer?

Thank participant for his/her time and provide gift card, as appropriate.

1 Different versions of the questionnaire booklets will be created for the actual cognitive interviews using the items presented in this document.

2 Please note that the 90 minutes includes time for introductions (maximum 15 minutes), conducting the interview (60 minutes), and debriefing and/or time for additional questions/feedback from the participants (maximum 15 minutes).

File Type	application/vnd.openxmlformats-officedocument.wordprocessingml.document
File Modified	0000-00-00
File Created	0000-00-00

NAEP Assessment of Educaitonal Progress (NAEP) Questionnaire Items for Core, Reading, Writing, and Mathematics - Cognitive Interviews

NCES Cognitive, Pilot, and Field Test Studies System

Volume II NAEP Questionnaires Cog Interviews