Computer-delivered National Assessment of Educational Progress (eNAEP) Pretesting Study 2016 Updated

National Center for Education Statistics

National Assessment of Educational Progress

Appendices K-L

Screener Materials

Consent Forms

Computer-delivered National Assessment of Educational Progress

eNAEP Pretesting Study 2016 Updated

OMB# 1850-0803 v. 169

Revision to a previously approved package (1850-0803 v.159)

May 2016

Revised September 2016

Table of Contents

Appendix K: EurekaFacts Recruitment Screener – Parents/Legal Guardians of Student Participants 1

Appendix L: EurekaFacts Consent Form for Parents/Legal Guardians of Student Participants 6

Appendix K: EurekaFacts Recruitment Screener – Parents/Legal Guardians of Student Participants

Script when calling parents from previously compiled list:

Good morning/afternoon/evening. Is this the <NAME FROM CALL LIST> household? My name is <NAME>, and I am calling from EurekaFacts. We are a local research company carrying out a study on behalf of the National Center for Education Statistics (NCES), part of the U.S. Department of Education. We are recruiting students to sign up to participate in a research study supporting testing of a new system for computer-delivered assessments for the National Assessment of Educational Progress, or NAEP. [If parent asks what this is: This national assessment is administered to students in elementary and middle schools throughout the United States.]

Are there any students in your household?

Yes: (Great! Let me give you some additional information about the study.)

No: (Thank you, have a good day/evening.)

We are carrying out research sessions to help us test a new system for computer-delivered assessments. This system will be used to deliver the National Assessment of Educational Progress (NAEP) to students nationwide. If selected to participate, your child will receive a <For events 1-2: $50; For events 3-5: $25> gift card (from a major credit card company). You will also receive a $25 gift card to thank you for your time in bringing your child to and from the session site.

The pretesting session will take place at <LOCATION>. It will consist of <For events 1-2: two 100-minute parts, with a 30-minute break in between; For events 3-5: a 100-minute session>. During the session, your child will be asked to respond to a test on a tablet computer. These sessions will be audio and/or video recorded.

The pretesting is an important stage of the NAEP test development process. By participating in the pretest, the students will have a key role in helping NCES improve the tests and enhance the experience of thousands of students all over the U.S. who will take them.

Do you believe your child would be interested in participating?

Yes: (Great! To ensure that we conduct this research with a broad mix of students, I have a few brief questions to ask about you and your child. It should only take a few minutes of your time. First, I want to collect some additional information about your child to identify if <HE/SHE> meets the participation requirements.

(Skip to Screener, on following page.)

No: (Thank you, have a good day/evening. END CALL.)

Script when calling a parent who responded to email, advertisement, or invitation

Good morning/afternoon/evening. Is this <NAME OF STUDENT>? My name is <NAME>. I’m calling from EurekaFacts on behalf of the National Center for Education Statistics (NCES), part of the U.S. Department of Education.

Thank you for contacting us about the possibility of your child participating in a session to help us test a new system for computer-delivered assessments for the National Assessment of Educational Progress, or NAEP. The pretesting is an important stage of the NAEP test development process. By participating in the pretest, the students will have a key role in helping NCES improve the tests and enhance the experience of thousands of students all over the U.S. who will take them.

If selected to participate, your child will receive a <For events 1-2: $50; For events 3-5: $25> gift card (from a major credit card company). You will also receive a $25 gift card to thank you for your time in bringing your child to and from the session site.

The pretesting session will take place at <LOCATION>. It will consist of <For events 1-2: two 100-minute parts, with a 30-minute break in between; For events 3-5: a 100-minute session>. During the session, your child will be asked to respond to a test on a tablet computer. These sessions will be audio and/or video recorded.

To ensure that we conduct research with a broad mix of students, I have a few brief questions to ask about you and your child. It should only take a few minutes of your time. First, I want to collect some additional information about your child to identify if <HE/SHE> meets the participation requirements.

Screener

1. What is your child’s name?

2. What grade is your child currently in (OR, IF THE CALL OCCURS DURING THE SUMMER: What grade did your child complete last year)? (INTERVIEWER: DO NOT READ LIST)

   • 4^th or 8^th – Good

   • If the call occurs during the summer and the student just completed 4^th or 8^th or will be enrolled in 4^th or 8^th in the Fall – Good

   • All other grades - Unfortunately, we are only interviewing students currently in grade 4 or grade 8 for this study. Thank you for your time. Have a good day/evening.

3. What school does your child attend? (INTERVIEWER: Note if homeschooled)

____________________________

4. What school district does he/she attend? (INTERVIEWER: Note if parochial, charter, homeschooled)

____________________________

5. Is your child currently enrolled in any of the following types of courses (select all that apply)

Honor courses

Remedial courses

Other courses

6. What is your child’s race or ethnicity? (INTERVIEWER: Read list only if respondent doesn’t immediately reply. “Is your child…?”)

Ethnicity:       Hispanic or Latino                                    Not Hispanic or Latino

Race (one or more of the categories below):

American Indian or Alaska Native

Asian

Black or African American

Hispanic or Latino

Native Hawaiian or other Pacific Islander

White or Caucasian

7. Just to be sure we're interviewing a broad range of students for this study, does your child participate in the National School Lunch program?

[If the respondent indicates they prefer not to disclose this information, the interviewer should say “That’s fine” and move on to the next question.]

8. Would you consider the area you live in to be …

   • Urban

   • Suburban

   • Rural

9. Ok. Thank you and what is the zip code of the area that you live in?

____________________________

Thank you. We would like to speak with your child to confirm if (he/she) is interested in participating in the research study. It will only take a couple of minutes and then I will ask to speak with you again for another moment. Is your child available to speak with us now or should we call (him/her) back at another time?

 Yes, the child is available for screening questions  (SKIP TO SCRIPT FOR 4th/8th GRADE STUDENTS)

 No, please call back.

Is the phone number you gave me earlier the best number to call?

Other phone numbers: ____________________________

Is there a good time for me to call? When would be best for you?

INTERVIEWER: IF CHILD NEEDS TO RECEIVE A CALL BACK, RECORD NAME, PHONE NUMBER, DATE/TIME

Parent Name ____________________

Child Name ____________________

Child Phone ____________________

Date ____________________

Time ____________________

SCRIPT FOR 4th/8th GRADE STUDENTS

Good morning/afternoon/evening. Is this <NAME OF STUDENT>? My name is <NAME>, and I’m calling from EurekaFacts. We are doing an important study for the National Center for Education Statistics, part of the U.S. Department of Education.

We have spoken to your parent/legal guardian and we are pleased that you may be interested in helping us test a new system for computer-delivered assessments. This system will be used to deliver the National Assessment of Educational Progress (NAEP) to students nationwide. Before I tell you more about what you would be asked to do, I need to ask you one question:

What grade are you in (OR, IF THE CALL OCCURS DURING THE SUMMER: What grade did you complete last year)? (INTERVIEWER: DO NOT READ LIST)

• 4^th or 8^th – Good

• If the call occurs during the summer and the student just completed 4^th or 8^th or will be enrolled in 4^th or 8^th in the Fall – Good

• All other grades - Unfortunately, we are only interviewing students currently in grade 4 or grade 8 for this study. Thank you for your time. I will need to let your parent/legal guardian know that you cannot participate. Is he/she available? TO PARENT/LEGAL GUARDIAN: Your child has indicated that he/she is not a 4^th or 8^th grade student. Unfortunately, we are interviewing only students currently in grade 4 or grade 8 for this study. I would like to thank you very much for taking the time to speak with us about this opportunity. Have a good day/evening.

Thank you. For the research session, you will be asked to visit <LOCATION>, <ADDRESS> and respond to sample reading, writing, math, and social studies questions on a tablet computer. Your responses will not be graded. The National Center for Education Statistics simply wants to test the new system to learn how well the system performs and if there are any issues that need to be corrected. Your input will help improve the tests and enhance the experience of thousands of students all over the U.S. who will take them. To thank you for participating, you will receive a <For events 1-2: $50; For events 3-5: $25> gift card (from a major credit card company). The research session will consist of <For events 1-2: two 100-minute parts, with a 30-minute break in between; For events 3-5: a 100-minute session>. Your participation is totally voluntary. These sessions will be audio and/or video recorded. If you participate, no one but the study’s researchers will see your responses and all other interview materials, and we will not use your name to identify you.

Would you like to participate?

 Yes

 No  Thank you for your time. I will need to let your parent/legal guardian know that you would not like to participate. Is he/she available?

If NO:

TO PARENT/LEGAL GUARDIAN: Your child has decided not to participate, but I would like to thank you very much for taking the time to speak with us about this opportunity.

If YES: Thank you for agreeing to participate in this important research study. I will need to speak to your parent/legal guardian to talk about the date/time of the research session. Could you please pass the phone back to your parent/legal guardian?

IF PARENT/LEGAL GUARDIAN AVAILABLE AND CURRENTLY SCHEDULING RESEARCH SESSIONS

Thank you again for allowing your child to participate in the NAEP research sessions. We will be holding our current research session on <DATE AND TIME>. Would your child be available to participate in this research session?

Date ____________________

Time ____________________

If NO:

TO PARENT/LEGAL GUARDIAN: Thank you for allowing your child to participate, we are currently only scheduling for research sessions on <DATE> and <TIME>. We will call you if new dates become available.

If YES: Thank you. We will follow up with a confirmation email/letter and a consent form. What is your email or postal address for us to send these to?

____________________________________________________________________________________

IF PARENT/LEGAL GUARDIAN AVAILABLE AND NOT CURRENTLY SCHEDULING RESEARCH SESSIONS

Thank you again for allowing your child to participate in the NAEP research sessions. We are in between research sessions and will need to call you back when we are actively scheduling the research sessions to determine the date and time that will work best.

Thank you so much for talking with us today. We look forward to communicating with you soon.

Appendix L: EurekaFacts Consent Form for Parents/Legal Guardians of Student Participants

PARENTAL CONSENT FORM

FOR PARTICIPATION IN RESEARCH

EurekaFacts, LLC

Title of Research Study: Pretesting of eNAEP System

Thank you for your interest in having your child participate in the research project described below. This consent form explains the research study. Please read it carefully, and feel free to ask questions about anything you do not understand. If you do not have questions now, you may ask them later as they occur to you.

1. What is this study about?

The National Center for Education Statistics (NCES), part of the U.S. Department of Education, is conducting a study with students currently in grade 4 or 8 to pretest a new system for computer-delivered assessments. This system will be used to deliver the National Assessment of Educational Progress (NAEP) to students nationwide. NAEP is the largest nationally representative and continuing assessment of what America's students know and can do in various subject areas. (More information about the NAEP assessment is available online at: http://nces.ed.gov/nationsreportcard/). By having students use the system, NCES wants to learn how well the system performs and if there are any issues that need to be corrected.

2. What will happen during the pretesting?

Each participant will take an early version of a new electronic NAEP system on a tablet computer. Participants will be asked to take the test as if it were an actual test. Participants will not be graded.

3. Where will the pretesting take place?

The pretesting will take place at <NAME OF LOCATION>, located at <LOCATION ADDRESS>, near <NEARBY LANDMARK OR METRO STATION>.

4. How long will the pretesting last and when will it take place?

The session will consist of <For events 1-2: two 100-minute parts, with a 30-minute break in between during which snacks will be provided; For events 3-5: a 100-minute session>. Research sessions are scheduled to take place on <DATE AND TIME>. Each session requires only one visit to our office.

5. Whose consent do you require for participation?

For students under the age of 18, we require written, informed consent from a parent/legal guardian in order for the eligible student to participate. We also ask the student for his/her verbal consent to participate during the prescreening process. Participation in the study is completely voluntary. The parent/legal guardian or student may withdraw consent for the student’s participation in the study at any time. The student also has the right to refuse to answer particular questions.

6. Will you keep information private and confidential?

All of your child’s responses will be used only for research purposes and will not be disclosed or used, in identifiable form, for any other purpose except as required by law [Education Sciences Reform Act of 2002 (ESRA 2002) 20 U.S.C., § 9573]. Your child will be assigned a unique student identifier (ID), and at no time will his/her name be linked to any of his/her answers. The sessions will be audio and/or video recorded, as long as you agree, and are also used only for research purposes.

7. Will the results go to my child’s school?

Your child’s answers will not be disclosed to his/her school and will not be linked to any personally identifiable information such as the school’s name.

8. Are there rewards or incentives for participating?

Yes, the student will receive a <For events 1-2: $50; For events 3-5: $25> gift card (from a major credit card company) from us at the end of his or her session. The student’s parent or guardian will also receive a $25 gift card to thank him or her for bringing the child to and from the testing site.

9. What are the possible risks of being in the study?

There are no known risks to participating in this study.

10. Can participation end early?

Students’ participation in this study is completely voluntary. Students have the right to refuse to answer particular questions. Students may elect to withdraw from this study at any time.

11. Whom can I contact with questions or for further information?

<CONTACT NAME> is coordinating this study at EurekaFacts on behalf of NCES. If you have any questions, please call <HIM/HER> at <CONTACT PHONE> or by email <CONTACT EMAIL>.

By signing below, you agree that your child, _______________________________, may participate in this study. Your child will receive a <For events 1-2: $50; For events 3-5: $25> gift card (from a major credit card company) at the conclusion of the session.

In addition, if transportation to the site is involved, you will also receive a $25 gift card to thank you for bringing your child to and from the research site.

Your signature below will indicate that your questions have been answered satisfactorily, and that you have read and understood the information provided above.

Print Name: _________________________________________________________________________

Signature: ___________________________________________________________________________

Date:_______________________________________________________________________________

School your student attends: ____________________________________________________________

Does your child have any food allergies? If so, please explain:__________________________________

To be completed by EurekaFacts staff:

Student Payment Card Transaction Number: ________________________________________________________

Parent/Guardian Payment Card Transaction Number: _________________________________________________