Supporting Statement

NATIONAL ASSESSMENT OF

EDUCATIONAL PROGRESS

Volume 1

SUPPORTING STATEMENT

FOR

WAVE 3 OF 2008 SUBMITTAL

(PART OF 2008-2010 SYSTEM CLEARANCE PROPOSAL

OMB# 1850-0790)

Student with Disabilities (SD) and English Language Learner (ELL) Questionnaires

for Field Test (Reading, Mathematics, Science) and Arts

September 12, 2007

Explanation and Burden Information for This Submittal

This document contains supplemental information pertaining to the 2008-2010 NAEP System Clearance proposal (submitted in January 2007). The terms of clearance for OMB approvals state that each subsequent submittal activity under the System Clearance is to be submitted to OMB.

This submittal contains burden information and the actual background questionnaires for the following components of the 2008 assessments:

• SD and ELL (Student Disabilities and English Language Learner) for the 2008 field test (reading, mathematics, and science) and Arts components

These specific questionnaires are the fourth and last group (Wave 3) of questionnaires submitted for approval for usage in 2008. The previous groups of questions that were submitted included:

1) the System Clearance submittal in January 2007 which included: student core questions (grades 4, 8, 12); reading and mathematics subject-specific background questions (grades 4 and 8); long-term trend (LTT) core, reading and mathematics questions (ages 9, 13, 17).

2) a Wave 1 submittal that included: student grade 8 questions (Visual Arts and Music); student grade 12 questions for reading and mathematics pilots; school grade 8 questionnaires for the Arts; and SD and ELL questionnaires for the Long-Term Trend (LTT) administration.

3) a Wave 2 submittal that included : student grade 4 pilot Science questions, student grade 8 pilot Science questions, student grade 12 pilot Science questions, and student grade 12 reading motivational study questions; grade 4 and grade 8 teacher questionnaires for reading, mathematics and science; and grade 4, 8, and 12 school questionnaires for reading, mathematics, and science, as well as a grade 12 school questionnaire for the reading motivational study.

2008 Burden Estimate Chart

Overall Respondent Burden for NAEP 2008 Assessments

By Grade Level

2008

Subjects	# of Students	Student Burden (in hours)	# of Teachers /	Teacher Burden	# of Schools	School Burden	SD/ELL (# of school personnel)	SD/ELL Burden	Total Burden
				(in hours)		(in hours)		(in hours)	(in hours)
LTT Ages 9	16,500	4,125					578	191	4,316
LTT Ages 13	16,500	4,125					578	191	4,316
LTT Ages 17	16,500	4,125					578	191	4,316
4th Grade -PreCalibration (Math & Reading); Science Pilot; Reading Bridge	30,700	7,675	1,842	608	614	307	1,073	353	8,944
8th Grade -PreCalibration (Math & Reading); Science Pilot; Reading Bridge; Arts Operational	39,200	9,800	2,352	776	784	392	1,372	453	11,421
12th Grade -ReadingPilot;Math Pilot; Science Pilot; Math Bridge; Reading Mot/Inc Study	23,500	5,875			470	235	823	271	6,381
E-Filing2						744			744
Totals	142,900	35,725	4,194	1,384	1,868	1,678	5,002	1,650	40,438

² A subset of the sample of schools where school personnel complete e-filing activities.

Estimated Respondent Burden for 2008 Assessments

Contained in this Submittal

By Grade *

Summary of Wave 3 components for 2008 (SD and ELL only)				SD and ELL (# of school personnel)	SD and ELL Burden (in hours)
GRADE 4
Grade 4 Science Pilot				167	55
Grade 4 Reading Precalibration				400	132
Grade 4 Mathematics Precalibration				173	57
Grade 4 Reading Bridge Study				333	110
Totals				1,073	353
GRADE 8
Grade 8 Science Pilot				142	47
Grade 8 Reading Precalibration				502	166
Grade 8 Mathematics Precalibration				163	54
Grade 8 Reading Bridge Study				377	124
Grade 8 Arts (Music Arts, Visual Arts)				188	63
Totals				1,372	453
GRADE12
Grade 12 Science Pilot				193	64
Grade 12 Reading Pilot				210	70
Grade 12 Mathematics Pilot				210	70
Totals				613	204
Totals for all grades				3270	1082

* See chart at end of Volume 1 for more detailed breakdown of burden by waves.

Overview of NAEP 2008-2010 Assessments

The following broad overview of the 2008-2010 NAEP assessments was submitted as part of the initial systems clearance submittal. The National Assessment Governing Board determines NAEP policy and assessment schedule, and future Board decisions may result in changes to some aspects of an assessment (e.g., which subjects are assessed in which years). However, overall methodology and assessment process will remain constant. In the 2008 assessment year, questionnaires will be administered to students at grades 4, 8, and 12; to students at ages 9, 13, and 17 for LTT; to teachers at grades 4 and 8; and to school administrators at grades 4, 8, and 12.

The 2008 assessments consist of:

• National operational assessments in the Arts (Visual Arts and Music) at grade 8 and long-term trend assessments in reading and mathematics at ages 9, 13, and 17.

• Pre-calibration field test assessments for reading and mathematics at grades 4 and 8.

• Pilot assessments in science at grades 4, 8, and 12; pilot assessments in reading and mathematics at grade 12; LTT pilot assessments for mathematics at ages 9, 13, and 17; bridging studies for reading at grades 4 and 8; and a special motivational study for grade 12 reading.

How, by Whom, and for What Purpose the Data Will be Used

In the original request for system clearance, NCES asked for approval of the instruments to be used to gather data from the 2008-2010 national and state assessments. This submittal applies to the fourth (and final) set of questionnaires (SD and ELL questionnaires for the field test (reading, mathematics, and science) and Arts components of the 2008 assessments.

Given that the purpose of NAEP is to gather data on the achievement of students in the subject areas assessed for use in monitoring education progress, and because of the program's increasing visibility, it is incumbent on the program to develop the most reliable and valid instruments possible. To do so, NAEP employs four strategies:

1. Small-scale pilot testing of new materials and test administration techniques;

2. Pilot testing items to determine which items best measure the constructs under consideration;

3. Field testing of operational assessments to accommodate the mandated six-month reporting; and

4. Full-scale operations.

Questionnaire development follows the same pattern as that of cognitive item development, although we tend to pilot fewer items with less duplication and use the resulting data to refine the questions. Guidance for what is asked is provided by the National Assessment Governing Board. NCES develops the questionnaires, which the Governing Board then approves for submission to OMB in a two-stage process. The Governing Board approves the questionnaires prior to pilot testing, and then again after NCES and its contractors make selections for the operational assessment based on pilot data. The questions are designed to provide the information for disaggregating data according to categories specified in the legislation, to provide contextual information that is subject specific (e.g. reading, mathematics) and has an impact and known relationship to achievement, and to provide policy relevant information specified by the Governing Board.

Design Information for the 2008 Subjects Contained In This Submittal

SD and ELL (Student with Disabilities and English Language Learners)

These questionnaires are completed by school personnel who are most knowledgeable about students identified as SD or ELL. NAEP encourages the inclusion of all students who can meaningfully participate in the assessment, including those with disabilities and those with limited English proficiency. In order to obtain a complete picture of educational progress for all students, it is important to collect supplemental information on students in the sample who have been identified as having a disability or are English language learners. Students with disabilities include those who have an individual education plan (IEP), Section 504 plan, or equivalent documentation.

The flowchart format utilized in the 2007 version reduces the number of questions required to complete the questionnaires, thus reducing overall burden. Since schools may have several students identified as SD and/or ELL, this revision of the question format is aimed at reducing overall school burden.

For 2008, the SD and ELL questionnaire formats from the 2007 assessments will be used with some modifications to address administrative issues encountered in the field. Two versions of the SD and ELL questionnaires are included with Wave 3. One version applies to the field test subjects of reading, mathematics, and science and the other version applies to the Arts assessment. There are some differences in the questionnaires because the Arts are not subjects usually administered in the regular state assessments thus requiring different wording in the charts and some questions.

2008 Estimated Respondent Burden (By Waves)

Year 2008	Subjects	# of Students	Student Burden (in hours)	# of Teachers /	Teacher Burden	# of Schools	School Burden	SD/LEP (# of school personnel)	SD/LEP Burden
					(in hours)		(in hours)		(in hours)
SC	LTT (Ages 9, 13, 17)
	LTT Ages 9	16,500	4,125					578	191
	LTT Ages 13	16,500	4,125					578	191
	LTT Ages 17	16,500	4,125					578	191
	Totals	49,500	12,375					1,734	573
SC	Math PreCalibration (Gr.4,8)
	Grade 4 (includes core plus subject)	5,200	1,300	312	103	104	52	182	60
	Grade 8 (includes core plus subject)	5,200	1,300	312	103	104	52	182	60
	Totals	10,400	2,600	624	206	208	104	364	120
SC	Reading PreCalibration (Gr.4,8)
	Grade 4	12,000	3,000	720	238	240	120	420	139
	Grade 8	16,000	4,000	960	317	320	160	560	185
	Totals	28,000	7,000	1,680	554	560	280	980	324
W1	Arts (Music Arts, Visual Arts) (Gr.8)	6,000	1,500			120	60	210	70
W1	Reading Pilot (Gr.12)	6,000	1,500					210	70
W1	Reading Incentive Study(Gr.12)	3,600	900			60	30
W1	Math Pilot (Gr.12)	6,000	1,500			120	60	210	70
W2	Science Pilot (Gr.4,8,12)
W2	Grade 4	5,000	1,250	300	99	100	50	175	58
W2	Grade 8	4,500	1,125	270	89	90	45	158	52
W2	Grade 12	5,500	1,375	330	109	110	55	193	64
	Totals	15,000	3,750	900	297	300	150	525	174
W2	Reading Bridge Study (Gr.4,8)
	Grade 4	10,000	2,500	600	198	200	100	350	116
	Grade 8	12,000	3,000	720	238	240	120	420	139
	Totals	22,000	5,500	1,320	436	440	220	770	255
	Totals	146,500	36,625	4,524	1,493	1,808	904	5,003	1,656
	E-Filing					744	744
	Total						1,648
	2008 Burden Chart
	In the Year column , the following coding is employed--Sys Clearance subjects are Orange, Wave 1 is pink, Wave 2 is red.
	In the columns with subject burden -- 4th grade is yellow, 8th grade is blue, 12th grade is green.
	Due to rounding some columns may be off by 1.
	Summary of Wave 1 components for 2008
	Subjects	# of Students	Student Burden (in hours)	# of Teachers /	Teacher Burden	# of Schools	School Burden	SD/LEP (# of school personnel)	SD/LEP Burden
					(in hours)		(in hours)		(in hours)
	GRADE 8
W1	Arts (Music Arts, Visual Arts) (Gr.8)	6,000	1,500			120	60	210	70
	Totals	6,000	1,500			120	60	210	70
	GRADE 12
W1	Reading Pilot (Gr.12)	6,000	1,500					210	70
W1	Reading Incentive Study(Gr.12)	3,600	900			60	30
W1	Math Pilot (Gr.12)	6,000	1,500			120	60	210	70
	Totals	15,600	3,900			180	90	420	140
	Summary of Wave 2 components for 2008
W2	Science Pilot (Gr.4,8,12)
W2	Grade 4	5,000	1,250	300	99	100	50	175	58
W2	Grade 8	4,500	1,125	270	89	90	45	158	52
W2	Grade 12	5,500	1,375	330	109	110	55	193	64
	Totals	15,000	3,750	900	297	300	150	525	174
W2	Reading Bridge Study (Gr.4,8)
	Grade 4	10,000	2,500	600	198	200	100	350	116
	Grade 8	12,000	3,000	720	238	240	120	420	139
	Totals	22,000	5,500	1,320	436	440	220	770	255

	Summary of Wave 3 components for 2008 (SD and ELL only)
	GRADE 4
W3	Grade 4 Science Pilot							175	58
W3	Grade 4 Reading Precalibration							420	139
W3	Grade 4 Math Precalibration							182	60
W3	Grade 4 Reading Bridge Study							350	116
	Totals							1,127	372
	GRADE 8
W3	Grade 8 Science Pilot							158	52
W3	Grade 8 Reading Precalibration							560	185
W3	Grade 8 Math Precalibration							182	60
W3	Grade 8 Reading Bridge Study							420	139
W3	Grade 8 Arts (Music Arts, Visual Arts)							210	70
	Totals							1,530	506
	GRADE 12
W3	Grade 12 Science Pilot							193	64
W3	Grade 12 Reading Pilot							210	70
W3	Grade 8 Math Pilot							210	70
	Totals							613	204
								3,269	1,081

2008 Wave 3 Supporting Statement 0