Memorandum United States Department of Education
Institute of Education Sciences
National Center for Education Statistics
DATE: January 14, 2020
TO: Robert Sivinski, OMB
THROUGH: Kashka Kubzdela, OMB Liaison, NCES
FROM: Jill McCarroll, Project Officer, Early Childhood Longitudinal Studies Program, NCES
SUBJECT: Early Childhood Longitudinal Study, Kindergarten Class of 2022-23 (ECLS-K:2023) Field Test Change Request (OMB# 1850-0750 v.20)
The Early Childhood Longitudinal Study (ECLS) program, conducted by the National Center for Education Statistics (NCES) within the Institute of Education Sciences (IES) of the U.S. Department of Education (ED), draws together information from multiple sources to provide rich, descriptive data on child development, early learning, and school progress. The ECLS program studies deliver national data on children’s status at birth and at various points thereafter; children’s transitions to nonparental care, early care and education programs, and school; and children’s experiences and growth through the elementary grades. The Early Childhood Longitudinal Study, Kindergarten Class of 2022-23 (ECLS-K:2023) is the fourth cohort in the series of early childhood longitudinal studies. The study will advance research in child development and early learning by providing a detailed and comprehensive source of current information on children’s early learning and development, transitions into kindergarten and beyond, and progress through school. The ECLS-K:2023 will provide data about the population of children who will be kindergartners in the 2022-23 school year, and will go beyond its predecessor kindergarten cohort studies by adding a round of data collection in the spring prior to children’s kindergarten year, known as the “preschool round.” Collecting parent data beginning in preschool will enable the study to measure influences on children’s development before entry into formal schooling, including children’s home environments and access to early care and education. The ECLS-K:2023 will focus on children’s early school experiences continuing through the fifth grade, and will include collection of data from parents, teachers, and school administrators, as well as direct child assessments. The request to conduct a field test of the ECLS-K:2023 preschool data collection activities from January through October 2020, to field test the preschool data collection materials and procedures, was approved in November 2019 (OMB# 1850-0750 v.19). The ECLS-K:2023 preschool field test will be followed by the kindergarten-first grade field test (planned for August-December 2021), the spring preschool national data collection (January-June 2022), and the fall (August-December 2022) and spring (March-July 2023) kindergarten national data collections – which will be requested under separate clearance submissions.
This request is to update study website designs, web surveys, and respondent materials that will be used in the ECLS-K:2023 preschool data collection activities. As planned, revisions were made to these materials in response to the preschool instrument usability studies (OMB# 1850-0803 v.253, approved September 2019). In addition, print versions of the web instruments are included as part of this submission.1 The preschool data collection procedures will be field tested from January through October 2020.2
The requested changes do not affect the
approved total cost to the federal government for conducting this
study, nor do they affect participant burden. Revisions were made to
all parts of the previously approved ECLS-K:2023 field test request
(OMB# 1850-0750 v.19) and are detailed below. Deletions are denoted
with red strikethrough text,
while additions are in red text.
Two new attachments have been added and are more fully described below: Attachment B2 (containing the print instruments), and Attachment E (containing a comparison between the web and print instruments).
The following edits were made in Part A:
REVISED – All mentions of this change request were removed from Part A, and surrounding text was updated as appropriate.
Attachment
B provides the preschool field test survey instruments (Attachment B1
provides the web versions and Attachment B2 the hard copy versions of
the instruments). Usability
testing of these instruments will be conducted in the fall of 2019
(under OMB# 1850-0803) and any resulting minor changes to these
instruments will be submitted to OMB for review as a change request
in early winter 2019-20.
(page
A-4)
Attachment
C provides text and screenshots from the MyECLS website, along with
descriptions of each webpage functionality (if
needed, revisions to these materials will be submitted to OMB for
review as a change request in early winter 2019-20).
(page A-4)
Prior
to the ECLS-K:2023 preschool field test, all web surveys will
undergo
underwent usability
evaluations in the fall of 2019 (see
OMB #1850-0803 v.253 and v. 255) to
test whether people understand the questions, whether there are
points in the survey where people become confused or frustrated, what
errors respondents make, how respondents correct mistakes, whether
help text is used, and other potential issues. The MyECLS website and
all web surveys will
also undergo
also
underwent testing
to ensure 508 compliance. A
request to conduct this usability testing will be submitted to OMB in
August 2019 (under OMB # 1850-0803) and any resulting minor changes
to the instruments and/or MyECLS website will be submitted to OMB for
review as a change request in early winter 2019-20.
(page A-8)
The
preschool field test instruments are provided in Attachments B1 and
B2. However,
as they will undergo usability testing in fall 2019, updated
instruments that reflect findings from the testing may be developed,
in which case the revised instruments and/or content of the MyECLS
website will be submitted to OMB for review as a change request in
early winter 2019-20.
(page A-15)
REVISED – The boilerplate language was revised to remove the reference to Westat being a nonprofit organization (page A-15).
NCES is authorized to conduct the Early Childhood Longitudinal Study,
Kindergarten Class of 2022-23 (ECLS-K:2023) by the Education Sciences
Reform Act of 2002 (ESRA 2002, 20 U.S.C. §9543) [and to collect
students’ education records from education agencies or
institutions for the purposes of evaluating federally supported
education programs under the Family Educational Rights and Privacy
Act (FERPA, 34 CFR §§ 99.31(a)(3)(iii) and 99.35)]. The
data are being collected for NCES by Westat, a U.S.-based nonprofit
research organization. All of the information [respondent
type] provide may be used only for statistical purposes and may
not be disclosed, or used, in identifiable form for any other purpose
except as required by law (20 U.S.C. §9573 and 6 U.S.C. §151).
[The collected information will be combined across respondents to
produce statistical reports.]
The following edits were made in Part B:
REVISED – Text describing the sample that is eligible to complete the parent survey was updated with a more specific description. (page B-2)
The child is 3 or 4 years old and is reported on the screener as expected to be in first grade or higher in the fall of 2020.
The within-household sampling algorithm will then sample one eligible child for data collection. The algorithm will assign each child in the household who is reported to be expected to attend kindergarten in fall 2020 an equal probability of selection and randomly choose one of these children for the study, irrespective of the children’s ages. If the household has no children who are expected to be attending kindergarten in the fall, but does have one or more 3- or 4-year-old children expected to be in first grade or higher, then the algorithm will randomly sample one these children per household for inclusion in the field test.
REVISED – Text describing the sample that is eligible to complete the fall follow-up survey was updated with a more specific description. (page B-2)
In
the web data collection, households with children age 10 and under
and no children eligible for the preschool parent survey will be
asked to provide information about the mapping of their home
addresses to their children’s schools. Households will be
qualified for these additional questions only if: (1) the highest
grade level of the youngest
child(ren)
enrolled
in school is
between
kindergarten and third
grade 3;
and (2) neither of the eligibility criteria for the preschool parent
survey (as described above) is satisfied. Among the households that
meet these qualifications, the child with the lowest grade level will
be sampled for additional questions about where this child in
kindergarten, first, second, and/or third grade attended or is
attending kindergarten. Other items, such as whether the child has
lived at the same address since kindergarten, will also be included
so that this information can be used in evaluating the linking of
addresses to kindergarten schools for the national study.
REVISED – The description of the postcard used to remind households to complete the screener was revised to reflect the type of postcard that will be used. (page B-5)
All
households will be sent a thank you/reminder postcard mailed one week
after the initial mailing and containing the same PIN the household
received in the first mailing. The
postcard will be a folded postcard with tear-off
tabs which
stickers to seal the three open sides. The postcard provides
respondents with their unique and confidential web survey log-in
credentials.
REVISED – All mentions of this change request were removed from Part B, and surrounding text was updated as appropriate.
Consideration
of questions.
As much as possible, the survey is streamlined so the questions
included are straightforward and easy for respondents to answer. In
addition, skip patterns based on answers to questions that appear
earlier in the survey are built into the survey so that not all
questions need to be asked of all parents. The
planned instrument usability testing may also inform the type and
format of questions that are included in the preschool field test; in
which case a change request will be submitted to OMB in early winter
1990-20.
(page
B-9)
This
request is to conduct the ECLS-K:2023 preschool field test, the
results of which will inform the sampling and operational procedures
employed for the national preschool data collection, planned to take
place in 2022. In
the fall of 2019 usability testing of the preschool field test survey
instruments was carried out (see OMB #1850-0803 v.253 and v. 255) and
the results were used to revise the preschool field test instruments.
A
request to conduct usability testing of the preschool field test
survey instruments will be submitted to OMB in August 2019 (under
OMB# 1850-0803). Results of the usability testing will be used to
revise the preschool field test instruments. Summary of the usability
testing results and the revised data collection instruments will be
submitted to OMB as a change request in early winter 2019-20. The
preschool field test findings will be summarized in the request to
conduct the 2022 national preschool round. (pages B-9-10)
The following edits were made in Part C:
REVISED – Text describing the attachments was updated to reflect that Attachment B1 is for the web survey and Attachment B2 is for the paper survey (page C-1).
This section provides information about the general contents of the ECLS-K:2023 household screener, the preschool parent survey, and the follow-up survey for use in the field test. The survey instruments can be viewed in Attachment B1 (web survey), Attachment B2 (paper survey), and Attachment D contains the full catalog of items along with information about the role each item plays in addressing the research questions and theoretical constructs described below.
REVISED – The word “web” was added to text to more precisely describe the additional questions in the web screener about children age 10 or younger and in the third grade or below (page C-1).
In the field test, the web screener will have additional questions about where children age 10 or younger and in the third grade or below who were not eligible for the preschool parent survey attended kindergarten and questions about the mobility of the household. These questions will inform the national study design about the location of schools within selected catchment areas.
REVISED – The words “the most” were deleted to match the text used in respondent materials (page C-1).
In
respondent materials for the preschool screener, it will be requested
that the household member who responds to the screener should be the
parent, guardian, or adult who knows the
most
about the
household children’s care and education.
REVISED – The words “Child’s gender” were added to the descriptions of child characteristics included in the preschool parent survey to fully describe this survey’s content (page C-2).
The preschool parent survey includes a question about the following child characteristics:
Child’s age;
Child’s gender; and
Child’s race and ethnicity.
REVISED – Revisions were made to section C.4 to better reflect the content of the fall parent survey. Three sentences were added to indicate that the fall follow-up survey begins by confirming that the child still lives with the respondent. These are “This survey starts by confirming that the child still lives with the respondent. If the child still lives with the respondent, further questions are asked as described below. If the child does not still live with the respondent, the respondent is thanked and the survey is concluded.” The words “or zipcode” were added because the paper follow-up survey asks for the zip code of the household instead of the state and county. This bullet was also moved to be the second bullet shown to correspond to the order of questions in the survey. In addition, a new fourth bullet notes the question about “Whether the child is in public school, private school, homeschooled, or not in school” (page C-9).
In the fall of 2020, parents with (entirely or partially) completed preschool parent surveys will be asked to complete a brief follow-up survey on web or paper. This survey starts by confirming that the child still lives with the respondent. If the child still lives with the respondent, further questions are asked as described below. If the child does not still live with the respondent, the respondent is thanked and the survey is concluded. The purpose of this survey is to gauge the extent to which children attend the schools parents stated they would attend the previous year, determining how well parents are able to predict where children will go to school the following fall. The fall 2020 survey includes questions about:
Whether the child is currently in kindergarten;
Whether the child moved since the spring survey and, if so, the state and county or zipcode of the current residence.
Whether the child is attending the school named in the parent survey in the previous round (if the parent provided the name of a school); and
Whether
the child
moved since the spring survey and, if so, the state and county of
the current residence
is in public school, private school, homeschooled, or not in school.
The following edits were made in Attachment A:
REVISED – The steps to begin the online survey were numbered and the numbering formatted the same way in letters A1, A3, A1-S and A3-S, as shown below (Attachment A, pages 5, 8, 42, and 44).
1. Go to: https://MyECLS.ed.gov
2. Enter your PIN: <PIN>
3. Click "Begin survey" to participate in the survey
REVISED – The address block in the following Spanish language letters, A1-S, A3-S through A12-S, A20-S, A26-S, and A27-S, was removed because the address block on the English side of the letter will be used for delivery (Attachment A, pages 42, 44 through 53, 61, 68, and 69).
REVISED – A2 and A2-S. The reminder postcard was reformatted to fit the text on a standard sized postcard; no revisions were made to the text itself. Attachment A now contains the formatted version of the front and back of the postcard (Attachment A, pages 6 and 7). The question mark was corrected to a period at the end of the statement following “¿Sabía usted?” in the Spanish version of the postcard. Additionally, text was added to A2-S to refer the reader back to A2 on page 7 for the Spanish text (Attachment A, page 43).
REVISED – In both the English and Spanish letters A4 and A4-S, the merged PIN number in the first bullet has been bolded (Attachment A, pages 9 and 45).
REVISED – In A5 in the second bullet, “online” was deleted because a paper version of the screener is enclosed (Attachment A, page 10).
An
adult in this household who knows about the care and education of any
children living here should complete this online
survey as soon as possible.
REVISED – In the English and Spanish version of the letters in which child information is merged and the merged information is bolded, the enlarged font has been reduced from 14pt to 11pt to match the rest of the font. This change was made to A6 through A12 and A6-S through A12-S (Attachment A, pages 11 through 17 and 47-53).
REVISED – In A8, a period was added to the end of the first bullet. Also, the break in the underlining of the second paragraph, between the words “the” and “survey”, was fixed (Attachment A, page 13).
REVISED – A sentence was added to emails and text messages describing what the respondent should do if the embedded link does not work. The added text in English reads, “If the link does not work, please copy and paste the link into your browser.” This text was added to A13, A13a, A14, A14a, A15, A16, A18, A19, A22, A22a, A28, A29, and A30 (Attachment A, pages 18, 19, 20, 21, 23, 24, 27, 28, 34, 35, and 36). In Spanish the added text reads, “Si el enlace no funciona al hacerle clic, cópielo y péguelo en su navegador.” This text was added to A13-S, A13a-S, A14-S, A14a-S, A15-S, A16-S, A18-S, A19-S, A22-S, A22a-S, A28-S, A29-S, and A30-S (Attachment A, pages 54, 55, 56, 57, 59, 60, 63, 64, 70, 71, and 72).
REVISED – Text was added to the description of the envelopes, noting that for mailings addressed to named respondents, “ADDRESS SERVICE REQUESTED” will be added near the return address in order to receive expedited notification of a forwarding address (Attachment A, pages 37, 38, 73 and 74).
REVISED --The list of endorsers contained on the Preschool Study Information Infographic Enclosure has been updated to reflect the additional organizations that have endorsed the study since the page was first produced (Attachment A, page 40-41 and 76-77 in the Spanish version).
REVISED – In A4-S, the Spanish name of the Department of Education has been revised from “el Departamento de Educación de EE. UU.” to “el Departamento de Educación de los Estados Unidos” to match the name as it appears in the other communications (Attachment A, page 45).
REVISED – The underline of the ECLS email address was removed in A5-S to be consistent with the display of the email address in the other printed communications (Attachment A, page 46).
REVISED – In A26, A26-S, A27, and A27-S (the cover letters for requested cash incentives), the phrase, “Si usted prefiere la versión en español, vea al dorso de la carta” was added to the English letters and “If you prefer to read this in English, please see the back of this letter” was added to the Spanish letters to make the letters consistent with the other letters sent in bilingual versions (Attachment A, pages 32, 33, 68, and 69).
REVISED – In A31-S, the Spanish translation that appears below the image of the envelope has been deleted. A Spanish language version of the envelope will not be printed (Attachment A, page 74).
REVISED – Text from the Spanish Study Information Infographic was replaced with the formatted Spanish Study Information Infographic, which also contains the updated list of study endorsers (Attachment A, A34-S, page 76).
The following edits were made in Attachment B1:
REVISED – The prefatory note introducing the web instruments was edited and updated. The paragraph describing the hard-copy version was updated, and the last bullet on page B1-2 was updated to describe how help text was handled between web survey and the print instruments (Attachment B1, page B1-2).
The hard-copy layout of the household screener and parent surveys
will be submitted to OMB as a
non-substantive change request by January 2020, once available
are presented in Attachment B2. The text
in the hard-copy versions will
does not vary significantly from the online version provided
in this document. Details of the differences
between the hard-copy and web modes are shown in Attachment F.
Generally, the web and the hard copy surveys differ The
differences between the hard-copy and web modes will be
as follows:
•
Most Hhelp text
used in the web version of the surveys will not be used in the
hard-copy versions. Some help text that was
determined to be essential text was moved to item instructions.
Respondents to the hard-copy survey may call in to the help
desk for any questions about survey items.
For the web surveys in Attachment B1, no substantive changes were made. Changes to Attachment B1 between the approved package (#1850-0750 v.19) and the version being submitted with this change memo can primarily been seen in the items. Minor edits were made to correct grammar, punctuation, and errors (e.g., repeated words, skips between items), and refinement of items was done to be responsive to findings from usability testing, but no new constructs were added. Additions of brief text were included to describe answer fields for 508 compliance. Programming specifications were also updated (i.e., internal programming notes) in the final web instrument (B1) relative to the prior, approved version, to refine these for clarity to the programmers. Surveys were also transferred from the original Word file into a format for programming. A comparison document was created to show text changes from the package OMB approved in November 2019 and is available to OMB by request.
Covers of the Print Instruments (previously contained in Attachment B1; now located in Attachment B2)
REVISED – The print instrument covers were significantly updated to enhance their readability and appeal. The previously-submitted covers were based on those used on the teacher and school administrator questionnaires in the ECLS-K:2011. However, potential ECLS-K:2023 respondents in this preschool round will not yet be invested in the study and thus are unlikely to be as motivated to participate as the school staff in the ECLS-K:2011 were. It was determined that more professionally-produced covers were needed to attract the attention of the households sampled for the preschool round. Additionally, the logos from the Department of Education and the Institute for Education Sciences, as well as a photograph of elementary-age children, were added. The expanded version of the ECLS-K:2023 logo was also used and the OMB expiration date was added. The time period (e.g., spring 2020) was removed from the covers as well (formerly in Attachment B1, page 160-165, now in Attachment B2, page B2-3, B2-5, B2-49, B2-53, B2-55, and B2-101).
REVISED – On the screener, the initial screen-out question (“Are there any children age 10 or younger living in this household?”) was placed on the cover, rather than including it inside the instrument booklet. The words “age 10 or younger” were also underlined to emphasize the text. Upon seeing the name of the study, household participants who do not have children, or do not have children 10 or younger, may be unlikely to open the print booklet to answer this screen-out question. Moving the question to the cover, as was done for the National Household Education Survey (NHES), increases the likelihood of response from non-eligible household participants (formerly in Attachment B1, page 160-165, now in Attachment B2, page B2-3 and B2-53).
REVISED –The instructions for completion of the survey (e.g., how to mark a response) were updated and were all moved from the front and back of the cover to the inside of the screener, parent survey, and fall follow-up survey (formerly in Attachment B1, page 160-165, now in Attachment B2, page B2-4, B2-6, B2-50, B2-54, B2-56, and B2-102).
Prepared
for the U.S. Department of Education National Center for Education
Statistics by: Westat
Use a black or blue ballpoint pen to
complete this survey.
RETURN
THIS COMPLETED QUESTIONNAIRE TO WESTAT IN THE POSTAGE-PAID ENVELOPE
PROVIDED
Instructions:
If you have any questions or require additional assistance with any part of this survey, please call 1-855-898-2018. (This text is at the bottom of the page in the screener, underneath the instructions on the first page of the parent survey, and at the bottom of the first page in the fall follow-up survey.)
Please use a black or blue pen to complete this form. (This text is shown in the first bullet of instructions at the top of the page in the screener, on the first page of the parent survey, and on the first page of the fall follow-up survey.)
Mark X to indicate your answer. (This text is shown in the second bullet of instructions at the top of the page in the screener, on the first page of the parent survey, and on the first page in the fall follow-up survey.)
If you want to change your answer, darken the box and mark the correct answer. (This text is shown in the third bullet of instructions at the top of the page in the screener, on the first page of the parent survey, and on the first page of the fall follow-up survey.)
• Your
answers are very important to us. Please print clearly.
There are arrows and instructions to GO TO a question or page number beside some
response options. These will help you move to questions that are appropriate for you. (This text is shown in the fourth bullet of instructions on the first page of the parent survey and the first page of the fall follow-up survey. Note that this instruction was only added to the parent survey and to the fall follow-up survey.)
REVISED – The OMB text was reformatted from two columns into one (formerly in Attachment B1, page 160-165, now in Attachment B2, page B2-3, B2-5, B2-49, B2-53, B2-55, and B2-101).
Attachment B2, containing the hard-copy versions of the preschool instruments, was added to the package for this submission. Attachment E, an Excel file that contains the details of how the hard-copy questionnaires differ from the online versions, has also been added to the package. Most of the differences in the hard copy versus online surveys are to accommodate the administration mode (paper versus online). That is, while the intent of the questions remains the same across the two modes, some small wording changes were made to better accommodate the hard-copy administration. See the description of Attachment E below for further details.
One small difference for household members who complete the instruments online versus those who complete them on paper is that on the MyECLS website and in the online screener, household members are asked to provide their mobile number or email address so that they can be provided with a temporary code to return to their online screener and/or survey at a later time. This functionality is not needed for the hard-copy screener and survey, so it was not included and household members who complete the surveys on paper will not be asked for this information.
Another small difference for household members who complete the instruments online versus those who complete them on paper is that is that there is text on the hard-copy screener that thanks the respondent and asks them to return the form in the enclosed postage-paid envelope. Web respondents are thanked on screens that are part of the web specifications in Attachment B1 and in the MyECLS screens that are shown in Attachment C.
Both Attachments B1 and B2 contain redacted items (see pp B1-114-121 and B2-19). An Attachment B3, sent under separate cover to OMB, contains the full text of those items.
The following edits were made in Attachment C (note that all changes unless otherwise noted were made to both the English and Spanish screens/text; changes listed that resulted in text changes are listed in both English and Spanish):
REVISED – In response to new NCES senior management directives on best practices for Longitudinal Studies Branch (LSB) web surveys, language was added to all of the MyECLS screens. The language for the English text is:
When you have finished or if you need to stop before finishing, please LOG OUT of the survey
system by clicking “Save and exit” and CLOSE ALL browser windows or screens to keep your responses secure.
For example, if you used Chrome or Safari to open the survey, make sure no Chrome or Safari windows or screens are open after you end the survey.
Not closing all browsers may allow someone else to see your responses.
The language for the Spanish text is:
Cuando haya terminado o si necesita parar antes de terminar, por favor SALGA de la encuesta haciendo CLIC en “Guardar y salir” y CIERRE TODAS las ventanas o pantallas del navegador para mantener sus respuestas protegidas.
Por ejemplo, si usó Chrome o Safari para abrir la encuesta, asegúrese de que no quede abierta ninguna ventana o pantalla de Chrome o Safari después que usted termine la encuesta.
Si usted no cierra todos los navegadores, alguien tal vez pueda ver sus respuestas.
REVISED – The overall page design was significantly updated to a cleaner style. Blue backgrounds were removed from all pages. Alerts were changed from red text displaying on the page to red boxes (for alerts that require action) or blue boxes (for alerts that serve as notifications). Alerts are included on Screens 2, 2a, 10a, 10b, 12, 13a, 15, and 16. All screenshots have been replaced with updated versions (Attachment C, pages 9, 11, 37, 39, 44, 48, 54, and 56).
REVISED – In the Purpose of Attachment, the universal description of screens has been updated. The second bullet has been updated to include the Spanish translation for the help desk text that appears at the bottom of every screen, and an additional bullet has been added to describe the new instructions about saving responses (Attachment C, page 4).
• recommended browser and help desk contact information and a link to Screen 21 (Study Information Page – Spring/Fall). The English text will read: “Questions or problems? Contact the study at 1-855-898-2018 or email ECLS@westat.com. Please click here for more information about the study.” The Spanish text will read “¿Tiene preguntas o problemas? Contacte al estudio llamando al 1-855-898-2018 o envíe un correo electrónico a ECLS@westat.com. Por favor haga clic aquí para obtener más información sobre el estudio.”
• instructions for saving responses and closing browser windows. The English text will read: "To save your responses and keep them secure, please LOG OUT of the survey system by clicking "Save and exit" and CLOSE ALL browser windows or screens. For example, if you used Chrome or Safari to open the survey, make sure no Chrome or Safari windows or screens are open after you end the survey. Not closing all browsers may allow someone else to see your responses." The Spanish text will read "Para guardar sus respuestas y mantenerlas protegidas, por favor SALGA de la encuesta haciendo CLIC en “Guardar y salir” y CIERRE TODAS las ventanas o pantallas del navegador. Por ejemplo, si usó Chrome o Safari para abrir la encuesta, asegúrese de que no quede abierta ninguna ventana o pantalla de Chrome o Safari después que usted termine la encuesta. Si usted no cierra todos los navegadores, alguien tal vez pueda ver sus respuestas.";
REVISED – The underline format was removed from “PIN” on Screen 1 (Attachment C, page 5).
REVISED – The text “Enter the 8-digit PIN found in the letter we sent you.” was moved from below the “Begin Survey” button to above the field where the PIN is entered and the word “or” was deleted from the center of the page on Screen 1 (Attachment C, page 6).
REVISED – The field where the PIN is entered is now one field instead of two on Screen 1. A hyphen will automatically appear between the two four-digit strings of the PIN as the respondent enters it. The page details have been updated to address this change (Attachment C, page 8).
A mask will be used in the PIN field to show a hyphen between the two 4-digit strings of the PIN.
REVISED – A watermark of “ABCD1234” has been added to the PIN field on Screen 1 (Attachment C, page 6).
ABCD1234
REVISED – “Pick up where you left off.” has been changed from a link to a button on Screen 1. The page details have been updated to indicate that this is now a button (Attachment C, page 6).
For
subsequent visits, respondents can click on “Pick up where you
left off” (Link
Button directs
to Screen 11 – Returning User).
REVISED – Browser recommendation text was added to Screens 1 and 14. The page details for Screens 1 and 14 have also been updated to reflect this update (Attachment C, pages 6 and 51).
Browser recommendation text:
For best results, use Google Chrome, Firefox, or Safari. (English)
Para que funcione mejor, use como navegador Google Chrome, Firefox, o Safari. (Spanish)
Updated page details:
Browser recommendations and OMB and security notices are included on this page.
REVISED – Formatting of the text section on Screen 2a has been edited to indicate that the text being displayed is additional text, as it is a validation message that appears on the screen, not a brand new screen. The Welcome text has been removed to reflect this as well. The text “return to your survey” has been changed to a blue, underlined hyperlink that will direct the respondent to Screen 11 (Returning User – Spring) (Attachment C, page 12).
Additional English Text Reads:
Welcome back to the Early Childhood
Longitudinal Study (ECLS)!
You have already provided us with an email address or mobile phone number.
Please use that to return to your survey.
Additional Spanish Text Reads:
¡Bienvenido(a)
nuevamente al Estudio Longitudinal de la Primera Infancia (ECLS)!
Usted ya nos dio una dirección de correo electrónico o número de teléfono celular.
Por favor use eso para regresar a su encuesta.
REVISED – The “Continue/Continuar” button that displayed with the validation message on Screen 2a has been changed to a link using the text available (“Please use that to return to your survey.”). This change has been reflected in the page details for Screen 2a (Attachment C, pages 12).
A
link to The
respondent will select the “Continue” button, which will
route them to
Screen
11 (Returning User – Spring) is
provided in this alert.
REVISED – A new validation message has been added, Screen 2b: Survey Complete Validation, to alert respondents that their survey has already been completed (Attachment C, page 14).
Additional English Text Reads:
You have already completed this survey. Thank you for your participation!
Spanish Text Reads:
Usted ya ha completado esta encuesta. ¡Gracias por su participación!
Page Details
Text alerting the user to the previous completion of the survey will be displayed if the respondent attempts to return to the survey using their email address or mobile phone number after they have already completed the parent survey.
REVISED – The underline format was added to “age 10 or younger” on Screen 3 (Attachment C, page 15).
REVISED – On Screen 5, the text “The session will timeout if left idle for more than 10 minutes.” was changed to reference 10 minutes rather than 15 minutes (number of minutes in the language about time out was changed from 15 to 10: “The session will timeout if left idle for more than 10 minutes.” (Attachment C, page 20). The same change was made to the Spanish text on this page.
REVISED – On Screen 5, the text “The session will timeout if left idle for more than 10 minutes.” was moved to come before “We will never share your email or number with others outside the study.”, which was made more prominent on the page (Attachment C, page 20). The same change was made to the Spanish text on this page.
REVISED – On Screen 5, the word “OR” has been added between Email Address and Mobile Number fields to indicate that the respondent only needs to choose one option (Attachment C, page 20). The same change was made to the Spanish text on this page.
Email Address:
OR
Mobile Number:
REVISED – On Screens 6 and 17, the word “Cash” has been changed to lowercase (Attachment C, pages 24 and 61).
If
you select Ccash,
your thank you will be mailed within 5 business days.
REVISED – “Edit my address” has been changed from a link to a button on Screens 7, 9, 18, and 20. References to “Edit my address” as a link have been changed to button in the page details for Screens 7, 7a, 7b, 9, 18, 18a, 18b, and 20. See an example of this in red text below, from Screen 7 (Attachment C, pages 26, 29, 32, 35, 64, 67, 70, and 73).
The respondent can click the “Edit my address” link
button, which will direct them to Screen 7a (Cash Thank You –
Edit Address – Spring), where they can update any or all of the
pre-filled fields.
REVISED – Quotes were added around Edit my address in the page details for Screens 7 and 9 (Attachment C, pages 27 and 36). The underlining of this text was also removed.
“Edit my address”
REVISED – The state field on Screens 7a and 18a have changed to dropdowns. Text has been added to the “English/Spanish Text Reads” section to describe the dropdown. See an example of this in the red text below, from Screen 7a (Attachment C, pages 28 and 66).
Editable fields with pre-filled text and a dropdown option for State:
John Smith
Updated Street Address
City, Select State (dropdown), Zip Code
REVISED – A list of editable field name has been added in English and Spanish for Screens 7a and 18a (Attachment C, pages 29 and 67).
Editable Field Names (English):
First Name:
Last Name:
Address:
City:
State:
Zip Code:
Editable Field Names (Spanish):
Primer Nombre:
Apellido:
Dirección:
Ciudad:
Estado:
Código Postal:
REVISED – A “copy” icon has been added to Screens 8 and 19 to the left of the displayed Amazon code. This is outlined in the page details for those Screens (Attachment C, pages 34 and 72).
A “copy” icon is included to the left of the code so that the respondent can easily copy the code and paste it into their Amazon wallet.
REVISED – The thank you message on Screen 10b has been updated to be more inclusive than to respondents who have already started the survey (Attachment C, page 39).
“Thank
you for starting the survey.
All of your answers have been saved.”
“Gracias
por
comenzar la encuesta.
Todas sus respuestas se han guardado.”
REVISED – Some clarifying text has been added to the page details of Screens 10a and 10b to describe the routing for a respondent who chooses to provide their contact information on Screen 10a (Logout Validation – Contact Information Not Provided) (Attachment C, pages 38 and 40).
Screen 10a page details:
The Logout Validation – Contact Information Not Provided screen is shown to eligible respondents who have not provided an email address or mobile number on Screen 5 and click on the logout button while completing the screener or survey. This screen notifies the respondent that if they continue the logout process without providing an email address or mobile number, they will need to restart their screener and survey the next time the instrument is accessed. The respondent is able to continue to logout without providing contact information. If the respondent chooses to provide their contact information on this page, clicking the “Next” button will direct them to Screen 10a: Logout Validation – Contact Information Provided.
Screen 10b page details:
The Logout Validation – Contact Information Provided screen is shown to eligible respondents who have provided an email address or mobile number on Screen 5 and click on the logout button while completing the screener or survey, or if they provide contact information on Screen 10a. This screen thanks the respondent for starting the survey, and provides instructions for returning to complete the survey at a later time.
REVISED – Watermarks were added to the “Email Address or Mobile Number” field on Screens 11 and 13 (Attachment C, pages 42 and 47).
name@domain.com or (555) 555-5555
REVISED – The text message disclaimer has been added to Screen 11 (Attachment C, page 42). The same change was made to the Spanish text on this page.
*By providing my mobile phone number, I agree to receive a text message to log back into this survey. Message and data rates may apply.
*Al proporcionar mi número de teléfono celular, acepto recibir un mensaje de texto para volver a iniciar sesión en esta encuesta. Pueden aplicarse tarifas de mensaje y transmisión de datos.
REVISED – The underline format was removed from “Temporary Code” on Screen 13 (Attachment C, page 46).
REVISED – The OMB statement (screenshots only) has been updated to reflect the appropriate burden time on Screens 14 and 15 (Attachment C, pages 50 and 54).
DELETION – “American Association of School Administrators” has been removed from the endorsements list in English and Spanish on Screen 21. It was a duplication for “The School Superintendents Association” which remains on the list (Attachment C, pages 77 and 80).
REVISED – The endorsements list has been updated on Screen 21 to reflect additional study endorsements received since the OMB package’s original submission (Attachment C, page 77).
Alliance for Excellent Education
American Federation of Teachers
American Montessori Society
Association for Middle Level Education
Association Montessori International/USA
Association of Christian Schools International
Association of Christian Teachers and Schools
Christian Schools International
Council for Exceptional Children
Council of Chief State School Officers
Council of Islamic Schools in North America
International Literacy Association
Islamic Schools League of America
Lutheran Church-Missouri Synod
National Alliance of Christian Schools
National Association of Elementary School Principals
National Association of Independent Schools
National Catholic Educational Association
National Christian School Association
National Council of Teachers of Mathematics
National Institute for Early Education Research
National Parent-Teacher Association
National School Boards Association
National Science Teachers Association
Texas State Teacher's Association
The School Superintendents Association
U.S. Conference of Catholic Bishops
WELS Commission on Lutheran Schools
The following edits were made in Attachment D:
REVISED – The cover page of Attachment D now notes that the attachment refers to the web specifications (Attachment D, first sheet).
This file contains a listing of every question that will be asked of household parent respondents in the Early Childhood Longitudinal Study, Kindergarten Class of 2022-23 (ECLS-K:2023) preschool field test. For each question, the question wording is provided, along with the item section and number, the construct the item measures, and the specific research question in Part C of this OMB submission for which the item is intended to provide information. This document is based on web specifications in the OMB package approved in November 2019 (#1850-0750 v.19). See attachment F for a discussion of the differences between the web specifications and the paper surveys.
REVISED – Although no substantive changes were made to the web item wording, minor edits were made to correct errors (e.g., repeated words) and be responsive to findings from usability testing (e.g. moved instructional text to help text to make more room on the screen, added text to make it clear to respondents when estimates were acceptable if they didn’t know exact answers, corrected errors like errant punctuation or duplicated words). Column F of the sheet for each instrument (Screener, Parent Survey, and Fall Follow-up Survey) shows text changes from the original OMB approved version of the study web instruments that were cleared in November 2019 and the current versions being submitted with this change.
REVISED – In addition to the wording and punctuation changes detailed in Attachment D, some programming of the web instruments was also revised, including changes in the display of web buttons, changes to internal coding for skipped questions, and similar changes to the internal programming structure of the web instrument. Although those changes are not exhaustively detailed in this package, a document detailing the changes is available upon request.
Attachment E illustrates the differences between the hard-copy surveys and the web surveys and was added to the package for this submission. The hard-copy survey and web survey are very similar, with most differences made to accommodate the change in mode. There are a few more substantial differences in the order of items in the fall follow-up survey (e.g., question FFS011 (whether the respondent moved since the last interview) on the web survey was placed at the end of the hard-copy survey (question 7), and questions FFS012A/B (state of residence) and FFS013A/B (county of residence) on the web survey were replaced by a question on the hard-copy survey that asks for the household zip code (question 8)). Columns A and C contain text from the hardcopy surveys, in English and Spanish respectively. Columns AM and BC contain text from the web surveys, in English and Spanish respectively. Any text that is different in the hard-copy version from the web version is shown in red font in column A (English) and blue text in column C (Spanish). In addition, any text that is shown in the hard-copy version but not in the web version or shown in the web version but not in the hard-copy version is marked and highlighted in yellow cells (e.g., “No Equivalent on Paper”).
1 The previously-approved submission only included web versions of the preschool round instruments (OMB# 1850-0750 v.19); print versions of the instruments were not developed until after the web instruments were finalized, using feedback from the preschool instrument usability studies. Updated versions of these web surveys are also included in this submission.
2 The field period contains both a spring and a fall data collection.
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
File Modified | 0000-00-00 |
File Created | 2021-01-14 |