APPENDIX B.1: SUMMARY OF U.S. CHANGES TO ICILS INSTRUMENTS
International Computer and Information Literacy Study (ICILS 2018) MAIN STUDY
OMB# 1850-0929 v.7
Appendix B.1
ICILS Main Study Questionnaires – Summary of Changes
Submitted by:
National Center for Education Statistics (NCES)
Institute of Education Sciences (IES)
U.S. Department of Education
Washington, DC
November 2017
revised January 2018
APPENDIX B.1: SUMMARY OF CHANGES TO U.S. ICILS INSTRUMENTS FROM FIELD TEST TO MAIN STUDY
The International Association for the Evaluation of Education Achievement (IEA) released the final international versions of the ICILS 2018 main study questionnaires, and has approved the adaptations to be made to the U.S. versions of the main study questionnaires. Appendix B.2 provides the final versions of the adapted U.S. versions of the ICILS 2018 main study questionnaires to be administered in the main study. This Appendix, B.1, lists the changes that were made to the U.S. versions of the field test questionnaire in preparation for the U.S. main study, which will begin in spring 2018.
The changes listed below are arranged by questionnaire (e.g., school principal, ICT coordinator, teacher, and student), and then by the four types of changes made: new U.S. adaptations (not already included in the field test U.S. versions); new items; deleted items; and revisions to item wording made to the U.S. versions of the field test items in preparation for using them in the U.S. versions of the main study questionnaires. This comparison is based on the final U.S. versions of the ICILS 2018 main study questionnaires, which were recently approved by the IEA.
The U.S. adaptations that were already made to the Field Test version of the questionnaires are kept for the Main Study version. New U.S. adaptations for the Main Study refer to any changes that need to be made from the Field Test version, such as the year of the test in the questionnaire introduction. Based on analysis of the field test data, the IEA and the international contractors revised some of the items from the field test international versions of the questionnaires, and also deleted some of the items. Furthermore, the U.S. added a few national questions that are commonly added to international surveys to provide data for the U.S. context. All of the changes are listed in this document. Straightforward adaptations of U.K. English to American English (e.g., favourite to favorite; adding a comma after “e.g.”, or removal of ® registered trademark symbols) were applied throughout each questionnaire and are not included in the tables below.
APPENDIX B.1 TABLE OF CONTENTS
Summary of Changes from ICILS 2018 U.S. Field Test to U.S. Main Study Principal, ICT Coordinator, Teacher, and Student Questionnaire Items
1. New Adaptations of all items (not already included in the U.S. field test version) 4
3. Deleted Items (entire stem) 5
B. ICT Coordinator Questionnaire 8
1. New Adaptations of all items (not already included in the U.S. field test version) 8
1. New Adaptations of all items (not already included in the U.S. field test version) 13
3. Deleted Items (entire stem) 13
1. New Adaptation of all items (not already included in the U.S. field test version) 23
3. Deleted Items (entire stem) 24
ICILS 2018 US Main Study (final) |
||
International term |
U.S. adaptation |
Item(s) |
Principal Questionnaire for the Main Survey |
Principal Questionnaire for the 2018 U.S. Main Study |
Cover Header |
Thank you for taking part in the 2018 International Computer and Information Literacy Study. The purpose of this study is to examine across different countries the extent to which young people in eighth grade have developed computer and information literacy, which is defined as the ability to use Information and Communications Technology (ICT) to investigate, create, and communicate with others at home, school, the workplace and in society. |
Your school has agreed to participate in the 2018 Main Study for the International Computer and Information Literacy Study (ICILS). ICILS is an educational research project sponsored by the International Association for the Evaluation of Educational Achievement (IEA). The purpose of ICILS is to examine across different countries the extent to which young people in eighth grade have developed computer and information literacy, which is defined as the ability to use Information and Communications Technology (ICT) to investigate, create, and communicate with others at home, school, the workplace, and in society. |
Note: Intro language and year and study type updated for year and study.
|
|
OMB No. 1850-0929, Approval Expires 12/31/2020 |
Note: Updated OMB date |
Q4 What is the total number of boys and girls in the school? (Please record a whole number. Record 0 (zero), if none.)
|
Q3 What is the total number of boys and girls in the school as of October 1, 2017? (Please record a whole number. Record 0 (zero), if none.)
|
Note: Added and updated new date. International version does not include a date. |
Q5 What is the total number of boys and girls in eighth grade? (Please record a whole number. Record 0 (zero), if none.)
|
Q4 What is the total number of boys and girls in eighth grade as of October 1, 2017? (Please record a whole number. Record 0 (zero), if none.)
|
Note: Added and updated new date. International version does not include a date. |
Item # |
Added Text/Item |
Q5 (U.S. Only) |
Around the 1st of October 2017, what percentage of students at this school were eligible to receive free or reduced-price lunches through the National School Lunch Program? (Please record a whole number. Record 0 (zero), if none.)
_______ Percentage of students |
Q6 (U.S. Only) |
Of the students currently enrolled in your school, what percentage has been identified as limited-English proficient (LEP)/English language learners (ELL)? (Please record a whole number. Record 0 (zero), if none.) _______ Percentage of students |
Item Number |
Deleted Item |
Q3 |
If you use ICT for any other school-related activities at least once a month, please list them. ___________ |
2018 FT Final U.S. Version |
2018 MS Final U.S. Version |
||
Item # |
Item |
Item # |
Revised Item |
Q4 – Q5 Q6 – Q9 Q10 Q14 – Q15 Q16 – Q18 |
|
Q3 – Q4 Q7 – Q10 Q10b Q14 Q15 – Q17 |
Note: Renumbered items |
Q2 |
How often do you use ICT for the following activities? (Please mark one choice in each row)
|
Q2 |
Note: New answer dimensions added
How often do you use ICT for the following activities? (Please mark one choice in each row)
|
Q8 |
What are the total numbers of full-time and part-time teachers in your school? A full-time teacher is employed on a regular basis as a teacher for at least 90% of full-time hours for the full school year. All other teachers should be considered part-time. (Please record a whole number for each. Record 0 (zero), if none.)
|
Q8 |
Note: Instructions wording modified.
What are the total numbers of full-time and part-time teachers in your school? A full-time teacher is employed on a regular basis as a teacher for at least 90% of full-time hours for the full school year. All other teachers should be considered part-time. (Please record a whole number. Record 0 (zero), if none.)
|
Q11 |
In your opinion, how important is each of the following outcomes of education in your school? (Please mark one choice in each row)
|
Q11
|
Note: Item stem reworded.
How important is the use of ICT in this school for each of the following outcomes of education? (Please mark one choice in each row)
|
Q14
Q15 |
Who has the main responsibility for making decisions about each of the following aspects of ICT in this school? (Please mark one choice in each row)
Who has the main responsibility for each of the following aspects of ICT management in this school? (Please mark one choice in each row)
|
Q14 |
Note: Two item stems and dimensions combined into one. Also, answer dimensions reworded and new ones added.
Who has the main responsibility for making decisions about each of the following aspects of ICT in this school? (Please mark one choice in each row)
|
ICILS 2018 US Main Study |
||
International term |
U.S. adaptation |
Item(s) |
Introduction for ICT-coordinators to the questionnaire |
ICT Coordinator Questionnaire for the 2018 Main Study |
Cover Header |
|
OMB No. 1850-0929, Approval Expires 12/31/2020 |
Note: Updated OMB date |
2018 FT Final U.S. Version |
2018 MS Final U.S. Version |
||
Item # |
Item |
Item # |
Revised Item |
Q5 – Q6 Q7 Q8a Q10 – Q17 |
|
Q5 Q6 Q7 Q8 – Q15 |
Note: Renumbered items |
Q2 |
Which of the following teaching duties do you have? (Please mark one choice in each row)
|
Q2 |
Note: Dimension reworded.
Which of the following teaching duties do you have? (Please mark one choice in each row)
|
Q3 |
How many years has your school been using ICT for teaching and/or learning purposes for students in eighth grade? (Please mark only one choice)
|
Q3 |
Note: Dimension reworded How many years has your school been using ICT for teaching and/or learning purposes for students in eighth grade? (Please mark only one choice)
|
Q5 - Q6 |
Please indicate the availability of each of the following software resources at your school. (Please mark one choice in each row)
Please indicate the availability of each of the following software resources at your school. (Please mark one choice in each row)
|
Q5 |
Note: Two questions Q5 – Q6 combined into one. Some dimensions removed
Please indicate the availability of each of the following software resources at your school. (Please mark one choice in each row)
|
Q7 |
Please indicate the availability of the following technology facilities in eighth grade. (Please mark one choice in each row)
|
Q6 |
Note: Dimension reworded and order changed. Please indicate the availability of the following technology facilities in eighth grade. (Please mark one choice in each row)
|
Q11 |
Approximately what percentage of students at the eighth grade have access to portable computers (laptops, netbooks or tablet devices) at school? (Please mark one choice in each row)
|
Q9 |
Note: Answer dimensions reworded
Approximately what percentage of students at the eighth grade have access to portable computers (laptops, netbooks or tablet devices) at school? (Please mark one choice in each row)
|
Q12 |
Where are school ICT devices for teaching and learning in eighth grade located? (Please mark one choice in each row) |
Q10 |
Note: Answer dimension reworded Where are school ICT devices for teaching and learning in eighth grade located? (Please mark one choice in each row) |
Q13 |
At your school, who provides day-to-day technical ICT support? (Please mark one choice in each row)
|
Q11 |
Note: Answer dimensions reworded
At your school, who provides day-to-day technical ICT support? (Please mark one choice in each row)
|
Q14 |
At your school, who provides day-to-day pedagogical ICT support for teachers? (Please mark one choice in each row)
|
Q12 |
Note: Answer dimensions reworded
At your school, who provides day-to-day pedagogical ICT support for teachers? (Please mark one choice in each row)
|
Q15 |
To what extent is the use of ICT in teaching and learning at your school hindered by each of the following obstacles? (Please mark one choice in each row)
|
Q13 |
Note: Answer dimensions reworded.
To what extent is the use of ICT in teaching and learning at your school hindered by each of the following obstacles? (Please mark one choice in each row)
|
Q17 |
In the teaching of computing, computer science, information technology, informatics, or a similar subject at the eighth grade in your school, how much emphasis is given to the following tasks? (Please mark one choice in each row)
|
Q15 |
Note: Removed some answer dimensions. The order of the dimensions was also changed. In the teaching of computing, computer science, information technology, informatics, or a similar subject at the eighth grade in your school, how much emphasis is given to the following tasks? (Please mark one choice in each row)
|
ICILS 2018 US Main Study |
||
International term |
U.S. adaptation |
Item(s) |
INTRODUCTION FOR TEACHERS TO THE QUESTIONNAIRE |
Teacher Questionnaire for the 2018 Main Study |
Cover Header |
|
OMB No. 1850-0929, Approval Expires 12/31/2020 |
Note: Updated OMB date |
Item # |
Added Text/Item |
Q3 (U.S. only) |
What year did you start teaching? _________________ (Please write in a year) |
Item # |
Deleted Text/Item |
Q16 |
How confident do you feel about teaching the following skills to the reference class? (Please mark one choice in each row)
|
Q23 |
Teachers often have beliefs about the emphasis that they typically prefer to place on different approaches to teaching and learning. Which priority do you think is more important in each of the pairs below? (Please mark the more important priority in each pair.)
a) Instruction should be built around problems with clear, correct answers. OR Instruction should focus on students finding solutions to open-ended problems. b) The main role of a teacher is to facilitate students’ own inquiry. OR The main role of a teacher is to demonstrate the correct way to do things. c) Students learn best by working through complex problems. OR Students learn best by progressing through sequences of simple elements of problems. d) Teaching should be based on direct instruction of ideas that most students can grasp quickly. OR Teaching should be based on supporting student exploration of complex ideas e) Knowledge of content and principles in core subject areas. OR Developing general inquiry processes that will support lifelong learning f) Students learn best when they decide on the activities to be undertaken in class. OR Students learn best when the teacher – not the students – decides what activities are to be done in class. |
2018 FT Final US Version |
2018 MS Final US Version |
||
Item # |
Item |
Item # |
Revised Item |
Q3 – Q9 Q10 – Q11 Q12 Q13 – Q14 Q15 Q17 – Q20 Q21 – Q22 |
|
Q4 – Q10 Q11 Q12 Q13 Q14 Q15 – Q18 Q19 |
|
Q3 |
What are the main subjects that you teach in this school in the current school year? (Please indicate the subjects that you teach in this school, indicating only those that individually account for at least four classes or two classes if block scheduling is used each week in this school. The exact name of one or more of your subjects may not appear in the list for each category. If it does not, please mark the category you think best fits the subject.)
|
Q4 |
Note: Dimension wording revised What are the main subjects that you teach in this school in the current school year? (Please indicate the subjects that you teach in this school, indicating only those that individually account for at least four classes or two classes if block scheduling is used each week in this school. The exact name of one or more of your subjects may not appear in the list for each category. If it does not, please mark the category you think best fits the subject.)
|
Q5 |
Approximately how long have you been using ICT for teaching purposes? (Please mark only one choice in each row)
|
Q6 |
Note: Added a new category. Approximately how long have you been using ICT for teaching purposes? (Please mark only one choice in each row)
|
Q7 |
How well can you do these tasks using ICT? (Please mark one choice in each row)
|
Q8 |
Note: Item Stem reworded. Some dimensions removed and reworded. The order of the dimensions was also changed. How well can you do these tasks on ICT? (Please mark one choice in each row)
|
Q8 |
Which of the following best describes the subject for this reference class? (Please mark only one choice)
|
Q9 |
Note: Answer dimensions and instructions reworded
In this section of the questionnaire please focus your responses on your teaching practices in a ‘reference’ class. This is the first eighth-grade class that you teach for a regular subject (e.g ., other than home room, assembly) on or after Tuesday following the last weekend before you first accessed this questionnaire. You may, of course, teach the class at other times during the week as well. If you did not teach an eighth-grade class on that Tuesday, please use the eighth-grade class that you taught on the first day after that Tuesday.
Which of the following best describes the subject for this reference class? (Please mark only one choice)
|
Q9 |
In your teaching of the reference class in this school year, how much emphasis have you given to developing the following ICT-based capabilities in your students? (Please mark one choice in each row)
|
Q10 |
Note: The order of the dimensions was changed. Some dimensions removed. In your teaching of the reference class in this school year, how much emphasis have you given to developing the following ICT-based capabilities in your students? (Please mark one choice in each row)
|
Q10 - Q11
|
How often do students in your reference class use ICT for the following activities? (Please mark one choice in each row)
How often do students in your reference class use ICT for the following activities? (Please mark one choice in each row)
|
Q11 |
Note: Two questions Q10 – Q11 combined into one. Also, some dimensions removed. How often do students in your reference class use ICT for the following activities? (Please mark one choice in each row)
|
Q12 |
How often do you use ICT with the following practices when teaching your reference class? (Please mark one choice in each row)
enrichment support to individual students or small groups of students
students on their work
|
Q12 |
Note: A dimension was removed How often do you use ICT with the following practices when teaching your reference class?
(Please mark one choice in each row)
enrichment support to individual students or small groups of students
students on their work
|
Q13 - Q14 |
How often did you use the following tools in your teaching of the reference class this school year? (Please mark one choice in each row)
How often did you use the following tools in your teaching of the reference class this school year? (Please mark one choice in each row)
|
Q13 |
Note: Two questions Q13 – Q14 combined into one. Some dimensions removed and reworded. The order of the dimensions was changed. How often did you use the following tools in your teaching of the reference class this school year? (Please mark one choice in each row)
|
Q15 |
In your teaching of the reference class this school year, how much emphasis have you given to student learning of the following skills? (Please mark one choice in each row)
|
Q14 |
Note: Item stem wording has changed. One answer dimension is removed. In your teaching of the reference class this school year, how much emphasis have you given to teaching the following skills? (Please mark one choice in each row)
|
Q17 |
To what extent do you agree or disagree with the following statements about the use of ICT in teaching at your school? (Please mark one choice in each row)
|
Q15 |
Note: Removed and reworded some answer dimensions. The order of the some dimensions were also changed.
To what extent do you agree or disagree with the following statements about the use of ICT in teaching at your school? (Please mark one choice in each row)
|
Q18 |
To what extent do you agree or disagree with the following statements about your use of ICT in teaching and learning at your school? (Please mark one choice in each row)
|
Q16 |
Note: Removed and reworded some answer dimensions
To what extent do you agree or disagree with the following statements about your use of ICT in teaching and learning at your school? (Please mark one choice in each row)
|
Q20 |
How often have you participated in any of the following professional learning activities in the past two years? (Please mark one choice in each row)
|
Q18 |
Note: Some answer dimensions removed and reworded.
How often have you participated in any of the following professional learning activities in the past two years? (Please mark one choice in each row)
|
Q21 - Q22 |
To what extent do you agree or disagree with the following statements about using ICT in teaching and learning at school? (Please mark one choice in each row) Using ICT at school …
To what extent do you agree or disagree with the following statements about using ICT in teaching and learning at school? (Please mark one choice in each row) Using ICT at school …
|
Q19 |
Note: Two questions Q21 – Q22 combined into one. Some dimensions removed and reworded. The order of the dimensions was changed. To what extent do you agree or disagree with the following statements about using ICT in teaching and learning at school? (Please mark one choice in each row) Using ICT at school …
|
2018 Main Study |
||
International term |
U.S. adaptation |
Item(s) |
Student Questionnaire for the Main Survey |
Student Questionnaire for the 2018 U.S. Main Study |
Cover Header |
|
OMB No. 1850-0929, Approval Expires 12/31/2020 |
Note: Updated OMB date |
Does your parent or guardian 2 work in a paid job?
|
Does your parent or guardian 2 work in a paid job?
|
Q12 Note: We have suggested to the IEA to add a third choice of “Not applicable” in case the student has only 1 parent. If approved by the IEA, Q12 and subsequent questions about parent/guardian 2 would not be seen by the student if they answer N/A. |
At school, how often do you use ICT during lessons in the following subjects or subject areas? (Please mark one choice in each row)
h) Practical or vocational |
At school, how often do you use ICT during lessons in the following subjects or subject areas? (Please mark one choice in each row)
|
Q25H |
Item Number |
Added Text/Item |
Q3 (U.S. only) |
Are you Hispanic or Latino? (Please mark only one choice)
|
Q4 (U.S. only) |
Which of the following best describes you? (Please mark all choices that apply)
|
Item Number |
Deleted Text/Item |
|
How often do you use ICT to read e-books in your home? (Please mark only one choice)
|
|
Do you have an Internet connection at home? (Please mark only one choice)
|
|
How often have the following activities taken place in your lessons? (Please mark one choice for each row)
|
|
How much do you agree or disagree with the following statements about ICT? (Please mark one choice in each row)
|
|
When studying during the current school year, to what extent have you learned how to do the following tasks? (Please mark one choice in each row)
|
|
How well do you think you can do the following tasks? (Please mark one choice in each row)
|
2018 FT Final U.S. Version |
2018 MS Final U.S. Version |
||
Item # |
Item |
Item # |
Revised Item |
Q3 – Q14 Q16 Q28 – Q33 |
|
Q5 – Q16 Q17 Q27 – Q32 |
Note: Renumbered items |
Q11 |
Does your parent or guardian 2 work in a paid job?
|
Q12 |
Note: Removed answer dimension
Does your parent or guardian 2 work in a paid job?
|
Q16 |
How many of the following ICT are currently used in your home? (Please mark one choice in each row)
|
Q17 |
Note: Some dimensions combined and removed
How many of the following ICT devices are currently used in your home? (Please mark one choice in each row)
Surface Pro, Kindle) |
Q18b |
Tablet devices |
Q18b |
Note: Dimension wording expanded
Tablet devices or e-readers (e.g., iPad, Surface Pro, Kindle) |
Q19b |
Create or edit documents |
Q19b |
Note: Dimension word added
Create or edit digital documents |
Q19c |
Create or edit presentations |
Q19c |
Note: Dimension word added
Create or edit digital presentations |
Q20 |
How often do you use ICT in these places? Please do not count the use of smartphones when making phone calls or writing text messages. (Please mark one choice in each row)
|
Q20 |
Note: Dimensions wording expanded, removed, and new dimensions added
How often do you use ICT in these places? Please do not count the use of smartphones when making phone calls or writing text messages. (Please mark one choice in each row)
|
Q22 |
How often do you use ICT to do each of the following communication activities? (Please mark one choice in each row)
|
Q21 |
Note: Dimension reworded and another removed.
How often do you use ICT for each of the following activities? (Please mark one choice in each row)
|
Q23 |
How often do you use ICT to do each of the following leisure activities? (Please mark one choice in each row)
|
Q23 |
Note: Removed and reworded some answer dimensions
How often do you use ICT to do each of the following leisure activities? (Please mark one choice in each row)
|
Q24 |
How often do you use ICT for the following school-related purposes?
(Please mark one choice in each row)
|
Q24 |
Note: Changed wording and removed some answer dimensions.
How often do you use ICT for the following school-related purposes? (Please mark one choice in each row)
|
Q25 |
At school, how often do you use ICT during lessons in the following subjects or subject areas? (Please mark one choice in each row)
|
Q25 |
Note: Dimensions reworded At school, how often do you use ICT during lessons in the following subjects or subject areas? (Please mark one choice in each row)
|
Q28 |
At school, to what extent have you learned how to do the following tasks? (Please mark one choice in each row)
|
Q27 |
Note: Added and removed answer dimensions.
At school, to what extent have you learned how to do the following tasks? (Please mark one choice in each row)
|
Q29 |
At school, have you learned about the importance of the following topics? (Please mark one choice in each row)
|
Q28 |
Note: Removed and reworded some answer dimensions.
At school, have you learned about the importance of the following topics? (Please mark one choice in each row)
|
|
YOUR THOUGHTS ABOUT USING ICT |
Section header |
YOUR THOUGHTS ABOUT USING AND LEARNING ABOUT ICT |
Q30 |
How well can you do each of these tasks when using ICT? (Please mark one choice in each row)
|
Q29 |
Note: Removed several answer dimensions
How well can you do each of these tasks when using ICT? (Please mark one choice in each row)
|
Q32 |
How much do you agree or disagree with the following statements about the use of ICT in society? (Please mark one choice in each row)
|
Q31 |
Note: Item stem wording has changed. Answer dimensions also added and removed..
How much do you agree or disagree with the following statements about ICT? (Please mark one choice in each row)
|
Q33
|
When studying during the current school year, to what extent have you learned how to do the following tasks? (Please mark one choice in each row)
|
Q32
|
Note: The answer dimensions have “To” preceding each now. Also, some answer dimensions have been added and some removed.
When studying during the current school year, to what extent have you been taught how to do the following tasks? (Please mark one choice in each row)
|
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
Author | Danielle Young |
File Modified | 0000-00-00 |
File Created | 2021-01-21 |