This document is to be used to record NQCM observations of the TIMSS 2015 and/or

TIMSS Numeracy 2015 administration procedures and to structure an interview with the School
Coordinator.
This Classroom Observation Record is organized into four sections as follows:
A. Documentation of the TIMSS/TIMSS Numeracy Testing Session
B. Summary Observations of the TIMSS/TIMSS Numeracy Testing Session
C. Student Questionnaire Administration and Distribution of the Early Learning Survey
D. Interview with the School Coordinator
You will need the Student Tracking Form for the class you are observing, and the Teacher
Tracking Form, and Class Listing Form for the school you are visiting in order to complete this
Classroom Observation Record.

Mark each completed observation record (electronically or on paper) with a name that clearly
indicates the grade, the class ID, and the date of the school visit. Also, note the school name and
school coordinator name and contact information. You may need to refer to your notes and/or
contact the school in case of any questions from the national center.

A. DOCUMENTATION OF THE TIMSS/TIMSS Numeracy TESTING

SESSION
In this section, you will record information about the timing of the TIMSS/TIMSS Numeracy
testing session and answer questions about how accurately the Test Administrator followed the
Test Administration Script. You should refer to the TIMSS/TIMSS Numeracy 2015 Test
Administrator Manual for the test administration script. For some questions, you will need to
refer to the Student Tracking Form for the class you are observing.
A.1.

How long did it take for the Test Administrator to prepare students to begin Part 1 of the
testing session, including distributing the test booklets and reading instructions?
Minutes

A.2.

Did the Test Administrator distribute test booklets according to the booklet assignment on
the Student Tracking Form and booklet labels? (Check one.)
Yes 1

No 2

Please describe how the Test Administrator ensured that each student received the booklet
specially prepared for him or her:

A.3.

Did the Test Administrator record each students participation status on the Student
Tracking Form? (Check one.)
Yes 1

No 2

Timing the TIMSS EIGHTH GRADE Testing Session

Time Allowed
Part 1

45 minutes

Break

Approximately 15 minutes (should not exceed 30 minutes)

Part 2

45 minutes

A.4.

Record the start time and stop time for Part 1 of the testing session.
a. Start Time ____.____
b. Stop Time ____.____

A.5.

Was the total testing time for Part 1 of the testing session equal to the time allowed?
(Check one.)
Yes 1

No 2

If Part 1 of the testing session was longer or shorter than 36 minutes for fourth grade or
45 minutes for eighth grade, please describe the reason for this:

A.6.

Did the Test Administrator announce, You have 10 minutes left prior to the end of Part 1
of the testing session? (Check one.)
Yes 1

A.7.

No 2

Were there any other time remaining announcements made during Part 1 of the testing
session? (Check one.)
Yes 1

If yes, please specify:

No 2

A.8.

When the Test Administrator ended Part 1 of the testing session, how well did the students
comply with the instructions to stop work (close their booklets and put their pens down)?
(Check one.)
Very well, all students stopped work........................... 1
Fairly well, almost all students stopped work............. 2
Not well at all, many students did not stop................. 3

A.9.

Was the total time for the break between Part 1 and Part 2 of the testing session equal to
or less than 30 minutes? (Check one.)
Yes 1

No 2

If the break was longer than 30 minutes, please describe the reason for this:

A.10. Were the booklets left unattended or unsecured during the break? (Check one.)
Yes 1

No 2

If yes, please explain what happened:

A.11. How long did it take for the Test Administrator to prepare students to begin Part 2 of the
testing session, including ensuring that everybody had his or her test booklet and reading
instructions?
Minutes

A.12. Record the start and stop times for Part 2 of the testing session.
a. Start Time ____.____
b. Stop Time ____.____

A.13. Was the total testing time for Part 2 of the testing session equal to the time allowed?
(Check one.)
Yes 1

No 2

If Part 2 of the testing session was longer or shorter than 36 minutes for fourth grade or
45 minutes for eighth grade, please describe the reason for this:

A.14. Did the Test Administrator announce you have 10 minutes left prior to the end of Part 2
of the testing session? (Check one.)
Yes 1

No 2

A.15. Were there any other time remaining announcements made during Part 2 of the testing
session? (Check one.)
Yes 1

If yes, please specify:

No 2

A.16. When the Test Administrator ended Part 2 of the testing session, how well did the students
comply with the instructions to stop work (close their booklets and put their pens down)?
(Check one.)
Very well, all students stopped work.............................. 1
Fairly well, almost all students stopped work................ 2
Not well at all, many students did not stop.................... 3

A.17. Were the booklets collected and secured after the testing session? (Check one.)
Yes 1

No 2

If no, please describe what happened to the booklets:

A.18.

A: Did the Test Administrator follow the test administration script in the TIMSS/TIMSS
Numeracy 2015 Test Administrator Manual? (Check one.)
Yes, no changes............................................... 1
No, some minor changes.................................. 2
No, major changes........................................... 3

B: If the Test Administrator made changes to the script, how would you describe them?
(Check one for each.)
Yes

No

a. Additions ...........................................................

b. Revisions ...........................................................

c. Deletions ...........................................................

A.19. In your opinion, had the Test Administrator familiarized himself or herself with the test
administration script prior to the testing? (Check one.)
Most likely yes................................................ 1
Most likely no................................................. 2
I cannot answer............................................... 3

B. SUMMARY OBSERVATIONS OF THE TIMSS/TIMSS Numeracy

TESTING SESSION
To answer these questions, you should refer to the TIMSS/TIMSS Numeracy 2015 Test
Administrator Manual for the test administration procedures. You may need to refer to the
Student Tracking Form for the class you are observing.
B.1.

Did the student identification information on the TIMSS/TIMSS Numeracy test booklets
correspond with the Student Tracking Form? (Check one.)
Yes 1

No 2

If no, please explain:

B.2.

A: Were any defective test booklets detected and replaced BEFORE the testing began?
(Check one.)
Yes 1

No 2

B: Were any defective test booklets detected and replaced AFTER the testing began?
(Check one.)
Yes 1

No 2

C: If any defective test booklets were replaced, did the Test Administrator replace them
appropriately, following instructions in the TIMSS/TIMSS Numeracy 2015 Test
Administrator Manual? (Check one.)
Yes 1

No 2

If no, please explain what was done:

B.3.

Were any late students admitted to the testing room? (Check one.)
No, there were no late students........................ 1
No, they were not admitted.............................. 2
Yes, but before the testing began..................... 3
Yes, after the testing began.............................. 4

B.4.

A: Did any students refuse to take the test (do not count the students with parental
permission denied)? (Check one.)
Yes 1

No 2

If yes, how many students refused to take the test?

Students

B: If a student refused, did the Test Administrator accurately follow the instructions for
excusing the student (collect the test booklet and record the incident on the Student
Tracking Form)? (Check one.)
Yes 1

No 2

If no, please describe what was done:

B.5.

In your opinion, were the conditions in the testing room suitable (lighting, temperature,
noise, etc.) for the students to work without distractions? (Check one.)
Yes 1

If no, please explain:

No 2

B.6.

Did the seating arrangement provide adequate space for students to work and not be
distracted by each other? (Check one.)
Yes 1

B.7.

No 2

During the testing session, did the Test Administrator walk around the room to be sure
students were working on the correct section of the test and/or behaving properly? (Check
one.)
Yes 1

No 2

If no, please describe what was done:

B.8.

Did the Test Administrator have a watch with a seconds hand, a stopwatch, or a timer for
accurately timing the testing session? (Check one.)
Yes 1

No 2

If no, please explain how the testing session was timed:

The Test Administrator is instructed not to answer any questions about the content of the tests.
They must not provide any specific information, answers, or instructions about any test question
or help students with spelling or reading. The Test Administrator is instructed to encourage the
students to do their best with the test. The Test Administrator may answer questions about what
students are to do and how they are to record their answers and follow general instructions.
B.9.

In your opinion, did the Test Administrator address students questions appropriately?
(Check one.)
Yes 1

No 2

If no, please describe how questions were addressed:

B.10. Did you see any evidence of students attempting to cheat on the test (e.g., by copying
from a neighbor)? (Check one.)
Yes 1

No 2

If yes, please explain what happened:

B.11. Did students store away everything, including all electronic devices, such as calculators,
cell phones, portable computers, and photo or video cameras, having only a pen or a
pencil and the test booklet for the duration of the test administration? (Calculators that do
not connect to the Internet are permitted for the eighth grade assessment.) (Check one.)
Yes 1

No 2

If no, please describe what happened:

B.12. A: Did any students leave the room for an emergency during the testing? (Check one.)
Yes 1

No 2

B: If a student left the room for an emergency, did the Test Administrator address the
situation appropriately (collect the test booklet, and if readmitted, return the test
booklet)? (Check one.)
Yes 1

No 2

If no, please describe what was done:

B.13. Were there any students requiring special accommodations (e.g., students with visual or
hearing impairment, Dyslexia)? (Check one.)
Yes 1

No 2

If yes, please specify the accommodation(s) provided:

B.14. Did any students finish either Part 1 or Part 2 of the assessment early (before the time
allowed was up)? (Check one.)
Yes 1

No 2

If yes, please describe how the situation was handled and what students were instructed to
do:

B.15.

A: To what extent would you describe the students as orderly and cooperative?
(Check one.)
Extremely orderly and cooperative................... 1
Moderately orderly and cooperative.................. 2
Somewhat orderly and cooperative................... 3
Hardly cooperative at all.................................. 4

Comments:

B: If the students were not orderly, did the Test Administrator make an effort to control the
situation? (Check one.)
Definitely yes.................................................. 1
Some effort was made..................................... 2
Hardly any effort was made............................. 3

B.16. In general, how would you describe the overall quality of the testing session?
(Check one.)
Excellent......................................................... 1
Very good........................................................ 2
Good

Fair

Poor

B.17. Please feel free to comment on any aspect of the assessment administration you wish to
note.

C. STUDENT QUESTIONNAIRE ADMINISTRATION

In this section, you will be asked questions about the timing of the TIMSS/TIMSS Numeracy
Student Questionnaire administration. You will also answer questions about how accurately the
Test Administrator followed the Test Administration Script. You should refer to the TIMSS/TIMSS
Numeracy 2015 Test Administrator Manual for the test administration script. For some questions,
you will need to refer to the Student Tracking Form for the class you are observing.
C.1.

Was there a break between the end of the achievement testing session and the distribution
and administration of the Student Questionnaires? (Check one.)
Yes 1

No 2

If no, please describe the situation. If there was a break, how long was the break?

C.2.

Did the Test Administrator distribute the Student Questionnaires according to the Student
Tracking Form and questionnaire labels? (Check one.)
Yes 1

No 2

Please describe how the Test Administrator ensured that each student received the
questionnaire specially prepared for him or her:

C.3.

Did the Test Administrator record each students participation status on the Student
Tracking Form? (Check one.)
Yes 1

C.4.

No 2

A: Did the Test Administrator follow the questionnaire administration script in the Test
Administrator Manual? (Check one.)
Yes, no changes............................................... 1

No, some minor changes.................................. 2

No, major changes........................................... 3

B: If the Test Administrator made changes to the script, how would you describe them?
(Check one for each.)
Yes

No

a. Additions ...........................................................

b. Revisions ...........................................................

c. Deletions ...........................................................

C.5.

Record the start time and the stop time for the administration of the Student
Questionnaire. This time period begins when the Test Administrator either starts reading
questions aloud or tells students to begin answering the questions, and ends when all
students have finished working.
a. Start Time ____:____
b. Stop Time ____:____

C.6.

Please feel free to comment on any aspect of the questionnaire administration you wish to
note.

Questions C.7 and C.8 are for TIMSS at the fourth grade and TIMSS Numeracy only.
C.7.

Did the Test Administrator read the questions aloud to the students or let the students
answer the questions independently? (Check one.)
Read the questions aloud................................. 1
Students answered the questions
independently.................................................. 2

C.8.

A: After the Student Questionnaire administration, did the Test Administrator distribute the
Early Learning Surveys? (Check one.)
Yes 1

No 2

B: If the Early Learning Surveys were distributed at this time, did the Test Administrator
distribute them according to the Student Tracking Form and survey labels? (Check
one.)
Yes 1

No 2

Please describe how the Test Administrator ensured that each student received the
survey specially prepared for him or her and how the students were instructed to return
the Early Learning Surveys:

D. INTERVIEW WITH THE SCHOOL COORDINATOR

The purpose of the interview with the School Coordinator is to get his/her evaluation of the
TIMSS/TIMSS Numeracy administration, gather suggestions for improvement, and obtain
additional background information. Please read through these questions and document the School
Coordinators responses.
D.1.

Overall, how would you say the testing went? (Check one.)
Very well, no problems.................................... 1
Satisfactory, few problems.............................. 2
Unsatisfactory, many problems........................ 3

If there were problems, please explain what they were:

D.2.

Overall, how would you rate the attitude of the other school staff members towards
TIMSS? (Check one.)
Positive 1
Neutral 2
Negative.......................................................... 3

Comments:

D.3.

Prior to the testing day, did you have time to check the shipment of materials from the
national center? (Check one.)
Yes 1

No 2

If yes, how long before the testing date?

D.4.

A: Did you receive the correct shipment of the materials as listed in your School
Coordinator Manual and according to the tracking forms? (Check one.)
Yes 1

No 2

B: If no, did the national center provide the missing materials in time for the testing?
(Check one.)
Yes 1

No 2

If no, please describe the situation:

D.5.

Where were the testing materials stored before and after the testing sessions?

D.6.

Was the national center responsive to your questions or concerns? (Check one.)
Yes 1

Comments:

No 2

D.7.

A: Was the Teacher Questionnaire(s) administered online or on paper? (Check one.)

Online 1

Paper 2

B: If the Teacher Questionnaire(s) was administered online, did the teacher(s) encounter
any problems? (Check one.)
Yes 1

No 2

If yes, please specify the problems and how they were resolved:

D.8.

A: Was the School Questionnaire administered online or on paper? (Check one.)

Online 1

Paper 2

B: If the School Questionnaire was administered online, did the person completing it
encounter any problems? (Check one.)
Yes 1

No 2

If yes, please specify the problems and how they were resolved:

Question D.9 is for TIMSS at the fourth grade and TIMSS Numeracy only.
D.9.

A: Was the Early Learning Survey administered online or on paper? (Check one.)
Online 1

Paper 2

B: If the Early Learning Survey was administered online, do you know of any problems
that parents/guardians encountered? (Check one.)
Yes 1

No 2

If yes, please specify the problems and how they were resolved:

D.10. A: Do you anticipate that a makeup session will be required at your school? (Check one.)
Yes 1

No 2

B: If yes, do you intend to conduct one? (Check one.)

Yes 1

No 2

D.11. Please comment on the selection and training of your Test Administrator(s). Did it work
well? Was the Test Administrator Manual useful for training purposes? Were you given
time by the principal to do the training?

D.12. Did the students receive any special instructions, motivational talk, or incentives to
prepare them for the assessment? (Check one.)
Yes 1

No 2

If yes, what special instructions, motivational talk, or incentives were provided and by
whom?

D.13. Overall, do you feel the School Coordinator Manual worked well for you or does it need
improvement? (Check one.)
Worked well.................................................... 1
Needs improvement......................................... 2

If you said needs improvement, how should the manual be improved?

D.14. What is your position at this school? (Check all that apply.)
a. Principal...................................................... 1
b. Counselor.................................................... 2
c. Teacher from the school, but not the
teacher of the class assessed........................ 3
d. Teacher of the class assessed....................... 4
e. Other 5
Please specify

For Questions D.15 through D.18, use the Class Listing Form for the school.
D.15. Is this the list of classes that you provided to the national center? (Check one.)
Yes 1

No 2

If no, please explain:

D.16. Is this a complete list of the classes in this grade at this school? (Check one.)
Yes 1

No 2

If no, please explain:

D.17. To the best of your knowledge, are there any students in this grade level who are NOT in
any of these classes? (Check one.)
Yes 1

No 2

If yes, please explain:

D.18. To the best of your knowledge, are there any students in this grade level in more than one
of these classes? (Check one.)
Yes 1

If yes, please explain:

No 2

D.19. If there was another international assessment, would you be willing to serve as a School
Coordinator? (Check one.)
Yes 1

No 2

D.20. Do you have any other comments? Please feel free to comment on any aspect of the
TIMSS assessment administration you wish to note:

This completes this Classroom Observation Record. Please attach the Class Listing Form, the
Teacher Tracking Form, and the Student Tracking Form you used during your visits to this school.