Professional Documents
Culture Documents
Standardized Testing
Prepared by
Fransiska Marsela Hambur
13020317410014
Question for Discussion
What is Standardization?
Do you agree?
What is standardization?
• The Graduate Record Exam (GRE) for entry into many graduate school
programs like Graduate Management Admission Test (GMAT) and the
Law School Aptitude Test (LSAT) specialize in particular disciplines.
Set of competencies
• TOEFL: This is the step of laying the foundation stones of the test.
Example:
TOEFL – Specifications:
1. Listening Section
2. Structure Section
3. Reading Section
4. Writing Section
Each specs are not just stated that way, it should include what does it
measures, what does it covers, and what material it uses.
EXAMPLE OF TEST SPESIFICATION
TOEFL SPESIFICATION: LISTENING SECTION
EXAMPLE OF TEST SPESIFICATION
TOEFL SPESIFICATION: READING SECTION
Comparison of Listening and Reading
Specification
• TOEFL Listening section focuses on a particular feature of language or
overall listening comprehension. It includes various listening stimuli,
such as dialogues, order of process, supporting ideas, etc.
• Real-world situation are emphasized more in listening section rather
than in reading section.
• While Reading section aims to test comprehension of long/short
passages, single sentence, phrases or words. Test items of reading
section are stated or implied without emphasizing real-word situation.
3. Design, select and arrange test
tasks/items
• Once specifications for a standardized test have been stipulated, the task of
designing, selecting and arranging test tasks/items begins.
• The specs act much like a blueprint in determining the number and types of
items to be created.
(A)TOEFL test design specifies that each item be coded for content and statistical
characteristics.
Content coding ensures assessment of variety skills and cover a variety of subject
matter without considering background of test-takers.
Examples: in TOEFL reading section, some items may target the assessment of
comprehension of main idea, stated details, unstated details, implied details, and
vocabulary in context.
EXAMPLES OF TOEFL READING SECTION
(Brown, p. 74-75)
DESIGNING ESLPT and GET
(C) The GET prompts are designed by a faculty committee of examiners who
are specialists in the field of university academic writing.
The assumption is made that the topics are appealing and capable of
producing essay that requires an organized logical argument and conclusion.
Examples of prompt of GET (Brown, p.76-77)
4. Make appropriate evaluations of
different kinds of items.
Terminology:
Item facility (IF) – % of people who give the right answer
Item Discrimination (IDis) – indicates the extent to which success on an item
corresponds to success on the whole test.
Item Difficulty (ID) - finding out the % of people who get the item right in
the try-out group.