PSYC 3140 Psychometric Principles | Section 1

Department of Psychology, IIUM

Department of Psychology
Kulliyyah of Islamic Revealed Knowledge and Human Sciences
International Islamic University Malaysia.
PSYC 3140 Psychometric Principles
Semester 1, 2016/2017

Enhancing Family and Individual Quality of Life

COURSE INTRUCTORS
Section 1
Section 2
Instructor: Shukran Abdul
Instructor: Jamilah Hanum Abdul
Rahman
Khaiyom
Phone: 6196 5146
Phone: 03-6196 5151
E-mail: shukran@iium.edu.my
E-mail: hanum@iium.edu.my
Office: Level 5, HS Building, &
Office : Room Number 5-008,
Level 3, Office of Head
Level 5
of
HS Building.
Department,
Department of
Psychology
Consultation hours:
Tuesday, Thursday: 10.0011.30 AM
Friday
: 9.00-11.00 AM
And by appointment

Consultation hours:
Monday, Wednesday: 2.00
3.30 PM
Tuesday, Thursday: 9:00
10.30 AM
1

PSYC 3140 Psychometric Principles | Section 1

And by appointment

PSYC 3140 Psychometric Principles | Section 1

You and Psychology@IIUM

As a Psychology student, you are currently undergoing a

training process which would prepare you for a higher level of
studies in Psychology field or for employment in, hopefully,
psychology related career. The Psychology@IIUM programme
is designed to produce competent future psychologists who
are equipped with fundamental competencies for them to be
further trained at masters degree after which they would
qualify to be considered as practitioners or researchers in the
field of Psychology.

What is a Psychologist? As a future psychologist you will be

dealing with the task, duties, and responsibilities which
require you to observe, analyse, explain, and predict human
behaviors and their cognitive processes at various settings.
The activities are essential for a psychologist to design
interventions for change, improvement, and development of
human conditions in the settings they operate or live. Where
do you learn the proper techniques to perform these tasks?
The Psychology@IIUM programme aims at producing
psychology graduates who would be able to enhance the
quality of life amongst individual and family through the
application of behavioral sciences knowledge and principles
they learnt in the programme.

You and PSYC 3140

Being a core course, Psychometric Principles provide a
significant component of training for Psychology students. It is
designed to introduce them the basic principles and issues in
psychological testing and measurement.

Students will learn the differences between testing and

assessment, and other essential concepts in psychological
testing and assessment such as reliability, and validity.

It requires some knowledge of introductory statistics and

understanding of statistical applications.

Approaches

PSYC 3140 Psychometric Principles | Section 1

In order to provide meaningful learning process for all

students, the course is designed to take include the
acquisition of knowledge and skills combined. In addition to
lectures, the course involves a variety of instructional
techniques such as class and group discussion, as well as
experiential exercises.

Students will experience hands-on process of estimating tests

reliability; validating a test; and developing a new test. Details
of the approaches of teaching and learning are as follows

Topic

Assessment Project

Test
Developme
nt

Conceptualization and
construction of a test
to measure a construct

Reliability
Estimation
and

Mark
allocat
ed
20

Deadline

Conceptualizati
on: 5/10 (Week
5)

Revised
Conceptualizati
on: 20/10 (Week
7)

Item
Construction:
3/11 (Week 9)

Content validation of
the newly developed
test

10

10/11 (Week 10)

This unit gives you the

chance to participate in
reliability estimation
4

20

Test Review:
22/9 (Week 3)

PSYC 3140 Psychometric Principles | Section 1

Validation

and validation for a

selected psychological
test.
Students will
administer the test on
relevant test takers in
Gombak areas.
The project drives the
students to:
a. Estimate the validity
level of the scale.
b. Estimate the
internal consistency
of the scale.

Administration:
29/9 (Week 4)

Data Analysis in Validity and

Reliability Topics
Week (Week 5,
Week 6, Week
7, and Week 8)

Assessments:
1. Online Mid semester test (10 marks). This will be administered on
iTaleem on 22nd October 2016 (Week 7).
2. Test Development Project (30 marks).
3. Validity and Reliability Estimation (20 marks).
4. End of semester examination (40 marks).
5.

PSYC 3140 Psychometric Principles | Section 1

Assessment in detail
The assessment structure at Psychology Department is designed to
facilitate the students to step out of different silos and start working
on more impactful assessment projects. The assessments have been
structured to integrate assessment activities (for the purpose of
learning) and benefits to the community. Assessment activities in
PSYC 3140 have been designed to engage the community to
actively participate in enhancing the teaching and learning process
you will go through. (Learning and Public community)
1. TEST DEVELOPMENT PROJECT
Main learning outcome:
Present information on how tests are constructed, administered, and
interpreted.
You will engage the Professional Community who will be the subject
matter experts to your test conceptualization exercise. The mark
allocated for this exercise is 30.
Activities:
In a group of not more than 4, you are to design a scale to measure
a psychological variable (using local trait term). For example a scale
to measure the level of budi-bahasa, budi pekerti, gangguan
keresahan, kemurungan, and others.
What to do?
Before embarking on the project, you have to do the following:
a. Housekeeping- such as plan your work, divide the tasks, and
other necessaries. This is a team project. Only one submission
is required from each section.
b. Read chapter on TEST DEVELOPMENT- this is essential, failing
which you cannot accomplish this assignment. DO NOT WAIT
UNTIL THE INSTRUCTOR DISCUSS THE TOPIC IN CLASS.
c. Organize discussions with team members and course
instructor- it takes series of discussions, lead by your project
leader. Course instructor can be consulted during consultation
hours.
d. You are to link the test that you develop with the principles
learnt in the course.
e. This carries emphasis for through this exercise, students have
the opportunity to present information of certain psychometric
principles.
Mark
This is a team project. Nevertheless, marks will be given
individually based on students degree of participations in the
group class discussions.
6

PSYC 3140 Psychometric Principles | Section 1

The mark awarded will reflect a students ability to apply the

principles gained from the course.

2. VALIDITY AND RELIABILITY ESTIMATION EXERCISE

Main learning outcome:
You will be able to use knowledge and apply understanding of basic
principles of psychological testing. You too will practice the
procedures to estimate psychometric properties of psychological
tests. You will engage the learning community, and public
community in Gombak neighborhood. The mark allocated for this
exercise is 20.
Activities:
In the same team you form for test development project (not more
than 4, you are to review and administer the test you selected
from the Testing Library. Students will administer the test
on relevant test takers in Gombak areas.
What to do?
Before embarking on the project, you have to do the following:
a. Housekeeping- plan your work, divide the tasks, and other
necessaries. This is a team project. Only one submission is
required from each section.
b. The following are the salient content in the review of the test.
1. Name of the device reviewed.
2. Developer of the device.
3. Publisher of the device.
4. Content of the device (i.e., what is the device designed
to measure? provide the definition of the construct/s
exist).
5. Bases for inclusion of the content.
6. Objectives of the device (What is the objective of the
test?).
7. Any other similar device? How do the goals of this
device differ from the goals of another device/test?.
8. Format of the device (What types of responses will be
required by test taker i.e., behavior, ability,
requirement as responses, and etc.).
9. Reliability and validity of the device.
10.
Is there a need for the test in your community?
11.
Who will use the test?

PSYC 3140 Psychometric Principles | Section 1

12.
Who will take the test (The test taker, their age,
and other background such as their sociodemographic
information).
13.
Procedure of administration (How is the test
administered?).
14.
Any potential for harms as the result of the
administration of the test?
c. Mark
This is a team project. Nevertheless, marks will be given
individually based on students degree of participations in the
group class discussions. The mark awarded will reflect a
students ability to apply the principles gained from the course.

PSYC 3140 Psychometric Principles | Section 1

INTERNATIONAL ISLAMIC UNIVERSITY MALAYSIA

COURSE OUTLINE

Kulliyyah

Islamic Revealed Knowledge and Human Sciences

Department

Psychology

Programme

BHSc (Psychology)

Name of Course /
Module

Psychometric Principles

Course Code

PSYC 3140

Name(s) of Academic
staff / Instructor(s)
Rationale for the
inclusion of the
course / module in the
programme
Semester and Year
(Level) Offered

Assoc. Prof. Dr. Shukran Abd Rahman

Ms. Jamilah Hanum Binti Abdul Khaiyom

Course Status

Core

Face to Face

42.00
9

Assessme
nt-Related
Activities

12.0

LearningIndependent

Batch of Students to
be Affected
13 Total Student
Learning Time (SLT)
12

Semester 2, 2010/2011 (Start date for the use of

the new course outline)
Students with matric number starting with 102
onwards.

Total

52.00

120.0

Others

11 Start Date

Bachelor

ExaminationEnd-of-Sem

10 Level of Programme

Others

Semesters1 and/or 2/ Level 3

Practical

Knowledge of the content of this course is essential

for the mastery of the field of psychology

Lecture /
Classroom

Instruction

14.0

PSYC 3140 Psychometric Principles | Section 1

14 Credit Value / Hours

15 Pre-requisites (if any)

PSYC 1000, PSYC 2070

16 Co-requisites (if any)

17 Course Objectives

18 Learning Outcomes

Transferable Skills:
Skills and how they are
developed and
19 assessed. Project and
practical experience
and internship

The objectives of this course are to:

1. introduce the basic principles and issues in
psychological testing and measurement,
2. present information on how tests are
constructed, administered and interpreted,
and
3. discuss methods of estimation of reliability,
validity, norms, interpretation of scores, error
in measurement, and other essential aspects.
At the end of this course, students are expected to
have the ability to:
1. demonstrate knowledge and understanding
of basic principles of psychological testing
(C3, LL2),
2. follow the procedures to estimate
psychometric properties of psychological
tests (P3)
3. express the importance of psychological
assessment and its properties (A3, CTPS3,
EM2)

Skills
(corresponding to
LOs)
CTPS3
EM2

10

Skill development
techniques
Discussion, Practical
exercises
Practical exercises

Course LOs
Method
%
1
Tests
10
2
Assignments
50
PSYC 3140 Psychometric
Principles | Section 1
3
End of semester
40
examination
20 Teaching-Learning
Teaching-learning
Assessment strategy
TOTAL
100
and Assessment
strategy
Strategy
Interactive teaching
combination of
coursework evaluation,
mid-semester test, and
final written
examination
This course covers the history of testing,
fundamentals of psychological testing and the
process of test construction and standardization.
This includes test conceptualization, item
21 Course Synopsis
generation, scaling, scoring and analysis. It also
describes various types of test norms, reliability
and validity.
Mode of Delivery
22 Lecture, Tutorial,
Workshop, Seminar etc.

Lecture

Assessment Methods
and Type / Course
23 Assessment
State weightage of each
type of assessment.

24

Mapping of the course

/ module to the
programme aims
See endnote for
explanation.1

Course
LOs
1
2
3
4

Programme Aims
Aim 1 Aim 2 Aim 3

Mapping of course / module to the Programme Learning Outcomes

25

26

Course
LOs
1
2
3
4

Programme Outcomes
3
4
5
6
7
8

10

Content outline of the course / module and the SLT per topic
Weeks
Topics
Learning Task/Reading
Hours

11

PSYC 3140 Psychometric Principles | Section 1

1,2

5,6

7,8

Introduction
Testing and Assessment
- Definition of Testing and
Assessment

Tools of Psychological
Assessment
Who, What, Why, How, and
Where of Assessments
Historical, Cultural, and
Legal/Ethical Considerations
Historical Perspective
Culture and Assessment
Legal and Ethical
Considerations
Basic statistics and norms
Why We Need Statistics
Scales of Measurement
Correlation and Regression
Norms

Reliability
Reliability: General Overview
Sources of Consistency and
Inconsistency in Test Scores
Conceptual framework
- True Score Theory
Methods of establishing
reliability
- Alpha Cronbach
- KR20
- Split-Half Reliability
- Test Retest Reliability
- Alternate Forms Reliability
- Inter-Scorer Reliability
Validity
Validity: Overview
Aspects of validity
- Face Validity
- Content Validity
- Construct Validity
- Criterion Validity

12

Cohen & Swerdlik

(2005): 1-36;
15.00

7.00

Kaplan &
Saccuzzo (2005):
3-12.

Cohen, Swerdlik,
& Sturman
(2013): 38-76

Cohen, Swerdlik,
& Sturman
(2013): 77-116;
7.00

Kaplan &
Saccuzzo (2005):
25-53, 62-75.
Cohen, Swerdlik,
& Sturman
(2013): 145-180;
Kaplan &
Saccuzzo (2005):
99-114.

15.00

15.00

Cohen, Swerdlik,
& Sturman
(2013): 181-210;
Kaplan &
Saccuzzo (2005):
132-154.

PSYC 3140 Psychometric Principles | Section 1

9,10,1
1, 12

13,14

Test

Construction
Test conceptualization
Test construction
Test tryout
Item analysis
- Item Difficulty
- Item Discriminability
- Traditional vs IRT Approach
Test revision

Selection and Decision Analysis

Test Manual
Base Rates
Hit Rates
Taylor Russell Tables

Cohen, Swerdlik,
& Sturman
(2013): 240-284;
46.00

15.00

Kaplan &
Saccuzzo (2005):
157-172.

Kaplan &
Saccuzzo (2005):
512-523.

Main references supporting the course

Required
27

Cohen, R. J., Swerdlik, M. E., & Sturman, E. D. (2013). Psychological testing

and assessment: An introduction to test and measurement. Boston, MA:
Prentice Hall
Additional references supporting the course
Recommended
Kaplan, R. M. & Saccuzzo, D. P. (2001). Psychological testing: Principles,
applications and issues. Belmont, CA: Wadsworth/Thomson Learning

28

Hogan, T. P. (2003). Psychological testing: A practical introduction. New York:

John Wiley &
Sons, Inc.
Murphy, K. R. & Davidshofer, C. O. (2001). Psychological testing. Englewood
Cliffs, NJ: Prentice Hall.

29
Prepared by:

Dr. Mariam Adawiah

Dzulkifli
Coordinator,
Curriculum
Committee
Department of
Psychology

Checked by:

Approved by:

Dr. Alizi Alias

Head, Department
of Psychology
KIRKHS

Dr. Badri Najib Zubir

Dean
KIRKHS

13

PSYC 3140 Psychometric Principles | Section 1

KIRKHS

At the end of the programme, students are able to:

1. Knowledge:
Demonstrate
familiarity
with
established
knowledge in the field of psychology and awareness of current
development therein.
2. Practical Skills: Use relevant skills learnt in psychology for
professional and personal development.
3. Social Skills and Responsibilities: Cooperate with others and
apply knowledge in a socially responsible manner for the
progress of the nation and the ummah.
4. Values,
Attitudes
and
Professionalism:
Demonstrate
commitment to ethics, autonomy and professionalism in the
workplace and everyday life.
5. Communication, Leadership and Team Skills: Communicate
with people from a diverse range of backgrounds with
empathy, show leadership qualities, and act as team player.
6. Problem Solving and Scientific Skills: Analyze issues and
demonstrate skillfulness in planning, executing and evaluating
strategies and action plans.
7. Information Management and Lifelong Learning Skills: Use the
necessary learning skills in information management and
apply effective strategies for lifelong self-improvement.
8. Managerial and Entrepreneurial Skills: Apply basic managerial
and entrepreneurial skills in relevant fields.
9. Islamicization: Use Islamic principles to analyze and evaluate
ideas and theories in modern disciplines.
10.
Integration: Integrate Islamic teachings in the
application of the discipline for the purpose of improving their
attitude and behavior.

14

PSYC 3140 Psychometric Principles | Section 1

Adab in Learning and Teaching Process

Absences
Students are strongly encouraged to be in touch with and benefit
from consultation with the instructor. Make full use of Learning
Management System (LMS)/ i-Taleem and e-mail facilities
for this purpose.

Attendance is mandatory. Students are required to maintain

80% or better record of attendance in the classroom. Students
who are absent for 4 times will be given a warning letter. If
absence happens for 6 times, they will be barred from taking
the end of semester examination.

Your presence in the class is essential for all teaching sessions.

Plan your time for other activities (solat, lunch, toilet-going,
consultation etc) so that you will not be late to your class. It is
important to be in the class before the instructor begins his
lesson, otherwise you will be disrupting the flow of learning and
teaching process. Be prepared to participate in class activities.

Please inform the instructor in advance if you have to miss

a class. Absence on the day of class presentation or test/exam
will automatically result in zero. Make-ups test/ assessment will
15

PSYC 3140 Psychometric Principles | Section 1

be permitted only when you can justify your absence. It has to be
supported with a valid reason, such as a medical certificate.
Important: You are responsible for materials covered and
assignments made on days you are absent (e.g. change of exam
dates, change of policy, lecture note). Ask your friends about
them)

16

PSYC 3140 Psychometric Principles | Section 1

DEPARTMENT OF PSYCHOLOGY
INTERNATIONAL ISLAMIC UNIVERSITY MALAYSIA
ASSIGNMENT COVER SHEET
__________________________________
Write course title and code here.
_________________________________
Write name of instructor here
Name of Students

Matric. Number

Your report should meet the following requirements. Please confirm

this (by ticking boxes) before submitting your assignment.
Assignment is presented on A4 paper.
Written on one side only.
Wide margin. Use 1 " margins.
Double-spaced text throughout the assignment.
Use 12-point Times New Roman font.
Pages firmly stapled
Declaration below is completed.
DECLARATION:
Except where we have indicated, the work we am submitting in
this assignment is our own work.
______________________________
(Signature of all team members)

17

PSYC 3140 Psychometric Principles | Section 1

Rubric for Assignment 1 & 2
Test Development Project & Validity and Reliability Estimation
Exercise
Compete
ncy
Area
Ideas

Advanced
3

Allocated Marks
Proficient
2

The writing is focused,

well developed, and
enhanced by details.

Organizati
on

Organization supports
the central idea. The
order and structure
move the reader
through the text easily.

Word
Choice

Precise, original, fresh

words. Creates vivid
images.

Presentati
on

Presentation includes
features beyond the
assigned requirements
which enhance
meaning. Neat and
legible

The writing may

be focused, but it
is only partially
developed and
may lack
necessary details.
Organization
supports the
central idea.
However, the
order and
structure do not
readily move the
reader through
the text.
Attempts to use
descriptive words
to create images.
Tries to use words
for specificity.
Experiments with
new and different
words with some
lacking.
Assigned format is
followed. Presentation
is neat and legible.

Low
1
The writing lacks
focus, is
incompletely
developed, and
has few details.
Organization
neither supports
nor develops the
central idea. The
lack of order and
structure detract
from the readers.
General or
ordinary words.
Attempts new
words with
limited success.
May include
inappropriate
words or limited
use of vocabulary.
Limited quality of
appearance.
Assigned format
not followed.

DEPARTMENT OF PSYCHOLOGY
INTERNATIONAL ISLAMIC UNIVERSITY MALAYSIA
PSYC 3140 PSYCHOMETRIC PRINCIPLES
Test Development Project - Marking Schedule
Content area
1. What is the test designed to
measure. Define the construct.
2. Content of the test.
3. Bases for the inclusion of the
content.
4. Objectives of the test.

Allocate
d Mark
3
3
3
3

18

Given
Mark

REMARK

PSYC 3140 Psychometric Principles | Section 1

5. Is there a need for the test in your
community? Who benefit from the test?
6. Any other similar test/device?
How do the goals of this test
differ from the goals of another
device/test?).
7. Format of the test (What types
of responses will be required by
testaker? behavior, ability
requirement as responses).
8. Should more than one form be
developed? Why?
9. Who will use the test?
10.Who will take the test (Your test
taker, their age and other
background).
11.How will you administer the
device (Procedure of
administration).
12.How will you determine the
psychometric properties of this
test? (Reliability and validity of
the test).
13.Any potential for harms as the
result of the administration of
the test?
14. What special training will be required
of test users? for administering and
interpreting.
TOTAL
(3 full marks 14 content area)
TOTAL
(received marks / 42 total
marks) 30%

3
3

3
3
3
3
3

3
3
42
/ 30

DEPARTMENT OF PSYCHOLOGY
INTERNATIONAL ISLAMIC UNIVERSITY MALAYSIA
PSYC 3140 PSYCHOMETRIC PRINCIPLE
Validity & Reliability Estimation Exercise - Marking Schedule
Content area
1. Name of the device.
2. Developer of the device.
3. Publisher the device.

Allocat
ed
Mark
3
3
3
19

Given
Mark

REMARK

PSYC 3140 Psychometric Principles | Section 1

4. Content of the device.
5. Bases for the inclusion of the
content.
6. Objectives of the device.
7. Any other similar device?
How do the goals of this
device differ from the goals
of another device/test?).
8. Format of the device (What
types of responses will be
required by testaker?
behavior, ability requirement
as responses).
9. Reliability and validity of the
device.
10. Is there a need for the
test in your community.
11. Who will use the test?
12. Who will take the test
(Your test taker, their age
and other background).
13. Procedure of
administration.(How will you
administer the device).
14. Any potential for harms as
the result of the
administration of the test.

3
3

TOTAL

42

3
3

3
3
3
3
3
3

(3 full marks 14 content area)

TOTAL

/ 20

(received marks / 42 total

marks) 20%

20