Professional Documents
Culture Documents
Criterion-related validity looks at the relationship between a test score and an outcome. For
example, SAT scores are used to determine whether a student will be successful in college. Firstyear grade point average becomes the criterion for success. Looking at the relationship between
test scores and the criterion can tell you how valid the test is for determining success in college.
The criterion can be any measure of success for the behavior of interest. In the case of a placement
test, the criterion might be grades in the course.
A criterion-related validation study is completed by collecting both the test scores that will be used
and information on the criterion for the same students (e.g., SAT scores and first-year grade point
average, or AP Calculus exam grades and performance in the next level college calculus course).
The test scores are correlated to the criterion to determine how well they represent the criterion
behavior.
A criterion-related validation study can be either predictive of later behavior or
a concurrent measure of behavior or knowledge.
Predictive validity refers to the "power" or usefulness of test scores to predict future
performance.
Examples of such future performance may include academic success (or failure) in a particular
course, good driving performance (if the test was a driver's exam), or aviation performance
(predicted from a comprehensive piloting exam). Establishing predictive validity is particularly useful
when colleges or universities use standardized test scores as part of their admission criteria for
enrollment or for admittance into a particular program.
The same placement study used to determine the predictive validity of a test can be used to
determine an optimal cut score for the test.
I would like to do an admission validity study.
I would like to do a predictive placement validity study.
Concurrent Validity needs to be examined whenever one measure is substituted for another,
such as allowing students to pass a test instead of taking a course. Concurrent validity is
determined when test scores and criterion measurement(s) are either made at the same time
(concurrently) or in close proximity to one another. For example, a successful score on the CLEP
College Algebra exam may be used in place of taking a college algebra course. To determine
concurrent validity, students completing a college algebra course are administered the CLEP
College Algebra exam. If there is a strong relationship (correlation) between the CLEP exam
scores and course grades in college algebra, the test is valid for that use.
Home >
Research >
Methods >
Criterion Validity
If the test has high concurrent validity, the members of the leftist party should receive scores
that reflect their left leaning ideology. Likewise, members of the right wing party should receive
scores indicating that they lie to the right.
If this does not happen, then the test is flawed and needs a redesign. If it does work, then the
researchers can assume that their test has a firm basis, and the criterion related validity is
high.
Most pollsters would not leave it there and in a few months, when the votes from the election
were counted, they would ask the subjects how they actually voted.
This predictive validity allows them to double check their test, with a high correlation again
indicating that they have developed a solid test of political ideology.