Practice:

Evaluate outcomes to show your program is

making a difference
Key Action: Identify outcome measures and instruments

SAMPLE MATERIAL: Evaluation Measures, Purposes, and Schedule

Purpose: An important aspect of planning an effective evaluation is to set a clear

purpose for each data collection instrument you use. In this sample
table, a district outlines the purpose for each instrument—achievement
tests; and surveys of administrators, teachers, students, and families—
and aligns those purposes with grant objectives and district strategic
goals. They also propose a schedule for administering tests and
surveys, which supports data collection logistics.

Note: While this proposal included experimental and quasi-experimental

evaluation designs, it is a useful model for any type of evaluation.

Source: From 2007 Magnet Schools Assistance Program (MSAP) grant

application, developed by St Paul Public Schools (SPPS), in
collaboration with their external evaluator, Mid-continent Research for
Education and Learning (McREL), 2007.

1

Measure
MCA-II
SAT-10
Student survey (existing
survey or McREL-
developed)
During Year 1 (2007-08),
McREL will locate or
develop a survey aligned
with the Magnet grant
objectives (and aligned with
SPPS district strategic
goals).
Teacher survey (existing
survey or McREL-
developed)
During Year 1 (2007-08),
McREL will locate or
develop a teacher survey
aligned with the Magnet
Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments
Table 2. Evaluation Measures, Purposes, and Schedule
Respondent Purpose Proposed Schedule
Treatment and To determine whether achievement of students in Spring 2008
comparison group magnet schools exceeds that of students in comparison Spring 2009
students group; to determine the relationship between exposure Spring 2010
to the intervention and achievement gains.
Treatment and To determine whether achievement of students in Spring 2008
comparison group magnet schools exceeds that of students in comparison Fall 2008
students group; to determine the relationship between exposure Spring 2009
to the intervention and achievement gains. Additional Spring 2010
SAT-10 administration may take place to meet needs of
grant evaluation.
Treatment and Measure: extent to which students perceive the Spring 2008
comparison group instructional capacity of teachers to be of high quality; Spring 2009
students student engagement; extent to which students perceive Spring 2010
decreased racial isolation; extent to which students
participate in heterogeneous group-based activities in-
and out-of-school (see also attendance data); extent to
which students feel “prepared for the future.”
Washington and Extent to which teachers perceive themselves as being Spring 2008
Arlington teachers involved in joint training and planning and curriculum Spring 2009
alignment; perception of recruitment efforts for hiring Spring 2010
diverse staff; extent to which teachers believe that
progress related to full implementation of the Critical
Components of NCHSTE has been made each year;
extent to which teachers perceive they are supported in
2
 Practice: Evaluate outcomes to show your program is
making a difference
Key Action: Identify outcome measures and instruments

Measure Respondent Purpose Proposed Schedule

grant objectives (and their implementation of the project; extent to which
aligned with SPPS district adequate professional development activities have been
strategic goals). provided.
Administrator survey Washington and Extent to which administrators perceive that the Spring 2008
(existing survey or Arlington marketing plan is viable; administrator perceptions of Spring 2009
McREL-developed) administrators; other teacher involvement in joint training and planning and Spring 2010
During Year 1 (2007-08), SPPS administrators curriculum alignment; perception of recruitment efforts
McREL will locate or for hiring diverse staff; perception of whether
develop an administrator partnerships have been developed and the nature and
survey aligned with the type of such partnerships; extent to which
Magnet grant objectives administrators perceive they have supported teachers in
(and aligned with SPPS the implementation of the project; extent to which
district strategic goals). adequate professional development activities have been
provided for teachers.
Parent survey (existing Parents of middle Parental perception of the impact of the marketing plan Spring 2008
survey or McREL- and high school- on their enrollment choices; extent to which parent and Spring 2009
developed) aged students community participation increased. Spring 2010
During Year 1 (2007-08), eligible for
McREL will locate or Washington or
develop a parent survey Arlington
aligned with the Magnet
grant objectives (and
aligned with SPPS district
strategic goals).
Attendance data SPPS To ascertain attendance at magnet schools (Washington Fall 2008
and Arlington) as well as the matched comparison Spring 2009
group; to determine participation in in-school and out- Spring 2010
of-school group-based activities (student demographic
data will also be collected to determine the extent of
interaction with heterogeneous groups).