2015-16 Network STEP Results

8/09/2016
 Preliminary

Purpose

Report anonymized 2015-16 STEP data for all schools that test at
least 80% of Fall Enrollment.
Show Network Examine variation in:

STEP Data - Spring Ending STEP Level

- Fall-to-Spring Progress*
- STEP Administration practices

These slides show the KIPP testing landscape and provide a

Set the context framework within which to interpret school-level STEP results.
about variation Across the network, there is substantial variation both in
administration practices and performance metrics.

*STEP growth targets assume students are tested over the course of the year. To make appropriate network-wide comparisons, only 2
schools that test STEP in the fall and spring are included. See slide 13 for more details.
 Preliminary

Executive Summary

More than half of K and 1st graders end the year at/above their
target STEP level.
Ending Level In older grades, wider distribution of ending STEP level.
Evidence of high ending performance found in all grades

At schools testing in fall and spring, majority of students are making

3+ STEPs progress, including
Progress - 80% of K students.
- 70% of 1st graders.
- 60% of 2nd graders.

Administration varies across the KIPP Network.

Administration Younger grades are assessed more frequently, more often

throughout the year
Practices Over 90% of students are stepping out over the course year or
ending the year with a DnA.

3
 Preliminary

Most K and 1 st students end the year at/above the STEP target level.
Distribution of ending STEP level is wider in older grades.
At/Above STEP
Spring STEP Level Target

39%
K 17% 22%
6% 9%
37 schools 3% 3% 1% 72%
Below 1 2 3 4 5 6 7 8 9 10 11 12 Total
STEP Above
% at STEP Level

1st 16% 18% 19%

11% 14%
12%
33 schools 1% 0% 3% 55%
Below 1 2 3 4 5 6 7 8 9 10 11 12 Total
STEP Above

2nd 19% 22%

6% 9% 11% 11%
24 schools 0% 0% 1% 2% 4% 6% 9% 48%
Below 1 2 3 4 5 6 7 8 9 10 11 12 Total
STEP Above

Due to wide variation in testing practices, 3rd grade By Spring, nearly 10% of 2nd
performance results are not shown graders have stepped out

Only includes students who are tested on/after April 1 or stepped out over the course of the year 4
Schools where < 80% of Fall Enrollment is tested are not included
 Preliminary

K variation in ending STEP Performance

K
% Ending At/Above STEP Target (3)

Above Target
At Target
100%
94% 96%
91% 91% 91% 93%
88%
84% 84% 84% 85% 86% 87%
81% 82% 83%
77% 77% 79%
74% 75% 75% 75% 76%
% of Tested Students

67% 68% 37%

51%
65%
62% 62% 63% 64%
28% 40% 46%
22% 54%
10% 29% 43% 48%
27% 31% 31% 36% 49% 51% 54%
48% 52% 52%
35% 68% 76%
48% 49% 49% 51%
13% 43%
27% 31%
50%
43% 26% 26% 30%
12%
9% 20%
24% 26%

24% 58% 55% 54% 54%

49% 47% 48% 47% 45% 45%
4% 44% 44% 43% 41%
38% 36% 38% 33% 38% 37% 39% 39% 39%
34%
29% 33% 34% 31% 35% 33% 33% 34%
24% 23% 23%
19% 18%

0%

Schools
N < 20 excluded
* Only includes students who are tested on/after April 1 or stepped out over the course of the year 5
** Students who step out in previous years not included
 Preliminary

1st Grade variation in ending STEP Performance

1st
% Ending At/Above STEP Target (6)
Stepped Out
Above Target
At Target
100%
93%
90% 91%
82%
76% 78%
% of Tested Students

72% 72%
69% 69%
65% 66% 67%
57%
53% 53% 55% 56%
49%
49% 49% 49% 50% 52% 31% 75% 79%
50% 33% 43% 53% 80%
50% 65%
40% 40% 41%
49%
25% 32%
33% 34% 22% 53%
24% 28% 37%
30% 35% 41% 45%
27% 21%
11% 25% 41%
21% 10% 19%
19%
15% 38%
11% 11% 18% 32% 32%
4% 11% 27% 27% 25% 24% 29%
24% 22% 23%
5% 19% 22% 19% 21%
17% 18% 18%
15% 14% 12% 11% 12% 13% 15% 12%
7% 11% 8% 11% 8% 8% 10%
0%

Schools
N < 20 excluded
* Only includes students who are tested on/after April 1 or stepped out over the course of the year 6
** Students who step out in previous years not included
 Preliminary

2nd Grade variation in ending STEP Performance

2nd
% Ending At/Above STEP Target (9)
Stepped Out
Above Target
At Target
100%
91%

79%
% of Tested Students

71% 6% 28%
65%
61%
59% 59% 61% 6%
54% 54% 55% 5%
7% 13% 30%
47% 9% 6% 12% 44%
50% 11%
41% 16% 26% 36%
38% 38% 39% 8% 14% 13%
36% 26%
31% 31% 8% 11% 17%
5% 9% 27% 19%
25% 26% 16%
22% 22% 23% 5% 8% 18% 14% 7% 25%
6% 17% 11% 45%
6% 6% 6% 13% 5% 15% 35% 35% 33% 29% 27%
6% 28% 26%
22% 22% 22% 20% 22%
14% 16% 12% 16% 13% 17% 18% 17% 14%
9% 11%
0%

Schools
N < 20 excluded
* Only includes students who are tested on/after April 1 or stepped out over the course of the year 7
** Students who step out in previous years not included
 Preliminary

At schools that test from fall-to-spring, most

students progress 3+ STEPS over the year.
Overall
% of Students making 3+ STEPS progress
100%
84%
% Meeting / Exceeding

72%
60%
STEP Target

50%

0%

K 1st Grade 2nd Grade

20 Schools 15 Schools 7 Schools

STEP growth targets assume students are tested over the course of the year. To make appropriate network-wide
comparisons, only schools that test students in the fall and spring are included. See slide 13 for more details.

Fall: prior to 11/1

Spring: on/after 4/1 or have stepped out over the course of the year. 8
Only includes students who tested from fall-to-spring, and schools where 80% of fall enrollment tested fall-to-spring
 Preliminary

At a majority of schools *, 80% of K students are

making 3+ STEPs progress.
K
% of Students making 3+ STEPS progress
100%
100% 94% 95% 96% 96% 97%
91% 91% 92%
87% 88% 88% 89%
84%
77% 78%
% Meeting / Exceeding

73%
64%
STEP Target

53%
50%
42%

0%
Schools

Fall: prior to 11/1

Spring: on/after 4/1 or have stepped out over the course of the year. 9
*Only includes students who tested from fall-to-spring, and schools where 80% of fall enrollment tested fall-to-spring
 Preliminary

At a majority of schools *, 70% of 1 st students are

making 3+ STEPs progress.
1st
% of Students making 3+ STEPS progress

100% 96%

86% 87% 87%

80% 82%
78% 80%
76%
% Meeting / Exceeding

70% 72%
70%
60%
STEP Target

50%
48%
43%

0%
Schools

Fall: prior to 11/1

Spring: on/after 4/1 or have stepped out over the course of the year. 10
*Only includes students who tested from fall-to-spring, and schools where 80% of fall enrollment tested fall-to-spring
 Preliminary

2nd Grade progress varies by school *.

2nd
% of Students making 3+ STEPS progress

100% 97%

84%
77%
% Meeting / Exceeding

60%
STEP Target

50%
50% 48%

11%

0%
Schools
Only 7 schools (of 27)

Fall: prior to 11/1

Spring: on/after 4/1 or have stepped out over the course of the year. 11
*Only includes students who tested from fall-to-spring, and schools where 80% of fall enrollment tested fall-to-spring
 Preliminary

Younger grades are assessed more frequently and

consistently throughout the year.

STEP Administration Summary

% Tested Fall & Avg. N % Stepping Out or
Grade Schools Students Spring* Assessments ending with DnA

K 41 4113 62% 7 93%

1 36 3705 51% 6 92%

2 27 2655 46% 6 91%

3 14 1157 36% 5 95%

Fall: prior to 11/1

Spring: on/after 4/1 or have stepped out over the course of the year.
*There is wide variation in testing practices across the network. See appendix for more details. 12
Data as of 6/20/2016
 Preliminary

STEP Terminology and Definitions

Assessment
Step Individual Assessment. There are twelve steps within the STEP framework
Baseline Assessment Assessment(s) given to new students to determine starting STEP level for progress calculations.
Progress Indicates a student receives a passing score on a non-Baseline assessment.
Did Not Achieve (DNA) Indicates a student did not pass a Step assessment with a passing score

Administration
Step Out When a student passes/achieves the 12th Step
Ending with DnA To ensure a student reaches the highest possible STEP level by the end of the year, STEP
recommends testing students until they receive a DnA score
Avg. N of Assessments The average number of non-baseline assessments a student takes over the year
STEP Target By the end of the year, STEP expects students to finish at the following levels:
K - Step 3
1st - Step 6
2nd - Step 9
3rd - Step 12
Fall-to-Spring Tested STEPs targets assume that students are tested throughout the year. Fall Tested indicates that a
student took any assessment prior to 11/1. Spring Tested indicates that a student took any
assessment after 4/1. Fall-to-Spring tested indicates a student tested in both seasons or stepped
out over the course of the year
Paper-Based vs. Computer- Schools can choose to administer STEP assessments on paper or electronically. Paper-administered
Based assessments require test administrators to manually enter in STEP results into the STEP data
management system (DMS).

13
 Preliminary

Data sources / metrics

Performance
Measurement Slides Metric Definition Source
Ending STEP End Column achievement.csv

Ending Performance 4-7

% At/Above STEP
Count of End at/above target step / Count of All achievement.csv
Level

Progress Progress Column achievement.csv

Progress 8-11
% 3+ STEPs Count of 3+ STEPS progress or stepping out /
achievement.csv
progress Count of All

Only students
Keep all students who tested:
who tested fall /
Fall-to-Spring Tested ALL A) Before 11/1 AllSteps.csv
spring or stepped
B) On/after 4/1 OR Passed STEP 12
out

Non-baseline
N Assessments 12 Assessments column Baseline column achievement.csv
Assessments

14
 Preliminary

Progress / Baseline Explanation (taken from, How

STEP DMS Measures Student Progress)
 Preliminary

Wide variation in testing practices across schools and

grades. Less than 60% of students test in fall and spring

% of Fall Enrollment testing Fall-to-Spring and Spring

K Fall-and-Spring Spring Only 2nd

F-S Avg.* Spring Avg.* F-S Avg.* Spring Avg.*
57% 84% 45% 91%
School

0% 25% 50% 75% 100% 0% 25% 50% 75% 100%

% Fall Enrollment
Fall: prior to 11/1
Spring: on/after 4/1 or have stepped out over the course of the year.
*Excludes schools testing fewer than 20 students. Excludes KIPP Voice and Jacksonville ES excluded because data is not disaggregated