Professional Documents
Culture Documents
NEIL DUGGER
Internal Auditor Interim Superintendent of Schools
BACKGROUND
In 1995, the 74th Texas Legislature enacted the Safe Schools Act designed to make Texas public
school safe from violent and disruptive students. It created Disciplinary Alternative Education
Programs (DAEPs) and Juvenile Justice Alternative Education Programs (JJAEPs) so that
students who were disruptive, suspended, or expelled could continue their education away from
regular classroom settings. To evaluate districts’ use of DAEPs and JJAEPs, the Disciplinary
Action Data – Student (425 Record) was added to the Public Education Information
Management System (PEIMS) to obtain the data necessary for analyzing these data 1 .
In 2007, the state began distinguishing school districts whose discretionary DAEP placement rate
(percentage) exceeded that state’s placement rate. This analysis examined the percentage of all
students placed in DAEP at the district’s discretion; as well as the African American and
economically disadvantaged (2007 only) groups. According to the discipline data reported for
the 2007 and 2008 school years, Irving ISD’s discretionary placement rate has exceeded the
state’s rate for all groups examined. The following table depicts the district’s rating and provides
a comparison with the state.
2008 2007
District Rate State Rate District Rate State Rate
All Students 2.7 1.7 2.9 1.9
African American 5.0 3.4 4.9 3.4
Economically Disadvantaged No Information 2.1 1.8
Difference Score 2.3 1.7 2.0 1.5
In summary, the district reported that 2.7% of its student population (5% of the African
American population) were removed from the traditional classroom setting and placed in the
District’s off-campus alternative education programs (i.e. Wheeler Transitional and
Development and Secondary Reassignment Centers) during the 2008 school year.
Roles and Responsibilities of 425 Coordinators
To aid in the management of the district’s disciplinary data, the 425 coordinator’s position was
created by central administration. The position was created to oversee the disciplinary records of
the campus. Principals were asked to assign an administrator for their campus, who would be
responsible for:
• Attending training (provided by central administration) on updates, and distributing the
information to their campuses,
• Reviewing the COGNOS reports for any discrepancies,
• Ensuring the integrity of the data input into Student Plus, and
• Addressing any PEIMS errors found during submissions.
1
2008 Discipline Data Validation Manual
1
Throughout the school year, central administration forwards COGNOS reports to the 425
coordinators which summarize all incidents input into Student Plus by the campus. In addition,
four error reports are also forwarded to the 425 coordinator. These reports should be reviewed
and corrected to ensure that data submitted to the TEA is accurate.
This formula only takes into account students removed from the campus and placed in the
district’s off campus alternative education programs. In addition, it only includes those incidents
in which the campus administrators have the discretion to determine the disciplinary action taken
against the student.
During Internal Audit’s testing, this formula was applied to all ethnic groups, to determine
whether any other ethnic group’s placement rate exceeded the district’s overall rate and the
state’s rate (from prior school years). In addition, the following testing of disciplinary data was
performed:
• Calculation of discretionary DAEP placement for each campus,
• Analyses of ethnic group placement for all disciplinary actions (i.e. In-School Suspension,
Out-of-School Suspension, etc.),
• Brief analyses of the integrity of disciplinary data records, and
• Comparison of the average number of days ethnic groups are removed from the classroom
setting.
Scope Limitations
At the initiation of audit test work, it was noticed that the discipline data was incomplete (i.e. one
campus had not reported any data for the entire school year as of March 2009). Although the
425 coordinators were informed of the impending audit, and were given multiple opportunities to
review (and correct) data input into Student Plus, Internal Audit’s review revealed numerous
errors. Due to the time constraints, the campus with the largest number of questionable items
was contacted. Although some of these issued were corrected by resubmission, complete
reliance can not be placed on the data submitted to PEIMS.
OVERALL CONCLUSION
Based on the test work performed Internal Audit has concluded that insufficient monitoring is
being performed at the campus level to ensure the integrity of the data submitted to the state to
2
calculate the district’s placement rate (for both the overall district and the African American
group). Numerous errors were discovered in the data reported for the 2009 school year, which
should have been detected during the reviews performed by the campus’ 425 coordinator. In
addition, it appears processes are not sufficient at the campus level to ensure that errors (i.e.
duplications) will not occur. Lastly, the Student Plus system is not designed with controls to
ensure that data input by the campuses is logical.
In regards to analysis of IISD’s discretionary DAEP placement rates, IA’s calculation is
consistent with the previous school years. It appears that 2009 African American discretionary
placement rate (5.1) will exceed the district’s placement rate for all students (2.7). The
additional testing performed on the remaining ethnic groups further reveals the African
American is the only ethnic group whose placement rate exceeds the district’s overall placement
rate.
RECOMMENDATION
It is recommended that the disciplinary process become standardized throughout the district.
Although it is customary for campuses to design the processes for documenting disciplinary
actions, it appears that this current method does not ensure the integrity of the data reported in
PEIMS. In addition, it appears that the integrity of our attendance data is also impacted, which if
tested during the TEA visit, could result in possible assessments against the district’s state
funding. 2
Central and campus administration should coordinate their efforts to improve the district’s data
quality. Possible actions could include the following:
• Create standardized procedures for the 425 coordinators, which will provide guidance on
performing their duties, and ensure consistency in the process.
• Standardize the documentation required for disciplinary data. This could include
consolidating the district’s safeguard form with campus forms.
• Implement deadlines for updating the disciplinary records and submitting corrections for the
reports sent to the 425 coordinators.
• Require all 425 coordinators and the data entry clerks to attend the required training.
• Require more specific incident information to be input into the system.
• Incorporate the responsibilities of the discipline administrators into their annual evaluations.
• Obtain a database which will perform data validation and reasonableness checks. The
current system allows erroneous, incomplete or invalid information to be input. For example,
incident dates and actions dates could be any date (i.e. dated entered from 2006/2007 school
year, or any day (Saturday, Sunday, or holiday), or be left blank in the database.)
MANAGEMENT’S RESPONSE
Central and campus administration will coordinate their efforts to address the recommended
actions presented in the discipline internal audit:
• Establish a task force of twelve (12) campus discipline 425 Coordinators to hear the audit
report and draft a plan of action to address the issues presented in the discipline audit.
The Task Force will meet on August 10, 8-10:00 A.M., Board Conference Room; August
12, 1-3:00 P.M., TR 3; and if needed, August 14, 8-10:00 A.M., TR 1. A discipline
handbook will be developed to include standard procedures and forms that will ensure
consistency in the process and data integrity.
2
TEC, §42.255, 19 TAC §129.21(m)
3
• Present findings of the discipline audit to all principals at the general principals’ meeting
on September 1.
• Conduct discipline accounting training for all discipline administrators on September 10,
15, and 17.
• Monitor the progress of the plan every six weeks throughout the school year. As designed
by the task force.
4
OBSERVATIONS
Review of Discretionary Alternative Education Placement (DAEP)
Internal Audit reviewed the 2009 disciplinary data to determine whether the trend, identified by
the state, continued for the current school year. Using the 1/9/2009 enrollment snapshot, the
placement rates for the district, as well as the placement rates for all ethnic groups, were
calculated. For disciplinary data reported as of 3/31/09 the African American discretionary
DAEP placement has again exceeded the district’s rate. In fact, the African American group is
the only ethnic group whose placement rate exceeded the district’s rate. The placement rate for
the overall district was 2.7 (excluding early childhood campuses). This rate exceeds the 2007
and 2008 state rate for all students (1.9 and 1.7 respectively), and is consistent with IISD’s rates
for the same years (2.9 and 2.7 respectively).
American African
Asian Hispanic Caucasian
Indian American
District Rate 2.7
Placement Rate 1.1 0.5 5.1 2.4 2.3
Difference Score (1.6) (2.2) 2.4 (0.2) (0.4)
100% 2% 1% 1% 1% 0%
4%
20%
10%
0% 0%
All Students Expel/JJAEP ISS (8,625) OSS (2,083) AEP (824) SpEd AEP (3)
(31,072) (42)
5
Comparison of DAEP Placement Rates
All Campuses
Testing was further extended to identify those campuses with placement rates that exceeded the
district or comparable campuses. The results are summarized below.
• All Campuses/All Ethnic Groups
For the 34 campuses tested (early childhood were excluded), twenty-nine percent of the
campuses’ DAEP placement rates exceeded the district’s rate of 2.7. All ten were
secondary campuses.
• Secondary Campuses/All Ethnic Groups
The placement rate for the 13 secondary campuses was 4.8. Six of the 13 (46%) campuses
exceeded this rate.
• Elementary Campuses
The placement rate for the 21 elementary campuses was 0.4. Five of the 21 (24%)
campuses exceeded this rate.
American African
Asian Hispanic Caucasian
Indian American
# of campuses whose placement rate
exceeded the overall secondary DAEP 0 0 10 3 5
placement rate
% of secondary campuses 0% 0% 77% 23% 38%
American African
Asian Hispanic Caucasian
Indian American
# of campuses whose placement rate
exceeded the overall elementary DAEP 1 1 11 1 7
placement rate
% of elementary campuses 5% 5% 52% 5% 33%
6
• Cluster
Comparison of placement rates between clusters reveals that the African American
placement rate in the Central cluster (6.7) exceeded the overall placement rate for all
African American students (5.1); and the placement rate for the other two clusters. This
rate seems high when African American students represent only 11% of the Central
cluster’s population (compared to 23% of the North cluster).
In addition, the placement rate for African Americans exceeded the district’s overall rate
(2.7) for all three clusters and the Academy of Irving ISD.
American African
Asian Hispanic Caucasian
Indian American
Placement Rate 0.0 1.0 6.7 2.4 2.1
Central (Irving)
% of Population 0% 3% 11% 73% 13%
Placement Rate 0.0 0.3 4.9 2.5 2.4
North (MacArthur)
% of Population 0% 6% 23% 50% 20%
Placement Rate 3.1 0.3 4.3 2.5 2.3
South (Nimitz)
% of Population 0% 4% 8% 66% 21%
Academy of Irving Placement Rate 0.0 0.0 5.0 2.2 12.0
ISD % of Population 0% 7% 8% 70% 15%
Union Bower Placement Rate 0.0 0.9 0.8 1.3 1.4
Center % of Population 0% 0% 9% 80% 11%
American African
Asian Hispanic Caucasian
Indian American
Days of Out of School Suspension 8.0 65.0 1,642.5 3,324.5 954.5
Number of incidents 8 34 910 1,627 466
Average Day(s) per Incident 1 1.9 1.8 2.04 2.05
Data Integrity
Internal Audit tested the reasonableness and reliability of the data entered into Student Plus
(which is ultimately reported to the TEA) and the attendance data recorded for the disciplinary
7
actions taken during the school year. The purpose of these tests was to test the accuracy of the
data recorded in Student Plus, and ultimately reported to the TEA.
Reliance can not be placed on the Discipline Data
Upon scanning the discipline records for the district (Excel format), the auditor found numerous
discrepancies. It should be noted that these discrepancies were found reviewing an EXCEL
spreadsheet provided by the PEIMS Department.
• A single incident was entered more than once into Student Plus, under different incident
number. Therefore, the number of incidents reported to the state was increased.
• Incident dates and action dates were erroneous entered in the system. Campuses recorded
incidents as occurring on the weekend, or on student holidays.
• Actions against students were entered into the discipline database more than once (under a
single incident).
Disciplinary Actions are not supported by Student Attendance Data
Attendance data in the Student Plus system did not accurately reflect the disciplinary actions
recorded on the 425 records. Disciplinary action for 154 students (8 secondary campuses) was
compared against the attendance recorded in Student Plus. Attendance for 55 actions (36%) did
not agree to disciplinary action assigned by the campus. The following errors were encountered:
• Disciplinary action reported in the attendance database could not be traced to an incident in
the discipline database.
• Students’ attendance in Student Plus did not reflect the removal from the classroom (ISS,
OSS)
• Funded absences were recorded as non-funded absences (i.e. ISS placements recorded as
unexcused absences).
• The dates the students were assigned to DAEP did not agree with the days students were
marked absent from the classroom.
• The supporting documentation for the disciplinary action did not agree to the data input
into Student Plus for incident dates and action start dates.
• A student was marked absent (ill) for all courses on the incident date.
Auditor’s Note: IA review of the records was not an in-depth review. Excel tools were used to
test the reasonableness of the data. More intensive review will be required of the campuses to
determine the extent of inaccuracies reported in 425 records.
8
REPORT DISTRIBUTION
9
ATTACHMENT A
Students with One Incident
American Indian Asian African American Hispanic Caucasian
Incident # of # of # of # of # of # of # of # of # of # of
Average Average Average Average Average
Days Students Days Students Days Students Days Students Days Students
13%
10%
19% 17% 16%
removing a student to an alternative education
90%
10%
program.
80%
14% 10% 16% American Indian
70%
14% 16%
Asian Emphasis of a “Positive Proactive Approach to
African American
60% Caucasian Discipline”
Hispanic
50%
The District stressed the value of keeping the
40%
student in the classroom. Best practices were
68% 70%
67%
30%
65% 65%
shared among campus administrators in
20%
administering disciplinary actions other than
10%
removing the student from the instructional
0%
setting. Based on interviews with campus
All Students Expel/JJAEP (10) ISS (4,851) OSS (1,309) DAEP (423)
(31,864) administrators, more are assigning students to
See Attachment A for larger view Friday after-school detention or Saturday
DAEP Rate Calculation School.
The discretionary placement rates for the
District and the three largest ethnic groups
Discretionary DAEP Placements
Audit Follow-Up
Page 2 of 4
Tone at the Top – Resolution No. 09-10-08 by central administration (i.e. additional training
The Board of Trustees adopted Resolution No. and labs and the standardization of the
09-10-08 in November 2009, which discipline form) have not fully addressed the
implemented strategies to “eliminate any issues resulting in poor data quality. (Refer to
disproportionate imposition of discipline or Attachment B)
assignment to alternative educational programs Disciplinary Data
due to or resulting from the student’s race, Internal Audit examined seventy-two percent of
color, national origin, by the end of the 2010- the discipline records (315 out of 435):
2011 School Year”. Erroneous data was found in seventy-five
African American Discretionary Referrals percent (72%) of the records reviewed.
There were 1,072 discretionary referrals for Three percent (3%) of the records were
African American students which resulted in the duplications or errors.
student being removed from the instructional A review of a report created by the
setting. According to the student information Reassignment Center (RAC) revealed that 13
system, 60% of the referrals were made by students were placed in AEP, but disciplinary
teachers (including substitutes) and records were not created for the students by the
paraprofessionals. The remaining 40% were home campuses.
made by campus administrators, police officers,
and campus auxiliary officers. Attendance Data
In addition, attendance errors were noted during
On the average, however, there were 1.85 the review. Attendance was reviewed for 225
referrals for every teacher/paraprofessional, but incidents.
7.7 referrals for every campus administrator, Errors were noted for 48% of the incidents.
police officer or campus auxiliary officer. The errors included both an underreporting
Assuming the data recorded in the student and over-reporting of Average Daily
information system is accurate, campus Attendance (ADA).
administrators (not teachers) are initiating the Numerous teachers were not reporting
disciplinary actions which have resulted in attendance on a daily basis (i.e. students
African American students being removed from assigned to RAC were not marked absent by
the instructional setting. the teacher).
Further examination of the referrals made by Some attendance clerks misunderstood the
teachers also revealed that those teachers with District’s procedures for students assigned
the highest number of referrals resulted from to AEP, or failed to update the attendance
repeat offenders. For example, the teacher with for students assigned to AEP.
the highest African American referrals resulted Inadequate Follow-Up for Carryover Students
for one student being referred thirteen times. In Approximately 30 of the erroneous 425 Records
fact, those teachers with the most referrals resulted from the home campus’ failure to
resulted from one to three students being follow up on students who did not complete
referred more than once. The most students their AEP placement from the prior school year.
referred by one teacher were five elementary Campuses have the option to require a student
students which resulted in seven referrals. who does not serve all days assigned to AEP, to
report the following school year.
Significant Remaining Risks
Actions are still needed to improve the integrity
of disciplinary and attendance data reported by
the campuses. It appears that the efforts made
100% 1% 2% 2%
4%
10%
13% 19% 17% 16%
90%
10%
50%
40%
68% 70% 67%
65% 65%
30%
20%
10%
0%
All Students Expel/JJAEP (10) ISS (4,851) OSS (1,309) DAEP (423)
(31,864)
ATTACHMENT B
Adjustments
Accuracy of Discipline Records Attendance Testing (Errors in ADA Period)
Funded Unfunded
% of % of Absence Absence
% of Erroneous
% of Records % of Records Records Attendance Attendance reported as reported as Error May
Total Not Sample Accurately Partially % of Records (Duplications/ Sample % of Reported Not Reported Unfunded Funded Not Impact
Loc# Campus Pop Tested Size Updated Updated Not Updated Overlaps/Errors) Size Population Accurately Accurately Absence Absence Funding
002 Irving HS 102 0 102 14% 38% 43% 5% 40 39% 70% 30% 6 3 3
003 MacArthur HS 95 39 56 63% 16% 20% 2% 45 47% 87% 13% 1 3 2
004 Nimitz HS 50 25 25 12% 52% 36% 0% 16 32% 63% 38% 0.5 4.5 1
005 UBCL 4 0 4 50% 50% 0% 0% 3 75% 0% 100% 3
006 Academy HS 16 7 9 33% 44% 22% 0% 9 56% 44% 56% 2 3
041 Bowie MS 37 11 26 8% 54% 31% 8% 23 62% 26% 74% 4.5 1.5 11
042 Crockett MS 10 0 10 30% 50% 20% 0% 10 100% 20% 80% 8
043 Travis MS 22 6 16 25% 56% 13% 6% 15 68% 0% 100% 1.5 1.5 12
044 Lamar MS 9 0 9 22% 67% 11% 0% 9 100% 0% 100% 1 8
045 Austin MS 16 7 9 11% 56% 33% 0% 7 44% 86% 14% 1
046 Houston MS 32 14 18 22% 67% 11% 0% 18 56% 0% 100% 18
048 de Zavala MS 27 11 16 13% 56% 31% 0% 15 56% 93% 7% 1
102 Brown ES 3 0 3 33% 33% 33% 0% 3 100% 67% 33% 1
103 Britain ES 1 0 1 0% 0% 100% 0% 1 100% 100% 0%
105 Good ES 3 0 3 0% 33% 67% 0% 3 100% 33% 67% 1 1
106 J. Haley ES 1 0 1 100% 0% 0% 0% 1 100% 0% 100% 1
107 T. Haley ES 1 0 1 0% 0% 100% 0% 1 100% 0% 100% 1
109 Keyes ES 1 0 1 0% 100% 0% 0% 1 100% 100% 0%
113 Farine ES 1 0 1 0% 100% 0% 0% 1 100% 0% 100% 1
114 Schulze ES 1 0 1 0% 0% 100% 0% 1 100% 0% 100% 1
121 Davis ES 1 0 1 0% 100% 0% 0% 1 100% 100% 0%
122 Gilbert ES 1 0 1 100% 0% 0% 0% 1 100% 100% 0%
124 Stipes ES 1 0 1 0% 100% 0% 0% 1 100% 0% 100% 1
435 120 315 25% 42% 30% 3% 225 52% 52% 48% 18.5 13.5 77