Professional Documents
Culture Documents
http://isc.sagepub.com
Published by:
Hammill Institute on Disabilities
and
http://www.sagepublications.com
Additional services and information for Intervention in School and Clinic can be found at:
Subscriptions: http://isc.sagepub.com/subscriptions
Reprints: http://www.sagepub.com/journalsReprints.nav
Permissions: http://www.sagepub.com/journalsPermissions.nav
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
Intervention in School and Clinic
Volume 44 Number 2
November 2008 83-90
© 2008 Hammill Institute on Disabilities
10.1177/1053451208321600
http://isc.sagepub.com
hosted at
http://online.sagepub.com
Using Single-Subject
Research to
Establish the
Evidence Base of
Special Education
MELODY TANKERSLEY
SANNA HARJUSOLA-WEBB
TIMOTHY J. LANDRUM
Research in the field of special education often incorporates single-subject designs to investigate the effectiveness of
educational practices for students with disabilities. As such, it is important that educators and educational profes-
sionals understand the characteristics of single-subject research methodologies and how those characteristics allow
conclusions to be drawn about effectiveness of practices. Because conclusions about whether an intervention causes
changes in student outcomes can be derived from single-subject research, it has much to offer to discussion of evidence-
based practice and the ultimate identification of evidence-based practices for students with disabilities.
83
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
84 Intervention in School and Clinic
conclusions about whether a practice causes the desired evidence-based practices, single-subject research can be
changes in participants’ outcomes. used to determine evidence-based practices.
Like group experimental designs, single-subject Essential features of single-subject research designs,
research designs also allow researchers to draw conclu- those related to measuring target behaviors, introducing
sions about whether an intervention causes desired the intervention, and analyzing the effects, allow
changes in student outcomes. Despite this conceptual researchers to make determinations about whether a prac-
similarity, single-subject designs differ from group exper- tice is effective. These features can be illustrated through
imental designs in important ways. First, instead of using their applications in special education literature. Single-
groups to make comparisons, in single-subject research, subject research designs are also closely aligned with
participants provide their own comparison. Their perfor- special education’s core principles of individualized
mance is compared across conditions in which they are instructional decisions and frequent monitoring of student
and are not participating in the intervention under study. progress. Both of these contributions—identifying the evi-
For example, a researcher might measure a student’s math dence base and providing meaningful information about
problem solving when teachers give frequent corrective individualized instruction—make single-subject research
feedback on their performance, compared to a condition methods critical considerations for special educators.
in which no corrective feedback is given.
Most typically, researchers who use single-subject
research methods study individual learning or behav- Essential Features of Single-Subject
ioral outcomes under at least two experimental condi- Research
tions, a baseline condition and an intervention
condition. A baseline condition generally involves the The purpose of single-subject research is to establish
status quo, or observations of behavior or performance whether a functional relationship exists between a prac-
in a typical setting (e.g., a classroom) before the inter- tice and student outcomes at the level of individual par-
vention in question is implemented. These observations ticipants. Despite its name, single-subject research
occur repeatedly to determine a reliable current level of designs rarely involve only one participant. Even so, the
performance. Once baseline performance is stable and data are organized and analyzed according to a within-
predictable, the educational practice or intervention is participant orientation that focuses on the individual.
introduced, and performance is again measured fre- That is, each participant’s behavior or performance is
quently while it is in place during a period of time. compared to his or her own behavior or performance
Researchers measure the target behaviors repeatedly across multiple conditions. Although there are a number
across baseline conditions and then across intervention of different single-subject research designs, three key
conditions to establish student performance in the components are common to all single-subject designs: (a)
absence and in the presence of the intervention. Target behaviors must be assessed repeatedly using
Comparisons of data across baseline and intervention trustworthy measures, (b) interventions must be system-
conditions provide the basis for establishing whether ically introduced and withdrawn, and (c) the effects
there is in fact a functional relationship between the across baseline and intervention conditions must be ana-
independent and dependent variables. Horner et al. lyzed for each participant (Kazdin, 1982, 1992).
(2005) recommended that single-subject designs include
at least three demonstrations of a functional relation- Repeated, Trustworthy Measurement
ship. Obviously, the more demonstrations a design of the Target Behaviors
includes, the more evidence researchers have that a true
functional relationship exists between a given practice The repeated measurement of target behaviors is crit-
and student performance. ical to single-subject research. By measuring target
Because changes within a student’s behavior or perfor- behaviors repeatedly, researchers can be more confident
mance are demonstrated from baseline to intervention that the collective measurement is a true representation
conditions, multiple examples of single-subject research of the participant’s performance and the effects of ran-
results can establish whether a particular practice has an dom conditions in the environment are minimized.
evidence base. That is, causal inferences—that the inter- Because the target behavior is measured repeatedly
vention causes the change in students’ behavior or perfor- within both baseline and intervention conditions, it must
mance—can be ascertained from the results of be measured in a way that allows for multiple assess-
single-subject research designs. And because causal infer- ments, and measurement must occur the same way each
ences are generally recognized as necessary for establishing time. Thus, assessments that change over time or cannot
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
Tankersley et al. / Using Single-Subject Research 85
be given in quick succession (e.g., reading probes that detail about a target behavior or response to allow
increase in difficulty, standardized tests that are designed observers to agree a majority of the time on whether the
to be given only once per year) are poor measurement behavior occurred. For example, the phrase is disruptive
choices for single-subject research. is not well-defined, whereas makes irrelevant comments
Repeatedly measuring the target behavior over time is during a teacher-led lesson is more operationally clear.
also important so that performance patterns and trends In the example mentioned previously, Agosta et al.
both prior to intervention and during intervention can be (2004) defined and measured “screaming behavior” in
identified (Kazdin, 1992). For example, single-subject their examination of the effects of social stories with a
researchers often continue a baseline phase until the target young child with autism as including yelling, crying, or
behavior appears to be stable. A stable baseline provides loud humming during group circle time. In the other
confidence that the observed behavior is occurring in a typ- example, Boulineau et al. (2004) evaluated whether story
ical way or at a typical rate for that participant and allows mapping would increase reading comprehension of 6
for a relatively unambiguous assessment of the impact of third- and fourth-grade students with learning disabili-
an intervention. For example, to examine the effect of ties. To measure the outcome variable, these researchers
social stories on the screaming behavior of a child with counted and then calculated a percentage of identified
autism, Agosta, Graetz, Mastropieri, and Scruggs (2004) story-grammar elements students correctly represented
observed and recorded the number of times the child on their story maps after they read passages.
screamed during a total of 36 days. These researchers col-
lected initial baseline data until a stable pattern was estab- Repeated and Systematic
lished in the first 8 of those days. In an academic behavior Introduction of the Intervention
example, Boulineau, Fore, Hagan-Burke, and Burke
(2004) recorded the percentage of story-grammar elements In addition to assessing target behaviors repeatedly
children represented correctly in story maps across 13 using trustworthy measurements, single-subject research
days, including 4 days of an initial, stable baseline phase. designs also require that interventions are systemically
In addition to measuring behavior repeatedly, single- introduced and withdrawn to determine whether the
subject researchers must ensure that their measures of intervention (or something else) caused any observed
behavior are trustworthy. In other words, they must change in the target behavior. By purposefully and sys-
ensure that the measurements used reflect what has tematically making changes in whether and how an
really occurred. The most common way this is accom- intervention is implemented (e.g., not present, provided
plished is to assess some form of interrater or interob- with more or less intensity) and then evaluating how the
server agreement (sometimes referred to as interrater or target behavior responds to those changes, researchers
interobserver reliability). To determine interobserver can make claims as to the extent to which the interven-
agreement, two independent observers record the same tion causes changes in student outcomes. It is this causal
student behaviors (e.g., hand raising) or score the same relationship between the use of a practice and changes
products (e.g., students’ spelling performance). A calcu- in student performance or behavior that is necessary for
lation is then made as to the extent to which the two determining evidence-based practices.
observers agreed that a behavior occurred or a student’s There are several different single-subject designs that
performance was correct or incorrect. Agreements are may be used to evaluate whether the intervention causes
then typically expressed as a percentage (e.g., 90%). changes in the target behavior. One of the common fea-
Many single-subject studies use some form of direct tures of most designs is that they use at least two condi-
observation of the target behaviors. Direct observation tions, a baseline and an intervention. Baseline data are
of student performance can occur in domains such as collected in the same manner across several different
academic skill areas (e.g., reading, writing, math), peer sessions and describe how the target behavior occurs
interactions (e.g., social skills, cooperation, peer tutor- without the intervention in place, similar to a pretest
ing), and behavioral skills (e.g., self-regulation, on-task measure. Once baseline levels of the target behavior are
behavior, disruptive behavior). Researchers strive to established, most single-subject designs then require an
define target behaviors in measurable terms that can be active intervention condition in which the educational
reliably observed and recorded. Clear behavioral or practice is implemented over time and multiple mea-
operational definitions of the target behavior help to surements of the target behavior continue. Comparison
promote replicability of the study, interobserver reliabil- of an individual’s performance of the target behavior
ity, and therefore the overall trustworthiness of the during baseline to his or her performance during the
research. An operational definition provides enough intervention condition determines the effectiveness of
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
86 Intervention in School and Clinic
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
Tankersley et al. / Using Single-Subject Research 87
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
88 Intervention in School and Clinic
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
Tankersley et al. / Using Single-Subject Research 89
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010
90 Intervention in School and Clinic
Cook, L., Cook, B. G., Landrum, T. L., & Tankersley, M. (2008). Kazdin, A. E. (1982). Single-case research designs: Methods for
Examining the role of group experimental research in establish- clinical and applied settings. New York: Oxford University Press.
ing evidence-based practices. Intervention in School and Clinic, Kazdin, A. E. (1992). Research design in clinical psychology (2nd
44(2), 76–82. ed.). Boston: Allyn & Bacon.
Dettmer, S., Simpson, R. L., Myles, B. S., & Ganz, J. (2000). The Stormont, M. A., Smith, S. C., & Lewis, T. J. (2007). Teacher imple-
use of visual supports to facilitate transitions of students with mentation of precorrection and praise statements in Head Start
autism. Focus on Autism and Other Developmental Disabilities, classrooms as a component of a program-wide system of posi-
15, 163–169. tive behavior support. Journal of Behavioral Education, 16,
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & 280–290.
Wolery, M. (2005). The use of single-subject research to identify Tawney, J. W., & Gast, D. L. (1984). Single subject research in
evidence-based practice in special education. Exceptional special education. Columbus, OH: Merrill.
Children, 71, 165–179.
Kazdin, A. E. (1978). History of behavior modification: Experimental
foundations of contemporary research. Baltimore: University Park
Press.
Downloaded from http://isc.sagepub.com at ESC NAL D EST PROFESS-ACATLAN on March 18, 2010