Professional Documents
Culture Documents
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at .
http://www.jstor.org/page/info/about/policies/terms.jsp
.
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact support@jstor.org.
Taylor & Francis, Ltd. is collaborating with JSTOR to digitize, preserve and extend access to College
Teaching.
http://www.jstor.org
OF TEACHING
OF THEOBSERVERAND THEOBSERVED
PERCEPTIONS
Gary F. Kohut, Charles Burnap, and Maria G. Yon
teaching. Although observers feel more stress about Although faculty are largely internally
motivated and become more self-refer
peer observations than observ?es, both groups experi enced in their careers (Maehr and
ence minimal stress in participating in observations. Braskamp 1994), they still need the sup
port and feedback of their colleagues to
Both groups also believe that peer observation reports
develop as scholars. Only collectively do
are valid and useful. faculty have the experience and standards
that are both credible and useful to indi
vidual faculty. Thus, peer evaluation needs
is considered tobe of primary pointment, promotion, tenure, and com
Teaching to be an essential element in any faculty
importance at many institutions of pensation (Cross 1986). Despite the claim evaluation system. Palmer (1997) argues
higher education, and it is therefore a that faculty evaluation also contributes to
that professionals need shared practice and
element of evaluation. Yet improved teaching, little evidence exists to
major faculty an honest in the
dialogue among people
the evaluation of teaching effectiveness is support this contention (Cross 1986; Glas As Centra
profession. argued,
wrought with controversy. For decades, sick,Huber, andMaeroff 1997; Pew High
Unless faculty members are to
evaluation has been conducted er Education Program 1989). Even with willing
faculty to stu
leave the evaluation of
largely to make judgments about reap the substantial body of literature on the teaching
dents, who possess only a limited view, or
evaluation of teaching, there appears to be
to administrators, who often don't have
Gary F. Kohut is a professor in theDepartment of little agreement on how to define and mea the time or necessary then
background,
at the University ofNorth Carolina at to invest their time in
Management sure effective teaching in colleges and uni they must be willing
Charlotte. Charles Burnap is an associate professor believe that efforts in peer evaluation of teaching.
versities. Indeed, many faculty
of mathematics at UNC Charlotte. Maria G. Yon is (1986, 1)
an at UNC
it is far easier to evaluate the quality of
associate professor of education
Charlotte. research than of teaching associated with Evidence of effective teaching is essen
Copyright ? 2007 Heldref Publications research because of the established public tial to a faculty member's promotion and
Vol. 55/No. 1 19
Ory (1994), and Edgerton (1993) have teaching, it is critical that the peer obser on research at the university: UNC Char
observed, teachers have little experience vation process be valid and reliable. Thus, lotte has been reclassified as a Research
collecting and presenting evidence about the processes of observation and evalua II educational institutionby theCarnegie
their teaching. To present a
comprehen tion require a very high degree of profes Foundation and now offers nine doctoral
sive picture, the teaching section of the sional ethics and objectivity, and training programs in addition to baccalaureate and
portfolio usually includes several "arti in observational and analytical skills. master's programs in its seven colleges.
facts of teaching" (Edgerton, Hutchings, The literatureavailable is helpful as a The growth and reclassification of the
and Quinlan 1991, 9). These artifactsmay source of recommendations for develop university have placed
new demands on
work, and student course evaluations. 2002). Suggestions include involving gral part of the evaluation of untenured
Additional evidence of teaching effective multiple observers; having multiple class faculty in theUNC system. In 1994, the
ness may include a statement of one's room visits; offeringextensive trainingfor North Carolina General Assembly
teaching philosophy and narratives that observers; following professional ethical required that classroom observations of
faculty than evaluations of teaching or ser about how those faculty members most UNC Charlotte, each college or depart
vice. Kremer (1990) reported that evalua intimately involved in peer observation ment was given the freedom to develop
tionsof teaching had lower reliabilitywhen perceive the process?the observers and its own peer observation process within
said were less confident those members who are a set of broad guide These
colleagues they faculty required guidelines.
about the basis for the evaluation. Many to be observed. This study follows an ear lines generally require a pre-observation
scholars have insisted that certain aspects lier examination of theperceptions of peer meeting,
a classroom observation, and a
of teaching can assessed
be only by class reviewers?deans, chairs, and peer review post-observation meeting. The process
room observation (Hart 1987) or analysis committee members?who are involved itself requires exchange and feedback
of videotapes (Perlberg 1983; Smith, inhigh-stakes decision making (Yon, Bur between observer and observ?e.
Hausken, Kovacevich, andMcGuire 1988). nap, and Kohut 2002). In this article, we We developed two surveys for this
However, peer observation usually examine the attitudes of the individuals study. One was mailed to every untenured
involves faculty peers that review an who were observed and those who con or newly tenured facultymember whose
instructor's class ducted classroom observations. classroom was observed as part of the pro
performance through
room observation as well as examination of The main goals of this study were to motion and tenure; this group included
instructional materials and course design. compare the perceptions of observers and 163 individuals and, for brevity,will be
Observations of classroom behavior are those observed regarding the process of referred to as observ?es. The second sur
intendedfor reviewing the teachingprocess peer observation, the reporting of peer vey was sent to all 343 tenured faculty
and its possible relationship to learning. observations, the usefulness of peer obser members who may have conducted peer
The focus is generally on verbal and non vation as an evaluation tool, and whether observations and will be referred to as
verbal behaviors of both the instructorand eithergroup feels thattheprocess improves observers. The surveys were similar, but
the students in the classroom. teaching effectiveness. When combined not identical. In particular, untenured fac
While peer observation of teaching is with our earlier data, we
compared the ulty
were asked about the usefulness of
common in the British higher education importance that Reappointment/Promo documents occasionally included in an
system as a means of enhancing the qual tion/Tenure (RPT) committees (including individual's teaching portfolio; these
ity of teaching and learning (Fullerton administrators) and those observed place questions
were not appropriate for tenured
1999; Wankat and Oreovicz 1993), peer on peer observation reports as well as other faculty members who were conducting
observation in theUnited States has not documents or artifacts that may be present peer observations. The results will be
enjoyed such prominence. As Hutchings ed as evidence of effective teaching. reported and compared with RPT commit
(1996) observed, however, there is now a tee opinions in a later study.
growing body of practice related to the Method In this study, survey data was used to
20 COLLEGE TEACHING
Engineering 6 7.5
Additional objectives sought to under Information Technology 3 3.8
stand whether observers: Nursing and Health 5 6.3
Missing 3 3.8
Tend to be more comfortable making
Total 80 =100.0
constructive rather than critical com
plays a role in RPT decisions, we asked In each survey, we asked several ques series of statements. Responses
were
both tenured observers and untenured tions about the process employed in coded on a
five-point scale, with 1 repre
observ?es to rate the importance of teach classroom observation. For and 5 represent
example, senting strong agreement
ing, research, and service inmaking such each group was asked about the type of ing strong disagreement. The observ?es
decisions. were coded on a instrument used in its academic unit. As were asked to agree or with the
Responses disagree
five-point scale ranging from 1 (very the results indicate in table 2, both statements using the same scale.
important) to 5 (not important).Not sur observers and observ?es reported that the Findings reported in table 3 suggest
prisingly, results indicate that both written narrative = 60.5 that observers have a broad of feel
(observer per range
= trained to engage in
observers and observ?es regard research cent; observ?e 52.1 percent) was the ings about being
=
as most
important (observer mean 1.33; predominant instrument employed in classroom observations. While many feel
observ?e mean = their academic units, followed by check that theywere adequately trained, roughly
1.37), followed by
= 2.46; observ?e
teaching (observer mean lists and narratives (for observers) and an equal number report the opposite senti
Vol. 55/No. 1 21
22 COLLEGE TEACHING
small, a Mest
atively paired-sample gives
TABLE 5. Usefulness of Peer Observation Reports a two-tailed significance of 0.071 to this
difference. (With 93 percent confidence,
Observers (Mean) Observ?es (Mean) this difference is statistically significant.)
ble 1998; Millis 1987; Morehead and asked if suggestions for improvement or demands for teaching evaluation have
Shedd 1997). This process is unavoidably alternate teaching methods were given. emerged: public demand for greater
summative in nature. That is, classroom Approximately three-quarters of respon accountability in higher education, a
= interest in the
observation was used in making person dents (observers 77.2 percent; resurgence of national
nel decisions. We were interested in observ?es = 72.9 percent) indicated that improvement of undergraduate educa
tive aspect. Formative evaluation is who reported that suggestions were given ation fairer, more accurate, and factored
designed to improve teaching perfor were then asked how these suggestions into collegiate reward structures.
mance. To this end, our survey included were made. With respect to observers, 21 Findings in this investigation are
several questions to investigate if the peer percent indicated that comments were grouped under three areas: the peer obser
Vol. 55/No. 1 23
observ?es reported that they valued the observers, and peer reviewers, and this stitutes excellent teaching and how to
peer observation process and the pre- and should exist in some systematic way measure it.
and Orsmond (2004), Manning (1986), and tation of effective teaching is viewed as Beaty, L. 1998. The professional development
of teachers in higher education: Structures,
Hogston (1995) all point to the benefits of encompassing a wide range of activities methods, and responsibilities. Innovations
trainingobservers. Faculty who are trained that contribute to the quality of teaching in Education and Training International 35
in observation techniques
or have experi and learning in an educational institution. (2): 99-107.
ence in observing and offeringfeedback to With no universal set of agreed-upon Bell, M. 2002. Peer observation of teaching in
Australia. Paper for LTSN Generic Centre,
faculty generally are more competent activities, one goal of a peer observation
http://www.heacademy.ac.uk/resources.asp
(Centra 1993, 1975) and may become process should be to develop a clear
?process=full_record§ion=generic&id
more accurate observers of their colleagues understanding of what is required to doc =28/ (accessed January 9, 2005).
andmore insightfulof theirown abilities as ument achievements. In this study, both Bernstein, D., and R. Edwards. 2001. We need
teachers (Keig andWaggoner 1994). How observers and observ?es noted that con objective, rigorous peer review of teaching.
Chronicle ofHigher Education 47 (17): B24.
ever, such training is not often provided ducting or participating in peer observa
Bernstein, D. J., J. Jonson, and K. Smith.
because of the lack of institutionalsupport, tion was not very stressful, and both 2000. An examination of the implementa
faculty time, and interest. Furthermore, groups noted that their own teaching tion of peer review of teaching. In Evaluat
observ?es may not know whether faculty improved as a result of theirparticipation ing teaching in higher education: A vision
members have been trained. in the process. Perhaps clear communica for the future, ed. K. E. Ryan, 73-86. San
Francisco:
It is likely that the peer observation tion and expectations as well as participa Jossey-Bass.
Braskamp, L. A., and J. C. Ory. 1994. Assess
process will influence how teaching is tion from the outset ameliorated the
ingfaculty work: Enhancing individual and
regarded in personnel decisions. Trust effects of stress and helped participants institutional performance. San Francisco:
and credibility, as Braskamp and Ory see the value of observation. Jossey-Bass.
24 COLLEGE TEACHING
Assessing what professors do: An introduc motivation factor: A theory of personal Learning, Seton Hall University.
tion to academic performance appraisal in investment. San Francisco: New Lexington Richlin, L., and B. Manning. 1996. Using
higher education. Westport, CT: Green Press. portfolios to document teaching excellence.
wood Press. Magin, D. J. 1998. Rewarding good teaching: In Honoring exemplary teaching: New
Edgerton, R. 1993. The re-examination of fac A matter of demonstrated proficiency or directions for teaching and learning, no.
ulty priorities. Change 25 (4): 10-25. documented achievement? International 65, ed. M. D. Svinicki and R. J. Menges.
Edgerton, R., P. Hutchings, and K. Quinlan. Journal of Academic Development San Francisco: Jossey-Bass.
1991. The teaching portfolio: Capturing the 3:124-35. Rinehart, G 1993. Quality education. Mil
scholarship of teaching. Washington, DC: Manning, R. F 1986. Evaluation strategies waukee: ASOQC Quality Press.
American Association for Higher Education. can be improved with peer observation. Seldin, P. 1984. Changing practices infaculty
French-Lazovik, G. 1981. Peer review: Docu School Administrator 43 (1): 14. evaluation. San Francisco: Jossey-Bass.
mentary evidence in the evaluation of Martin, G, and J. Double. 1998. Developing Smith, P., C. Hausken, H. Kovacevich, and M.
teaching. In Handbook of teacher evalua higher education teaching skills through McGuire. 1988. Alternatives for developing
tion, ed. J.Mi liman, 73-89. Newbury Park, peer observation and collaborative reflec teacher effectiveness. Seattle: School of
CA: Sage. tion. Innovations in Education and Training Education, Seattle Pacific University.
Fullerton, H. 1999. Observation of teaching. In International 35 (2): 161-69. Travis, J. E. 1997. Models
for improving col
in Mento, A. J., and A. Giampetro-Meyer. 2000. A faculty resource. AS HE
A handbook for teaching and learning lege teaching:
higher education, ed. H. Fry, S. Ketteridge, Peer observation of teaching as a true devel ERIC Higher Education Report, no. 6. Eric
and S. Marshall, 226-41. London: Kogan opmental opportunity. College Teaching 48 Document Reproduction Service No.
Vol. 55/No. 1 25