Professional Documents
Culture Documents
March 2007
Assessing Student Learning
in General Education
Linda Suskie, Executive Associate Director
Middle States Commission on Higher Education
3624 Market Street, Philadelphia PA 19104
Web: www.msche.org Email: LSuskie@msche.org
© Linda Suskie, MSCHE
Today…
1. Laying a foundation for Gen Ed assessment
Ø Engaging faculty
Ø Getting organized
2. Identifying and articulating Gen Ed learning goals
3. Aligning Gen Ed goals & curricula
4. The assessment tool box
© Linda Suskie, MSCHE
What is Assessment
of Student Learning?
l Deciding what we
want our students to
learn
l Making sure they
learn it!
Jane Wolfson, Director, Environmental Science
& Studies Program, Towson University
© Linda Suskie, MSCHE
The TeachingLearningAssessment
Cycle
Learning Goals
Using Learning
Results Opportunities
© Linda Suskie, MSCHE
Assessment
1. Laying a Foundation for
Assessment Success
© Linda Suskie, MSCHE
Why is it so hard to assess
General Education?
l Unclear definitions of Gen Ed & its components
l Lack of ownership
l Lack of concern & engagement
l Lack of coordination
l Some Gen Ed curricula are ineffective
l Outdated
l Politically driven
l Little interest in improving Gen Ed
l Time consuming to assess & improve
© Linda Suskie, MSCHE
Five Stages of Assessment
(from Elisabeth KublerRoss)
1. Denial
2. Anger or resentment
3. Bargaining
4. Depression
5. Acceptance
6. [Panic!!!]
© Linda Suskie, MSCHE
Why might faculty and institutional
leaders not engage with assessment?
© Linda Suskie, MSCHE
Two Major Barriers
1. Lack of understanding of the value &
importance of assessment
2. Lack of resources to engage in assessment
• Marilee Bresciani
© Linda Suskie, MSCHE
What’s the big deal with
assessment?
Why aren’t grades
good enough?
© Linda Suskie, MSCHE
Students who pass my course
should know how to…
1.
2.
3.
4.
5.
6.
© Linda Suskie, MSCHE
1. Tests, assignments, and grades
often don’t match goals.
l Would your colleagues have come up with the
same list?
l Would your students have come up with the
same list?
© Linda Suskie, MSCHE
Tests, assignments, and grades often...
2. Don’t focus on thinking skills
3. Poor quality
4. (Grades) Reflect things other than student
learning
5. Not used to improve things
© Linda Suskie, MSCHE
Getting Faculty “On Board”
l Professional development
l Grants/stipends to get started
l Value efforts to improve teaching
l Scholarship of teaching
l Value assessment efforts
l Written letters of thanks
l Pay attention to results and use them to make
improvements!
© Linda Suskie, MSCHE
More Ideas
l Help faculty find time.
l Help faculty stop doing something else.
l Help them see that assessment is not an “add on.”
l Provide clear guidelines.
l Set priorities.
l Provide support & resources.
l Minimize paperwork.
l Provide feedback.
© Linda Suskie, MSCHE
Keep your sanity!
l Recognize that some important goals can’t
be assessed.
l Realistic expectations for quality
l Don’t expect to get everyone on board.
© Linda Suskie, MSCHE
What about academic freedom?
l Teachers are entitled to freedom in the
classroom in discussing their subject.
l AAUP 1940 Statement of Principles on Academic
Freedom & Tenure
l Excellence in student learning can be
demanded without telling a faculty member
how to achieve or how to evaluate it. Such a
demand is not a violation of academic freedom.
l Marilee Bresciani
© Linda Suskie, MSCHE
What about adjuncts?
l Provide common core materials
l Core syllabi
l Core learning goals
l Core assignments/tests
l Require assessment participation in contract
l Invite to professional development
l Coordinators for adjunctheavy courses/programs
l Appoint faculty mentors (with stipend)
© Linda Suskie, MSCHE
Time to Think and Talk!
© Linda Suskie, MSCHE
Getting Organized
l Identify someone to coordinate/shepherd Gen
Ed assessment.
l Identify faculty committee to set Gen Ed
assessment policies & monitor/review efforts.
l Invite faculty teaching Gen Ed courses to
participate in discussions.
© Linda Suskie, MSCHE
2. Articulating Assessable
Learning Goals
l Learning objectives
l Learning
competencies
l Learning outcomes
© Linda Suskie, MSCHE
What should all students
be learning at your institution?
Why?
© Linda Suskie, MSCHE
Middle States Standard 12:
General Education
l The institution’s curricula are designed so that
students acquire and demonstrate collegelevel
proficiency in general education and essential
skills, including
l Written communication
l Oral communication
l Scientific reasoning
l Quantitative reasoning
l Technological competence
l Critical analysis & reasoning
© Linda Suskie, MSCHE
Middle States Standard 11:
Educational Offerings
l [Foster] information literacy and technological skills
across the curriculum.
l What is information literacy?
l Recognize the need for information.
l Identify what information is needed.
l Find that information efficiently and effectively.
l Evaluate information critically for relevance &
credibility.
l Use information to solve a problem or answer a
question.
l Use information legally & ethically.
© Linda Suskie, MSCHE
Other External Sources of
Potential General Education Goals
l League for Innovation Learning Outcomes
l Equipped for the Future
l Greater Expectations
l Teaching Goals Inventory
l National Resource Center for the First Year
Experience & Students in Transition
(www.sc.edu/fye)
© Linda Suskie, MSCHE
Internal Sources of
Potential General Education Goals
l Mission statement & strategic goals
l Syllabi of current Gen Ed courses
l Transcript analysis
l What Gen Ed courses do most students take?
l When?
l In what sequence?
l Ask faculty to meet and brainstorm common
goals across courses
© Linda Suskie, MSCHE
Why are you here?
l What do you need to learn in this session?
l Why?
l What do you want to be prepared to do when
you get “back home”?
l How do you want to use what you’ll learn “back
home”?
© Linda Suskie, MSCHE
What is a good learning goal?
l Outcomes – what graduates should be able to do
l Observable –what graduates should be able to DO
l Action words
l Understand
l Clear – no fuzzy terms
l Demonstrate (how?), critical thinking, communication
skills
l Skills and/or attitudes/values
l Important meet student/employer needs
© Linda Suskie, MSCHE
More Examples of Learning Goals
l Demonstrate effective communication skills
across disciplines.
l Demonstrate understanding of other cultures.
l Demonstrate ability to work effectively with
computer components.
© Linda Suskie, MSCHE
Learning Goals as a Continuum
Too Too
Just Right!
Specific Broad
© Linda Suskie, MSCHE
Time to Think!
n Why do many colleges have a General
Education requirement in the social sciences?
n Why is it a good idea for college students to
study the social sciences?
n How should our students be different 510
years from now, because they completed this
requirement?
n Draft three learning goals for a General
Education requirement in the social sciences.
© Linda Suskie, MSCHE
Time to Practice!
1. Draft at least one learning outcome for your
General Education curriculum.
2. Trade papers with someone else; critique &
edit the other person’s goals.
l Clear? No fuzzy words?
l Observable? Action words?
l Outcomes?
l Important? Lasting?
3. If you need help, ask me!
© Linda Suskie, MSCHE
Prioritizing and Achieving
Consensus on Learning Outcomes
l Ask faculty to “vote.”
l Write goals on flip chart paper.
l Maybe group similar goals together.
l Vote with dot stickers.
© Linda Suskie, MSCHE
3. Aligning Goals & Curricula
l Do you want to develop a new General
Education curriculum?
l Or keep and tinker with the one you have?
© Linda Suskie, MSCHE
Analyzing Your Current General
Education Curriculum
l Grid of Gen Ed goals x courses
l Look for underrepresented and “overkilled” Gen Ed
goals.
l Transcript analysis
l What courses do students usually take to fulfill Gen
Ed requirements?
l Are students achieving a Gen Ed goal through
courses in their majors?
l Syllabus analysis
l Do students have enough classwork & assignments
to achieve this goal?
© Linda Suskie, MSCHE
Consider Modifying Syllabi
l State relevant General Education goals.
l Grid of General Education goals x assignments
l Reapprove all General Education courses
regularly (every five years?).
l Check that classwork and assignments address
relevant General Education Goals.
© Linda Suskie, MSCHE
4. The Assessment Toolbox
© Linda Suskie, MSCHE
What is “Good” Assessment?
Used Reasonably
accurate &
truthful results
Cost Valued
effective
Clear &
important
goals
© Linda Suskie, MSCHE
Build on Existing Learning
Experiences and Assessments
l Focus on only the most popular Gen Ed courses?
l Ask faculty how students achieve your goals.
l Homework/classwork (e.g., lab reports)
l Endofcourse papers, projects, performances,
presentations
l Final exams in Gen Ed courses
l “Capstone” experiences
l Field experience evaluations
l Surveys
l Create grid of Gen Ed goals x existing
assessments?
© Linda Suskie, MSCHE
Create New/Improved Tools
As Needed
l Coursespecific assessment
l All sections of each course have common
assessment approaches.
AND/OR
l Multicourse assessment
l All courses with common goals have common
assessment approaches.
AND/OR
l Institutionwide assessment
l Published tests & surveys
l Portfolios
l Capstone experiences
© Linda Suskie, MSCHE
Useful and Not Too Much Work
l Rubric (rating scales/grading criteria) to
assess papers, projects, performances,
presentations, portfolios
l Set of questions on final exams
l Identical on all exams in multiple courses
l Identical on all exams in one course
© Linda Suskie, MSCHE
Assessing Values & Attitudes
l Reflective writing
l If you met two alumni…
l One had achieved your goal; the other hadn’t.
l How would you tell them apart?
l Proxy measures
l As the twig is bent, so grows the tree.
l Do students now show signs of the dispositions we
hope to instill?
l Some goals aren’t assessable.
l Some goals aren’t teachable.
© Linda Suskie, MSCHE
Useful But More Time & Work
l Portfolios
l Locally developed tests
l Locally developed surveys
l Interviews & focus groups
© Linda Suskie, MSCHE
Published Tests?
l Published Tests l Local Assessments
l Out of the ivory tower l Your learning goals don’t
l See growth over time match test goals.
l Sometimes... l Your curriculum doesn’t
l Breadth of
match test content.
coverage l Good (validated)
l Good quality
instruments aren’t
questions available.
l Motivating students to
l Evidence of validity
and reliability take a published test and
give it their best effort
l Identify strengths
l Published instruments
and weaknesses
don’t yield diagnostic
information.
© Linda Suskie, MSCHE
Published Tests May Have Value
If and Only If
l They match our learning outcomes.
l They yield useful information.
l We give students compelling incentives.
l There is sound evidence of their quality (validity).
l They are part of a multiple measures approach.
© Linda Suskie, MSCHE
Time to Think Again!
© Linda Suskie, MSCHE
Volunteer for
Middle States Evaluation Teams!
l Go to our web site (www.msche.org)
l Click on “Evaluators.”
l Click on “How to Become an Evaluator.”
l Download the “Evaluator Biographical Data Form.”
l Complete it and send it to us with your resume.
© Linda Suskie, MSCHE
Time to Reflect!
© Linda Suskie, MSCHE