Professional Documents
Culture Documents
SCIENCES CURRICULA:
PRINCIPLES AND PROCESS
Only workbook for HSE 3704
Study Unit 7
Page 1
OVERVIEW ................................................................................................... 3
7.1
Introduction ................................................................................................... 4
7.2
Definitions ..................................................................................................... 6
7.2.4
A comprehensive definition..................................................................... 9
7.3
7.4
7.5
7.6
7.6.1 Evaluating the mission of the educational institution and the curriculum
outcomes .......................................................................................................... 16
7.6.2
7.6.3
7.7
Conclusion .................................................................................................. 30
7.8
Page 2
Week
14 - 15
16 hours
OVERVIEW
In the previous study units you learnt what a curriculum is and how a curriculum is
developed. In study units 2 and 3 we explained that curriculum evaluation is part and
parcel of the curriculum development process. You already learnt how to conduct a
situation analysis and use the obtained data and information to make informed
decisions during the stage of curriculum design. You also learnt what designing a
curriculum entails.
The content of this study unit builds upon the knowledge you gained in the first and
second levels of the Health Sciences Education course. You are now required to
revisit and apply all your previously gained knowledge to curriculum evaluation.
Specific outcomes:
After you have worked through this study unit you will be able to discuss curriculum
evaluation, based on your ability to
define curriculum evaluation
HSE 3704 Curriculum Development workbookCreated by: Dr JC (Irene) Lubbe
Page 3
The reading that you need to do for this study unit is not restricted to the prescribed
or suggested reading material. You need to scan the Worldwide Web for other
appropriate material such as video-clips, articles, e-books or journal articles, etc. to
contribute to your knowledge-base. You might want to start with Chapter 28 in
Billings and Halstead (2012:503-549). Focus on the sections on programme
evaluation theories and the programme evaluation plan in Billings and Halstead
(2012:506) for background knowledge. (We will come back to this at a later stage.)
**Note that the authors use the term programme evaluation'', while we use the term
curriculum evaluation''.
7.1
Introduction
We all know that evaluation is important, because most often: what get measured
gets produced. Therefore, our curriculums should not be any different.
Activity 7.1: If you think of the module(s) you are currently teaching (or hope to
teach one day), what would evaluation of that module entails? In your own words,
just write down a few aspects or concepts that you think should be evaluated.
Content, data collected, Validity, standards, criteria, relevance
Would it differ from evaluation of the entire curriculum or programme? Why / Why
not?
No it will not differ because the whole curriculum would be evaluated based on the same
standards. Meaning the whole curriculum would be evaluated using the same framework.
Activity 7.2: Before you move to the other readings of this study unit, please watch
Ctrl
click
Page 4
Development (Warning: It is an hour long, so get the popcorn and kick out the
shoes!)
Jot down the major issues and concepts that Kiely touched upon.
Documentation
Curriculum evaluation
Accountability
Motivation
Autonomy
Mentoring
Teacher professionalism types
Change
Reflect on why documentation and understanding seems to be so important in
curriculum evaluation and what does it entail?
Documentation is where all observations, research data and statistics will be kept.
When we do evaluations not only do we rely on physical observations, but also on
what has been used before, what has been observed, what did not work and where it
went wrong. We rely on documentation to be able to make recommendation,
whether is for changing or leaving everything as it is. Understanding will ensure that
one knows what to do and they that they will be able to apply knowledge to make
execute correct decisions.
Make a K-W-L summary of the video. Thus, what you:
o Already KNEW (K),
o WANTED to know (W), and
o have LEARNED (L) about the topic.
You will use this in your discussion on myUnisa.
K
Classroom observation
W
Links
between
data, Accountability
is
evaluation Evaluation
implemented
Evaluation
support
strategies
Teacher research
documentation
make
Mentorship
must
is
set
of
Remote stakeholders
of Purpose
of
program
evaluation
Page 5
But before we drift off to responsibilities and accountabilities, lets first take a proper
look at exactly what curriculum evaluation is how will you define it?
Accountability is taking ownership of ones actions and the consequences thereof.
Taking full responsibility of ones actions or lack thereof.
7.2
Ctrl
click
Definitions
Page 6
Does this not remind you of some of the basic steps of the nursing process?
Anyway, lets get back to our definitions. Lets take a look at the various types of
definitions.
Page 7
a process for finding out how far the learning experiences are
developed and organised,and actually produced the desired results.
These definitions make it clear that curriculum evaluation is concerned with judging
the character, quality and effectiveness of a curriculum.
Page 8
Improvement: evidence-based.
Activity 7.3: Now, use these words (you may add more) to draw in MindMeister
your own diagram or mind map to compile a comprehensive definition. Paste it in the
space below and upload it to your e-portfolio.
https://www.mindmeister.com/528367844
Page 9
Billings and Halstead (2012:503) provide a comprehensive definition. Note that the
authors use the term program evaluation''.
The definitions also indicate that the curriculum evaluation results (evidence) are
used to judge:
the worth of the existing curriculum based on appropriate and relevant data
its implementation
its effectiveness, namely whether it has produced the desired results.
The definitions also tell us that the curriculum evaluation results enable the
curriculum committee to make informed (evidence-based) decisions on which
corrective measures are required to improve the existing curriculum.
Quickly go back to the previous two mind-maps you have created on curriculum
evaluation. Did it include all these important aspects? Most probably not and that is
OK. As we progress, our initial definition(s) will change and evolve. The important
fact however, is that we do not stay stuck on an initial idea or definition and refuses
to adapt and elaborate. Please re-work your mind-map and paste it in the space
below.
Page 10
7.3
Planning forms the solid foundation of most of our professional activities. Curriculum
evaluation is no different. Uys and Gwele (2005:102) list a few crucial questions that
we need to ask while planning the evaluation.
Why are we doing it?
What is the purpose of the evaluation or review?
What should be evaluated?
HSE 3704 Curriculum Development workbookCreated by: Dr JC (Irene) Lubbe
Page 11
Once we know what needs to be evaluated and who will conduct the evaluation, we
need to compile a formal plan on the how and the when of the evaluation.
7.4
Why are
we doing
it?
Page 12
review the entry behavior requirements for admission into the course
identify:
o How an Intended Curriculum is enacted
o How it becomes operational
o The factors which may affect it and result in unintended effect.
Activity 7.4: Now try to write your own comprehensive purpose statement in one or
two sentences. To determine if planned actions executed produced the desired result
efficiently and to make decisions that will lead to improvement of programme and
effectiveness thereof.
7.5
Most of the curriculum evaluations consist of the same generic steps. Uys and
Gwele (2005:102) list them as:
defining the standards
investigating the performance or data collection
synthesizing the results
formulating recommendations
feeding recommendations and lessons learned back into the programme.
Page 13
Activity 7.5: Take the 5 steps, draw a diagram (also known as a mind map) and add
the most important activities or concepts to the diagram. Paste it in the area below.
Attach this final mind map in the myUnisa discussion area created for it.
Evaluate at least 2 other students mind maps and write an educational,
evaluative response to it (also on myUnisa).
Page 14
Copy and paste the two responses on your mind map here:
Response 1: ____________________
Response 2: ____________________
7.6
What should
be
evaluated?
Curriculum evaluation entails scrutinising the official curriculum and its foundations,
andinvestigating whether the operational curriculum is congruent with the official
curriculum.
Operational curriculum:
Official curriculum:
Activity 7.6: A little bit of revision: Return to study unit 1 and enter the definitions in
the blocks above. Is it clear why these should align? Yes
Very often the worth of a curriculum is judged by determining the competencies ofits
graduates, and how satisfied the employer and health care consumer are with these
graduates' services. Specific methods are employed to investigate each of the focus
areas.Billings and Halstead (2012) comprehensively covers curriculum evaluation in
Chapter 28.
The following table serves as a structure according to which you could summarise
the focus areas which we specify in sections 7.6.1 - 7.6.11.
HSE 3704 Curriculum Development workbookCreated by: Dr JC (Irene) Lubbe
Page 15
Structure
Explanation
Identify the
focus area
The process starts with an in-depth look at the philosophical underpinnings and
outcomes of the module or program. Firstly one needs to identify and determine the:
Page 16
Mission
Philosophy
Program goals
Mission of the
University / NEI
Outcomes
When deciding whether the mission of the nursing department/school is aligned with
the mission of the university/institution, you will need to look for similar key-phrases.
Do you think that the students are also part of the stakeholders? Yes students are
part of the stake holders because they are products of the programme. If so, add
them to the stakeholder block where they belong. You can consult Uys and Gwele
(2005:99). (It is a free e-book.)
The lecturers form an important part of the stakeholders and it is essential that they
also have consensus amongst themselves regarding the mission and philosophy of
the NEI. A modified Delphi-technique might be useful here.
Structure
Explanation
Explanation
intentions of the institution
Narrative statement of beliefs or values
Outcomes
Examples:
questionnaires
surveys
advisory committees
Page 17
forums
Data collection:
outcomes
job placement
rates
program
satisfaction
licensure and
certification
pass rates
Criteria for data
interpretation:
mission and
governance
mission and goals
reviewed
periodically in a
defined process
communities of
interest have input
into program
process and
decision making
debates
Data collection strategies:
Questionnaires
surveys
internet
brochures
catalogues
Structure
area: Data required:
Skills
of
of
Methods of enquiry
Ways of knowing
Data sources:
mission
outcome
statements
Explanation
Explanation
What students will be able to do after
completion
Blooms taxonomy
Blooms taxonomy
Examples:
goals
Objectives of programmes
competencies of learners
Page 18
philosophy
organisation
congruency
values
vertical/horizontal organisation
linear congruency
Data collection:
objectives
subject matter
learning activities
outcomes
link between
objectives and
mission
Criteria for data
interpretation:
Placement of
major concepts in
flowing conceptual
framework
Entry level skills
required to
progress
sequentially
Representation
matching
competencies to
courses and
learning objectives
Structure
Explanation
Explanation
To evaluate student performance
Examples:
Lesson plans
Technical
textbooks
assignment
Page 19
Data collection:
Qualitative
assessments
Assessment
methods
Teaching
strategies
Assessment of
student learning
Structure
Trends in health
institution
care
Focus
Explanation
Explanation
Methods of recruitment need attention
Admission policies should be clear
Data sources:
Demographic
profiles
Academic profiles
Examples:
Marketing materials
Aptitude tests
Discipline specific tests
Essays
Data collection:
Standardized tests
Page 20
essays
assignments
annual review
surveys
interviews
reasons why student leave course
Structure
philosophy
and
Data sources:
qualifications
outcomes of the profile of faculty
course material
program
expected
Explanation
Explanation
Educators must have more than minimum
requirements in qualifications
Educators must be educated enough in
their field of work
Examples:
masters
doctorates
degrees
Data collection:
Goals set
expectations
professional
development
research
Page 21
of scholarly
acitivities
professional development
Evaluation of faculty performance promotes
quality improvement
Aggregate faculty outcomes are consistent
with achievement of programs mission,
goals
The following aspects need consideration when evaluating the educator or faculty
dimension. These factors include:
The number of qualified faculty
Qualifications of faculty
Faculty development
Faculty scholarship
Evaluation of faculty performance
7.6.5.1
It is difficult to provide a specific number or ratio that will work in all institutions, as
many factors influence the number of educators that should be appointed. Some of
the major factors are the:
nature of the program;
expectations of the parent institution (if any); and
Requirements of accrediting bodies (such as SANC and CHE).
Activity 7.7: In the institution where you are currently employed, what is the
prescribed number of faculty members for your department? How was that number
calculated? You might need to consult the HoD (Head of Department), Campus
Manager or Principal for this answer.
I am currently not working in an education department, however in our hospital there is one
training and development consultant (head of training) and two clinical facilitators working
under training and development consultant, where they are both responsible each for half of
the hospital.
7.6.5.2
Qualifications of faculty
It is important that lecturers are appropriately qualified for their teaching role. The
rule of thumb is that the lecturer needs at have at least one qualification (degree)
Page 22
higher than the qualification she is teaching. The minimum formal qualification for a
lecturer facilitating or teaching an associate or baccalaureate nursing degree
program is a Masters degree in the appropriate field (Billings & Halstead, 2012:525530).
But, before you and all your colleagues register at your current institution where you
are employed: Billings and Halstead (2012:525) warns against a situation called
inbreeding, where all the faculty members acquired their qualifications at the same
institution. This is not a healthy situation as it does not allow for diversity in contexts
or openness to new ideas. We need to allow new blood and though-patterns into
our community of practice.
When you visit the South African Nursing Councils website (www.sanc.co.za), the
statistics on age distribution can be retrieved. The diagram below contains the age
distribution of professional registered nurses (PRN) in South Africa (including nurse
educators). Nearly half of the PRNs on the diagram is 50 years or older. That paints
a daunting picture for our profession.
HSE 3704 Curriculum Development workbookCreated by: Dr JC (Irene) Lubbe
Page 23
At the beginning of 2013, there were only 12 400 (out of a possible 129 015) PRN
with an additional qualification in nursing education on SANCs register. However,
not every PRN with a qualification in nursing education is in a teaching post.
Activity 7.8: Look at the faculty age distribution in the institution where you are
currently working. Make a pie-diagram and paste it in the space provided
below.Write one or 2 sentences to elaborate.
There are only few staff members with an education qualification in the institution I work in.
2.30%
<30 years
31-39 years
40-49 years
50-59 years
6.40%
Page 24
7.6.5.3
Faculty development
7.6.5.4
Faculty scholarship
7.6.5.5
Structure
Explanation
Focus area:
Data required:
Explanation
Page 25
Data sources:
Data collection:
Examples:
Structure
Explanation
Focus area:
Data required:
Data sources:
Data collection:
Explanation
Examples:
Page 26
Structure
Explanation
Focus area:
Data required:
Data sources:
Data collection:
Explanation
Examples:
Structure
Explanation
Focus area:
Data required:
Explanation
Page 27
Data sources:
Data collection:
Examples:
Structure
Explanation
Focus area:
Data required:
Data sources:
Data collection:
Explanation
Examples:
Page 28
7.6.11Outcome evaluation
Outcome evaluation is conducted to determine to what extent existing graduates
meet thehuman resources needs of the health care system and how competent the
graduates are incomparison to social expectations.
Study Billings and Halstead (2012:539) and summarise thissection according to the
structure provided in table 7.1.
Table 7.12: Outcomes evaluation
Focus area
Structure
Explanation
Focus area:
Data required:
Data sources:
Data collection:
Explanation
Examples:
Page 29
7.7
Conclusion
This concludes the module on the principles and process of curriculum development.
We trust that you enjoyed working through this challenging module. We anticipate
that you will now be able to participate in curriculum development activities and apply
what you have learnt to improve your teaching practices.
End that is (nearly) the end of this module! You deserve a good cup of coffee! Make
yourself one and please come back there is just ONE more thing left to do before
this module id done-and-dusted
7.8
As a faculty member, reflection should form part of our daily activities. I hope that
you make use of this in your own classes as well.
Reflective report: Please write a short reflective paragraph (minimum 200 words)
on how you have experienced these activities (study unit 1-7). Your reflection can be
positive or negative (as long as it is honest). You will be rewarded for your effort with
an additional 5 points added to the marks of your portfolio.
These activities were very challenging. They forced one to consult many sources in
order to complete them. The manner in which they were structured made in way that
resulted in me understanding most concepts better. All information one acquired
from first year finally made sense when applied top this module. The correlation of
the data acquired to this very practical module made it easier to understand why we
had to learn what we learned in the preceding module.
Page 30
HSE3704 would have been impossible to understand if the modules were not
structured in the manner in which they are now. Some activities I found to be straight
forward, which is very useful if one is eager to go forward with the rest of the work.
The activities were structured in a way that makes distance learning an enjoyable
experience. All those activities that required mind maps made understanding even
the most difficult concepts very easy. They compelled one to challenge own
technology skills in a very pleasant way. I think if more modules are structured this
way, not only will the students be able to name facts in exams and get high marks
like we always do because we memorize facts, but we will be challenged to know
how to apply the knowledge gained. The beginning was not as smooth as the end
when I finally understood what it was all about.
Page 31