2

Open Campus of the University of the West Indies

Course: EDID 6508_ Developing Instructional Media

Evaluation Report

Prepared for Dr. Leroy Hill

Course Coordinator

Student: Jane Pierre

 3

Table of Contents
Executive Summary................................................................................4
Overview .................................................................................................................. 4
Methods...................................................................................................................... 5
Key Findings..........................................................................................6
Conclusion................................................................................................................ 7
Response to evaluators comments............................................................................8
Recommendations ................................................................................9
Appendixes............................................................................................................... 10
Reference ...........................................................................................16
 4

EXECUTIVE SUMMARY

This report provides findings from the performance evaluation of the Group Three
Multimedia Project. Group Three members in alphabetical order are:
GLORIA BUTCHER
GENEVIEVE COX
JANE PIERRE
RUPATEE RAJKUMAR-SINGH
SEAN THOMAS
RACHEL WAGCLIFFE
The performance evaluation was conducted by two peers (hereafter called the Evaluators)
from the: EDID 6508_ Developing Instructional Media Programme.
Group Threes Multimedia Project consisted of a unit of lessons on the human respiratory system

aimed at enhancing student knowledge and understanding of the human respiratory system of

pupils in the upper primary level of schools in the Caribbean.

Overview of Multimedia Project

The Multimedia Project on the human respiratory system was created by the members of Group

Three (previously named) using Adobe Captivate 9 e-learning authoring programme. New

technologies are changing the way educators deliver learning objectives in the classroom. Adobe

Captivate 9 e-learning authoring tool is a desktop application available for both Mac and

Windows computers.
 5

Methods

To evaluate the Group Three Multimedia Project on the human respiratory system, the

Evaluators examined the performance and utility of the Multimedia Project through the

following peer evaluation rubric criteria:

Story Board or Planning Sheet

Organization of Content

Originality

Copyright and Documentation

Format and Platform Transferability

Subject Knowledge

Graphical Design

Mechanics

Screen Design

Use of enhancements

The peer evaluation rubric criteria had a minimum score of 1 and a maximum of 4

Please see Appendix A for the entire rubric

 6

Key Findings

Positive feedback (Things that can remain as are)

Overall Design was well done

Topic of the human respiratory system was applicable to the primary school level chosen

Many links provided to related subject matter

The jeopardy game was seen as appropriate

Flow of lesson was suitable

Negative Feedback (Things that can be changed)

Motivational rewards was only given at the end of the content

User was not able to navigate forward after an incorrect assessment answer was given

Content a bit wordy at times

Lack of sound effects to enhance content on slides

Change the name of the game from Jeopardy to something else closer to the topic

Please see Appendix B for the Evaluators Scoring

 7

Conclusion

Findings suggest that the planning, content and overall layout of Group Threes Multimedia

Project on the human respiratory system were effective to meet most of the objectives of Gagne's

Nine Events of Instructions, which are:

1. Gain Attention

2. Inform the learner of objective

3. Stimulate recall of prior learning

4. Present new material

5. Provide learning guidance

6. Elicit the performance

7. Provide Feedback

8. Assess performance

9. Enhance retention and transfer

However despite the Multimedia Projects effectiveness the evaluators comments revealed that

there were areas of vulnerability that required improvement in order to meet teaching and

learning objectives.
 8

Response to evaluators comments

Evaluation is the process of collecting data on a programme to determine its worth and
value with the aim of deciding whether:
The programmes effectiveness can be improved upon
Justify funding for the programme
To improve the implementation and effectiveness of the programme
Document programme accomplishments
Satisfy ethical responsibility to clients to demonstrate positive and negative
effects of programme participation
(Community Tool Box, n.d.) identifies programme stakeholders as persons with a vested interest,
or who will use the evaluation results to support the programme or who will be affected by the
evaluation results and stakeholder engagement is essential for strategic direction, to determine
and prioritize key questions for the evaluation, add validity and credibility to the data analysis.
As a stakeholder in the development of the Multimedia Project on the human respiratory system
the evaluators views are important and I response to their comments the following are offered:
Teachers are always developing assessments for the classroom as assessments assist
teachers in gathering evidence of student learning that informs instructional decisions and
provide corrective instructions. Hence it was not initially viewed as an error for the user
not to advance forward with the submission of an incorrect answer but was a way of
ensuring that the user understood the lesson.
Motivation is a need or desire that serves to energize behaviour and move a person to
complete a task and achieve their goal(s). Having the achievement certificate at the end
was seen as a motivator to the user to get 100%. Since according to Bandura, (1994)
perceived self-efficacy is defined as people's beliefs about their capabilities to produce
designated levels of performance that exercise influence over events that affect their
lives. Self-efficacy beliefs determine how people feel, think, motivate themselves and
 9

behave. Such beliefs produce these diverse effects through four major processes. They
include cognitive, motivational, affective and selection processes.

Methods to achieve improvement recommendations made by the Multimedia

Projects Evaluators

Criteria Recommendations
Motivational rewards Revise content so that at main lesson ending, different types of motivational
was only given at the end rewards such as a sound or points could be used issued.
of the content According to Bandura, (1994) a strong sense of efficacy enhances human
accomplishment and personal well-being in many ways. People with high
assurance in their capabilities approach difficult tasks as challenges to be
mastered rather than as threats to be avoided. Such an efficacious outlook
fosters intrinsic interest and deep engrossment in activities. They set
themselves challenging goals and maintain strong commitment to them. They
heighten and sustain their efforts in the face of failure.

User was not able to Revise content so that at main lesson ending different types of assessment
navigate forward after an could be used such as: cloze test and journal reflection
incorrect answer

Content a bit wordy Review and rewording of content where possible.

Lack of sound effects Addition of sound effects at appropriate areas of the unit

Change the name of the Suggestions can be elicited from other stakeholders
game from Jeopardy
 10

Appendix: A
 11

1 2 3 4
Story Board or Story board is Story board is not Story board is somewhat Story board is complete.
Planning incomplete and complete. complete. Includes many Includes all assigned
Sheet. lacks necessary Includes few assigned elements, in elements, in addition to
URLs, formats, assigned elements addition to most planned planned formats,
and resources to or planned formats, necessary necessary URLs, and
complete project. formats, URLs, and resources. resources.
necessary URLs, Story board is complete.
and resources.
Organization No logical Some logical Logical sequence of Logical, intuitive
of Content. sequence of sequence of information. Menus and sequence of information.
information; menus information, but paths to more information Menus and paths to all
and paths to menus and paths are clear and direct. information are clear and
information are not are confusing or direct
evident. flawed
Originality The work is a The work is an The product shows The product shows
minimal collection extensive evidence of originality significant evidence of
or rehash of other collection and and inventiveness. While originality and
peoples ideas, rehash of other based on an extensive inventiveness. The
products, images peoples ideas, collection of other majority of the content
and inventions. products, images peoples ideas, products, and many of the ideas are
There is no and inventions. images and inventions, fresh, original, inventive,
evidence of new There is no the work extends beyond and based upon logical
thought. evidence of new that collection to offer conclusions and sound
thought or new insights. research.
inventiveness..
Copyright and Sources have not Sources have not . Most sources and All sources are properly
Documentation been properly cited been properly property cited according cited according to MLA
and permissions cited and all to MLA style; style; Permissions to use
have not been permissions have Permissions to use any any graphics from
received. not been received. graphics from web pages commercial web pages on
or other sources have other sources have been
been received, printed, received, printed, and
other sources have been saved
received, printed, and
saved
Format and The stack, The stack, Most of the stack, The stack, presentation, or
Platform presentation, or presentation, or presentation, or web page web page plays easily on
Transferability web page plays web page plays plays easily on both Mac both Mac and PC. Care
only on either Mac best on either and PC. Although there has been taken in naming
or PC. There are Mac or PC. There are minor problems with files, selecting
problems with the are problems with a few files, care has been technologies, or creating
operation of some the operation of taken in naming files, enhancements to produce
files and the project some files and the selecting technologies, or a final product that is
is not cross- project is not creating enhancements to cross-platform.
platform. cross-platform produce a final product
 12

that is cross-platform.
Subject Subject knowledge Some subject Subject knowledge is Subject knowledge is
Knowledge is not evident. knowledge is evident in much of the evident throughout (more
Information is evident. Some product. Information is than required). All
confusing, information is clear, appropriate, and information is clear,
incorrect or flawed. confusing, correct. appropriate and correct
incorrect or
flawed.
Graphical Exaggerated Graphical and Design elements and The combination of
Design emphasis upon multimedia content combine multimedia elements with
graphics and elements effectively to deliver a words and ideas takes
special effects accompany high impact message with communication and
weakens the content but there the graphics and the persuasion to a very high
message and is little sign of words reinforcing each level, superior to what
interferes with the mutual other could be accomplished
communication of reinforcement. with either alone. The
content and ideas Theres no mixture brings about
attention paid to synergy and dramatic
visual design effects which reach the
criteria such as intended audience
proportion,
balance, and
harmony restraint.
There is some
tendency toward
random use of
graphics.
Mechanics Presentation has Presentation has Presentation has fewer Presentation has no
four or more three or more than two misspellings misspelling errors or
spelling errors spelling errors and/or grammatical grammatical.
and/or grammatical and/or errors.
errors. grammatical
errors
Screen Design Screens are either Screens are Screens contain adequate Screens contain all
all necessary confusing and difficult to navigational tools and necessary navigational
navigational cluttered or barren navigate, but buttons. Users can tools and buttons. Users
tools and and stark. Buttons some buttons and progress through screens can progress intuitively
buttons. Users or navigational navigational tools in a logical path to find through screens in a
can progress tools are absent or work. Users can information. logical path to find
intuitively confusing navigate a few information.
through screens.
screens in a
logical path to
information.
Use of No video, audio . Limited video, Some Video, audio Appropriate amounts of
Enhancements enhancements are audio enhancements are used Video, audio
 13

present or use of enhancements are appropriately to entice enhancements are used

these tools is present. In most users to learn and to effectively to entice users
inappropriate. instances, use of enrich the experience. In to learn and to enrich the
these tools is some cases, clips are experience. Clips are long
appropriate. either too long or too enough convey meaning
short to be meaningful. without being too lengthy.

Figure 1: Peer Evaluation Rubric Criteria:

 14

Appendix: B

Rubric Criteria Evaluator 1 given scores Evaluator 2 given scores

Story board/planning Sheet
Organization of Content
Originality
Copyright/Documentation
Format & Platform
4 4
3 4
3 2
3 3
4 4
 15

Transferability
Subject Knowledge 4 3
Graphical Design 3 2
Mechanics 3 3
Screen Design 3 3
Use of Enhancements 3 2
Total= 40 33 30

Figure 2: Evaluators Scoring

Reference
 16

Reference

Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2003). Evaluation: A systematic approach. Sage
publications.
Newcomer, K. E., Hatry, H. P., & Wholey, J. S. (2015). Handbook of practical program evaluation. John
Wiley & Sons.
Pintrich, P. R. (2003). A motivational science perspective on the role of student motivation in learning and
teaching contexts. Journal of educational Psychology, 95(4), 667.
https://mainweb-v.musc.edu/vawprevention/research/programeval.shtml
Rehman, A., & Haider, K. (2013). The Impact of Motivation on Learning of SecondarySchool Students in

Karachi: An Analytical Study. Educational Research International, 2(2), 139-147.

Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological

review, 84(2), 191.

Bandura, A. (1994). Self-efficacy. In V. S. Ramachaudran (Ed.), Encyclopedia of human

behavior (Vol. 4, pp. 71-81). New York: Academic Press. (Reprinted in H. Friedman [Ed.],
Encyclopedia of mental health. San Diego: Academic Press, 1998).