Evaluation Proposal for Determining Instructional Purposes Training Package

Submitted to: Far West Laboratory for Educational and Research Development By: Kalinago Consultants International

Introduction
Far West Laboratory issued an offer for bids to evaluate its Determining Instructional Purposes (DIP) training package. Kalinago Consultants International (KCI) submits this proposal in response that offer. KCI is based in Barbados, with a global reach through its international partners in USA, Canada, England, Australia, and France. We offer consultancy services in evaluations, data analysis, organizational management, and marketing to a range of clients in education, and the corporate and public sector.

Program Description
Far West Laboratory for Education and Resource Development (FWL) has created a training package Determining Instructional Purposes (DIP) to develop skills in planning effective school programs. The prospective clients are school administrators and education administration students in graduate programs. The DIP contains three units (Setting Goals, Analyzing Problems, Deriving Objectives) which can be used individually or in combination with other units. A group of trainees work through the modules under the supervision of a coordinator in a workshop session. The units are estimated to take between 10-18 hours to complete and should contain all the information, activities, and materials required to successfully meet the learning objectives of the package. Each participant is provided with a handbook at a cost of $8.95 per unit ($24.95 for the set of three units) and the coordinators version costs $4.50. All materials are in print form, running between 155 to 259 pages. However, there has not yet been any training carried out with the materials.

Evaluation Method
FWL requires an evaluation of the DIP training package so the company can decide their most effective course of action to market and sell DIP units. Additionally, school administrators will be able to use the information from the evaluation to decide if to buy and how to use DIP. An evaluation conducted by Kalinago Consultants International will allow FWL to decide if DIP merits investment for a major marketing initiative integral to the companys future growth. The evaluation will report principally to the directors and marketing team of FWL who will have lead responsibility to make the ultimate marketing decisions. FWL program developers will also receive information on adjustments that might improve marketability and potential sales of the units. Informational leaflets will also be generated for distribution to school administrators and instructors who make decisions to buy and use DIP as part of their educational development strategies. To decide on the potential and strategies for marketing DIP, its selling points must be known. One of these is the effectiveness of the package materials and their relevance to and ability to meet the needs of the users. Also important are the cost of the package, as well as opportunities to sustain sales in traditional FWL markets and to penetrate new markets. Background information on the goals and philosophy of FWL and its outlook on the training package will be

obtained from the Directors of FWL, the marketing director, and Lead Program Developer. This will clarify the evaluation questions for the program. The Principal Evaluator will lead a discussion and semi-structured interviews with the persons identified via video conferencing. The interview will have some set questions to generate information for the program design. Related program documents, which can either be sent electronically or posted, will be reviewed. Video conferencing allows KCI clients face to face interaction with its network of professionals while significantly reducing expensive travel and related costs. The Principal and Assistant Evaluator will have focused video conference meetings with program developers to gather information about activities, materials, and the delivery platform (print form) of DIP and to understand their rationales, perceived strengths and potential weaknesses. The cost in time and resources to make changes to the units will also be discussed in the event that such change might be indicated. Informal interviews will allow for free flowing discussion and bring clarity to the evaluation design. The same approach with focused video conferences will also be done with the marketing director and or team to gather their perceptions of the selling points of DIP such as cost, potential for new or expanded markets, its adaptability to market trends in training, and special qualities DIP offers over similar products. Both Evaluators will hold another meeting with the marketing team for further input after the DIP undergoes the field testing discussed below and before the final report. Since DIP was not used in real or simulated training, field trials will be undertaken to assess its strengths and weaknesses in relation to its selling points. Our KCI partner at Caldwell University in Sacramento is Associate Professor in Education Henry Franklin. He will first work through the three DIP units, review the coordinators handbook and then complete a survey on his assessment of the materials. Using educational administration graduate students from Caldwell, higher education and K12 administrators, he will coordinate workshops for each unit, over varying time periods as set out in the task schedule. Each workshop will be made up of 15 participants in all, who will receive complimentary copies of the units. All the participants will complete a survey on their perceptions of DIPs effectiveness, time required to complete the units, platform delivery, cost, appeal, relevance, and ease of use. The survey for administrators will include items specific to buying and implementing the DIP in their jurisdictions.

Task Schedule

TASK
Video Conference meeting with FWL board, Marketing Director and Lead Program Developer. Discuss goals and evaluation objectives. Get feedback from marketing team on DIPs selling points Get feedback from Program Developers on DIP s design. Finalize and submit Evaluation objectives for approval Submit for approval data collection instruments for Field Trials Coordinator work through modules Run Field Trials Unit 1 (2 days) Unit 2 (3 days) Unit 3 (2 days) Data Analysis Completed Second Video Conference with marketing team Draft Report submitted Feedback on Draft report Final Report submitted.

RESPONSIBILITY
FWL and KCI

DATE DUE
6 Aug 2012

KCI and FWL KCI KCI KCI KCI Partner KCI Partner

8 Aug 2012 9 Aug 2012 13 Aug 2012 28 Sept 2012 22 Oct 2012 23 Nov 2012

KCI

11 Jan 2013 18 Jan 2013 22 Feb 2013 8 Mar 2013 12 April 2013

Project Personnel
Dr. Annette Babb- Principal Evaluator. Co-founder and Director of Kalinago Consultants International has a doctorate in Psychology with Evaluation and Applied Research Methods from Claremont Graduate University; MS in Organizational Behavior (Melbourne University, Australia) and B.A. in Philosophy (University of the West Indies). Global connections formed during her studies, lead Dr Babb to set up KCI and to partner with experts in a range of disciplines to offer a variety of consultancy services. Within the last 6 years, Dr. Babb has conducted program evaluations for the University of the West Indies, Lincoln University (England), several multinational corporate clients and is a consultant evaluator on the Caribbean Development Banks register. She is a part time tutor in Organizational Behavior at BIMAP (Business Institute) in Barbados. Luke Boyd- Assistant Evaluator. MS in Market Research. Luke has worked as a market research analyst for past 2 years with KCI. Prior to that, he spent 4 years as an analyst for Carbonated Colas Conglomerate and 1 year as Research Assistant to Dr. Davis Howell at University of Technology (Jamaica). This combination of marketing experience and research skills, with some in an education context positions Luke as an excellent assistant to evaluate DIP.

Henry Franklin Ed. D- Field Trial Coordinator. KCI partner. Associate Professor at Caldwell University in Sacramento, his area of specialization is Educational Leadership and Management. His expertise in Educational Administration and his access to graduate students in the field affords KCIs proposal optimal conditions to conduct a field trial of DIPs effectiveness and get feedback on usability, appeal, and relevance. Having worked with several school districts in previous professional development sessions, he has a core of administrators to draw on to assist in the program evaluation. Research Method Interns: Two undergraduate students in Research Methodology at Caldwell will assist in entering the data from the paper based training survey, which will be evaluated by the team. As research students, they should appreciate the need for accurate and timely data entry. The interns will be present during the workshops to assist Professor Franklin with room set up and distributing materials. They will be given a stipend for their work.

Budget
COST Personnel Principal Evaluator Assistant Evaluator Field Trial Coordinator Research Interns (2) Stipend 40 days @ $500 35 days @ $275 17 days @ $300 2 persons @ $400 TOTAL $20000 $9625 $5100 $800

Communications/Supplies Video-Conferencing/Telephone Postage* Less if documents are transferred electronically Office Supplies Field Trials 45 trainee handbooks/1 Coordinator handbook Field Trial Workshop Room Set up/Coffee Breaks with snacks

$800 $500

$300

Provided by FWL Participants/Coordinator and Interns (55 persons x 7 days)

$00.00 $5000

$42125