HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

Increasing Awareness of Prescription Drug Abuse

Program Evaluation Plan

Prepared by:

Keely Niemeyer, Kanale Rodrigues, Tarah Hernandez, Melissa Acuna

Cal State San Bernardino MPH Grad Students

May 28, 2017

Page 1
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

1. INTRODUCTION AND STAKEHOLDER ENGAGEMENT

Evaluation Purpose

The purpose of this evaluation is to increase awareness that 20% of college students
abuse prescription drugs, but this means that 80% are capable of coping with college
lifestyle demands without the use of prescription drugs. According to Vargas (2012),
nearly 20% of college students abuse prescription drugs such as adderall to help with
studies, but students who abuse the drugs are unaware of the risk for addiction and
overdose because the use has become normalized behavior among college students.
According to the Journal of Modern Psychology, there are more risks to prescription
drug abuse that include decreased motivation, increased aggression and agitation,
heart palpitations, tremors, heart disease, and death. Our goal is to provide educational
materials that explain the health concerns related to prescription drug abuse and
provide resources for students to seek treatment and reduce the amount of prescription
drug abuse.Findings from the evaluation can be used to determine the effectiveness of
PSA and Zine materials in encouraging CSUSB students to utilize the student health
center resources and programs to treat prescription drug abuse.
The overall goal of the CSUSB Student Health Center is to promote good health
through preventative health services for students striving toward academic and
professional success. They offer counseling and psychological services to assist
students in coping with the stress of academics and student life. As such, increasing
awareness of prescription drug abuse as a health issue and listing resources available
through the student health center for students who wish to seek treatment is a right fit
for the overall goals of the CSUSB Student Health Center.

Stakeholders
Individuals and groups that have an interest in the outcomes of this evaluation include
the Run Like a Mother 5K participants and volunteers, staff at the Student Health Center
TH!VE promotions team, students who abuse prescription drugs seeking treatment, and
MPH students developing the program.
MPH students along with the THR!VE Health promotions team are both invested and
interested in the effectiveness of this program. The MPH students are particularly
interested in the effectiveness of the program as they are the ones who are involved in
the development process. The CSUSB Student Health Center THR!VE Promotions
staff are most interested in effectiveness and increased use of services for students
seeking treatment to improve negative health outcomes associated with prescription
drug abuse. Lastly, Program planners and CSUSB Student Health Center THR!VE
Health promotions staff are interested in the cost associated with the implementation of
the program.
The role of participants will be our target population to disperse the Zine and show the
PSA. The 5K volunteers and program developers (MPH students who will oversee) will
act in the role of conducting pre-survey asking about the awareness of prescription drug
abuse, passing out Zine and showing the PSA to 200 or more participants. Additionally,
the volunteer workers will host a booth with a question wheel to draw attention and have
a place to pass out materials. The MPH students will serve on the planning committee.
Page 2
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

The CSUSB Student Health Center staff will be the external reviewers and act as
sources of information for students seeking treatment for prescription drug abuse.
Volunteers will be initial data collectors. There will also need to be data collected after
the completion of the 5K event. This can be run by MPH students who will also interpret
data. Results received will be in the role of MPH students and CSUSB Student Health
Center Staff.

Table 1. Stakeholder Assessment and Engagement Plan

Interest or
Stakeholder Name Role in the Evaluation
Perspective
5K Participants Program participant Given resources and
completing surveys before
and after the event,
participating in booth
activities.
CSUSB Student Health Center Staff External review and
Staff provider of services to
students seeking treatment
for prescription drug abuse,
participating in advertising
of health center resources
to reduce stress.
5K Race Volunteers/Staff Staff (MPH Student Run booth with games to
overseers) attract participants, conduct
pre-survey, show PSA and
hand out Zine materials,
participate in meditation
and Zumba demonstrations
to reduce stress.
MPH Students Program planning Organize educational
committee, data materials and develop
analysis program plan, evaluate data
to determine impact

Cultural Competence

We will engage stakeholders who reflect the diversity of those who may be affected by
the evaluations findings through a randomized recruitment process seeking volunteers
that are CSUSB students to work at the race. To ensure that we successfully elicit and
incorporate the various perspectives we will evaluate the training process for 5K
volunteers, communicate and collaborate with the student health center in the planning
process of the event as well as during data analysis after the event. Additionally, we will
determine an up front cost for printing services to add a budget for this program to be a
success.To account for the influence of context and culture in our evaluation design,
implementation, and reporting, part of the survey will ask demographic information to
better understand the diversity of our target audience. Additionally, survey questions will
ask participants how relevant the materials were to them and how likely they would be
Page 3
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

to recommend this information to friends and family.

2. DESCRIPTION OF INCREASING AWARENESS OF PRESCRIPTION DRUG ABUSE

The prescription drug abuse program is comprised of the prescription drug abuse PSA
and informational Zine that will be presented and distributed at the second annual Run
Like a Mother 5K Run/Walk. The goal of our program is to increase knowledge about
prescription drug abuse while simultaneously increasing the knowledge and use of
resources such as meditation, counseling, and coyotes for recovery available to CSUSB
students.

Need
The needs our program is designed to meet are: goals to increase awareness of
prescription drug abuse among college students, show students who abuse prescription
drugs that there are resources available through the CSUSB Student Health Center,
and help students cope with the stress of academics without resorting to the abuse of
prescription drugs. Through research we have discovered that 20% of college students
abuse prescription drugs to cope with the demands of college academics and
maintaining a social, family and work life (Vargas, 2012). According to Intervention
strategies (2017), one in three college students abuse prescription drugs to help them
study. Project know (2017), discovered that adderall is the number one abused
prescription drug because to students, it is the smart drug that will help them focus on
studies. Adderall is prescribed to individuals diagnosed with ADHD and according to
students with the prescription, they are often asked by peers to sell their medication.
Students assume that prescription drugs are safe because they are prescribed by
physicians and therefore do not need to worry about negative side effects such as
tremors and heart disease risk. Additionally, students learn from peers how to take the
right dose to accomplish their study goals. Unfortunately, not everyone reacts the
same to prescription medications and without discussing the use with a physician,
prescription drugs can lead to addictive behaviors and risk overdose or medication
interactions.

Context
The programs context is the Run Like a Mother 5K Run/Walk event hosted on CSUSB
campus. This event is in place to encourage physical activity and raise charitable funds
for organizations that help mothers. As such, race participant population may differ from
that of the diverse CSUSB student population and care will be needed to address
prescription drug abuse health concerns without creating an environment of participants
feeling put on the spot.

Population Addressed
The population for whom activities are intended includes any race participant on
CSUSB campus who may attend the 5K. This can be friends, family, faculty, community
members and CSUSB students.

Stage of Development:Currently in the planning stage.

Page 4
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

The program has been in the planning and development process for nearly 20 weeks.
Development of the Zine and PSA were completed in the winter 2017 Quarter by our
group of MPH students and undergraduate interns. The spring 2017 quarter has
consisted of continued research and development of a program evaluation plan as well
as work toward hosting the Run Like a Mother 5K event for the Fall 2017 quarter. The
program itself including pre/post survey and passing of materials will be concluded in
one day (the day of the 5K event).

Resources/Inputs
Resources available to support the program include: printing services, volunteer staff at
the race event, participants, CSUSB Student Health Center Staff, time at the 5k event,
space available on the CSUSB campus to conduct demonstrations and provide
materials, table, chairs, IPads, TV screens, Wi-Fi access, 200-300 copies of the Zine,
$100-$200 budget for printing and advertising.

Activities
Specific activities to be conducted (or planned) to achieve the programs outcomes
include: volunteers and MPH students passing out Zine and showing PSA as well as
volunteers conducting spin games to attract race participants, MPH students asking
questions and assuring materials are passed out to participants interested, health
center staff advertising resources to deal with stress and treat prescription drug abuse,
volunteers and MPH students collecting post-surveys at the end of the event, volunteers
demonstrating meditation classes, peer advisors available to discuss treatment options
for prescription drug abuse. In addition to passing Zines at the 5K event and showing
the PSA, our group may show the PSA and have awareness activities during the
academic year especially before holiday seasons to help students continue treatments.

Outputs
Nearly 200 Zines distributed with 67% of participants stating they have seen the PSA.
Approximately, 5% or more CSUSB students may schedule an appointment with the
student health center to seek treatment for prescription drug abuse. Students who
attended the program will be aware of prescription drug abuse as a health issue and
have resources to seek treatment.

Outcomes
Short-term outcomes will be an increase in awareness of prescription drug abuse health
risks. Intermediate outcomes will be continued participation in program activities, and
5% increase of students making counseling appointments and using the student health
center resources. Long-term outcomes will be a reduction in the percentage of college
students abusing prescription drugs.
Ultimately we want to decrease the percentage of prescription drug abuse among
college students and increase the use of student health center resources to cope with
the stress of academics and college life.With our activities, the point at which we see
ultimate outcomes are; an increase in awareness of prescription drug abuse as a

Page 5
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

health-related issue, an increase in acceptance of prescription drug abuse problems,

and students actively seeking treatment through the CSUSB Student Health Center
resources.

Logic Model

3. EVALUATION DESIGN

Page 6
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

Stakeholder Needs
To determine the success of our program the key stakeholders and developers will
monitor and evaluate the Prescription drug abuse prevention program operations. The
CSUSB Student Health Center, THR!VE Health Promotions has a vested interest in this
evaluation as the department is responsible for the resources available to students on
campus. The CSUSB Student Health Center needs the information to be disbursed in a
manner that is consistent and yields results shown by increased participation in
services. The findings of our program will be used to improve the already existing
programs offered by the Student Health Center. The Student Health Center provides the
Coyotes for recovery program, meditation and psychological counseling along with
other classes and workshops held at CSUSB. The findings will directly affect those
programs already offered by the CSUSB student health center. Accessibility of the
program as well as the accessibility of the already available resources will be assessed.
The current objectives of our program will also be assessed and the necessary changes
will be made to meet the need of the stakeholders. Stakeholders will take an active role
in our program evaluation as their input is essential for the success of the program. The
positive and negative aspects of our program will be evaluated by the stakeholders and
used to improve the current program. All contact with the stakeholders will be in a
professional and ethical manner with strict standards for confidentiality.

Process Evaluation Questions

1. Did all the race participants receive the zine and view the PSA?
2. Were all program activities carried out during the 5k race?
3. Did the information provided in the zine and the PSA influence the race
participants desire to utilize the resources available on the CSUSB campus?
4. Is there a need for more resources or varying availability to the already existing
programs and resources available to those struggle with prescription drug
addiction?
5. Are there enough staff members including volunteers and peer health educators
to maintain activities and keep participants interested?
6. Is there a measurable change in awareness regarding health risks associated
with prescription drug abuse?
7. What Improvements can be made to the design of the program if specific goals
are not meet?

Outcome evaluation questions,

1. Did the participants show a 5% increase in knowledge associated with the Zine
and PSA?
2. Did the Student health center receive a 5% increase in appointments made for
counseling by those who attended the 5K race?
3. Has the coyotes for recovery program shown a 5% increase in participants by
the end of the quarter following the 5K race, by those who attended the race?

Page 7
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

Evaluation Design
Pre/post Survey will be administered to the race participants to measure any change in
knowledge of prescription drug abuse. This design will allow us to accurately assess the
participants increase in knowledge as well as information such as demographics and
the risks assessment of each individual. The reason we chose this design is a need to
understand base knowledge about prescription drug abuse among college students.
With understanding health behaviors and base knowledge we can organize the program
activities to meet the needs and create a better impact. The post survey and data
collection of appointments made and Student Health Center resources utilized will
reveal our program outcome impact on bringing awareness to college students.
Quality improvement questionnaires will be distributed and collected to help improve the
program. Part of the post survey questions will ask participants if there were any
changes they wish to see in the future regarding the table demonstrations and
educational materials provided. This information will assist us in improving program
delivery for continued educational aspects.

4. GATHER CREDIBLE EVIDENCE

Data Collection Methods

New data will be collected via pre and post survey to find out what the level of
knowledge of the students have before and after the program. There will also be
satisfaction surveys available for students to provide feedback on our program. We will
use the run like a mother 5k race to select our sample. Participants who complete both
a pre and post survey will be selected as our sample.
We will identify or create data collection instruments using surveymonkey software to
build pre/post surveys. Data collection surveys will be collected by volunteers and MPH
students during the 5K event and blasted through email after the event for post data
collection. To test instruments for readability, reliability, validity, and cultural
appropriateness we plan to pilot test the surveys with randomly selected undergraduate
students.To determine the quality and utility of existing data we plan to include
questions seeking areas for improvement from participant perspective and using data
from sign in logs at the Student Health Center that students complete at appointments
to determine the current number of participants and understand if there is a 5% increase
in Student Health Center uses after our program delivery. Our source of data includes
any 5K participant.

Table 3: Evaluation Questions and Associated Data Collection Methods

Evaluation Question Data Collection Source of Data
Method

Did all the race participants Question on post participants/students of the

receive the zine and view the survey 5k run/walk
PSA?

Page 8
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

Did the information provided in
the zine and the PSA influence
the race participants to desire to
utilize the resources available
on the CSUSB campus?
Staff answering phones CSUSB student health
will ask students how center and the THR!VE
they found out about Promotions Team.
their requested service
and keep a tally.
Number of visits to the
CSUSB health center
events

Were all program activities carried feedback from MPH Students/volunteers

out during the 5k race? staff/volunteers Rec center staff members

Is there a measurable change in Post Survey participants/students of the

awareness regarding health risks Increased attendance to 5k run/walk
associated with prescription drug programs offered by the
abuse? CSUSB health Center

Is there a need for more Post survey-open ended participants/students of the

resources or varying availability to questions on days and 5k run/walk
the already existing programs and time slots students would
resources available to those like resources available.
struggle with prescription drug
addiction?
Are there enough staff members feedback from participants/students of the
including volunteers and peer staff/volunteers/post 5k run/walk
health educators to maintain survey- Question on post
CSUSB student health
activities and keep participants survey asking if the
center and the THR!VE
interested? participants felt their was
Promotions Team. MPH
enough staff for their
students
needs
Rec Center Employees

Has the coyotes for recovery Sign in sheets during the CSUSB student health
program shown a 5% increase in meetings center and the THR!VE
participants by the end of the Promotions Team.
quarter following the 5K race, by
those who attended the race?

Page 9
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

Did the participants show a 5% Pre/ Post survey analysis participants/students of the
increase in knowledge associated 5k run/walk
with the Zine and PSA?

Did the Student health center
receive a 5% increase in
appointments made for
counseling by those who attended
the 5K race?
Staff answering phones CSUSB student health
will ask students how center and the THR!VE
they found out about Promotions Team
their requested service
and keep a tally

What improvements can be made Identify the specific CSUSB student Health
to the design of the program if areas that can be and Center and the
specific goals are not meet? improved to increase THR!VE Promotion team
the chance of reaching MPH students
overall goals
Volunteers
peer group leaders

5. DATA ANALYSIS AND INTERPRETATION

Indicators and Standards

Some measurable or observable elements that can serve as markers of our programs
performance include:
1. Increased number of students making appointments to see a counselor.
2. Increased number of students attending meditation.
3. Increased number of students utilizing and attending the coyotes for recovery
meetings.
Success of our program is measured by a 5% increase in the number of students that
take part in stress relief activities directly related to prescription drug abuse. As well as
an increase in the number of students attending workshops, one on one counseling
sessions, and coyotes for recovery program.

Table 4. Indicators and Success

Standards
Evaluation Question Criteria or Indicator (What Constitutes
Success?)
Has the coyotes for recovery Attendance Participation increase
program shown a 5%
Page 10
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

increase in participants by the

end of the quarter following the Students attend more 5% or more
5K race, by those who recovery meetings
attended the race?
Did the Student health center Scheduled/Attended Appointment increase
receive a 5% increase in Students actively
appointments made for scheduling
counseling by those who 5% or more
appointments
attended the 5K race?

Did the participants show a Identify Health Risk Correct response to ?

50% increase in knowledge
associated with the Zine and
PSA?
Students capable of 50% or more post
identifying health risk survey participants can
associated with list 1 or more health
prescription drug risk and resources
abuse and resources available to treat
available to treat prescription drugs

Analysis
Mix methods will be used as some of the survey questions will be open ended and
some will have a fixed answers. Chi square and Anova along with descriptives will all be
ran using SPSS software, on data collected from the pre and post surveys as well as
the data collected on increased rates students access existing resources.

Interpretation
The MPH students organizing the prescription drug abuse booth at the 5K, CSUSB
Student Health Center team leaders in charge of the activities at the CSUSB health
center (eg: meditation classes, peer counseling, & coyote to recovery programs) will be
the be the members involved in the data collection to determine program effectiveness.
Those that are part of the data collection and administering activities performed at
CSUSB health center and reviewing and recording the pre/post survey will have an
impact on program output.
CSUSB Student Health Center group leaders would be part of the data collection
process and monitoring the students that filled out the pre/post surveys involvement in
the activities, peer counseling, and coyote to recovery program through sign-in lists. Any
students that did not fill out the survey from our program, but are part of the Student
Health Center classes or are taking part in the health centers activities will be asked
where they heard about the resources and if the participated in the 5K event.

6. USE AND COMMUNICATION OF EVALUATION FINDINGS

Use
Evaluation findings will be utilized by the Student Health Center at CSUSB. THR!VE
Page 11
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

promotions located in the Student Health Center will use the information collected to
improve services to students. The MPH students will use the information to make
improvements to the program as it progresses.

The timeline for reporting findings and potential recommendations align with key events
for which we will need information from the evaluation include completion of program
plan, training of volunteers/peer educators, and pilot testing of surveys for improvement
prior to October 21st 2017, the date of the 2nd Annual Run Like a Mother 5K event.
Post surveys need to be completed and pilot tested before the above date and emailed
to all participants the Monday after to allow time for participants to absorb materials and
think about resources. From that point on until the end of the quarter December 15th
2017, data will be collected from the Student Health Center regarding participation in
resources for treatment of prescription drug abuse and MPH students will analyze
survey results to report requests and population needs to stakeholders for Winter
quarter planning.

The MPH group members are responsible for creating and monitoring an action plan to
guide the implementation of evaluation recommendations. Follow up is needed to
monitor program delivery and pilot test results for improvements to questions prior to
program implementation.

Lessons learned, including those about evaluation and evaluation capacity building, that
should be shared include: ability to complete program activities on the day of the event,
population needs suggested from pre/post survey results, impact of program and areas
that may need improvement to create a bigger impact. They will be documented by the
MPH student leaders who have overseen the planning and evaluation process. They
will be documented as research for continued improvement in health outcomes of
prescription drug abusers.

Communication
Evaluation stakeholders we will communicate with are the Student Health Center Staff,
CSUSB students, and MPH program directors for the purpose of updating the
evaluation process in areas of success and areas needing improvements for future
uses, and sharing findings to encourage continued positive behavior changes.
Prior to program delivery, we will meet with Student Health Center staff to ensure
program connects with their mission and goals. We will complete updated newsletters to
show positive effects of the 5K event on bringing awareness to prescription drug abuse
and sen through emails to CSUSB students on campus. We will also present our
findings in various undergraduate courses on campus to continue bringing awareness to
college students about the health risks associated with prescription drug abuse.
These methods appropriate for the specific evaluation stakeholder audience of interest
because the Student Health Center will learn the impact of our program and
understanding student needs and their input is valuable to the process. The use of
email newsletters reaches a large portion of CSUSB students as everyone has a
student email account. This will encourage continued awareness activities and let
students know about events happening on their campus. Presentations can reach

Page 12
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

students on a more personal level.

7. EVALUATION MANAGEMENT

Evaluation Team

MPH students, volunteers, and the Student Health Center will be responsible for
managing the evaluation. In order to successfully conduct the evaluation, all
stakeholders must be involved in the process. Other MPH Students that are not directly
involved in this program will be external reviewers used to provide additional feedback
on the evaluation plan. They have provided feedback for improvements in the
evaluation plan and changes will continue to be made prior to delivery.

Table 5. Roles and Responsibilities of the Evaluation Team Members

Individual Title or Role Responsibilities

MPH students Create, implement Gather and evaluate data by
and analyze means of data collection material
evaluation data. (surveys) and in person data
collection (interviews) through
activities while tabling at the 5K
run.
Volunteers Assist MPH students Disperse educational materials
in data collection and gather data and demographic
informations about prescription
drug abuse to 5K run participants.
Student Health Analyze data The Student health center will use
Center health presented by MPH the data gathered to create and
educators students for further implement new and additional
campus wide substance abuse recovery
developments programs, improve and adjust
already existing resources,and to
add additional support systems.
Additionally, will focus efforts of
prevention by means of educating
students on healthy alternatives.

Data Collection Management

Data that will be collected include the information pertaining to participants knowledge
of prescription drug abuse. More specifically, if participants gained knowledge about
healthy alternative methods to help with studying, and resources available to those who
may be abusing prescription drugs. These will be collected using various methods, such
as pre and post surveys and data from the student health center to determine whether
more students are seeking help with prescription drug abuse issues.
The activities needed to collect data from the pre and post survey will be conducted at
Page 13
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

the 5K run and through email the following Monday. Through tabling at the event,
students will be asked questions pertaining to prescription drug abuse, given
educational materials and resources, asked to view the PSA and zine, and lastly be
given the post test to list 1 health impact and 1 resource. The post survey will be
collected the following Monday through email. Also, stakeholders in the Student Health
Center will be able to collect data on how many new students are seeking help with
prescription drug abuse.
MPH group members and volunteers will be responsible for tabling, providing
information, and collecting surveys. Student health center stakeholders will be
responsible for gathering the data necessary for us to evaluate long term behavior
changes. MPH group members, stakeholders, and the Student Health Center will
oversee the conduct of the evaluation to assure appropriate implementation.

Table 6. Data Collection Plan

Evaluation Data Collection Activities needed Person(s) Due Date

Question Method responsible

Question on post Use IPad to motor the CSUSB 10-21-17

Did all the race survey, when the survey
participants survey and MPH
running out of is completed online and students
receive the zine submitted to our
and view the copies Volunteers
database (Pre/Post
PSA? survey)
Volunteers passing out
copies of the Zine to
participants at the booth
as well as showing the
PSA to those that stop by
the booth

Did the Staff answering A Call center/ dispatch CSUSB 12-15-17

information phones will ask team MPH
provided in the students how Medication classes (sign Students
zine and the they found out in sheet) Volunteers
PSA influence about their Coyote to Recovery Peer Group
the race requested programs (sign in sheet) leaders
participants service and keep
desire to utilize a tally. Class
the resources instructors
Final recorded
available on the number of times
CSUSB participants went

Page 14
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

campus? CSUSB health

center program
events

Were all program feedback from
activities carried staff/volunteers
out during the 5k
race?
Conduct a spin the wheel CSUSB MPH 10-21-17
activity with true/ false students
questions that to attract volunteers
participants to the booth peer
with prizes with correctly educators
answered questions. Volunteer
10 volunteers along with mediation
peer educators to answer and exercise
any questions about instructors
prescription drug abuse
that participants at the
event might have.
Pet the stress away
Mediation, kickboxing,
and circuit training demos

Is there a Post Survey Student will be given a Participants 10-27-17

measurable pre and post survey of the Run
change in detailing if the learned like a
awareness new information mother 5k
regarding health regarding prescription
CSUSB
risks associated drug abuse, and will be
MPH
with prescription able to list at least two
Students
drug abuse? new pieces of information
based off the Zine and
PSA.

Page 15
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

Is there a need for Post survey-open MPH group members MPH group 10-27-17
more resources or ended question on and volunteers will members,
varying availability days and time explain the available volunteers,
5K
to the already slots students programs for student who
participants.
existing programs would like need recovery. Post
and resources resources surveys will then be
available to those available. evaluated to see if
struggle with additional services are
prescription drug needed for students.
addiction?

Are there enough feedback from Have students fill out MPH group, 10-21-17
staff members staff/volunteers/po survey at the 5K event. volunteers
including st survey- Post survey will include if
volunteers and Question on post they still had any
peer health survey asking if remaining questions,
educators to the participants felt concerns or suggestions
maintain activities their was enough about Rx drug abuse.
and keep staff for their Also, gauge feed back
participants needs from MPH group
interested? members and volunteers
for feedback regarding
student outreach and
participation levels.
Has the coyotes Sign in sheets Have student sign in with Coyote for 12-15-17
for recovery during the initials to keep Recovery
program shown a meetings confidentiality the the facilitators,
student
5% increase in recovery meetings. This
health center.
participants by the will be passed around
end of the quarter weekly at the beginning
following the 5K of the meetings. Sign in
race, by those will also have a spot for
who attended the students to write how
race? they learned about the
meeting.

Page 16
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

Did the Pre/ Post survey Student will be given a MPH group 12-15-17
members
participants show analysis pre and post survey
and
a 50% increase in detailing if the learned
volunteers.
knowledge new information
associated with regarding prescription
the Zine and drug abuse, and will be
PSA? able to list at least two
new pieces of information
based off the Zine and
PSA.
Did the Student Staff answering The data gathered from CAPS 12-15-17
health center phones will ask the counseling center will center staff,
receive a 5% students how be compared to previous MPH
increase in data sets before the 5K students,
they found out
appointments event was held. student
about their health
made for requested center.
counseling by service and keep
those who a tally
attended the 5K
race?

Data Analysis Management and Interpretation

All data will be kept in the student health center in a cabinet with a lock. The data will be
analyzed using SPSS software. Data will be entered into a spreadsheet and used to run
descriptive data, chi square and ANOVA.
Pre/post survey and Student Health Center sign-in log data will be analyzed. The pre
survey consisting of current behaviors and attitudes toward prescription drug abuse,
student life stressors and demographics will be analyzed using descriptive data to
determine risk groups and areas to target for prescription drug abuse treatments. This
data will be compared to post survey data in order to determine improvements in
knowledge and self-efficacy for seeking necessary resources. Data from the Student
Health Center logs will be analyzed for the remainder of the fall 2017 quarter to using
SPSS software to determine increased percentage of resource uses and overall impact.
The MPH student leaders are responsible for conducting the analyses.The MPH
students will work together with the Student Health Center THR!VE promotions team to
conduct the analysis of the data. We will engage stakeholders in confirming analysis
results and interpreting them through continued collaboration and discussion of impact
results.

Table 7. Data Analysis Plan

Data to Be Person(s)
Analysis to Be Performed Due Date
Analyzed Responsible

Page 17
HSCI 614 Program Evaluation Plan Adapted from CDC Asthma Program Evaluation Guide

ANOVA, Descriptive Pre survey data MPH Students 12-15-17

Chi Square, Comparison Post survey data MPH Students 12-15-17
Primary outcome measure Health center log MPH students 12-15-17

Communicating and Reporting Management

The audiences for reporting the progress made on the evaluation and/or evaluation
findings include: the Student Health Center THR!VE promotion team and CSUSB MPH
students who may be interested in positive health outcomes and resource
improvements.The purpose of the communications with this audience are to provide
feedback from CSUSB students regarding needs for treatment of prescription drug
abuse and impact of programs that are currently in place.
The most appropriate type of communication method to use with this audience, for this
purpose is one-on-one discussions, newsletters and email communications.The
communication will take place periodically throughout the evaluation process and after
analysis is completed at the end of the quarter.

Timeline
Planning and administrative tasks are occurring during the spring 2017 quarter and will
continue in the beginning of the fall 2017 quarter. Data collectors will be trained with the
survey script one week prior to the 5K event. We will pilot test data collection
instruments 3 weeks before the 5K event to provide necessary time to make changes to
questions if required. Formal data collection will occur during the 5K event and the
following Monday. Analysis will occur throughout the months of November and
December 2017. Interpretation tasks will occur prior to submission of results to
stakeholders.Information dissemination tasks will occur during the 5K event and after
impact results have been interpreted.
Upon mapping all of the above on a single timeline, the foreseeable bottlenecks or
sequencing issues will involve timing of pilot studies and reestablishing corrections prior
to the event. To counter this issue it might be necessary to involve more MPH students
or undergraduate interns.

Wrapping Up

At the end of the evaluation, we will acknowledge the contributions of planning team
members and others who contributed to the successful implementation of the plan
through thank you newsletters and including the names and organizations of all who
were involved.To document evaluation lessons learned in the course of implementing
the evaluation we will include a limitations section in our final documents describing
lessons learned and possible suggestions for future improvements. To archive relevant
documents, instruments, and data we will save all files in the locked cabinet at the
student health center.

Page 18