You are on page 1of 20

Evaluation Tyler McLachlan Elizabeth Hendricks Rachel Hunsaker Job Description: To record, collect and retain consistent information

that will help us better understand if we were successful in implementing our Hospitality Mission Statement through the Employment Expo. This information will be collected through online surveys given to employers setting up booths, participants at the expo, and the student hosts. In addition, we will have a one on one interview with our programs partner, The Department of Workforce Services. Goals: To collect data from 3 population groups with 3 online surveys on Monday, November 26th from 10am-2pm at Employment Expo. To analyze data from 3 population groups from Monday, November 26thFriday, December 7th and record findings for SEPPP Final. Objectives: Rachel, Liz and Tyler will write rough draft surveys of 10 questions for our population groups, students, participants and employers by Friday, November 9th. Rachel, Liz and Tyler will revise questions and finalize them down to 5 questions for our 3 population groups and develop them into an online survey by Friday, November 23rd. Rachel, Liz and Tyler will collect data by online surveys on Monday, November 26th at Employment Expo. Rachel, Liz and Tyler will compare/analyze results and together develop and write findings in SEPPP Final by Friday, December 7th.

Operation Plan:
November 1-3 Create job description, goals, and objectives Post on Canvas goals, objectives, and contact information Tyler/Liz/Rachel Tyler

November 4-10

November 11-17

November 18-24

November 25-26

Nov. 27- Dec. 7

Tues- Submit Evaluation team budget Fri- Create 10 survey questions for employers Fri- Create 10 survey questions for participants Fri- Create 10 survey questions for students Fri- Pilot test survey rough drafts with class and Rose Arrange for getting computers for event (Rose) Call 10 assigned employers Sun- Submit Evaluation plan to Eric for the SEPPP #1 Tues- Submit final 5 question survey drafts to leaders Thurs- Set up final survey questions online Thurs- SEPPP #2 draft due Call and collect 2 confirmed employers for expo Call and collect any additional employers Call and remind confirmed employers Arrange computer pick-up & drop-off (Tyler T.) Gather pens, scratch paper for drawing (Kate) Make sure online survey has no glitches (Rose) Have computers and needed supplies Set-up and clean-up computers/ survey desk Survey 3 collective groups at Expo Return computers and supplies Complete Evaluation analysis, write-up Make eval. result slides for Thurs presentation Complete Eric's in-class eval. questions Complete SEPPP final and post

Tyler Liz Tyler Rachel Tyler/Liz/Rachel Tyler Tyler/Liz/Rachel Liz Tyler/Liz/Rachel Liz/Tyler Liz Tyler/Liz/Rachel Tyler/Liz/Rachel Tyler/Liz/Rachel Liz Liz Liz Tyler/Rachel Tyler/Liz/Rachel Tyler/Liz/Rachel Tyler/Rachel Liz Tyler Rachel Leaders

Evaluation Process Purpose: This evaluation is being conducted to judge the students successfulness of accomplishing their mission. Mission: to promote the hospitality industry by investing time to improve ones marketable qualifications at a professional level, facilitate networking between professional associates, and to stimulate further growth to the Utah economy. Audience: This evaluation is for us as students. To better help, us as students understand the importance and effectiveness of implementing our mission, vision, and values in program planning.

Process: Our purpose, of implementing our mission, will be conducted through multiple surveys with different types of questions. As well, we want to assess outputs, outcomes, and impacts of our logic model. This will also be found through the carefully selected survey questions and a one on one interview. Issues: Issues to be addressed is making sure we get a large enough sample to take the surveys, making sure the questions address finding connections to our logic model and mission, and being ready to take the surveys at the event. Resources: Resources needed and available are pens, paper, computers, Wi-Fi, survey table, and present members of evaluation team. Data-Gathering: Data will be collected through three individualized online surveys, one made for each of our three population groups by each of our three members in the evaluation team. Data will also be gathered through observations, one on one interview, and teacher feedback. Analysis: Evidence of this projects effectiveness will be analyzed through survey results from each of our individual population groups, personal observations, and interview with event partner. Reporting: A report will be created by the evaluation team and given to event leaders for further review. The report created will be put into the SEPPP. Sampling information: Quantitative/Qualitative: Mixtures of qualitative and quantitative questions were used. In order to predict feelings about the successfulness of students following the mission, vision, and values we used qualitative questions. In

order to predict successfulness of creating an environment of networking we used quantitative questions. Population/Sample: We were able to online survey all the employers and students and consider them to be population samples. With participants that came to the Employment Expo we were only able to collect a sample from 28 of the random assortment of the 52 participants that showed up. Instrument used & Administered: We used three online surveys given on computers with online access on the day of the event. We also used personal observation and interview to collect data on the event day and prior. Type of Sampling: Non-probability sampling was used because of the convenience to sample everyone at the event the day of and whoever came to the survey table. Also, we had a purposive sampling opportunity when we purposefully had a one on one interview with our program partner to collect qualitative information. Type of Instrument: Online survey, one for each population and specific to that population/sample group. Reliability/Validity: The survey process was consistent with everyone through the entire event with all of our population and sampling sizes. The questions asked were to measure students effectiveness and were not misleading or bias. We consider our method of sampling to be valid and reliable to the best of our knowledge but understanding any one person could choose to falsely answer questions or exaggerate opinions. Scales: We had at least one scale in each of our three surveys. We used only the likert scale option because it was more useful to accomplishing our main objective of finding if they were happy or not and we didnt go beyond those boundaries to ask if they felt opposite. Pilot Test: A pilot test was administered Friday, November 9th during class. This pilot test included all three rough draft surveys of ten questions. This gave proper feedback, from the hospitality emphasis group as a whole, of incorrectly worded questions, irrelevancy, and well-liked questions. A second pilot test was administered with all three final surveys of 4-6 questions to the two team leaders and Rose prior the event.

Participants Survey:

Satisfaction Survey Thank you for attending the Employment Expo today! Please take a moment to answer the questions below and let us know how we did! In exchange for your help, you will be entered into a drawing for free prizes (Just leave your name at the desk).

1. How many employers did you speak with? 0 1-3 4-6 7-9 10-12 13+ 2. How many employers do you feel you can have a productive follow-up with? 0 1-2 3-4 5-6 7-8 9+ 3. In your perception, how has your sense of confidence increased after speaking with potential employers? No Increase in Confidence Some Increase in Confidence A Good Increase in Confidence A Great Increase in Confidence 4. In your view, how effective were the employers in giving you a clear understanding of what they are looking for in job candidates?

Not Effective Somewhat Effective Very Effective Extremely Effective 5. How helpful was the resume workshop in providing feedback that you feel will strengthen your resume? Not Helpful at all Somewhat Helpful Very Helpful Extremely Helpful I Did Not Attend the Resume workshop 6. How likely would you attend another Employment Expo put on by a group of University Students? Not Likely Somewhat Likely Very Likely Extremely Likely

Students Survey:
Follow-up Survey Thanks for everyone's amazing participation at the Employment Expo! Please fill out this survey to the best of your knowledge.

1. How effective do you feel this job fair was? Not Effective Somewhat Effective Very Effective Extremely Effective

2. Would you recommend an Employment Expo to the students next year? Yes No 3. Do you feel that we, the Hospitality group, were successful at accomplishing our mission? Mission: To promote the hospitality industry by investing time to improve one's marketable qualifications at a professional level, facilitate networking between professional associates, and to stimulate further growth to the Utah economy. Not Successful Somewhat Successful Very Successful Extremely Successful 4. How much do you feel that you contributed to the success of this program? No Contribution Some Contribution Good Amount of Contribution Extreme Contribution 5. Out of 1-5, 5 being the strongest... What were the strong areas in the Employment Expo?
1 Weakest 2 3 4 5 Strongest

Set-Up Greeters Employers Resume one-on-one Evaluation

Clean-Up 6. Do you feel this was a well-planned event? Yes Kind of No

Employers Survey:
Employment Expo Survey Thank you for taking this brief survey! Please answer these questions to the best of your understanding.

1. Would your company participate in this Expo again? Yes No 2. Do you feel the host students were... Very Enthusiastic Enthusiastic Unenthusiastic 3. Do you feel the host students were... Very Prepared Prepared Not Prepared 4. Please indicate around how many contacts you...
none 1-4 5-8 9-12 13-16 more

talked to during this Expo? set up interviews with?

consider employable?

Assessment of Outputs, Outcomes, and Impacts Outputs: In the logic model we had expected outputs we wanted to achieve. The first output listed was having 20 companies represented at the Employment Expo. This was almost met with 16 companies agreeing on being present however the day of the event only 8 employees showed up. We were 12 companies below our expected output. To make the expected output possible we set individual goals of contacting so many employers, we divided a calling list, and tried to use personal connections. Another output mentioned was to have at least 100 participants show up seeking jobs at the Employment Expo. We ended up with around 52 participants showing up. This was half the amount expected but considering the smaller amount of employers it was a better situation. In order to achieve this goal of an output we had marketing come up with a flyer and distributed the flyer through Facebook, The Department of Workforce Services e-mail chain, and locally. Other outputs listed on the logic model was participants gaining recognition of jobs available, having a three hour opportunity to network, at least three substantial connections, and being in an inviting atmosphere. All participants were able to see eight companies hiring as well as being presented with a paper of other local businesses hiring by the Department of Workforce Services. The event lasted three hours and everyone was given plenty of time to talk to employers as there was no rush or line presented. In some of the survey results we asked about how many contacts they met that they felt they could follow up with and 62% felt they could follow-up with 1-2 employers and 25% felt they could follow up with 3-4 employers. These results show a closer connection to expected outputs and the actual output which only happened through event logistics in finding a suitable place to host the event, many students efforts into finding employers, and our partner. Outcomes: The first listed outcome in the logic model is creating discussion of employment opportunities. The rest of the list is similar: increased networking, increased awareness of companies hiring, resume refining, and a grasp of career exploration. We cannot fully comprehend the impact of this event on our participants and if that caused employment discussions but through casual conversations we learned that a lot of them came because they heard about the

Employment Expo from another. This was just prior to the event and we can hope that the information gained at our event was passed on through word of mouth. Networking was measured through surveys on both the employers and participants side. 50% of Employers responded that they talked to 13 or more participants while 62% participants responded to talking with 1-3 employers. It seems that companies were willing to talk but participants only visited with select companies and thus there was only slight increase in networking. Also, each participant had an opportunity to get one-on-one feedback about their resumes and so refining resumes was an achieved outcome through this event. Impacts: The impacts created were extremely broad, such as: lower unemployment, enhancing job searching confidence, increasing job hunting, and stimulate local economy. We will admit that these things cant be solved through one program event but small things can make small impacts. We hope through this event at least one job was created and one less person is unemployed, but since this was not our primary focus to collect data for we have no way of knowing. We asked participants if they felt there confidence in their selves increased after resume advice and speaking with a variety of employers and the majority felt some or more increase in their confidence. This confidence could lead to an increase in job searching but this is all hypotheses and cannot be presumed. Interview with Department of Workforce Services (partner): During the Employment Expo one of the evaluation team members was able to have a one on one interview with our partner. The event wasnt what the evaluation team expected it to be with missing employers, empty tables, and slow incoming traffic. We felt as those our efforts were a waste. This individual was able to clearly identify themselves as a member of evaluation who hoped to gain truthful feedback from them. The entire conversation was low-key and positive. The environment was friendly and the individual built a good rapport with them to make the transfer of information possible. What was discovered from interviewing our host, The Department of Workforce Services was that they considered the event to be a success given our circumstances. They informed us that planning hiring events in their situation was started a year before the event day. They always plan to create job fairs during peak hiring times to draw in a larger amount of employers and participants and have

employer fees to keep them from bailing out last minute. However, they enjoyed being on the other side of our event sitting down at a booth as part of an employer resource and to experience that side of an employment expo. During the interview the partner was supportive and understanding. Mentioning they have planned worse events and the number of participants for the time of year seemed spot on. While talking to them they said, by the time we agreed to partner with you, we realized the event was right around the corner. This turned out great given your time constraints and the time of year. They pointed out the large factor time has to do with a successful expo and early advertising. When asked if they had questions they wanted to know basic validation procedures and what exactly was the planning time limit given to students to create this employment expo. Altogether, these partners were incredibly friendly and supportive with information and morale. Results (((((((((Attached graphs in 3 separate files, cant figure out how to put them into the report though))))))))))))))) Participants Results:
1) How many employers did you speak with? 00 (0.0%) 1-3 18 (62.1%) 4-6 8 (27.6%) 7-9 2 (6.9%) 10-12 1 (3.4%) 13+

0 (0.0%) 2) How many employers do you feel you can have a productive follow-up with? 0 3 (10.3%) 1-2 18 (62.1%) 3-4 7 (24.1%) 5-6 0 (0.0%) 7-8 0 (0.0%) 9+ 1 (3.4%) 3) In your perception, how has your sense of confidence increased after speaking with potential employers? No Increase in Confidence 7 (24.1%) Some Increase in Confidence 10 (34.5%) A Good Increase in Confidence 11 (37.9%) A Great Increase in Confidence 1 (3.4%)

4) In your view, how effective were the employers in giving you a clear understanding of what they are looking for in job candidates? Not Effective 2 (6.9%) Somewhat Effective 7 (24.1%) Very Effective 16 (55.2%) Extremely Effective 4 (13.8%) 5) How helpful was the resume workshop in providing feedback that you feel will strengthen your resume? Not Helpful at all 0 (0.0%) Somewhat Helpful 2 (6.9%) Very Helpful 7 (24.1%) Extremely Helpful 5 (17.2%) I Did Not Attend the Resume workshop 15 (51.7%) 6) How likely would you attend another Employment Expo put on by a group of University Students? Not Likely

3 (10.3%) Somewhat Likely 8 (27.6%) Very Likely 10 (34.5%) Extremely Likely 8 (27.6%)

Employers Results:
1) Would your company participate in this Expo again? Yes 8 (100.0%) No 0 (0.0%) 2) Do you feel the host students were... Very Enthusiastic 6 (75.0%) Enthusiastic 1 (12.5%) Unenthusiastic 1 (12.5%) 3) Do you feel the host students were... Very Prepared 7 (87.5%)

Prepared 1 (12.5%) Not Prepared 0 (0.0%) 4) Please indicate around how many contacts you... none talked to during this Expo? set up interviews with? 1-4 5-8 9-12 13-16 more Responses Average Score 4.25 / 6 (70.83%) 2.13 / 6 (35.50%) 1.75 / 6 (29.17%) 2.71 / 6 (45.17%)

0 1 1 2 1 3 8 (0.00%) (12.50%) (12.50%) (25.00%) (37.50%) (12.50%) 2 2 1 0 0 3 8 (37.50%) (25.00%) (25.00%) (12.50%) (0.00%) (0.00%)

consider 2 0 0 0 0 6 8 employable? (25.00%) (75.00%) (0.00%) (0.00%) (0.00%) (0.00%)

Students Results:
1) How effective do you feel this job fair was? Not Effective 0 (0.0%) Somewhat Effective 8 (61.5%) Very Effective 5 (38.5%) Extremely Effective 0 (0.0%) 2) Would you recommend an Employment Expo to the students next year?

Yes 6 (46.2%) No 7 (53.8%) 3) Do you feel that we, the Hospitality group, were successful at accomplishing our mission? Mission: To promote the hospitality industry by investing time to improve one's marketable qualifications at a professional level, facilitate networking between professional associates, and to stimulate further growth to the Utah economy. Not Successful 0 (0.0%) Somewhat Successful 5 (38.5%) Very Successful 7 (53.8%) Extremely Successful 1 (7.7%) 4) How much do you feel that you contributed to the success of this program? No Contribution 0 (0.0%) Some Contribution 1 (7.7%) Good Amount of Contribution 7 (53.8%) Extreme Contribution

5 (38.5%) 5) Out of 1-5, 5 being the strongest... What were the strong areas in the Employment Expo? 1 5 Average 2 3 4 Responses Weakest Strongest Score 0 2 10 4.69 / 5 Set-Up 0 (0.00%) 1 (7.69%) 13 (0.00%) (15.38%) (76.92%) (93.80%) 0 2 5 6 4.31 / 5 Greeters 0 (0.00%) 13 (0.00%) (15.38%) (38.46%) (46.15%) (86.20%) 2 5 5 2.38 / 5 Employers 1 (7.69%) 0 (0.00%) 13 (15.38%) (38.46%) (38.46%) (47.60%) Resume 0 4 9 4.69 / 5 0 (0.00%) 0 (0.00%) 13 one-on-one (0.00%) (30.77%) (69.23%) (93.80%) 0 6 6 4.38 / 5 Evaluation 0 (0.00%) 1 (7.69%) 13 (0.00%) (46.15%) (46.15%) (87.60%) 0 3 10 4.77 / 5 Clean-Up 0 (0.00%) 0 (0.00%) 13 (0.00%) (23.08%) (76.92%) (95.40%) 4.20 / 5 (84.07%) 6) Do you feel this was a well-planned event? Yes 11 (84.6%) Kind of 1 (7.7%) No 1 (7.7%)

Conclusion The purpose of this evaluation is to judge the students successfulness of accomplishing their mission in creating the Employment Expo event. The mission we are trying to achieve is: to promote the hospitality industry by investing time to improve ones marketable qualifications at a professional level, facilitate networking between professional associates, and to stimulate further growth to the Utah economy. Surveys were created to depict the feelings of attendees and us as students to see if we were able to be successful.

Promoting the hospitality industry was attempted during the planning phase of the event through marketing. Marketing came up with a hefty list of hospitality employers with the idea of trying to get the majority of employers to be strictly from the hospitality industry. The entire student team divided this list and called every single one. They quickly realized they needed to branch out and include employers in every field due to the lack of response and interest they were receiving. Class discussion started to focus on how everyone is in the job of hospitality. All businesses needed a positive image with individuals to sell their products in a hospitable way and even if they werent providing a hospitable good they still needed the qualities of hospitality. Investing time to improve ones marketable qualifications was accomplished through a resume workshop. Out of our survey results 41% percent said this was helpful for them but 52% had not taken part in the resume workshop. So, all those who participated in the one on one interview found it extremely helpful and beneficial. As the hospitality team came closer to the event we realized we still did not have anyone to host the resume workshop. They asked several agencies including our partner but no one was able to. If it wasnt for a last minute plea for help to a teacher this mission would not have been accomplished at all. Another mission point that we strived to accomplish the most was to facilitate networking with professionals. There were 16 set employers to come to the event, all of these 16 companies we were lucky to find and especially given a last minute invite. On the event day only 8 employers showed up, half of what we expected and planned for. This was a huge blow. However, with the 8 that showed up we had 52 participants walk in for the event and so it balanced well. With our survey questions we glean that the employers spoke with more than 13 individuals at the event. The participants results showed that they would only speak with 1-3 companies before they left. So, average networking was going on. The environment really made it possible for individuals to talk to certain companies for quite a bit of time but this did not happen. The average networking was not due to the lack of efforts by the hospitality team but maybe a lack of interest in the companies there by participants. The last mission point that wanted to be achieved was to stimulate growth in Utahs economy. This was a very broad impact was put down. Mostly, stimulating growth came from the idea that if we could get more individuals hired before Christmas or even just hired then they would have extra cash to spend into the community and thus Utahs economy would be stimulated. However, we cannot determine such a broad intention. We can only mention that participants and employers felt they took away from this event an opportunity to follow-up with 1-2 individuals to discuss employment further.

In conclusion, the event was a success to those who came. Both participants and employers stated they had high interest in returning to another Employment Expo hosted by students and they gave positive feedback regarding the students preparedness and excitement at the event. What was interesting was the lack of enthusiasm in the students results. Only some felt like the event was effective, 54% of students said they wouldnt recommend other students to do an Employment Expo in future years, and they felt the lack of employers was the weakest section of the entire expo. This is a great learning experience for the host students to reflect on and realize that they really did have a successful expo by trying to fulfill their mission as best they could. Recommendations In order to make sure that mistakes are not repeated we would like to discuss recommendations that would make another Employment Expo better. The mission statement focused on, stimulating the economy, an outcome that was hard to measure. In the future it is recommended to think more about what realistically wants to be achieved through one program and create a statement based off those ideas. Looking back at the mission statement and the desired qualities wanted, we could have included more specifics. We never even discussed technical evaluations per our separate leadership roles in the planning. We could have focused on the effort side in creating the program. Thus, giving credit to those on the team who did or did not do their parts. The department of Workforce services gave the recommendation if we hosted another Employment Expo to pick a time of the year that hiring is in demand, give companies and partners plenty of time to decide on coming and then lots of followup. If students of the CORE continue to plan programs given their time limit then it would be suggested that they quickly decide, find a partner and venue and advertise to both the employers and participants. In this case, those things were accomplished but if we properly used our first two weeks we could have been ahead of the game. Another recommendation would be to think outside of the box. The hospitality group did the best possible job under the tight circumstances, but when you took a look at other groups presentations and all that they accomplished in their time constraints it emphasized the point that to think big is to accomplish big. We really did have an opportunity to do so much good and while our mission of facilitating networking was accomplished what deeper meaning was revealed? When we plan a program next time we should plan something that intrinsically motivates us and then we will have a stronger resolve to do all that we can.

You might also like