You are on page 1of 9

International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842

Issue 05, Volume 4 (May 2017) www.irjcs.com

Design and Implementation of Lecturer Evaluation System


Using ELECTRE Method in Web-based Application
Fajar Masya Hendra Prastiawan Destriyani Putri
Information System Information System Information System
Computer Science Faculty Computer Science Faculty Computer Science Faculty
Mercu Buana University Mercu Buana University Mercu Buana University
fajar.masya@mercubuana.ac.id; hendra.prastiawan@mercubuana.ac.id; deyani.putri13@gmail.com;
Manuscript History
Number: IRJCS/RS/Vol.04/Issue05/MYCS10083
Received: 25, April 2017
Final Correction: 20, April 2017
Final Accepted: 22, April 2017
Published: May 2017

Abstract -- In order to improve the performance of human resources (in this case is a lecturer) at the Faculty of
Computer Science University of Mercu has conducted a lecturer's performance evaluation at the end of each
semesterBuana periodically. The evaluation is aimed at improving the ongoing teaching and learning process. Based
on the evaluation results, we will get an overview of the lecturer's work value for each semester. Ongoing lecturer
evaluation activities have several problems such as lecturer evaluation process is still done manually.To solve these
problems, it needs a change within the system that is from the manual lecturer evaluation system into web-based
lecturer evaluation information system.Thus, all processes in lecturer evaluation activities can be done by online,
either in the input process of questionnaires or in presenting a report.Lecturer evaluation activities which conducted
by online can assist in making decision to get the best lecturer's recommendation by using ELECTRE method.System
development method which use are use case diagram, activity diagram, sequence diagram, and class diagram and
then is use PHP and MySQL as a programming language.
Keywords: Performance Evaluation of Lecturers, ELECTRE Method, Waterfall

I. INTRODUCTION
In order to improve the performance of human resources (in this case is a lecturer) at the Faculty of Computer Science
University of Mercu has conducted a lecturer's performance evaluation at the end of each semester Buana
periodically.The evaluation is aimed at improving the ongoing teaching and learning process. Based on the evaluation
results, we will get an overview of the lecturer's work value for each semester. The university assigns each lecturer who
teaching in the class to distribute the questionnaire to the students and each student fills out the questionnaire to evaluate
the teaching and learning process of the course. The Questionnaire which filling is still done manually by filling the sheet
of paper. Then the sheets are collected and the University will process the data.Based on this, it certainly has some
problems such as filling questionnaires only done by some students who are in the class when the questionnaire was
distributed.The results of the questionnaires which got a bad score will separated by its lecturers to avoidthe reduction of
the score of their work due to lack of supervision from the University, so The University still difficult to get the real score
by its reports.Baed on the existing problem, this research intends to create a Lecturer Evaluation System by Student
usingElimination et Choix Traduisant la Realite (ELECTRE) Methodto assist and facilitate in making decision related to
lecturer's evaluation to get the best lecturer's recommendation.
1.2 RESEARCH PROBLEMS
Based on the above background, the author tries to identify some of the issues that exist among them as follows:
1) How can a decision-making system with Elimination et Choix Traduisant la Realite (ELECTRE) method provide
solutions in determining the best lecturer rankings?
_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 242
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

2) How to design a lecturer performance evaluation information system that can provide online questionnaire filling
service and can present the output performance evaluation result from each lecturer?
1.3 LIMITATION OF RESEARCH
The limitation in this research are:
1) The method used in decision making is the ELECTRE method to determine the best lecturer rank.
2) Objects that are evaluated are lecturers.
3) Filling in the questionnaire data online by the students and can present the results of the questionnaire.
4) The system to be built is a web-based application which can be accessed via the Internet network.
5) This application is built using Apache web server, PHP web programming language and MySQL as its database.
6) The process of developing lecturer evaluation information system is only at the Faculty of Computer Science Mercu
Buana University
7) In the form of questionnaires there are 4 assessment scales, among others:
a. Very unsatisfactory
b. Not satisfactory
c. Satisfactory
d. Very satisfactory
1.4 PURPOSE AND OBJECTIVES
The purpose of this research are:
1) Analyze the ongoing lecturer evaluation system, design and develop an information system capable of reducing the
error rate in input data evaluation, data processing evaluation, calculating the evaluation value and presenting the
result of evaluation output obtained by each lecturer.
2) To apply Elimination et Choix Traduisant la Realite (ELECTRE) method in determining the best lecturer rank from
the result of lecturer's value.
3) With the new information system is expected to facilitate the activity in evaluating the performance of lecturers.

II. METHODOLOGY
2.1 DEFINITON OF DECISION SUPPORT SYSTEM
The Decision Support System (DSS) is an organized collection of people, procedures, software (software), databases and
tools used to help make decisions to solve problems. (Reynolds and Ralph, 2015: 316)
Decision Support System consists of several components as follows:
1) DSS DATABASE
DSS database management system enables managers and decision makers to perform qualitative analysis on large
enterprise data in databases, data warehouses, data marts using data mining and business intelligence. DSS database
management systems can also connect to external databases to provide managers and decision makers with more
information and decision support. External databases can include internet, libraries, government databases etc. The
combination of access from internal or external databases can improve the performance of DSS systems.
2) BASE MODEL
Base model allows managers and decision makers to perform quantitative analysis on both internal and external data.
Once large databases are collected and stored, companies use models (analysis) to turn data into future products, services
and benefits. Base model gives decision makers access to various models so as to explore different scenarios and can be
seen the effect. It can help in the decision making process.
3) USER INTERFACE OR DIALOG MANAGEMENT
The user interface or manager dialog allows the user to interact with the DSS to get the information.
2.2 MULTI CRITERIA DECISION M AKING
Multi Criteria Decision Making (MCDM) is a decision-making method to establish the best alternative of a number of
alternatives based on certain criteria. Criteria are usually the size, rule or standard used in decision making. MCDM is
used to solve problems in discrete space. Therefore, the MCDM is usually used to assess or select a limited number of
alternatives. There are some common features that will be used in MCDM, ie alternatives, attributes, conflicts, between
criteria, decision weight and decision matrix.Some methods that can be used to solve MCDM problems include:
1) Simple Additive Weighting Method (SAW)
2) Weighted Product Model (WPM)
3) ELECTRE
4) Technique for Order Preference by Similarity to Ideal Solution (TOPSIS)
5) Analytic Hierarchy Process (AHP)
_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 243
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

2.3 ELECTRE
ELECTRE Method is included in the multicriteria decision-making method of analysis originating from Europe in the
1960s. ELECTRE is an acronym of Elimination et Choix Traduisant la Realite.The ELECTRE method is one of the
methods used to rank and determine the best alternative. The basic concept of the ELECTRE method is to handle
outranking relationships by using pairwise comparisons of several alternatives based on each appropriate criteria.
Outranking relationships explain that the i-alternatives do not dominate the j-alternatives quantitatively.Alternatives are
said to be dominated if there are other alternatives that outperform them in one or more attributes and the same in the
remaining attributes (Made Sudarma et al, 2015).

1) The first thing that to do in the ELECTRE method is that each attribute is converted to a comparable value. Any
normalization of the value () can be done by the formula:

So we get the R matrix which is the result of normalization.

R is a normalized matrix, where m represents an alternative, denotes the criterion and is the normalization of the choice
of alternative i in relation to the j criterion.

2) After normalization, the next step is to assign the weight (factor of interest) to each criterion expressing its relative
importance () by means of each column of the matrix R multiplied by the weights () determined by the decision
maker. Thus, the weighted normalized matrix is V = RW written in the following formula:

Where W is:

3) The third step is to determine the set of concordance and discordance, for each pair of alternatives k and l (k, l = 1, 2,
3, ... m and k l) the set of criteria j is divided into two subsets, concordance and discordance. When a criterion in an
alternative including concordance is:

Instead, the complementary of this subsection is discordance, that is, when:

4) The fourth step is to determine the value of concordance and discordance matrices.
a. Concordance
To determine the value of the concordance matrix is to add the weights included in the concordance set, mathematically
as follows:

_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 244
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

So the concordance matrix produced is:

b. Discordance
To determine the value of the elements in the discordance matrix is to divide the maximum of the difference of the
criterion value included in the discordance set with the maximum difference of the values of all the existing criteria,
mathematically as follows:

So the discordance matrix produced is:

III. ANALYSIS AND DESIGN SYSTEM


3.1 PROBLEM IDENTIFICATION
The problems faced in the ongoing lecturer evaluation system are as follows:
1) There are students who do not fill out the questionnaire form completely so as to result in data processing in the
evaluation process becomes ineffective and there is a possibility of data obtained is not valid.
2) Evaluation activities of lecturers take a lot of time, because the procedure used has long stages. In addition, there are
often lecturers in the classroom without any students or the number of students who attend just a little.
3.2 PROBLEM SOLVING
Problem solving used in solving existing problems is by changing the lecturer evaluation system that is running manually
with computerized system based on website.With this solution, it is expected that there will be no more processing of
data in the process of ineffective evaluation, long evaluation procedures of lecturers that take a lot of time. The lecturer's
evaluation process is done online. Each student and lecturer has a special account in the process of filling out the
questionnaire form or viewing the evaluation report.
3.3 ANALYSIS OF CURRENT SYSTEM
This analysis is conducted to illustrate the ongoing lecturer's performance evaluation system at Mercu Buana University,
especially the Faculty of Computer Science. The implementation flow begins with Puslit in coordination with the
Director of Learning, Research and Technology in developing the PBM evaluation questionnaire form. After the
questionnaire was approved, LPPM (Institute for Research and Community Service) formed a lecturer evaluation team
(enumerator officer). After that, the evaluation instrument of lecturers is ready to be circulated by the enumerator officer
to the students in each class where the learning process is ongoing between the students and the lecturer concerned
according to the course. Before distributing the lecturer evaluation instrument, the enumerator officer gives first lecture
letter to the lecturer as the enumerator identifier. After getting permission from the lecturer, the enumerator officer
distributes lecturer evaluation instrument to the students and the students are asked to fill the questionnaire instrument. If
the students have evaluated the evaluation process of the lecturer, the student returns the evaluation instrument of the
lecturer to the enumerator officer.

After the enumerator officer receives all results of the lecturer's evaluation instrument, the officer checks the feasibility of
the lecturer's evaluation instrument. Then, the enumerator officer sends the result to the LPPM to be processed to the next
stage which is to enter data into computer by using Microsoft Excel software, then analyzed and calculated the
acquisition result.Based on the results of data processing that has been done in the previous stage, the LPPM reports the
results of the evaluation of lecturers and the evaluation report is distributed to the Related Party (Rector, Vice Rector of
Fields 1, 2 and 3, Director of Learning, Research and Technology, Director of Resources, Coordinator MKCU, Head of
Quality Assurance Center and Dean of Faculty). The following is a description of the flow of the running system.

_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 245
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

Fig. 1 Analysis of Current System

3.4 PROPOSED SYSTEM


Below is the proposed architecture for building the system.

Fig. 2Proposed System Architecture

_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 246
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

3.5 ACTIVITY DIAGRAM

1) Activity Diagram Proposed Filling Questionnaire

Fig. 3.Activity Diagram Proposed Filling Questionnaire


2) Activity Diagram Proposed Managing Questionnaire Evaluation

Fig. 4.Activity Diagram Proposed Managing Questionnaire Evaluation

_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 247
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

3) Activity Diagram Proposed Calculating Electre Method

Fig. 5Activity Diagram Proposed Calculating Electre Method

3.6 CLASS DIAGRAM

Fig. 6.Class Diagam


_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 248
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

IV. IMPLEMENTATION
4.1 USER INTERFACE DISPLAY OF FILLING QUESTIONNAIRE
This page is a display of questionnaires filled by students after logging into the system and clicking the questionnaire
button on the student's main page. Then, students are asked to choose the name of lecturers and courses taught by the
lecturer before the system displays form filling questionnaire.

Fig. 7- User Interface Display of Filling Questionnaire

4.2 TEST RESULT ANALYSIS


After thorough testing, it can be concluded that the test has presented the output (output) and the process in accordance
with the design of the application. The results of this test can be said that this application can work well because it has
been proven from the results of test scenarios. Test results obtained can be analyzed as follows:
1) The admin login page that controls menu activity and the form in the system has done well.
2) The user login page in the system has been running properly.
3) The admin home page in the system is running well.
4) The main page of the user in the system running well and in accordance with the expected.
5) All sub menus contained in the menu of master data, menu questionnaire evaluation and electre process works well
in accordance with the planned.

V. CONCLUSION
The conclusion that the author can be taken from the results of the implementation and evaluation of this research are as
follows:
1) Lecturer evaluation system that has been made has been computerized and web-based and can be used as an
alternative solution to assist in lecturer evaluation process.
2) With this system, admins and lecturers can see the best lecturer ranking obtained from the calculation using the
ELECTRE method.
3) For further research, it is expected that the system will be added for evaluation of lecturer based on the research and
community service

_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 249
International Research Journal of Computer Science (IRJCS) ISSN: 2393-9842
Issue 05, Volume 4 (May 2017) www.irjcs.com

REFERENCES

[1] Connolly, Thomas dan Carolyn Begg. 2014. Database Systems: A Practical Approach to Design, Implementation, and
Management, 6th edition. New Jersey: Pearson.
[2] Dennis, Alan dkk. 2015. System Analysis & Design An Object Oriented Approach with UML, 5th edition. New
York: John Wiley.
[3] Eniyati, Sri dan Rina Candra N. S. 2010. Perancangan Sistem Pendukung Keputusan Penilaian Prestasi Dosen
Berdasarkan Penelitian dan Pengabdian Masyarakat. Journal Teknologi Informasi DINAMIK. Vol. XV, No. 2.
(ISSN: 0854-9524).
[4] Gilmore, W. Jason. 2010. Beginning PHP and MySQL: From Novice to Professional, 4th edition. New York: Apress.
[5] Gupta, Hitesh. 2011. Management Information System (An Insight). New Delhi: International Book House PVT.
LTD.
[6] Situmeang, Mesdina. 2015. Perancangan Aplikasi Penilaian Hasil Kinerja Dosen Terbaik Dengan Metode Simple
Multi Attribute Rating Technique (Studi Kasus: AKPER Yayasan Binalita Sudarma Medan). Pelita Informatika Budi
Darma.Vol. IX, No. 1. (ISSN: 2301-9425).
[7] Stair, Ralph M. dan George W. Reynolds. 2015. Fundamentals of Information System, 8th edition. USA: Cengage
Learning.
[8] Suehring, Steven dan Janet Valade. 2013. PHP, MySQL, Javascript & HTML5 All-In-One for Dummies. New York:
John Wiley.
[9] Valacich, Joseph S. dan Christoph Schneider. 2015. Information Systems Today Managing in the Digital World, 7th
edition. New Jersey: Pearson.

_________________________________________________________________________________________________
IRJCS: Impact Factor Value SJIF: Innospace, Morocco (2016): 4.281
Indexcopernicus: (ICV 2015): 79.58
2014- 17, IRJCS- All Rights Reserved Page - 250

You might also like