10/28/2009

SETARA2009 (RATING
SYSTEM FOR MALAYSIA
HIGHER EDUCATION)
EXERCISE
(BY MQA)

Briefed By:
Prof. Dato’ Dr. Md. Tahir Md. Azhar
Deputy Rector (Academic & Planning)

1
 10/28/2009

INTRODUCTION
Objective: To measure the institutional level quality
of teaching and learning of undergraduate
programmes in university and university colleges.

Data will be captured through:

1) MyMOHES

2) COPIA (2nd Edition) – Rating based on the

Academic Performance Audit
3) JPT’s Tracer Study

4) Employers’ Survey which will be conducted by the

SETARA Team
5) Institution Data Key-In

2
 10/28/2009

DOMAINS

DOMAIN SUB-DOMAIN

1) Talent (faculty & student)

INPUT
2) Resources (physical, financial,
student support & services)
3) Governance

PROCESS 1) Curriculum Design

2) Delivery/Pedagogy
3) Assessment
4) Monitoring
5) Ancillary Activities

1) Student Marketability
OUTPUT 2) Student Satisfaction
3) Employers’ Satisfaction

3
 10/28/2009

SETARA – DETAILED CRITERIA FOR INPUT

(TALENT – 8%)
No Criteria KPI Full
marks
1 Faculty: Students per faculty 0.8
Adequacy
Capability PhD qualified faculty 1.44
Average annual emolument of faculty/staff 0.48
Staff training (including conferences, 0.48
sabbaticals) expenses
Experience Teaching experience 0.32
Industry/professional experience 0.64
Experience teaching abroad 0.64
2 Student Percentage of enrolment with CGPA > 3.00 2.38
quality or equivalent on entry
Students on scholarships 0.42
International Percentage of international students 0.40
Students
TOTAL 8%

4
 10/28/2009

SETARA – DETAILED CRITERIA FOR INPUT

(GOVERNANCE – 20%)
No Criteria Full marks
1 Governing body (Board of Directors, Governors, 2.5
Council, etc.)
2 Academic Governance 2.5
3 Leadership and Staff 2.5
4 Strategic Planning 2.5
5 Academic Autonomy 2.5
6 Clearly defined lines of responsibility & decision-making 2.5
7 Student representation 2.5
8 Organizational climate 2.5
TOTAL 20%

Note: The criteria and weightage are still subjected to changes by the SETARA
team.

5
 10/28/2009

SETARA – DETAILED CRITERIA FOR INPUT

(RESOURCES – 5%)

No Criteria KPI Full

marks
1 Infrastructure Number of titles of teaching material per 2.06
(Physical) student
Size of space per student for teaching and 0.69
learning
2 Financial Annual expenditure per student on library 0.25
resources
Percentage of annual expenditure on ICT 0.25
facilities
3 Support Percentage of FTE students given full fee 0.44
Services waiver or equivalent financial aid
Number of students per licensed counselor 0.88
Number of student per doctor (including 0.44
panel doctors)

TOTAL 5%

6
 10/28/2009

SETARA – DETAILED CRITERIA FOR PROCESS

(CURRICULUM – 33%)
No Criteria KPI Full
marks
1 Curriculum Relevance (Based on needs of 1.24
stakeholders, scholarship. Future needs)
Comprehensiveness (Extent it meets the 1.24
cognitive, psychomotor, affective)
Challenging (Extent it encourages higher 1.24
order thinking and decision making)
Currency ( Extent it incorporates the latest 1.24
appropriate philosophy, theories,
techniques, etc.)
2 Quality Effectiveness (Extent it achieves its 4.29
Delivery/ objectives)
Pedagogy
Efficiency: ratio of annual operating budget 1.65
to enrolment
Efficiency: ratio of academic staff to total 0.66
staff population

7
 10/28/2009

SETARA – DETAILED CRITERIA FOR PROCESS

(CURRICULUM) – CONT.
No Criteria KPI Full
marks
3 Quality Validity of assessment (Extent it measures 4.95
Assessment the learning outcomes)
Reliability: % of courses with marking 0.83
schemes
Reliability: % of courses with scoring rubrics 0.83
Reliability: % of courses with moderated 0.83
answer scripts
Transparency (to students) of assessment 0.83
4 Monitoring External: MQA & professional 2.97
Internal: Programme monitoring 3.96
Internal: Student progress 2.97

Note: The criteria and weightage are still subjected to changes by the SETARA
team.

8
 10/28/2009

SETARA – DETAILED CRITERIA FOR PROCESS

(CURRICULUM) – CONT.

No Criteria KPI Full

marks
5 Ancillary Internship: % of student participating in 1.82
Activities internship
Outreach: % of student participating in 0.33
outreach programmes
Exchange: % of inbound exchange students 0.33
Exchange: % of outbound exchange 0.33
students

Extra-curricular: % of student participating 0.50

in social & extra-curricular activities
TOTAL 33%

Note: The criteria and weightage are still subjected to changes by the SETARA
team.

9
 10/28/2009

SETARA – DETAILED CRITERIA FOR OUTPUT

(QUALITY OF GRADUATES – 33%)
No Criteria KPI Full
marks
1 Student Employment rate (6 months of graduation 6.6
marketability or continuing studies)
Average monthly starting pay of graduates 6.6
2 Student Average satisfaction with the University 4.95
satisfaction (Scale of 1 – 5)
3 Employers’ Average satisfaction with the graduates of 5.94
Satisfaction the university (Scale 1 – 5)
Intention to employ from the university 8.91
(Scale 1 – 5)
TOTAL 33%

Note: The criteria and weightage are still subjected to changes by the SETARA
team.

10
 10/28/2009

SETARA will be conducted every 3 years.

The results of “Research University” and “SETARA”

will become the assessment of IPT performances.

1) RU: for research evaluation

2) SETARA: for teaching and learning evaluation

11
 10/28/2009

THANK YOU

12