Professional Documents
Culture Documents
Pages: 454-462
454
455
456
Requirement Verified
Requirement Validated
Requirement Severity
Tacit Category
Explicit Category
Innovative Category
3.1.2
Usability Measures
Rating on Operability
Rating on Communicativeness
Rating on Accessibility
User Rating on UI
Expert Rating on UI
3.1.3
Availability Measures
Availability of Portal
3.1.4
Relevance Measures
3.1.5
Interaction Measures
Rating on methodology
Rating on Links and Resources
Rating on Events
Rating on Feedback and Reviews
3.1.6 Application of WAM
The weighted mean is similar to an arithmetic
mean (the most common type of average); where
instead of each of the data points contributing
equally to the final average, some data points
contribute more than others. The weights can be
specified for the measures or metrics collected,
based on the user or implementer or evaluation
needs. For example, training organizations gives
higher weightage to the quality of the training
material, certifications obtained by the participants
and also the employability of the participants after
completing the training, which indicated its
effectiveness. In higher learning institutions like
universities and engineering colleges, the relevance
of the knowledge asset based on the syllabus or
curriculum gets more weight as it reflects the
standard. Additional weights can be given to the
academic institutions, if the knowledge asset on a
specific subject encourages students to do projects
or submit research papers or obtain higher scores in
the exams in the subjects taught and presented in
the knowledge portal or repository. The web based
e-Learning measures can be weighted either
equally or non-equally, based on the evaluation or
ranking criteria; in this case, we considered four
different aspects of the knowledge sharing, and
assigned equal weights as the measures are equally
important to provide reasonable ranking. The noncritical or supportive measures which indirectly
contribute towards web based e-Learning
measurement will be considered as non-weighted
measures for our evaluation. The 90:10 formulas
are adapted for our ranking and rating using the
weighted average mean; in these formulas, 90
indicates 90% of the allocation for critical web
based e-Learning measures and 10 indicates 10%
of the allocation for non-weighted measures such
as management, supporting infrastructure and
participants subject knowledge.
457
10%
for
overhead
infrastructure.
rg
yaopthamology
e-Learning portal
E_L
p_3
http://www.sei.cmu.ed
u/training/elearning
Software
engineering
institute
E_L
p_4
http://ifrs.icai.org
Financial, cost
and management
accounting
eLearning portal
E_L
p_5
http://www.ilearnsmart
.com/Academic
learning content
for K-12 and
higher education
students, and
professionals
E_L
p_6
http://aditya.edu.in
Aditya
College(learning
beyond campus)
E_L
p_7
http://www.dbuglobal.
com
Donbosco
university eLearning portal
E_L
p_8
http://elearning.naarm.
ernet.in
National
academy of
agriculture
research
management eLearning portal
E_L
p_9
https://mybanklearning
.sbi.co.in/xsl-portal
State Bank of
India e-Learning
portal
for
supporting
p_2
eLear
ning
Port
al
No
e-Learning
link
e-Learning
Portal type
E_L
p_1
http://www.ilearnsmart
.com
E_L
http://www.ekalavya.o
SankaraNethrala
e-Learning
Functionality
Measure/Metric
Wei
ght
(10
%)
Capture
d
Rating(f
rom
Metric
DB)
Weight
ed
Calcula
tion
F_M1
OverallFunctionalit
yRating
20%
3.5
0.7
F_M2
RequirementVerifie
d
10%
3.2
0.32
F_M3Requirement
Validated
10%
3.6
0.36
10%
2.1
0.21
F_M4
RequirementSeverit
458
y
F_M5
TacitCategory
10%
4.1
0.41
F_M6
ExplicitCategory
10%
2.4
0.24
F_M7
InnovativeCategory
30%
3.1
0.93
100
%
Total
Score
3.17
0.371
e-Learning
Availability
Measure/Metr
ic
Wei
ght
10%
)
U_M1
OverallUsability_Ratin
g
Capture
d
Rating(
from
Metric
DB)
Weight
ed
Calcul
ation
3.8
0.76
20%
(30%)
Captured
Rating(fro
m Metric
DB)
Weighted
Calculatio
n
A_M1
Content
Rating
30%
3.2
0.96
A_M2
Structure
Rating on
Operability
30%
3.9
1.17
A_M3
Content
Rating
20%
3.2
0.64
A_M4 Rating
on Strategy
10%
4.2
0.42
A_M5
Availability
Of Portal
10%
1.0
0.1
100%
Total
Score
3.29
0.987
e-Learning Usability
Measure/Metric
Weigh
t
TABLE
e-Learning
Efficiency
Measure/Metri
c
Weigh
t
(20%)
Capture
d Rating
I_M1 Rating on
methodology
20%
3.9
0.78
20%
3.5
0.7
(from
Metric
DB)
Weighted
Calculatio
n
U_M2
RatingOnOperability
20%
0.8
U_M3RatingOnComm
unicativeness
10%
2.9
0.29
I_M2 Rating on
Links
and
Resources
0.7
I_M3 Rating on
Events
30%
4.1
1.23
I_M4 Rating on
Feedback and
Reviews
30%
3.6
1.08
100%
Total
Score
3.79
U_M4
RatingOnAccessibility
20%
3.5
U_M5
UserRatingOnUI
20%
0.8
U_M6
ExpertRatingOnUI
10%
3.6
0.36
100
%
Total
Score
3.71
0.758
0.37
459
6.
e-Learning
Efficiency
Measure/Metri
c
R_M1 Overall
User Rating on
Relevance
R_M2 Overall
Expert Rating
on Relevance
R_M3 Modulewise relevance
rating by user
R_M4 Modulewise relevance
rating by expert
Weigh
t
(10%)
Capture
d Rating
(from
Metric
DB)
RELEVANCE
Weighted
Calculatio
n
2.2
10 % of Non Weighted
Dimension Group Score
3.9
90%
0.78
10%
20%
3.5
0.22
Allocation
20%
11.0
0.7
Type
Derived
Score
Weighted Dimension
Group
2.866
Non Weighted
Dimension Group
0.22
4.1
1.23
Rank
30%
3.6
1.08
100%
Total
Score
3.79
Category
Rating
Outstanding
Extremely
Effective
Effective
DIMENSION
Below Effective
Not Effective
0.379
Captured
Rating(from Metric
DB)
3.0
NW_M2 Management
Support
2.0
NW_M3 Condusive
Environment
1.0
NW_M4 Particpants
Subject or Domain
Knowledge
2.0
NW_M5Participants Thrust
for Knowledge Collabration
3.0
eLea
rnin
g
Por
tal
No
e-Learning Portal
link
e-Learning
Portal type
eLea
rnin
g
rate
d
sco
re
E_
Lp_
1
http://www.ilearns
mart.com
School based
e-Learning
portal
3.0
86
E_
Lp_
2
http://www.ekalav
ya.org
SankaraNethr
alayaopthamol
ogy
2.9
6
e-Learning
portal
E_
Lp_
3
http://www.sei.cm
u.edu/training/elea
rning
Software
engineering
institute
3.3
85
E_
Lp_
4
http://ifrs.icai.org
Financial, cost
and
management
accounting eLearning
3.5
67
460
portal
E_
Lp_
5
http://www.ilearns
mart.com/Academi
c
learning
content for K12 and higher
education
students, and
professionals
E_Lp_1
E_Lp_3
E_Lp_5
E_Lp_7
E_Lp_9
5
4
3
Rank
2
1
0
3.6
56
e-Learning
rated
score
e-Learning portals
Figure 5. shows the graph which demonstrates the
ranking of web based e-Learning portal based on
table 9
The Table 7 contains the summary values for both
weighted and non-weighted scores for the first
sample presented in Table 1.. The weighted
dimension group score is 2.866 which is derived by
adding all the five quality dimension scores and the
non-weighted dimension group was given 0.22 and
both the derived scores were added to make up the
overall web based e-Learning portal Effectiveness
Score of 3.086. The portal which was evaluated by
the users and experts with the score of 3.086 and
hence it is considered to be effective. The
dataobtainedforthisexperimentconcerned with the
effectiveness of the web based e-Learning portal is
presented in Table 9. for different organizations.
From the graph fig 5, it is very clear that all the
considered samples are ranked and rated as either
effective or below effective.
5. CONCLUSION
By referring to table 7 and the guideline table 8 for
ranking and rating, Table 9 is generated based on
the calculation measures provided in the Table
2,3,4,5,6, it is clear that the evaluated web based eLearning portal is effective as the overall evaluation
rating is 3.086 for the first sample. The same
procedure is followed for the other web based eLearning portals and the results are presented in
Table 9.In this research work, we have attempted to
use the metric database and a proven statistical
technique, the weighted average mean to validate
the effectiveness of the e-Learning process and the
portal using ranking and rating. This proves that the
combination of the metric database with a statistical
technique such as the WAM could be useful to
predict the usefulness and effectiveness of the e-
Venkata
S
Dayanandan,
Angelina
Geetha(2011), Adaptation of Goal Question Metric
Technique For Evaluation of Knowledge
Management Systems, Review of Knowledge
Management Journal, Volume 1, Jan-June 2011,
ISSN:2231-5845
[2]
461
462