Professional Documents
Culture Documents
Article information:
Access to this document was granted through an Emerald subscription provided by emerald-srm:614218 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald for
Authors service information about how to choose which publication to write for and submission guidelines
are available for all. Please visit www.emeraldinsight.com/authors for more information.
The current issue and full text archive of this journal is available at
www.emeraldinsight.com/0265-671X.htm
IJQRM
28,5
484
Abstract
Downloaded by EKB Data Center At 07:26 09 August 2016 (PT)
Purpose As with the ISO 9000 standard, some doubts arise from the scientific literature about the
impact of the EFQM model in companies success. This paper aims to present an analysis of the
relationships in the 2003 version of the EFQM model using data from the actual self-evaluations of 68
organizations. It also analyzes if there are possible differences in the EFQM implementation between
public and private organizations.
Design/methodology/approach The Partial Least Squares (PLS) method is used to test
hypotheses.
Findings Results show that the model does not behave in the way that the designers of the EFQM
expected. Two of the results variables are not sufficiently correlated with the others to be part of the
complete model. When the model is tested without these two variables, the connection between
enablers fails, since policy and strategy, people, and partnership and resources do not have
statistically significant effects on the process. There is a slightly higher achievement in the group of
manufacturing/private companies compared with the group of public/educational institutions.
Research limitations/implications This paper is an exploratory study. A deeper analysis of the
agency criteria might produce improved results. It would also be possible to examine sub-criterion
levels. Each enabler in the model is composed of different sub-criteria and the relationships among
them have not been explored in the literature. The question that needs to be addressed is whether the
inclusion of enablers in the EFQM Excellence Model can be justified on empirical grounds.
Originality/value Previous research has been conducted using secondary data. The study has
been made using the real self-evaluations of organizations, evaluations that have been validated by
official staff of the EFQM organization. In addition, whereas much of the previous research analysed
the 1999 version of the model, this paper focuses on the latest version of 2003.
Keywords European Foundation for Quality Management, Quality management,
Total quality management, ISO 9000 series, Spain
Paper type Research paper
1. Introduction
Since 1950 much has been written in the scientific arena about quality management
and its vital importance for company survival. The Japanese effort to reconstruct their
economy was the trigger of a series of fundamental changes in management that are
still affecting enterprises worldwide. Considering quality as the responsibility of all
areas in the company, prevention rather than inspection, customer orientation,
continuous improvement and quality leadership are some key characteristics of a
Financial support from Ministerio de Ciencia e Innovacion (Reference project ECO2008-02387) is
gratefully acknowledged.
company implementing the Total Quality Management (TQM) principles, which were
initially used in Japan and quickly adopted by US and European companies.
Associated with these concepts were a number of statistical and teamwork tools that
could help to develop continuous improvement and a culture of participation. In the
words of Adebanjo (2001), TQM shifts from Management of Quality to Quality of
Management.
The Deming Prize in Japan was the outcome of the importance attributed to quality
management in that country. As previously with the TQM philosophy, the USA
quickly developed its own prize, the MBNQA and, with some delay (1992), Europe
followed this trend with the EFQM award. Later, many national prizes were created (53
according to Tan et al. (2003)) and most of them have been designed taking the first
three as models (Curkovic et al., 2000).
However, at the time of the birth of EFQM, companies in Europe were paying
attention to another management trend related with quality: the ISO 9000 series of
standards. These standards were initially designed as a quality assurance system but
they were later changed to converge towards a quality management system as well.
Europe has given great importance to this certificate, and in many cases, it has been
imposed, by industrial customers, or governments. As a consequence, the number of
certifications grew exponentially. In fact, it could be stated that, what at the beginning
was considered as a source of competitive advantage (Benner and Veloso, 2008), today
is simply a requirement to do business in some sectors in Europe.
The focus on quality management has also been reflected in the literature. Special
attention has been paid to the ISO 9000 standard. Most of these papers have tried to
find whether the ISO standard could drive companies to achieve higher performance
(Benner and Veloso, 2008). However, these studies have not been conclusive. Some of
them found positive effects (e.g. Corbett et al. (2005) while others did not
(Martnez-Costa et al., 2009). Possible factors that influence this relationship have
also been the subject of research, among them the TQM environment (Terziovski et al.,
1997), time since adoption (Corbett et al., 2005; Sroufe and Curkovic, 2008), motivation
(Martnez-Costa et al., 2008), the way in which the standard is implemented (Naveh and
Marcus, 2005), firm size (McGuire and Dilts, 2008) and technological coherence (Benner
and Veloso, 2008).
The question is: what is the next step for European companies? It seems that the
answer to this question may be the EFQM model. This is being applied in companies
and other organizations at a growing rate. The EFQM model is considered
synonymous with TQM by many researchers and practitioners (Hendricks and
Singhal, 1996; Adams et al., 1999; Forza and Filippini, 1998) and as a step forward after
ISO 9000 certification.
The EFQM model, as well as the Deming and the MBNQA models, was designed
looking at the TQM principles. In fact, some researchers have used it as a proxy when
analyzing the effect on performance of a TQM system (Santos and Alvarez, 2007a, b;
Prajogo and Sohal, 2004). Probably, one of the determinants of its success is that it
offers a clear framework, a terminology and a methodology that is not so clear in TQM.
Different papers that have tried to define TQM dimensions (Black and Porter, 1996;
Flynn et al., 1995; Saraph et al., 1989) and each includes different dimensions. The
elements of the EFQM model create a reasonably clear path that the company has to
follow in order to improve its results. In fact, results were introduced into the model
Critical
evaluation of the
EFQM model
485
IJQRM
28,5
486
and 50 per cent of the points that are earned by a company in this model depend on its
results with customers, workers, and society, and its key results. In addition, EFQM is
offered as a tool that managers can find useful for self-evaluation of their organizations
(Van der Wiele et al., 2000; Ahmed et al., 2003; Samuelsson and Nilsson, 2002).
Probably, the most important effect that ISO 9000 has had in European industries is
the dissemination of a general interest in quality management. Some authors even
consider it to be a good basis for later implementation of the EFQM model (Geraedts
et al., 2001). As has been previously stated, the EFQM model is now starting to be
valued as the next logical stage in the quality journey, in the framework of a
continual improvement philosophy.
However, as with the ISO 9000 standard, some doubts arise from the scientific
literature about the impact of the EFQM model in companies success. This model has
been called an excellence model, deleting the term quality from its name, despite
the origin and real substance of its concepts. This fact has been criticized by authors
such as Dale et al. (2000), who argue that it reinforces the erroneous belief that TQM is
a fad and quality is no longer an important issue for European businesses.
This paper tries to make a contribution to the scientific evaluation of the EFQM
model. It presents an analysis of the results of the evaluation of 68 organizations, 43
industrial companies and 25 service organizations mainly from the education sector
(public companies). Within the public sector in Spain, the education sector has been one
of the sectors where the EFQM Excellence Model has been more extensively applied
and more organizations have attained the excellence level.
Therefore, the importance of researching on the EFQM Excellence Model is clear,
since it is being used by an increasing number of companies and is presented not only
as a model of TQM application but as a model of excellence in management. Although
some previous papers have analysed this topic, two important contributions of the
present research are:
(1) All previous research has been conducted using secondary data. Our study has
been made using the real self-evaluations of organizations, evaluations that
have been validated by official staff of the EFQM organization.
(2) Whereas much of the previous research analysed the 1999 version of the model,
this paper focus on the latest version of 2003. Since the changes could be
considered relevant, it is necessary to know the usefulness of the model in its
present form. In fact, a new version of the model was approved while this
research was in progress, and this new version will have to be analyzed in the
future.
The EFQM Excellence Model has been adapted in its 2003 version for non-profit
organizations like public institutions (Eskildsen et al., 2004). There are several
differences with this kind of company, the most fundamental being that they do not
intend to secure financial results. The application of this model in public organizations,
raises the problem that they are much more regulated, and have less flexibility to adapt
to new models of management. This fact implies that, though managers of these public
organizations intend to implement the EFQM Excellence Model (and governments may
push them to do so), legal restrictions can be an obstacle to the application of many
elements of the model. In this sense, our second objective in this paper is to evaluate
Critical
evaluation of the
EFQM model
487
IJQRM
28,5
488
the model. They show innovation and learning helping to improve enablers that in turn
lead to improved results.
This structure assumes the existence of interrelations among enablers and results
and the fact that having success in an isolated area is not enough to achieve excellence
(Naylor, 1999).
Adebanjo (2001) affirms that this model incorporates the quality of management
principles while largely leaving the management of quality issues to individual
organizations. This means that mere quality assurance aspects, related mainly to
production process control, are assumed and companies will probably count on other
systems such as ISO 9000, or six sigma to focus in those aspects.
Figure 1.
The EFQM Excellence
Model
the key role of policy and strategy in the results criteria, since it determines the impact
on society and results in customers.
Bou-Llusar et al. (2005) did not analyze all the relationships of the EFQM model, but
only how the agents impact on results, and confirmed that the enabler factor, as a
whole, improves results. In a more recent paper (Bou-Llusar et al., 2009) the same
authors group enablers into social and technical and measure their impact on four
types of results: customer, people, society and key. In their conclusions they find that
the Enabler Excellence construct is reflected to a greater degree by the criteria related
to the social dimension than the technical dimension, and that in the result domain,
Society results is the criterion which shows least relationship with the Result
Excellence construct.
A summary of the main studies analyzing EFQM relationships is found in Tables I
and II. These studies generally confirm the internal logic that underlies in the EFQM
model. However, apart from Bou-Llusar et al. (2009), all these papers are about previous
versions of the EFQM model and not about the 2003 version. On the other hand,
Author
Version
Information source
Dijkstra (1997)
Eskildsen and Kanji (1998)
Eskildsen and Dahlgaard (2000)
Prabhu et al. (2000)
Eskildsen et al. (2001)
Eskildsen et al. (2002)
Reiner (2002)
Bou-Llusar et al. (2005)
Calvo de Mora et al. (2005)
Calvo de Mora and Criado (2005)
Bou-Llusar et al. (2009)
1992
1992
1999
1992
1999
1999
1999
1999
1999
1999
2003
Secondary
Secondary
Secondary
Secondary
Secondary
Secondary
Secondary
Secondary
Secondary
Secondary
Secondary
Criteria
C1
C2
C3
C4
C5
C6
C7
C8
C9
C1
C2
C3
C4
C5
C6
C7
C8
Critical
evaluation of the
EFQM model
489
Table I.
Studies analyzing the
EFQM Excellence Model
relationships
C9
2,6,8,9,10
2,4,5
2,4,5
4,5,6
3
2,4,5,8
2,4,5
2,4,5,9
4,5
1,2,4,5,9,10
10
1,2,3,10
1,3,4,5,10
2,8,9
8,10
4,5,8
8,10
1,2
1,4,5
7,8,10
6,8
6
7,10
6,7
Table II.
Relations among the
EFQM elements
according to the literature
IJQRM
28,5
490
Bou-Llusar et al. (2009) did not analyze specific relationships but the general impact of
agents in results. All these studies use secondary data collected from the companies to
analyse the relationships statistically.
Once the literature had been reviewed, a gap regarding the specific relationships of
the 2003 version of the EFQM model was detected. The main objective of this study is
to find out if the relationships in the new version of the model follow the EFQM logic.
This is, consequently, a first exploratory study with the following hypotheses derived
from the EFQM excellence model. These hypotheses assume the sense of the causal
relationships implicit in the model, from left to right. However, there are four
relationships that cannot be deduced using this criterion, since the connectors are
vertical. Therefore, these 4 relationships will be explained in detail.
H1.
H2.
H3.
H4.
H5.
H6.
H7.
H8.
H9.
H10.
H11.
H12.
H13.
H14.
H15.
Critical
evaluation of the
EFQM model
H16.
491
The EFQM Excellence model has been adapted in its 2003 version for non-profit
organizations like public institutions (Eskildsen et al., 2004). Differences between
public/private organizations have been addressed in political science literature (Lane,
1993). A key difference is that managers in public organizations have limitations at the
time of determining strategic objectives. This fact affects the decision-making process,
resources availability, personnel management, and so on. Despite these differences,
many models and norms have been developed for private/profit organizations
assuming that other organizations can adapt them (Eskildsen et al., 2004, Massey,
1999).
Tar (2008) analyzes differences in the implementation of the EFQM model between
a private company and five services of a public university. His conclusions are that
higher education institutions may adopt business practices, but these must be
adaptable to their own context.
In the light of these findings, the analysis of possible differences in the EFQM
relationships between these two types of companies may be interesting, comparing
ones from the education/public sector with others from private manufacturing
companies. In order to examine this question in the case of as many companies as
possible, H17 was developed:
H17. There are no differences in the relationships proposed by the EFQM model
between public/education organizations and private/manufacturing
companies.
3. Data collection and methodology
An important difference of the present study compared with previous research is that
the data for this study is composed of the real values in each criterion obtained from 68
Spanish organizations.
Data was provided by a consultancy agency licensed by EFQM to evaluate
companies. The sample provided were 68 organizations that were evaluated by this
agency in the period 2004-2007. This agency provided the scores on each factor and
main characteristic of the organizations for the research team without identifying the
organizations. Consequently, the data used for this study are the assigned scores on
each factor of the EFQM model collected by the consulting agency according to the
criteria of the EFQM organization. This ensures that the data are not collected by the
authors using a questionnaire, but are the real scores assigned to the companies by the
EFQM-licensed agency.
The 68 organizations in the sample include manufacturing/private companies from
different sectors (43) and service organizations from the education sector (25). Since the
organizations in the education sector were public organizations, these organizations
IJQRM
28,5
492
are consequently non-profit organizations. The paper by Tar (2008) found similarities
in the application of the EFQM model in one private company and public universities.
Our paper analyses these two kinds of companies both jointly and separately.
Since scores on each criterion range over different scales, in order to get a
homogeneous scale scores on each criterion were divided by the maximum value of the
criterion according to the EFQM Model.
In this research the Partial Least Squares (PLS) method is used to test hypotheses.
PLS path modelling represents a well-substantiated method for estimating complex
cause-effect-relationship models in business research (Gudergan et al., 2008). It is
based on least squares estimation with the main objective being to maximize the
explanation of variance in a structural equation models dependent constructs
(Henseler et al., 2009).
One of the advantages of PLS is that it is more flexible in sample size than
covariance-based structural equation modelling (e.g. LISREL) when estimating path
coefficients (Anderson and Gerbing, 1988). In fact, the use of PLS is recommended
when samples are small (Reinartz et al., 2009). It is suggested that the sample size be
equal to the larger of the following:
.
ten times the number of indicators of the scale with the largest number of
formative indicators; or
.
ten times the largest number of structural paths directed at a particular construct
in the inner path model.
In this case our available information was from 68 companies. This sample size would
not be enough for using covariance-based structural equation modelling but it is
enough for PLS.
The second reason for using this method was that it is explicitly recommended in
early stages of theoretical development in order to test and validate exploratory models
(Henseler et al., 2009). As has been pointed out previously, the objective of this research
is exploratory.
A structural model using PLS consists of two models, the measurement model
(outer model) and the structural model (inner model). In the present research constructs
are composed of only one indicator since it is the real value of the construct provided
by the EFQM licensing company. For that reason, the only purpose of applying PLS is
to test the relationships between constructs (structural model or inner model) and not
the measurement instrument (outer model).
PLS does not use fit indices. For PLS (in contrast to covariance-based structural
equation modelling), a good model fit is established with significant path coefficients,
acceptably high R 2 values they should not be lower than 0.1 according to Falk and
Miller (1992) and internal consistency (construct reliability) above 0.7 (this last
point is not applied in this research since our constructs are formed with the real
indicators) for each construct (Gefen et al., 2000). Another assessment of the
structural model involves the models capability to predict. The predominant measure
of predictive relevance is Stone-Geissers Q2, which can be measured using
blindfolding procedures (Henseler et al., 2009). If this value for a certain endogenous
latent variable is larger than zero, its explanatory variables provide predictive
relevance.
4. Results
Table III shows main descriptive statistics for the variables.
Since the sample is composed by two different kinds of organizations, industrial/
private, and education/public sector, tests were first conducted to see whether there
were differences between them. In general, companies in the manufacturing sector
obtained higher scores on most of the criteria, the most important differences being in
the results criteria. After having obtained these results an ANOVA was conducted to
evaluate if these differences were statistically significant. Table IV shows the results.
As can be seen, statistically significant differences were found for partnership and
resources, processes, society results and key performance results, where industrial
companies had higher scores.
Proceeding to test the hypotheses, Table V shows the main indicators of the
structural model, R 2 adjustment and Stone Geissers Q2. According to Falk and Miller
(1992) R 2 should not be lower than 0.1. The predominant measure of predictive
Minimum
Maximum
Mean
SD
Leadership
Policy and strategy
People
Partnership and resources
Processes
Customer results
People results
Society results
Key performance results
68
68
68
68
68
68
68
68
68
0.11
0.09
0.12
0.16
0.11
0.06
0.06
0.05
0.14
0.56
0.58
0.60
0.53
0.60
0.46
0.51
0.53
0.69
0.3065
0.2775
0.2986
0.3448
0.3373
0.2412
0.1929
0.1969
0.3141
0.09514
0.10074
0.08298
0.07827
0.10821
0.09000
0.08840
0.09356
0.11832
Variable
Organization
Mean
Sig.
Leadership
Industrial
Service
Industrial
Service
Industrial
Service
Industrial
Service
Industrial
Service
Industrial
Service
Industrial
Service
Industrial
Service
Industrial
Service
43
25
43
25
43
25
43
25
43
25
43
25
43
25
43
25
43
25
0.3068
0.3061
0.2821
0.2697
0.2994
0.2973
0.3688
0.3036
0.3619
0.2950
0.2426
0.2388
0.2022
0.1771
0.2122
0.1705
0.3625
0.2308
0.001
0.978
0.237
0.628
0.010
0.922
12.931
0.001
6.546
0.013
0.027
0.870
1.277
0.263
3.239
0.076
27.279
0.000
Critical
evaluation of the
EFQM model
493
Table III.
Descriptives
Table IV.
ANOVA to evaluate
differences between
private companies and
education organizations
IJQRM
28,5
494
Table V.
R 2 adjustment and Stone
Geissers Q2
Table VI.
R 2 adjustment and Stone
Geissers Q 2: modified
model
R2
Stone-Geissers Q2
0.37
0.73
0.34
0.39
0.40
0.01
0.09
0.51
0.35
0.70
0.29
0.30
0.27
0.001
0.0024
0.47
R2
Stone-Geissers Q2
0.37
0.73
0.34
0.39
0.25
0.32
0.35
0.70
0.29
0.30
0.23
0.31
St. b
T-statistics
0.611
0.736
0.358
0.175
0.291
2 0.022
0.402
0.318
0.502
0.563
3.744 * * *
7.348 * * *
1.826 *
1.3574
1.265
0.072
1.524
1.308
2.888 * * *
4.192 * * *
Notes: * * *Significance at a 0.01 level, * *Significance at a 0.05 level, *Significance at a 0.1 level
Critical
evaluation of the
EFQM model
495
Table VII.
Results from path
analysis: modified model
These results indicate the way the model functions. The EFQM model has been
designed following TQM principles and implies that leadership is the engine of the
system that makes the other elements function. Once running, processes are improved
by both policies and strategies designed to prioritize quality and empower and
motivate employees. The results of the present paper show that the EFQM model, as it
has been defined, does not work as a whole. This does not mean that the elements of the
model cannot be useful to organizations, but the set of relationships proposed in the
model does not work as the model proposes.
It may be that a model that is not valid for some types of organizations could be
valid for others. To test H17 and compare the model in manufacturing/private
companies and public/education organizations, a multi-group analysis was performed
(Chin, 2000; Keil et al., 2000). The results are shown in Table VII. Differences in the
EFQM relationships are shown for private/manufacturing companies and
public/education organizations in our sample. The standardized betas for each
group, and the T-statistics for their differences, are also listed (see Table VIII).
According to these results, there are some differences in the relationships between
manufacturing and service firms. There is slightly higher achievement in the
0,679 * * *
0,7763 * * *
0,4294 * *
0,1394
0,2259
0,0609
0,5591 * *
2 0,0696
0,4434 * *
0,6998 * * *
0,6852 * * *
0,7943 * * *
0,2546
0,0918
0,4339 * *
0,3954
0,3327
2 0,3033
0,4342 * *
0,7119 * * *
Tmultigroup
0,214
0,683
3,516 * * *
1,460
3,448 * * *
4,539 * * *
3,475 * * *
2,924 * *
0,204
0,612
Notes: * * *Significance at a 0.01 level, * *Significance at a 0.05 level, *Significance at a 0.1 level
Table VIII.
Multigroup analysis:
differences in
manufacturing and
service companies:
modified model
IJQRM
28,5
496
Figure 2.
Alternative suggested
model
Table IX.
R 2 adjustment and Stone
Geissers Q2: alternative
suggested model
R2
Stone-Geissers Q2
0.37
0.71
0.29
0.36
0.51
0.47
0.31
0.51
0.35
0.70
0.25
0.36
0.32
0.39
0.15
0.47
St. b
T-statistics
0,6111
0,8431
0,5362
0,603
20,3524
0,2727
0,0656
0,4163
0,4456
0,4586
0,4119
0,0847
0,0317
0,1151
0,0326
0,0815
0,111
20,0706
0,1174
0,3647
0,4166
4,17 * * *
12,52 * * *
3,53 * * *
5,25 * * *
1,28
0,91
0,23
1,45
1,50
1,63
1,36
0,28
0,08
0,51
0,12
0,28
0,43
0,30
0,58
2,26 * * *
2,05 * * *
Notes: * * *Significance at a 0.01 level, * *Significance at a 0.05 level, *Significance at a 0.1 level
elements comply with the minimum required. Table X shows the results of the path
analysis. These results show that leadership has a positive and significant impact on
processes, policy and strategy, people and partnership and resources. However, the
model is once again broken, because none of these agents have any impact on results.
Moreover, the positive effect of processes on customer results disappears, making the
gap with the official model even greater. Looking at the part of the model that deals
with results, customer results and society results do have a positive and significant
impact on key performance results but people results do not. People and society results
do not have a significant effect on customer results either.
5. Conclusions
The main contribution of this paper has been to analyze the relationships among the
criteria of the EFQM model (version 2003) using the actual results attained by the
companies in their evaluations and validated by approved staff, as the European
Foundation for Quality Management demands. This is the first work that uses this
kind of data and, since these data are the real points obtained by companies according
to the official criteria of the EFQM organization, this research offers a more accurate
evaluation of the functioning of the EFQM Excellence Model.
The model does not behave as expected according to its definition by the EFQM.
The test of the official EFQM model shows that two of the results variables are not
correlated with the others enough to be part of the complete model. The elimination of
the results in people and society indicates that the model is useful primarily for what
Critical
evaluation of the
EFQM model
497
Table X.
Results from path
analysis: alternative
suggested model
IJQRM
28,5
498
could be considered the core and classic objectives of private companies, customer
satisfaction and obtaining good financial results.
However, when the model is tested without these two variables for kinds of results,
the connection between enablers fails, since policy and strategy, people, and
partnership and resources have no significant effect on processes.
Since the sample combined two very different types of organization,
manufacturing/private companies and public/educational organizations, the
performance of the model was analyzed separately for each group. The results show
that there are significant differences between the two groups, and that
manufacturing/private companies provide a better fit to the EFQM model than the
other entities. The fact that in manufacturing/private companies there is a positive
relationship between people and processes may indicate that the model is partially
valid for these industries. It would also provide support for TQM, as people are far
more important from a TQM point of view than strategy or resources and partnership
management. However, since after dividing the sample the number of organizations in
each group is very small, these results must be interpreted with caution.
Finally, based on previous results and using the logic identified in the literature on
management in general and TQM in particular, the model was redefined, so that
leadership has an impact on the other four enablers and all these have an impact on
people, society and customer results. The results of this last analysis reinforce the
previous results of this research in two ways. First, leadership again has a significant
effect on policy and strategy, people and partnership and resources. Second, the effect
of enablers on results is even worse, since now none of policy and strategy, people, or
partnership and resources have a significant effect on results, but neither do processes.
These results lead us to conclude that the EFQM fails to embody certain
relationships that the theory and practice of TQM indicate are important. The absence
of a relationship between people and processes or between processes and customer
results cannot be explained if it is intended to maintain EFQM as an interpretation of a
TQM system. In this regard, Ritchie and Dale (2000) conclude that Business
Excellence practices advocated today are not the equivalent of TQM, but a more
diluted version of the original TQM concept.
A key element of TQM, in order to improve processes, is good management of
human resources, especially motivation, and training. The lack of a relationship
between this element and process improvement would negate this principle. On the
other hand, the main objective of process improvement, according to TQM, is to
increase customer satisfaction, and this relationship is not clear, according to our
results. A possible explanation of these facts could be:
.
An exception to the general rule of the TQM philosophy has been found. Previous
studies see, for example, Flynn et al. (1995) have also found relationships that
were not in line with the expected model. However, in the present research there
are too many important exceptions to have happened by chance.
.
The EFQM model is not well defined as it is, and probably the methodology to
evaluate these aspects should be revised. The problem could derive from two
sources: the original model or how the evaluators interpret the model.
This research has important managerial implications. According to the results, the
effect of enablers on company results is not clear and appears to be null. If these results
were confirmed in later research, managers should not follow the EFQM excellence
model if their intention is to improve their results, since it does not work as predicted.
However, this paper has its limitations and more research is needed.
The first limitation of the present study is that it is based on a limited number of
available cases in the sample. The sample was a convenience sample and researchers
could not control the process of data collection. On the other hand, the data were
provided by an organization licensed by EFQM, which implies that the data reliably
reflect the information that EFQM uses.
The transverse nature of the study produces another limitation, as it does not allow
the confirmation of causality in the relationships of the EFQM model, although
evidence of this causality is indicated.
The options for future research are wide. First, as usual in such cases, in order to
have more confidence in the causality of the proposed relationships, a longitudinal
design would be necessary. Second, an analysis of the agency criteria could also
produce improved results. An analysis of the interrelations underlying the EFQM
model could also examine sub-criterion levels. Each enabler of the model is composed
of different sub-criteria, and the relationships among them have not been examined in
the literature. The question that needs to be addressed is whether the inclusion of
enablers in the EFQM Excellence Model can be justified on empirical grounds.
References
Adams, G., McQueen, G. and Seawright, K. (1999), Revisiting the price impact of quality
awards, Omega, Vol. 27, pp. 595-604.
Adebanjo, D. (2001), TQM and business excellence: is there really a conflict?, Measuring
Business Excellence, Vol. 5, pp. 37-40.
Ahmed, A.M., Yang, J.B. and Dale, B.G. (2003), Self-assessment methodology: the route to
business excellence, Quality Management Journal, Vol. 10, pp. 43-57.
Anderson, J.C. and Gerbing, D.W. (1988), Structural equation modelling in practice: a review and
recommended two-step approach, Psychol. Bull., Vol. 103, pp. 411-23.
Benner, M. and Veloso, F. (2008), ISO 9000 practices and financial performance: a technology
coherence perspective, Journal of Operations Management, Vol. 26, pp. 611-29.
Black, S.A. and Porter, L.J. (1996), Identification of the critical factors of TQM, Decision
Sciences, Vol. 27, pp. 1-21.
Bou-Llusar, J.C., Escrig-Tena, A., Roca-Puig, V. and Beltran-Martn, I. (2005), To what extent do
enablers explain results in the EFQM excellence model? An empirical study, International
Journal of Quality & Reliability Management, Vol. 22, pp. 337-53.
Bou-Llusar, J., Escrig-Tena, A., Roca-Puig, V. and Beltran-Martin, I. (2009), An empirical
assessment of the EFQM Excellence Model: evaluation as a TQM framework relative to
the MBNQA model, Journal of Operations Management, Vol. 27, pp. 1-22.
Brown, A. and Van der Wiele, T. (1995), Quality management self-assessment in Australia,
Total Quality Management, Vol. 3, pp. 293-308.
Calvo de Mora, A. and Criado, F. (2005), Analisis de la validez del modelo europeo de excelencia
para la gestion de la calidad en instituciones universitarias: un enfoque directivo, Revista
Europea de Direccion y Economia de la Empresa, Vol. 14 No. 3, pp. 41-58.
Calvo de Mora, A., Leal, A.G. and Roldan, J.L. (2005), Relationships between the EFQM model
criteria: a study in Spanish universities, Total Quality Management & Business
Excellence, Vol. 16, pp. 741-70.
Critical
evaluation of the
EFQM model
499
IJQRM
28,5
500
Chin, W. (2000), Frequently Asked Questions-Partial Least Squares & PLS Graph, available at:
http://disc-nt.cba.uh.edu/chin/plsfaq/multigroup.htm
Collier, D.A., Goldstein, S.M. and Wilson, D.D. (2002), A thing of the past?, Quality Progress,
Vol. 35, pp. 97-104.
Conti, T. (1993), Building Total Quality Management: A Guide for Management, Chapman & Hall,
London.
Conti, T. (2007), A history and review of the European Quality Award model, The TQM
Magazine, Vol. 19, pp. 112-28.
Corbett, C.J., Montes-Sancho, M.J. and Kirsch, D.A. (2005), The financial impact of ISO 9000
certification: an empirical analysis, Management Science, Vol. 51, pp. 1046-59.
Curkovic, S., Melnyk, S., Calantone, R. and Handfield, R. (2000), Validating the Malcolm
Baldrige National Quality Award framework through structural equation modelling,
International Journal of Production Research, Vol. 38, pp. 765-91.
Dale, B.G., Zairi, M., Van der Wiele, A. and Williams, A.R.T. (2000), Quality is dead in Europe
long live excellence true or false?, Measuring Business Excellence, Vol. 4, pp. 4-10.
Dijkstra, L. (1997), An empirical interpretation of the EFQM framework, European Journal of
Work and Organizational Psychology, Vol. 6, pp. 321-41.
Eskildsen, J.K. and Dahlgaard, J.J. (2000), A causal model for employee satisfaction, Total
Quality Management, Vol. 11, pp. 1081-94.
Eskildsen, J.K. and Kanji, G.K. (1998), Identifying the vital few using the European Foundation
for Quality Management model, Total Quality Management, Vol. 9, pp. 92-5.
Eskildsen, J.K., Kristensen, K. and Juhl, H.J. (2001), The criterion weights of the EFQM
excellence model, International Journal of Quality & Reliability Management, Vol. 18,
pp. 783-95.
Eskildsen, J.K., Kristensen, K. and Juhl, H.J. (2004), Private versus public sector excellence,
The TQM Magazine, Vol. 16, pp. 50-6.
Evans, J.R. and Jack, E.P. (2003), Validating key results linkages in the Baldrige performance
excellence model, American Society for Quality, Vol. 10, pp. 7-24.
Falk, R.F. and Miller, N.B. (1992), A Primer for Soft Modelling, The University of Akron Press,
Akron, OH.
Finn, M. and Porter, L.J. (1994), TQM self-assessment in the UK, The TQM Magazine, Vol. 4,
pp. 56-61.
Flynn, B.B., Schroeder, R.G. and Sakakibara, S. (1995), The impact of quality management
practices on performance and competitive advantage, Decision Sciences, Vol. 26,
pp. 659-91.
Forza, C. and Filippini, R. (1998), TQM impact on quality conformance and customer
satisfaction: a causal model, International Journal of Production Economics, Vol. 55,
pp. 1-20.
Gefen, D., Straub, D. and Boudreau, M. (2000), Structural equation modeling techniques and
regression: guidelines for research practice, Communications of Association for
Information Systems, Vol. 7, pp. 1-78.
Geraedts, H., Montenarie, R. and Van Rijk, P.P. (2001), The benefits of total quality
management, Computerized Medical Imaging and Graphics, Vol. 25, pp. 217-22.
Gudergan, S.P., Ringle, C.M., Wende, S. and Will, A. (2008), Confirmatory tetrad analysis in PLS
path modelling, Journal of Business Research, Vol. 61, pp. 1238-49.
Hendricks, K.B. and Singhal, V.R. (1996), Quality awards and the market value of the firm:
an empirical investigation, Management Science, Vol. 42, pp. 415-36.
Henseler, J., Ringle, C.M. and Sinkovics, R.R. (2009), The use of partial least squares path
modelling in international marketing, Advances in International Marketing, Vol. 20,
pp. 277-319.
Hillman, G.P. (1994), Making self-assessment successful, The TQM Magazine, Vol. 6, pp. 29-31.
Keil, M., Tan, C.Y., Wei, K.K., Saarinen, T., Tuunainen, V. and Wassenaar, A. (2000),
A cross-cultural study on escalation of commitment behavior in software product, MIS
Quarterly, Vol. 24, pp. 299-325.
Lane, J. (1993), The Public Sector, Sage, London.
McGuire, S.J. and Dilts, D.M. (2008), The financial impact of standard stringency: an event study
of successive generations of the ISO 9000 standard, International Journal of Production
Economics, Vol. 113, pp. 3-22.
Martnez-Costa, M., Martnez-Lorente, A.R. and Choi, T.Y. (2008), Simultaneous consideration of
TQM and ISO 9000 on performance and motivation: an empirical study of Spanish
companies, International Journal of Production Economics, Vol. 113, pp. 23-39.
Martnez-Costa, M., Choi, T.Y., Martinez, J.A. and Martnez-Lorente, A.R. (2009), ISO 9000/1994,
ISO 9001/2000 and TQM: the performance debate revisited, Journal of Operations
Management, Vol. 27, pp. 495-511.
Massey, A. (1999), Quality issues in the public sector, Public Policy and Administration, Vol. 14,
pp. 1-14.
Meyer, S. and Collier, D.A. (1998), An empirical test of the casual relationship in the Baldrige
health care pilot criteria, Journal of Operations Management, Vol. 19, pp. 403-26.
Naveh, E. and Marcus, A. (2005), Achieving competitive advantage through implementing a
replicable management standard: installing and using ISO 9000, Journal of Operations
Management, Vol. 24, pp. 1-26.
Naylor, G. (1999), Using the Business Excellence Model to develop a strategy for a healthcare
organization, International Journal of Health Care Quality Assurance, Vol. 12, pp. 37-44.
Porter, L. and Tanner, S. (1996), Assessing Business Excellence, Butterworth-Heinemann, Oxford.
Prajogo, D.I. and Sohal, A.S. (2004), The multidimensionality of TQM practices in determining
quality and innovation performance an empirical examination, Technovation, Vol. 24,
pp. 443-54.
Reinartz, W., Haenlein, M. and Henseler, J. (2009), An empirical comparison of the efficacy of
covariance-based and variance-based SEM, International Journal of Research in
Marketing, Vol. 26, pp. 332-44.
Reiner, G. (2002), Analysis of critical factor of company success based on the EFQM model,
Proceeding of the Seventh World Congress for Total Quality Management, Vol. 2, pp. 361-6.
Ritchie, L. and Dale, B. (2000), Self-assessment using the business excellence model: a study of
practice and process, International of Production Economics, Vol. 66, pp. 241-54.
Samuelsson, P. and Nilsson, L.-E. (2002), Self-assessment practices in large organizations:
experiences from using the EFQM excellence model, International Journal of Quality
& Reliability Management, Vol. 19, pp. 10-23.
Santos, M.L. and Alvarez, L.I. (2007a), Gestion de la calidad total de acuerdo con el modelo
EFQM: Evidencias sobre sus efectivos en el rendimiento empresarial, Universia Business
Review, Vol. 1, pp. 76-89.
Santos, M.L. and Alvarez, L.I. (2007b), TQM and firms performance: an EFQM excellence model
research bases survey, International Journal of Business Science and Applied
Management, Vol. 2, pp. 21-41.
Saraph, J.V., Benson, P.G. and Schroeder, R. (1989), An instrument for measuring the critical
factors of quality management, Decision Science, Vol. 20, pp. 810-29.
Critical
evaluation of the
EFQM model
501
IJQRM
28,5
502
Sroufe, R. and Curkovic, S. (2008), An examination of ISO 9000:2000 and supply chain quality
assurance, Journal of Operations Management, Vol. 26, pp. 503-20.
Tan, K.C. (2002), A comparative study of 16 national quality awards, The TQM Magazine,
Vol. 14, pp. 165-71.
Tan, K.C., Wong, M.F., Mehta, T. and Khoo, H.H. (2003), Factors affecting the development of
national quality awards, Measuring Business Excellence, Vol. 7, pp. 37-55.
Tar, J. (2008), Self-assessment exercise: a comparison between a private sector organization and
higher education institutions, International Journal of Production Economics, Vol. 114,
pp. 105-18.
Terziovski, M., Samson, D. and Dow, D. (1997), The business value of quality management
systems certification. Evidence from Australia and New Zealand, Journal of Operations
Management, Vol. 15, pp. 1-18.
Van der Wiele, T., Brown, A., Millen, R. and Whelan, D. (2000), Improvement in organizational
performance and self-assessment practices by selected American firms, Quality
Management Journal, Vol. 7, pp. 8-22.
Van der Wiele, T., Williams, A.R.T., Dale, B.G., Carter, G., Kolb, F., Luzon, D.M., Schmidt, A. and
Wallace, M. (1996), Self-assessment: a study of progress in Europes leading organization
in quality management practices, International Journal of Quality & Reliability
Management, Vol. 13, pp. 84-104.
Wilson, D.D. and Collier, D.A. (1996), An empirical study to test the impact of the criteria
weights implied in the Malcolm Baldrige National Quality Award on firm performance
and customer satisfaction, Proceedings of the National Decision Science Institute.
Wilson, D.D. and Collier, D.A. (2000), An empirical investigation of the Malcolm Baldrige
National Quality Award Causal Model, Decision Sciences, Vol. 31, pp. 361-90.
About the authors
Joaqun Gomez Gomez is Industrial Engineer and Master on Technology and Innovation
Management. He has worked as Director of the Research and Development Area of the Furniture
and Wood Technological Center of Murcia. Now he is Project Manager of the Business
Innovation Center of Murcia (Spain). Joaqun Gomez Gomez is the corresponding author and can
be contacted at: joaquin.gomez@ceeim.es
Micaela Martnez-Costa is Associate Professor of Operations Management at the University
of Murcia (Spain). Her research mainly focuses on quality management and its relationship with
company performance. She has published in eminent journals, including the Journal of
Operations Management, International Journal of Operations and Production Management,
International Journal of Production Economics and International Small Business Journal among
others.
Angel R. Martnez-Lorente was awarded his PhD by Murcia University in 1996 and is
Professor at the Polytechnic University of Cartagena, where he is the Head of the Management
Department. He teaches operations management and quality management. He has been visiting
researcher at the University of Manchester. His papers have been published in journals including
the Journal of Operations Management, International Journal of Production Research,
International Journal of Operations and Production Management and International Journal of
Production Economics. He is member of the Editorial Advisory Board of the International Journal
of Quality and Reliability Management.
12. Louis Kirkham, Jose Arturo Garza-Reyes, Vikas Kumar, Jiju Antony. 2014. Prioritisation of operations
improvement projects in the European manufacturing industry. International Journal of Production
Research 52:18, 5323-5345. [CrossRef]
13. Arash Shahin Department of Management, University of Isfahan, Isfahan, Iran Hadi Balouei Jamkhaneh
Department of Management, University of Isfahan, Isfahan, Iran Sayedeh Zahra Hosseini Cheryani
Department of Planning, Isfahan Province Gas Company, Isfahan, Iran . 2014. EFQMQual: evaluating
the implementation of the European quality award based on the concepts of model of service quality gaps
and ServQual approach. Measuring Business Excellence 18:3, 38-56. [Abstract] [Full Text] [PDF]
14. Javier Tamayo-Torres Management Department, Universidad de Granada, Granada, Spain Vanesa
Barrales-Molina Management Department, Universidad de Granada, Granada, Spain Maria Nieves PerezArostegui Management Department, Universidad de Granada, Granada, Spain . 2014. The influence
of manufacturing flexibility on strategic behaviours. International Journal of Operations & Production
Management 34:8, 1028-1054. [Abstract] [Full Text] [PDF]
15. Maria Arajo, Paulo Sampaio. 2014. The path to excellence of the Portuguese organisations recognised
by the EFQM model. Total Quality Management & Business Excellence 25:5-6, 427-438. [CrossRef]
16. Anne Martensen, Jan Mouritsen. 2014. Prioritising investments in marketing activities to improve business
performance. Total Quality Management & Business Excellence 25:5-6, 582-601. [CrossRef]
17. Abdallah Abdallah Talal Abu-Ghazaleh Graduate School of Business, German Jordanian University,
Amman, Jordan . 2014. Implementing quality initiatives in healthcare organizations: drivers and
challenges. International Journal of Health Care Quality Assurance 27:3, 166-181. [Abstract] [Full Text]
[PDF]
18. Mladen Vukomanovic, Mladen Radujkovic, Maja Marija Nahod. 2014. EFQM excellence model as the
TQM model of the construction industry of southeastern Europe. Journal of Civil Engineering and
Management 20:1, 70-81. [CrossRef]
19. Arturo Calvo-Mora Department of Business Administration and Marketing, University of Seville, Seville,
Spain Araceli Picn Department of Business Administration and Marketing, University of Seville, Seville,
Spain Carolina Ruiz Department of Business Administration and Marketing, University of Seville, Seville,
Spain Lourdes Cauzo Department of Business Administration and Marketing, University of Seville,
Seville, Spain . 2013. The relationships between soft-hard TQM factors and key business results.
International Journal of Operations & Production Management 34:1, 115-143. [Abstract] [Full Text] [PDF]
20. Omar AlTabbaaLeeds University Business School, University of Leeds, Leeds, UK Kenneth GaddLeeds
University Business School, University of Leeds, Leeds, UK Samuel AnkrahLeeds University Business
School, University of Leeds, Leeds, UK. 2013. Excellence models in the nonprofit context: strategies
for continuous improvement. International Journal of Quality & Reliability Management 30:5, 590-612.
[Abstract] [Full Text] [PDF]
21. Louise BoulterMiddlesex University Business School, Hendon, UK Tony BendellCoventry University
London Campus, Coventry, UK and Services Limited, Nottingham, UK Jens DahlgaardDepartment of
Management and Engineering, Linkoping University, Linkoping, Sweden. 2013. Total quality beyond
North America. International Journal of Operations & Production Management 33:2, 197-215. [Abstract]
[Full Text] [PDF]
22. Rhys Rowland-Jones. 2013. A perspective on United Arab Emirates small and medium-sized enterprises
management utilising the European Foundation for Quality Management concepts of excellence. Total
Quality Management & Business Excellence 24:1-2, 210-224. [CrossRef]