Professional Documents
Culture Documents
Access to this document was granted through an Emerald subscription provided by emerald-srm:273599 []
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald for
Authors service information about how to choose which publication to write for and submission guidelines
are available for all. Please visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company
manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as well as
providing an extensive range of online products and additional customer resources and services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the Committee
on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for digital archive
preservation.
*Related content and download information correct at time of download.
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
The current issue and full text archive of this journal is available at
www.emeraldinsight.com/0114-0582.htm
PMS
Performance management system effectiveness
effectiveness in Australian local
government
161
Kevin Baird, Herbert Schoch and Qi (James) Chen
Department of Accounting and Corporate Governance,
Macquarie University, Sydney, Australia
Abstract
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
Purpose The purpose of this paper is to examine the association between three organizational
factors (the use of multi-dimensional performance measures, link to rewards, and training) and three
organizational culture dimensions (innovation, outcome orientation, and teamwork) with the
effectiveness of performance management systems (PMSs).
Design/methodology/approach Data were collected by survey questionnaire from a random
sample of 450 Australian local governments.
Findings The performance management systems of Australian local councils are only moderately
effective in relation to performance related outcomes, and less effective in relation to the achievement
of staff related outcomes. The results indicate a significant relationship between the use of
multidimensional performance measures, link of performance to rewards, training and two
organizational culture factors (team work/respect for people and outcome orientation) with the
effectiveness of PMSs. Different factors were found to influence the effectiveness of PMSs for large and
small sized councils.
Practical implications The findings imply that there is a need for the managers of local
government councils to improve the effectiveness of their PMS.
Originality/value The study provides an initial empirical examination of the effectiveness of
performance management systems and the influential factors in the Australian local government
context. The study assists local government managers in effectively managing their employees and
operations.
Keywords Performance management system, Multi-dimensional performance measures,
Local government, Culture dimensions, Organizational dimensions, Performance management, Australia
Paper type Research paper
1. Introduction
A performance management system (PMS) enables organizations to plan, measure and
control their performance, so that decisions, resources and activities can be better
aligned with strategies to achieve desired results (Bento and Bento, 2006). The PMS
also provides a means of recognizing and rewarding good performance and managing
poor performance (Australian Public Service, 2001). By incorporating explicit
standards and measures of performance, a PMS facilitates an enhanced focus on
outcomes and avoids goal conflict and ambiguity (Brunetto and Farr-Wharton, 2005;
Hood, 1991).
An effective PMS is one which successfully achieves these and other objectives Pacific Accounting Review
Vol. 24 No. 2, 2012
identified in the literature. There is evidence that an effective PMS can lead to pp. 161-185
improved organizational performance (Bevan and Thompson, 1991) and contribute to q Emerald Group Publishing Limited
0114-0582
other important outcomes such as improved employee involvement, commitment and DOI 10.1108/01140581211258461
PAR motivation (Taylor and Pierce, 1999). An effective PMS can also assist with
24,2 restructuring organizations (Weiss and Hartle, 1997), and enhancing their ability to
recruit, deploy, develop and retain employees (Fletcher and Williams, 1992).
Given the importance of PMSs (McAdam et al., 2005), this study is motivated to
examine the factors related to the effectiveness of a PMS. Specifically, the study
attempts to ascertain the organizational and cultural factors that are conducive to
162 enhancing the effectiveness of PMSs, by examining the association between three
organizational factors (use of multi-dimensional performance measures, link of
performance to rewards, and training) and three aspects of organization culture
(innovation, outcome orientation, and teamwork) with the effectiveness of PMSs.
These associations are explored in the context of the Australian local government.
The local government in Australia has expanded significantly in the last few decades.
For instance, the annual expenditure by local government in Australia is about
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
$24 billion, allowing it to provide a wider range of services and to take on a greater role
than ever before in economic and social development and environmental management
(Australian Local Government Association, 2006). The focus on the Australian local
government is also considered appropriate given the significant reforms undertaken as
policy makers attempt to enhance the efficiency of municipal service delivery (Dollery
and Johnson, 2005).
This Australian local government based study is mirrored by a number of
performance management related studies in other countries, thus giving credence to the
importance of examining PMSs in the public sector on an international scale. For
example, Walker and Boyne (2006) and Andrews et al. (2005) undertook studies of
English local government that examined the impact of public management reform
variables on organizational performance; in a USA context, Melkers and Willoughby
(2005) examined models of performance measurement use in a cross section of local
governments. Sanderson (2001) suggests that public sector reforms are taking place
throughout OECD member states, with a strong emphasis on performance management.
Brignall and Modell (2000) use the context of the new public sector. which calls for
greater efficiency and effectiveness in the UK and Scandinavian public sectors, to
examine implementation of multi-dimensional performance measurement and
management. Finally, in a Norwegian context, Johnsen (1999) explored the
implementation success of performance measurement in local government in that
country. The level of international interest in public sector reform, PMSs and their
effectiveness, further highlights the importance of ascertaining the factors that
contribute to PMS effectiveness.
This study has two objectives:
(1) To examine the association between specific organizational and cultural factors
with the effectiveness of PMSs.
(2) To evaluate the effectiveness of PMSs in Australian local governments.
The remainder of the paper is structured as follows. Section 2 reviews the existing
literature on PMSs, discusses the association between the organizational and cultural
factors and the effectiveness of PMS, and develops the relevant hypotheses. Section 3
discusses the research method used and describes the measurement of the variables,
and Section 4 provides the results. Finally, Section 5 provides the conclusions,
limitations and the suggestions for future research.
2. Literature review PMS
2.1 Performance management systems effectiveness
A PMS is a system that covers all aspects of performance that are relevant for the
existence of an organization as a whole. The PMS should provide management with an
insight into how well the organization is performing its tasks and to what extent the
organizational objectives are achieved (Flapper et al., 1996, p. 27). This can involve
motivating, monitoring, controlling, and rewarding employees for attaining desired 163
outcomes (Lawler, 2003). The PMS is aimed towards enhancing the performance of
individuals and units, with the ultimate purpose of improving organizational
effectiveness (Biron et al., 2011, p. 1294). It contributes to aligning the interests of
employees and management by providing a clear indication of the strategic direction of
the organization (Becker et al., 2011, p. 255).
A PMS is broader than a performance measurement system in that performance
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
Financial measures fail to capture most of the intangible value that an organization
has or can create (Soderberg, 2006). For example, in local government, the focus is not
profit maximization, with customer satisfaction and the efficiency of internal processes
considered to be much more important. Traditional financial measures have also been
criticized for focusing mainly on what has transpired in the past rather than what
needs to be done in the future (Soderberg, 2006). Furthermore, traditional measures do
not provide decision makers with sufficient information to manage their organizations
(Atkinson et al., 1997; Kaplan and Norton, 1996, 1992).
Johnson and Kaplan (1987) recognized that traditional financial performance
measures are not only provided too late to aggregate, but also provide poor proxies for
aspects that matter to customers, such as quality and speed of delivery. As a result,
a number of multi-dimensional performance measurement systems including the
balanced scorecard (Kaplan and Norton, 1992), the performance pyramid (Lynch and
Cross, 1991) and the results and determinants framework (Fitzgerald et al., 1991) have
been developed. It is claimed that these multi-dimensional performance measurement
approaches lead to more effective performance management in the nonprofit sector
(Becker et al., 2011; Kaplan, 2001). Among these systems, the balanced scorecard (BSC) is
argued to be the most popular (Maltz et al., 2003) with organizations in both the private
and public sector using it as a tool for performance improvement (Chan and Ho, 2000;
Hoque and James, 2000). Accordingly, this study operationalizes the use of
multi-dimensional performance measures in respect to the extent to which
organizations use measures relating to the five perspectives of the BSC: financial,
internal, customer, learning and growth, and environment.
The effectiveness of PMSs in local governments is expected to be enhanced by the use
of a multi-dimensional performance measurement system for a number of reasons. First,
in the local government sector, objectives are often stated in non-financial terms.
Financial reporting will therefore not fully capture performance, and hence the use of
non-financial performance measures can provide a more accurate assessment of
performance (Guthrie and English, 1997). Second, multi-dimensional performance
measures can also support a local governments strategy (Kloot, 1999). Long-term
survival of an organization is linked to its chosen strategy and short-term financial
results cannot adequately support the strategy. For example, a study of a local
government child-care organization indicated that multi-dimensional performance
measures are needed to implement strategy (Brignall, 1993). Third, Kaplan and Norton
(1992, 1996) argue that by using multiple performance measures, the BSC provides a PMS
comprehensive view of an organizations performance. Local government is also effectiveness
accountable to a variety of stakeholders, hence, it is necessary to provide different
perspectives of performance to enhance service delivery and better resource allocation.
The use of multi-dimensional performance measures, as part of a PMS, can result in
more accurate and meaningful measurement of performance, provide a stronger
strategic focus for local government, encourage appropriate employee behavior and 165
provide management with better information for decision making purposes, thereby
assisting local governments in achieving their goals. Martinez and Kennerley (2010)
refer to a number of survey studies highlighting the positive effect of a balanced PMS
on organizational performance. Hypothesis 1 is therefore stated as follows:
H1. The extent of use of multi-dimensional performance measures is positively
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
effective PMS.
2.2.4.2 Outcome orientation. Sheridan (1992) refers to outcome orientation as the extent
to which organizations emphasize action and results, have high expectations for
performance and are competitive. Grutter et al. (2001) proposed that organizations which
are more outcome oriented would be more performance oriented. In addition, Hofstede
(1998) indicated that employees in outcome oriented organizations would be more
motivated with employees perceiving that everyday could bring new challenges.
Therefore, employees are more likely to apply maximum effort to their work. Motivated
employees are also likely to have a higher level of commitment to their organization,
which will be reflected in greater work related effort (McKinnon et al., 2003).
Given that PMSs have the objective of enhancing organizations performance,
motivating employees and improving employees organizational commitment, it can be
posited that outcome oriented organizations are more likely to achieve such desired
results. It is hypothesized therefore that a more outcome oriented organization will
have a more effective PMS:
H4b. Organizations with more outcome oriented cultures are expected to have a
more effective PMS.
2.2.4.3 Team work. Work teams are popular in todays business and related environments
(Reader et al., 2009; Wuchty et al., 2007; Tata and Prasad, 2004; LaFasto and Larson, 2001).
Teams are considered the best way to deliver high performance in a competitive
marketplace. Increased focus on teamwork is envisaged to have a number of benefits. Team
work has been associated with increased performance, improvements in quality of
products and increases in the level of innovation (Tata and Prasad, 2004). Teams are also
thought to provide a better means of integrating the unique skills of individuals to produce
better performance across a variety of tasks than could be achieved by any individual
working alone or by individuals working outside a team structure (Katzenbach and Smith,
1993). Teamwork enables team members to plan, organize and coordinate the activities of
the team for goal attainment (Pineda and Lerner, 2006). Therefore, employee resources will
be used more efficiently. Increased frequency of team meetings can lead to increased social
contacts and will give employees the opportunity to learn from each other. Learning how to
deal with other team members can also serve as a valuable developmental outcome for a
team member, especially if the team has to work together on a recurring basis
PAR (Pineda and Lerner, 2006). Further, team members satisfaction with their team could
24,2 lead to greater commitment, less absenteeism and reduced turnover in the workplace
(Ulloa and Adams, 2004). In particular, since teamwork is usually associated with greater
employee empowerment and greater delegation of decision making power and
responsibilities, it is argued that the additional responsibilities and autonomy in
performing tasks leads to greater commitment amongst employees. Carson et al. (1999), for
168 example, found a positive association between employee empowerment and the level of
EOC. Similarly, Park et al. (2005) found a strong relationship between teamwork and
employee commitment. Hypothesis 4c follows from the above discussion:
H4c. Organizations with more teamwork oriented cultures are expected to have a
more effective PMS.
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
3. Method
Data were collected through a postal mail survey of finance managers, or similarly titled
executives in 450 Australian local governments. The random sample ensured the
inclusion of local governments of different sizes from across the country, inclusive of city
and regional councils. The potential respondents were randomly selected from the
Australian Local Government Association web site. Finance managers were chosen due
to their understanding of the PMSs within their organization. The survey was
administered using Dillmans (2007) Tailored Design Method approach, with the survey
adhering to guidelines on format and style of questions, as well as the recommended
techniques to personalize and distribute the survey.
A total of 184 responses were received, for a response rate of 40.9 percent. This
comprised 111 responses (24.7 percent) from the initial distribution (early responses), and a
further 73 responses (16.2 percent) from the follow-up (late responses). Non-response bias
was assessed by comparison of the independent and dependent variable values between
early and late responses. Table I reveals that the early and late responses were
Early Late
respondents respondents
Mean (SD) Mean (SD) F-value p-value
Dependent variable
Effectiveness of PMS 2.95 (0.72) 3.19 (0.70) 5.158 0.024
Independent variables
The use of multi-dimensional performance
measures 3.12 (0.59) 3.38 (0.70) 6.452 0.012
Link of performance to rewards 2.45 (0.96) 2.85 (1.00) 7.401 0.007
Level of training 3.63 (0.99) 4.10 (0.69) 12.033 0.001
Teamwork/respect for peoplea 16.94 (5.98) 15.07 (5.98) 4.231 0.041
Innovation 15.16 (3.50) 14.13 (3.26) 3.907 0.050
Attention to detail 9.92 (2.67) 9.95 (2.76) 0.003 0.960
Table I. Stability 7.51 (2.53) 7.23 (2.33) 0.578 0.448
Results of one-way Outcome orientation 16.46 (4.46) 15.23 (3.97) 3.560 0.061
ANOVA comparing the
mean values of all the Notes: aThe factor analysis of the cultural factors produced a combined team work/respect for people;
variables between early lower scores on the organizational culture dimensions indicate that the cultural attribute is more
and late respondents prevalent in business units
significantly different regarding the effectiveness of PMSs (at p # 0.05). They also PMS
differed significantly for the use of multi-dimensional performance measures, link of effectiveness
performance to rewards, training, teamwork/respect for people and innovation
(at p # 0.05). Specifically, the late responses indicated higher PMS effectiveness,
greater use of multi-dimensional performance measures, a stronger link of performance to
rewards, a higher level of training, and more innovative and teamwork/respect for people
oriented cultures. 169
To gain a deeper understanding of the differences between early and late responses,
further analysis was undertaken into the nature of the two respondent groups. First, an
analysis of the size of local governments across the two groups was undertaken.
The overall mean population of the responding 180 local governments was 51,285, with
early respondents tending to be smaller in size (mean population of 43,290) and late
respondents larger (mean population of 63,278). The mean population of both early and
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
late responding local governments was much larger than the mean (37,808) of the
sampling frame (450 local governments), indicating that the mean population of
non-respondents must be less than this, approximately 28,749[1]. Hence, non-respondents
appear to be smaller local governments, thus making early respondents more
representative of non-respondents. Given the identified differences in the values of the
independent and dependent variables for the two groups of respondents, coupled with
the apparent difference in mean populations for the two groups, the analysis of the
hypothesized associations was conducted on an overall basis, and separately for larger
and smaller sized councils. The delineation mark for larger and smaller councils was set
at 37,808, the average population for the entire sample of 450 councils. The distinction
between larger and smaller sized councils was also considered appropriate given
evidence of better performance in larger authorities (Andrews et al., 2006).
4. Results
The summary statistics for the dependent and independent variables are provided in
Table II. For the multi-item scales, the actual range was comparable with the 171
theoretical range, and with the exception of the link of performance to rewards, the
Cronbach a coefficients met or exceeded the 0.70 threshold generally considered
acceptable in regard to scale reliability (Nunnally, 1978, p. 245). While the Cronbach a
for the link of performance to rewards fell below this threshold (0.609), this is still
considered acceptable (Fleming, 2010; Moss et al., 1998).
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
Regarding the two dependent variables, the mean score for performance related
outcomes (3.13) was slightly higher than the mid-point of the range, indicating that on
average the respondents assessed their PMS to be moderately effective in achieving
such outcomes, while in relation to the staff related outcomes, the mean score (2.94) was
at the mid-point of the range, indicating less emphasis was being placed on the
achievement of staff related outcomes. Additional analysis revealed that the majority
of the performance related outcomes (eight out of ten) were achieved to a greater extent
than six of the seven staff related outcomes. The performance related outcomes that
were achieved to the greatest extent included assisting in achieving council goals
(mean score of 3.44) and providing useful performance feedback to employees
(mean score of 3.39). The staff related outcomes that were achieved to the greatest
extent included developing individuals skill and knowledge (mean score of 3.33) and
identifying poor performing employees (mean score of 2.99).
The mean score (3.23) for the use of multi-dimensional performance measures was
slightly above the mid-point of the range, indicating a moderate level of use of
multi-dimensional performance measures. This relatively low use of multi-dimensional
performance measures was further highlighted by the fact that only 25 councils
Independent variables
Use of multidimensional performance
measures 168 3.23 0.65 1.32 (1) 4.75 (5) 0.841
Link of performance to rewards 184 2.61 0.99 1.00 (1) 5.00 (5) 0.609
Training 184 3.82 0.92 1 (1) 5.00 (5)
Teamwork/respect for people 179 2.31 0.86 1.00 (1) 4.43 (5) 0.943
Innovation 179 2.95 0.69 1.40 (1) 4.80 (5) 0.806
Outcome orientation 177 2.66 0.72 1.00 (1) 4.67 (5) 0.892
Dependent variables
Effectiveness of PMS (performance related
outcomes) 178 3.13 0.75 1 (1) 4.50 (5) 0.932
Effectiveness of PMS (staff related
outcomes) 179 2.94 0.79 1.00 (1) 4.86 (5) 0.903
a
Note: The number of responses (n) varies due to the fact that not all survey items were completed by Table II.
respondents Descriptive statistics
PAR (13.8 percent) indicated that they were using a BSC. Table III shows that councils
24,2 placed greatest emphasis on the financial perspective (3.45) followed by the internal
(3.39), and environmental (3.37) perspectives whereas the focus on the customer (3.09)
and learning and growth perspectives (2.70) was substantially less than the other three
perspectives.
172 4.1 Analysis of the association between the organizational and cultural factors with the
effectiveness of the PMS
Table IV presents the results of the one-way analysis of variance (ANOVA) examining
the difference in the level of PMS effectiveness for respondents using or not using a
BSC. The level of PMS effectiveness for performance related outcomes was
significantly higher for the 25 councils employing a BSC. While the achievement
of staff related outcomes was also higher for BSC users, the difference was not
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
statistically significant. These results provide preliminary evidence that the use of
multi-dimensional performance measures is associated with the effectiveness of PMSs,
thereby providing partial support for H1.
Stepwise regression was used to examine the association between the organizational
and cultural factors with PMS effectiveness, with the results presented in Table V. In
respect to the effect on performance related outcomes, the model was statistically
significant (F 25.783, p 0.000) with an R 2 of 0.331. Two organizational factors
(the use of multi-dimensional performance measures and the link of performance to
rewards) and one cultural factor (outcome orientation) were significantly associated
with the performance related outcomes. The staff related outcomes model was also
statistically significant (F 17.014, p 0.000) with an R 2 of 0.301. Three
organizational factors (use of multi-dimensional performance measures, training, and
link of performance to rewards) and one cultural factor (teamwork/respect for people)
were significantly associated with the staff related outcomes. The findings provide
support for H1 and H2 and partial support for H3 and H4b and H4c.
Further analysis was performed to assess the hypothesized relationships for both
smaller and larger sized councils due to the significant divergence in the mean scores
for the independent and dependent variables between early and late respondents, and
the observed differences in the populations of councils between the two groups
of respondents. The two groups were split into large and small based on the mean
population (37,808) of the entire sample population (i.e. all 450 councils), with the
findings presented in Tables VI and VII.
Table VI reveals that the models for the large sized councils were statistically
significant for both the performance related (F 9.977, p 0.000) and staff related
(F 6.568, p 0.003) outcomes with R 2 values of 0.253 and 0.182, respectively.
Similarly, Table VII reveals that the models for the smaller sized councils were
also statistically significant for both the performance related (F 22.718, p 0.000)
and staff related (F 19.951, p 0.000) outcomes with much higher R 2 values of
0.428 and 0.465 reported.
The use of multi-dimensional performance measures was significantly associated
with both the performance and staff related outcomes for both large and small councils.
In addition, training was significantly associated with the performance (staff) related
outcomes for large (small) councils. The only other factor associated with PMS
effectiveness for large councils was teamwork/respect for people, which was
significantly associated with the staff related outcomes. Finally, in respect to small
Use of multidimensional
performance measures 1.043 3.595 0.001 0.588 2.485 0.016
Training 2.081 2.119 0.038
Teamwork/respect for
people 2 1.603 2 1.967 0.054
F-value 9.977 6.568 Table VI.
p-value 0.000 0.003 Results of stepwise
R2 0.253 0.182 regression analysis of the
Adjusted R 2 0.227 0.154 association between the
n 61 61 organizational and
cultural factors with the
Note: For large councils, population . 37,808 effectiveness of PMSs
PAR
Performance related outcomes Staff related outcomes
24,2 Variables Coefficient t-statistics Significance Coefficient t-statistics Significance
Use of multidimensional
performance measures 0.806 3.694 0.000 0.312 2.004 0.048
Training 1.550 2.733 0.008
174 Link to rewards 1.186 3.290 0.001 1.067 4.566 0.000
Outcome orientation 22.184 22.244 0.027
Teamwork/respect for
Table VII.
people 2 1.083 2 2.055 0.043
Results of stepwise
F-value 22.718 19.951
regression analysis of
p-value 0.000 0.000
the association between
R2 0.428 0.465
the organizational and
Adjusted R 2 0.409 0.441
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
sized councils, the link of performance to rewards was significantly associated with both
performance and staff related outcomes, and outcome orientation was significantly
associated with the achievement of performance related outcomes.
Note
1. [(37,808 450) 2 (107 43,290) 2 (73 63,278)]/270 (NB: four responding local
governments who failed to indicate their population were included in the denominator in
this calculation).
References
Andrews, R., Boyne, G., Chen, A. and Martin, S. (2006), Population Size and Local Authority
Performance, Department for Communities and Local Government, Cardiff University,
London, October.
Andrews, R., Boyne, G., Law, J. and Walker, R. (2005), External constraints on local service
standards: the case of comprehensive performance assessment in English local
government, Public Administration, Vol. 83 No. 3, pp. 639-56.
Armstrong, M. and Baron, A. (1998), Performance Management Handbook, IPM, London.
Atkinson, A.A., Banker, R.D., Kaplan, R.S. and Young, S.M. (1997), Management Accounting,
2nd ed., Prentice-Hall, Upper Saddle River, NJ.
Audit Commission (1999), Performance Measurement as a Tool for Modernising Government,
Audit Commission, London.
Australian Government Productivity Commission (1997), Performance measures for councils,
Industry Commission Research Report, Commonwealth of Australia, Sydney, October.
Australian Local Government Association (2006), available at: www.alga.asn.au/about (accessed
7 April 2008).
Australian Public Service (2001), Performance Management in the Australian Public Service,
available at: www.apsc.gov.au/publications01/performancemanagement.htm (accessed
14 April 2009).
Bae, E.K. (2006), Major elements and issues in performance management system: a literature
review, Academy of Human Resource Development International Conference (AHRD),
Columbus, OH, 22-26 February, pp. 1430-7.
Baird, K., Harrison, G. and Reeve, R. (2007), Success of activity management practices: the
influence of organizational and cultural factors, Accounting and Finance, Vol. 47 No. 1,
pp. 447-67.
Becker, K., Antuar, N. and Everett, C. (2011), Implementing an employee performance PMS
management system in a nonprofit organization, Nonprofit Management & Leadership,
Vol. 21 No. 3, pp. 255-71.
effectiveness
Bellamy, S., Morley, C. and Watty, K. (2003), Why business academics remain in Australian
universities despite deteriorating working conditions and reduced job satisfaction:
an intellectual puzzle, Journal of Higher Educational Policy and Management, Vol. 25
No. 1, pp. 13-28. 177
Bento, A. and Bento, B. (2006), Factors affecting the outcomes of performance management
systems, Journal of Information Technology Management, Vol. 17 No. 2, pp. 23-32.
Bevan, S. and Thompson, M. (1991), Performance management at the cross-roads, Personnel
Management, November, pp. 36-40.
Biron, M., Farndale, E. and Paauwe, J. (2011), Performance management effectiveness: lessons
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
Hood, C. (1991), A public management for all seasons?, Public Administration, Vol. 69 No. 1,
pp. 3-19.
Hoque, Z. and James, W. (2000), Linking balanced scorecard measures to size and market
factors: impact on organizational performance, Journal of Management Accounting
Research, Vol. 12, pp. 1-17.
Houston, D., Meyer, L.H. and Paewai, S. (2006), Academic staff workloads and job satisfaction:
expectations and values in academe, Journal of Higher Education Policy and
Management, Vol. 28 No. 1, pp. 17-30.
Johanson, U., Skoog, M., Backlund, A. and Almqvist, R. (2006), Balancing dilemmas of the
balanced scorecard, Accounting, Auditing & Accountability Journal, Vol. 19 No. 6,
pp. 842-57.
Johnsen, A. (1999), Implementation mode and local government performance measurement:
a Norwegian experience, Financial Accountability & Management, Vol. 15, pp. 41-66.
Johnson, H.T. and Kaplan, R.S. (1987), The rise and fall of management accounting,
Engineering Management Review, Vol. 15 No. 3, pp. 36-44.
Jusoh, R.D.N., Ibrahim, N. and Zainuddin, Y. (2008), The performance consequences of multiple
performance measure usage, International Journal of Productivity and Performance
Management, Vol. 57 No. 2, pp. 119-36.
Kaplan, R.S. (2001), Strategic performance measurement and management in nonprofit
organizations, Nonprofit Management & Leadership, Vol. 11 No. 3, pp. 353-70.
Kaplan, R.S. and Norton, D.P. (1992), The balanced scorecard measures that drive performance,
Harvard Business Review, Vol. 70, pp. 71-9.
Kaplan, R.S. and Norton, D.P. (1996), Linking the balanced scorecard to strategy, California
Management Review, Vol. 39 No. 1, pp. 53-79.
Katzenbach, J.R. and Smith, D.K. (1993), The discipline of teams, Harvard Business Review,
Vol. 71, pp. 111-20.
Kloot, L. (1999), Performance measurement and accountability in Victorian local government,
The International Journal of Public Sector Management, Vol. 12 No. 7, pp. 565-83.
Kloot, L. and Martin, J. (2000), Strategic performance management: a balanced approach to
performance management issues in local government, Management Accounting Research,
Vol. 11 No. 2, pp. 231-51.
Kotter, P. and Heskett, L. (1992), Corporate Culture and Performance, Macmillan, New York, NY.
LaFasto, F.M. and Larson, C.E. (2001), When Teams Work Best, Sage, Thousand Oaks, CA.
PAR Lawler, E.E. (2003), Reward practices and performance management system effectiveness,
Organizational Dynamics, Vol. 32 No. 4, pp. 396-404.
24,2
Lebas, M.J. (1995), Performance measurement and performance management, International
Journal of Production Economics, Vol. 41 Nos 1-3, pp. 23-35.
Li, H. and Atuagene-Gima, K. (2001), Product innovation strategy and the performance of
new technology ventures in China, Academy of Management Journal, Vol. 44 No. 6,
180 pp. 1123-34.
Lynch, R.L. and Cross, K.F. (1991), Measure Up! Yardsticks for Continuous Improvement, Basil
Blackwell, Cambridge, MA.
McAdam, R., Hazlett, S.A. and Casey, C. (2005), Performance management in the UK public
sector: addressing multiple stakeholder complexity, International Journal of Public Sector
Management, Vol. 18 No. 3, pp. 256-73.
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
McKinnon, J.L., Harrison, G.L., Chow, C.W. and Wu, A. (2003), Organisational culture:
association with commitment, job satisfaction and propensity to remain, and information
sharing in Taiwan, International Journal of Business Studies, Vol. 11 No. 1, pp. 25-44.
McShane, S. and Travaglione, T. (2003), Organizational Behaviour on the Pacific Rim,
McGraw-Hill, Sydney.
Malina, M.A. and Selto, F.H. (2001), Communication and controlling strategy: an empirical study
of the effectiveness of the balanced scorecard, Journal of Management Accounting
Research, Vol. 13, pp. 47-90.
Maltz, A.C., Shenhar, A.J. and Reilly, R.R. (2003), Beyond the balanced scorecard: refining the
search for organizational success measures, Long Range Planning, Vol. 36 No. 2,
pp. 187-204.
Martinez, V. and Kennerley, M. (2010), Impact of performance measurement and management
systems, Management Services, Summer, pp. 42-7.
Melkers, J. and Willoughby, K. (2005), Models of performance-measurement use in local
governments: understanding budgeting, communication and lasting effects,
Public Administration Review, Vol. 65 No. 2, pp. 180-90.
Melo, A., Sarrico, C. and Radnor, Z. (2010), The influence of performance management systems
on key actors in universities, Public Management Review, Vol. 12 No. 2, pp. 233-54.
Meyer, J.P. and Allen, N.J. (1991), A three component conceptualization of organizational
commitment, Human Resource Management Review, Vol. 1 No. 1, pp. 61-89.
Mohanty, R.P. (1999), Value innovation perspective in Indian organizations, Participation
& Empowerment: An International Journal, Vol. 7 No. 4, pp. 88-103.
Moss, S., Prosser, H., Costello, H., Simpson, N., Patel, P., Rowe, S., Turner, S. and Hatton, C. (1998),
Reliability and validity of the PSA-add checklist for detecting psychiatric disorders in
adults with intellectual disabilities, Journal of Intellectual Disability Research, Vol. 42,
pp. 173-83.
Nankervis, A. and Compton, R. (2006), Performance management: theory in practice?,
Asia Pacific Journal of Human Resources, Vol. 44 No. 1, pp. 83-101.
Naveh, E. and Erez, M. (2004), Innovation and attention to detail in the quality improvement
paradigm, Management Science, Vol. 50 No. 11, pp. 1576-86.
Nunnally, J.C. (1978), Psychometric Theory, McGraw-Hill, New York, NY.
Ogbonna, E. and Harris, L. (2000), Leadership style, organizational culture and performance:
empirical evidence from UK companies, International Journal of Human Resources
Management, Vol. 11 No. 4, pp. 766-88.
OReilly, C.A., Chatman, J. and Caldwell, D.F. (1991), People and organizational culture: a profile PMS
comparison approach to assessing person-organization fit, Academy of Management
Journal, Vol. 34 No. 3, pp. 487-516.
effectiveness
Padovani, E., Yetano, A. and Orelli, R. (2010), Municipal performance measurement and
management in practice: which factors matter?, PAQ, Winter, pp. 591-635.
Park, S., Henkin, A.B. and Egley, R. (2005), Teacher team commitment, teamwork and trust:
exploring associations, Journal of Educational Administration, Vol. 43 No. 5, pp. 462-79. 181
Pineda, R.C. and Lerner, L.D. (2006), Goal attainment, satisfaction and learning from teamwork,
Team Performance Management, Vol. 12 Nos 5/6, pp. 182-91.
Reader, T.W., Flin, R., Mearns, K. and Cuthbertson, B. (2009), Developing a team performance
framework for the intensive care unit, Critical Care Medicine, Vol. 37 No. 5, pp. 1787-93.
Rigby, D. and Bilodeau, B. (2009), Management Tools and Trends, Bain & Company, Boston, MA.
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
Rollins, T. (1988), Productivity-based group incentive plans: powerful, but use with caution,
Compensation & Benefits Review, Vol. 21 No. 3, pp. 39-50.
Roper, S. and Love, J.H. (2002), Innovations and export performance: evidence from the UK and
German manufacturing plants, Research Policy, Vol. 31 No. 7, pp. 1087-102.
Rynes, S.L., Gerhart, B. and Parks, L. (2005), Personnel psychology: performance evaluation and
pay for performance, Annual Review of Psychology, Vol. 56, pp. 571-600.
Sanderson, I. (2001), Performance management, evaluation and learning in modern local
government, Public Administration, Vol. 79, pp. 297-313.
Selden, S. and Sowa, J. (2011), Performance management and appraisal in human service
organizations: management and staff perspectives, Public Personnel Management, Vol. 40
No. 3, pp. 251-64.
Sheridan, J.E. (1992), Organizational culture and employee retention, Academy of Management
Journal, Vol. 35 No. 5, pp. 1036-56.
Singleton, R.A. and Straits, B.C. (2005), Approaches to Social Research, Oxford University Press,
New York, NY.
Smith, M. (1998), Culture and organizational change, Management Accounting Magazine,
Vol. 76 No. 7, pp. 1-5.
Soderberg, M.J. (2006), The Balanced Scorecard: Structure and Use in Canadian Companies,
available at: http://library 2.usask.Ca/theses.available/etd-04262006-154022 (accessed
12 April 2008).
Speckbacher, G., Bischof, J. and Pfeiffer, T. (2003), A descriptive analysis on the implementation
of balanced scorecard in German speaking countries, Management Accounting Research,
Vol. 4 No. 4, pp. 361-88.
Stanton, P. and Nankervis, A. (2011), Linking strategic HRM, performance management and
organizational effectiveness: perceptions of managers in Singapore, Asia Pacific Business
Review, Vol. 17 No. 1, pp. 67-84.
Storey, J. and Sisson, K. (1993), Managing Human Resources and Industrial Relations,
Open University Press, Milton Keynes.
Swiss, J.E. (2005), A framework for assessing incentives in results-based management,
Public Administration Review, Vol. 65 No. 5, pp. 592-602.
Tait, P. and Vassey, I. (1988), The effect of user involvement on systems success: a contingency
approach, MIS Quarterly, March, pp. 91-108.
PAR Tardivo, G. and Viassone, M. (2010), Creating an innovative social assistential performance
management system: beyond the economic-financial perspective: empirical research
24,2 findings, Journal of Financial Management and Analysis, Vol. 23 No. 2, pp. 99-110.
Tata, J. and Prasad, S. (2004), Team self-management, organization structure and judgment of
team effectiveness, Journal of Managerial Issues, Vol. 16 No. 2, pp. 248-65.
Taylor, P.J. and Pierce, J.L. (1999), Effects of introducing a performance management system on
182 employees subsequent attitudes and effort, Public Personnel Management, Vol. 28 No. 3,
pp. 423-52.
Trevor, C.O., Gerhart, B. and Boudreau, J.W. (1997), Voluntary turnover and job performance:
curvilinearity and the moderating influences of salary growth and promotions, Journal of
Applied Psychology, Vol. 82 No. 1, pp. 44-61.
Tung, A., Baird, K. and Schoch, H. (2011), Factors influencing the effectiveness of performance
measurement systems, International Journal of Operations & Production Management,
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
Appendix
Use of multi-dimensional performance measures
To what extent are each of the following measures used to assess your councils performance?
Customer perspective
.
Surveys of customer satisfaction.
.
Number of customer complaints.
.
On-time service delivery.
.
Reduced waiting time for services.
Environment perspective
.
Average time for approval of building/development applications.
.
Environmental compliance.
.
Investment in community services. PMS
.
Investment in environmental management. effectiveness
Financial perspective
.
Operating income.
.
Debt ratio.
.
Return on investment.
183
.
Improvement in net assets/liquidity.
. Collection of rates and charges.
.
Cost effectiveness of providing services.
.
Quality of services.
.
Efficiency of providing services.
.
Usage/wastage of resources.
Link to rewards
To what extent is performance measurement linked to financial rewards (pay, bonuses, etc) in
your council?
To what extent is performance measurement linked to non-financial rewards (recognition,
service awards, etc) in your council?
Training
To what extent is training provided to staff in your council?
Organizational culture
Please indicate the extent to which each of the following values is valued in your council.
Teamwork/Respect for people
.
Fairness.
.
Respect for the rights of the individual.
.
Tolerance.
.
Being socially responsible.
.
Being people oriented.
.
Being team oriented.
.
Working in collaboration with others.
Outcome orientation
.
Being competitive.
.
Being analytical.
PAR .
Having high expectations for performance.
24,2 .
Being achievement oriented.
.
Being results oriented.
.
Being action oriented.
Innovation
184 .
A willingness to experiment.
.
Not being constrained by many rules.
.
Being quick to take advantage of opportunities.
.
Being innovative.
.
Risk taking.
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)
Stability
.
Security of employment.
.
Stability.
.
Predictability.
Attention to detail
.
Being careful.
.
Paying attention to detail.
.
Being precise.
.
Being rule oriented.
Effectiveness of the PMS
PMS effectiveness was assessed in respect to the extent to which the PMS of councils achieved
the following outcomes.
Performance related outcomes
.
Motivating performance (Selden and Sowa, 2011; Rynes et al., 2005; Swiss, 2005; Lawler, 2003).
.
Assisting the council to achieve goals (Harper and Vilkinas, 2005; Lawler, 2003).
.
Developing a performance oriented culture (Gruman and Saks, 2011; Lawler, 2003).
.
Supporting change efforts (Harper and Vilkinas, 2005; Nankervis and Compton, 2006;
Lawler, 2003).
.
Supporting councils values (Lawler, 2003).
.
Providing an accurate assessment of performance (Lawler, 2003).
.
Ensuring staff commitment to council objectives (Selden and Sowa, 2011; Lawler, 2003).
.
Linking individual performance to unit performance (Helm et al., 2007; Lawler, 2003).
.
Providing useful performance feedback to individuals (Lawler, 2003).
.
Supporting councils strategy (Becker et al., 2011; Lawler, 2003).
1. Rusdi Akbar, Robyn Ann Pilcher, Brian Perrin. 2015. Implementing performance measurement systems.
Qualitative Research in Accounting & Management 12:1, 3-33. [Abstract] [Full Text] [PDF]
Downloaded by Universitas Gadjah Mada At 09:27 11 September 2015 (PT)