You are on page 1of 12

Doggett 9/22/05 1:53 PM Page 34

Root Cause Analysis:


A Framework for Tool Selection
A. MARK DOGGETT, HUMBOLDT STATE UNIVERSITY
2005, ASQ

This article provides a framework for analyzing the


performance of three popular root cause analysis INTRODUCTION
tools: the cause-and-effect diagram, the interrelation- Beneath every problem is a cause for that problem. In
ship diagram, and the current reality tree. The litera- order to solve a problem one must identify the cause of
ture confirmed that these tools have the capacity to
find root causes with varying degrees of accuracy and
the problem and take steps to eliminate the cause. If
quality. The literature, however, lacks a means for the root cause of a problem is not identified, then one
selecting the appropriate root cause analysis tool is merely addressing the symptoms and the problem
based upon objective performance criteria. Some of will continue to exist. For this reason, identifying and
the important performance characteristics of root eliminating root causes of problems is of utmost
cause analysis tools include the ability to find root importance (Andersen and Fagerhaug 2000; Dew
causes, causal interdependencies, factor relationships,
and cause categories. Root cause analysis tools must
1991; Sproull 2001).
also promote focus, stimulate discussion, be readable Tools that help groups and individuals identify
when complete, and have mechanisms for evaluating potential root causes of problems are known as root
the integrity of group findings. This analysis found cause analysis tools. The cause-and-effect diagram
that each tool has advantages and disadvantages, (CED), the interrelationship diagram (ID), and the
with varying levels of causal yield and selected causal current reality tree (CRT) are three root cause analysis
factor integrity. This framework provides decision
makers with the knowledge of root cause analysis per-
tools frequently identified in the literature as viable
formance characteristics so they can better under- mechanisms for solving problems and making deci-
stand the underlying assumptions of a recommended sions. The literature provides detailed descriptions, rec-
solution. ommendations, and instructions for their construction
Key words: collaboration, decision making, problem and use. Furthermore, the literature is quite detailed in
solving, quality methods providing colorful and illustrative examples for each of
the tools so they can be quickly learned and applied. In
summary, the literature confirms that these three tools
are capable of finding potential root causes.
Conversely, although there is much information
about the individual attributes of these root cause
analysis tools, there is little information regarding the
performance of these tools relative to each other. Thus,
problem solvers and decision makers are likely to select
a tool based on convenience rather than on its actual
performance characteristics. Thus, the purpose of this
article is to explore and synthesize the current literature
for a head-to-head performance analysis of the CED,
ID, and CRT. The intent is to provide problem solvers
with a mechanism that can be used to select the appro-
priate root cause analysis tool for the specific problem.

34 QMJ VOL. 12, NO. 4/ 2005, ASQ


Doggett 9/22/05 1:53 PM Page 35

Root Cause Analysis: A Framework for Tool Selection

The first section of this article presents an overview Figure 1 Steps in building a cause-and-effect
and a background of the CED, ID, and CRT. For each diagram.
tool, there is a brief history, a presentation of various
construction techniques, and a summary of the tools Characteristic
or effect
advantages and disadvantages. The second section
reviews published articles that compare these tools. A. Write the characteristic to be improved.

The third section analyzes the literature and provides a


Cause Cause
conceptual framework with a head-to-head compari-
son for problem-solving practitioners and decision
Characteristic
makers. The final section concludes with implications or effect
and recommendations for management.
Cause Cause

AN OVERVIEW OF ROOT CAUSE B. Add the main factor branches.

ANALYSIS TOOLS Cause Cause

Cause-and-Effect Diagram (CED) Minor


Characteristic
or effect
The CED was designed to sort the potential causes of a causes
problem while organizing the causal relationships.
Cause Cause

2005, ASQ
Professor Kaoru Ishikawa developed this tool in 1943 to
C. Add the detailed causal factors as twigs.
explain to a group of engineers at Kawasaki Steel Works
how various manufacturing factors could be sorted and
interrelated. The original intent of the CED was to solve them using a classification schema. The construction
quality-related problems in products caused by statisti- and study of the diagram is intended to stimulate
cal variation, but Ishikawa quickly realized it could be knowledge acquisition and promote discussion, but it
used for solving other types of problems as well. The tool can also educate others about a process or problem.
later came into widespread use for quality control The CED encourages data collection by highlighting
throughout Japanese industry (Ishikawa 1982). As its areas of expertise or by showing where knowledge is
use spread to other countries, it became known as the lacking. Fredendall et al. (2002, 51) calls the CED
Ishikawa diagram, or more informally, the fishbone process an exercise in structured brainstorming. The
because of its appearance once complete (Arcaro 1997; logic of the CED is that one cannot act until the rela-
Moran, Talbot, and Benson 1990; Sproull 2001). tionship between the cause and effect of a problem is
Brassard and Ritter (1994, 23) assert that the CED known. Consequently, the CED attempts to show related
enables a team to focus on the content of the problem, causes so action can be taken.
not on the history of the problem or differing personal Ishikawa (1982) outlines the following steps for
interests of team members. Andersen and Fagerhaug constructing a CED.
(2000, 14) write that the CED is an easily applied tool
Step 1: Decide on the problem to improve or control.
used to analyze possible causes to a problem, while
Wilson, Dell, and Anderson (1993, 195) call it a highly Step 2: Write the problem on the right side and draw
visual technique which aids the process of defining the an arrow from the left to the right side, as shown in
elements of a problem or event and determining how it Figure 1(A).
probably occurred. Step 3: Write the main factors that may be causing
CEDs are drawn primarily to illustrate the possible the problem by drawing major branch arrows to the
causes of a particular problem by sorting and relating main arrow. Primary causal factors of the problem

www.asq.org 35
Doggett 9/22/05 1:53 PM Page 36

Root Cause Analysis: A Framework for Tool Selection

can be grouped into items with each forming a them according to their relationship to the problem
major branch, as shown in Figure 1(B). and each other. The advantage of this method is that
Step 4: For each major branch, detailed causal fac- all proposed causes are listed and solutions are encour-
tors are written as twigs on each major branch of the aged without confining thinking, with the resulting
diagram. On the twigs, still more detailed causal diagram being quite complete. The disadvantage is
factors are written to make smaller twigs, as shown that it may be difficult to establish a direct relationship
in Figure 1(C). between any given cause and the final effect (Andersen
and Fagerhaug 2000; Ishikawa 1982).
Step 5: Ensure all the items that may be causing the
A thoroughly completed CED looks rather compli-
problem are included in the diagram.
cated with many branches, twigs, and smaller twigs.
Major cause category branches can be initially iden- Conversely, too simple a diagram generally indicates
tified using the four Ms: material, methods, machines, that knowledge of the process or problem is shallow
and manpower, or more correctly, the four Ps: parts and requires further investigation (Ishikawa 1982).
(raw materials), procedures, plant (equipment), and Also, the CED may highlight knowledge gaps through
people. Categories can also be tailored depending on the the lack of probable causes on a particular category
problem (Moran, Talbot, and Benson 1990; Scholtes branch.
1988; Sproull 2001). Sometimes measurement or envi- A drawback to using the CED is that there is no
ronment is the fifth category. Arcaro (1997) suggests specific mechanism for identifying a particular root
using no more than eight major categories. cause once complete. One technique is to look on the
There are various types of CEDs. The dispersion diagram for causes that appear repeatedly within or
CED develops groups of probable causes as the main across major categories. Selecting a single root cause,
branches. Participants are asked to identify why disper- however, may prove difficult unless the characteristics
sions (or variations) in the problem occur. The reasons of the problem are well known or documented. As a
for the dispersions are then drawn as twigs on the last resort, groups can select a root cause through
branches (Ishikawa 1982; Sproull 2001). The advan- unstructured group consensus or a structured tech-
tage of this method is that breaking down causes into nique such as multivoting or nominal group technique
more detail helps organize and relate the factors. The (Brassard and Ritter 1994).
disadvantage is that the final form is highly dependent Overall, the advantage of the CED is that it is easy to
on the person or group constructing it, and small use, it promotes structure while allowing some creativi-
causes of variation may be overlooked (Andersen and ty, and it works best when the problem is well defined
Fagerhaug 2000). and data driven (Scholtes 1988). The disadvantage of
The process classification CED lists all the the CED is that it is heavily dependent on detailed
process steps on the main arrow. Factors that may knowledge of the problem and it only identifies possible
affect that particular process step are added as causes (Sproull 2001). Bhote (1988) criticizes the
branches or drawn as individual CEDs. This type of CED as ineffective, saying it is a hit-and-miss process
diagram is like an assembly line with each process that may take months or years to find root causes
step drawn on the main arrow with detailed branches because it tends to emphasize opinions and overlook
added. The advantage of this method is that it is easy causal interactions.
to understand because it follows the sequence of the
process. The disadvantage is that similar causes may
appear repeatedly, while causes due to interdependent Interrelationship Diagram (ID)
factors are difficult to illustrate (Andersen and The ID, originally known as the relations diagram,
Fagerhaug 2000; Ishikawa 1982). was developed by the Society of Quality Control
The cause enumeration CED simply lists all pro- Technique Development in association with the Union
posed possible causes of the problem and organizes of Japanese Scientists and Engineers (JUSE) in 1976.

36 QMJ VOL. 12, NO. 4/ 2005, ASQ


Doggett 9/22/05 1:53 PM Page 37

Root Cause Analysis: A Framework for Tool Selection

The relations diagram was part of a toolset known as logical relationships between different ideas or issues in
the seven new quality control (7 new QC) tools. It was a complex or confusing situation and borders on
designed to clarify the intertwined causal relationships being a tool for cause-and-effect analysis. Brassard
of a complex problem in order to identify an appropri- and Ritter (1994) state that the ID allows groups to
ate solution. The relations diagram evolved into a identify, analyze, and classify the cause-and-effect rela-
problem-solving and decision-making method from tionships that exist among all critical issues so that key
management indicator relational analysis, a method factors can be part of an effective solution. The intent
for economic planning and engineering. Original of the ID is to encourage practitioners to think in mul-
relations diagrams analyzed cause-and-effect relation- tiple directions rather than linearly so that critical
ships using complex calculations for each factor issues can emerge naturally rather than follow person-
(Mizuno 1988). al agendas. The ID assists in systematically surfacing
In 1984, GOAL/QPC, an educational consulting basic assumptions and reasons for those assumptions.
company, formed the Statistical Resource Committee to In summary, the ID helps identify root causes.
research, review, and redesign its training materials for The ID uses arrows to show cause-and-effect rela-
statistical process control (SPC). The result of the com- tionships among a number of potential problem fac-
mittees work is a practitioners handbook, The tors. Short sentences or phrases expressing the factor
Memory Jogger, which describes the various SPC tools are enclosed in rectangles or ovals. Whether phrases or
for practitioners and front-line managers. These tools sentences are used is a group decision, but authors rec-
are known as the seven quality control (7QC) tools and ommend the use of at least a noun and a verb
include the CED. During the development of the hand- (Brassard 1996; Brassard and Ritter 1994). Arrows
book, the authors at GOAL/QPC became aware of the drawn between the factors represent a relationship. As a
seven new QC tools as proposed and published by rule, the arrow points from the cause to the effect or
Mizuno. After translating a working version of from the means to the objective. The arrow, however,
Mizunos book, which was not published in English may be reversed if it suits the purpose of the analysis
until 1988, the Statistical Resource Committee refined (Mizuno 1988).
Mizunos tools into another toolset called the seven The format of the ID is generally unrestricted with
management and planning (7MP) tools. The commit- several variants. The centrally converging ID places
tee developed the term 7MP to indicate that this was not the major problem in the center with closely related
a new toolset to replace the old QC set of tools, but factors arranged around it to indicate a close relation-
rather supplement them and more accurately describe ship. The directionally intense ID places the problem
their intended application (Brassard 1996). As an out- to one side of the diagram and arranges the factors
come, GOAL/QPC published the Memory Jogger Plus+ according to their cause-and-effect relationships on
in 1989, which features the 7MP tools and a variation the other side. The applications format ID can be
of Mizunos relations diagram called the interrelation- unrestricted, centrally converging, or directionally
ship digraph. A digraph is a combination of the words intense, but adds additional structure based on factors
diagram and graph (Moran, Talbot, and Benson such as organizational configuration, processes, or
1990). Thus, the terms interrelationship digraph, systems.
interrelationship diagram, and relations diagram are The ID may use either quantitative or qualitative
generally used interchangeably. formats. In the qualitative format, the factors are sim-
The interrelationship diagram takes complex, ply connected to each other and the root cause is
multivariable problems and explores and displays all of identified based on intuitive understanding. In the
the interrelated factors involved. It graphically shows quantitative format, numeric identifiers are used to
the logical (and often causal) relationships between determine the strength of relations between factors
factors (Brassard 1996, 5). Andersen and Fagerhaug and the root cause is identified based on the numeric
(2000, 14, 19) state that the ID is a tool used to identify value (Andersen and Fagerhaug 2000).

www.asq.org 37
Doggett 9/22/05 1:53 PM Page 38

Root Cause Analysis: A Framework for Tool Selection

Figure 2 Example of an interrelationship diagram.


IN OUT
6 1 IN OUT
2 2
Scheduled
IN OUT appointments Emergency
0 1 appointments

Pay levels

IN OUT IN OUT
0 3 3 1
Equipment
Administrative
quality and
workload
availability

IN OUT
1 3 IN OUT
4 1
Support
functions Changes in
availability scheduled
appointments
Health
professional
availability

2005, ASQ
IN OUT
1 5

Mizuno (1988) recommends the following when factors, then place them on an easel or whiteboard in
creating a relations diagram: a circular shape and assess the relationship of each
Step 1: Collect information from a variety of sources. factor on other factors using arrows. After all relation-
ships have been assessed, count the number of arrows
Step 2: Use concise phrases or sentences as opposed pointing into or out of each factor. A factor with more
to isolated words. out arrows than in arrows is a cause, while a fac-
Step 3: Draw diagrams only after group consensus is tor with more in arrows than out arrows is an
reached. effect. The causal factors form the starting point for
Step 4: Rewrite diagrams several times to identify analysis. Figure 2 shows an example of an unrestrict-
and separate critical items. ed quantitative interrelationship diagram.
A variant of the ID is the ID matrix, which places
Step 5: Do not be distracted by intermediate factors all the factors on the first column and row of a
that do not directly influence the root causes. matrix. This format creates a more orderly display
Mizuno recommends asking why questions to sur- and prevents the tool from becoming too chaotic
face true cause-and-effect relationships and to slow when there are many factors. The strength and direc-
the process so participants can critically evaluate, tion of the relationships can be represented through
revise, examine, or discard factors. arrows, numbers, or other symbols placed in the cells
Andersen and Fagerhaug (2000) write that the of the matrix. Brassard (1996) and Brassard and
first step for using an ID is to determine and label the Ritter (1994) argue that users become careless with

38 QMJ VOL. 12, NO. 4/ 2005, ASQ


Doggett 9/22/05 1:53 PM Page 39

Root Cause Analysis: A Framework for Tool Selection

large, complicated diagrams, so the ID matrix is a a basis for understanding complex systems (Dettmer
good technique to force participants to pay attention 1997). Schragenheim (1998, 19-20) writes, The
to each factor in a more systematic fashion. current reality tree depicts the current state of an
A particular concern of the ID is that it does not organization with the objective of identifying a root
have a mechanism for evaluating the integrity of the cause. Scheinkopf (1999, 144) states that the CRT
selected root cause. In using the quantitative or qual- is used to pinpoint a core drivera common cause
itative method, practitioners must be able to assess for many effects. The CRT assumes that all systems
the validity of their choices and the strength of the are subject to interdependencies among the factor
factor relationships. Some users may simply count components. Therefore, related causes must be identi-
the number of arrows and select a root cause without fied and isolated before they can be addressed.
thoroughly analyzing or testing their assumptions Like the other tools, the CRT uses entities and
about the problem. arrows to describe a system. Entities are statements
Overall, the IDs strength is that it is a structured within some kind of geometric figure, usually a rec-
approach that provides for the analysis of complex tangle with smooth or sharp corners. An entity is
relationships using a nonlinear approach. The disad- expressed as a complete statement that conveys an
vantage is that it may rely too heavily on the subjective idea. An entity can be a cause, an effect, or both
judgments about factor relationships and can become (Dettmer 1997). Arrows in the CRT signify a suffi-
quite complex or hard to read (Andersen and ciency relationship between the entities. Sufficiency
Fagerhaug 2000). implies that the cause is, in fact, enough to create the
effect. Entities that do not meet the sufficiency crite-
ria are not connected. The relationship between two
Current Reality Tree (CRT) entities is read as an if-then statement such as,
Goldratt (1990, 3) promotes the idea that the factors If [cause statement entity], then [effect statement
of problems are interdependent and result from a few entity] (Dettmer 1997; Scheinkopf 1999).
core (root) causes. Goldratt asserts, We grossly In addition, the CRT uses a unique symbol, the oval
underestimate the power of our intuition. Intuitively, or ellipse, to show relationships between interdependent
most people know how to solve problems, but are causes. The literature distinguishes between interrela-
unable to because they have no method of focusing tionship and interdependency using sufficient cause
their intuition. Without a means to focus, people will logic such that effects due to interdependency are
do the opposite of what they really believe and will attributed to multiple and related causal factors.
play a lot of games with numbers and words. Because the CRT is based on sufficiency, there may be
Goldratt expands on the idea of problem solving cases where one cause is not sufficient by itself to create
through focused intuition in the book Its Not Luck the proposed effect. Thus, the ellipse shows that multi-
(Goldratt 1994), which introduces the CRT. The CRT ple causes are required for the produced effect. These
is one of five thinking process (TP) tools, a toolset causes are contributive in nature such that they must
that Goldratt developed for implementing the theory all be present for the effect to take place. If one of the
of constraints (TOC). interdependent causes is removed, the effect will dis-
The CRT addresses problems by relating multiple appear. Relationships that contain an ellipse are read
factors rather than isolated events. Its purpose is to help as, If [first contributing cause entity] and [second
practitioners find the links between symptomatic contributing cause entity], then [effect entity].
factors, called undesirable effects (UDEs), of the core Figure 3 shows an example of a CRT.
problem. The CRT was designed to show the current The CRT also allows for looping conventions that
state of reality as it exists in a system. It reflects the either positively or negatively amplify the effect. In this
most probable chain of cause-and-effect factors that situation, an arrow is drawn from the last entity back
contribute to a specific set of circumstances and creates to one of the earlier causes. If the original core cause

www.asq.org 39
Doggett 9/22/05 1:53 PM Page 40

Root Cause Analysis: A Framework for Tool Selection

Figure 3 Example of a current reality tree.

Operators do not use


standard practices

Operators view standard practices


as a tool for inexperienced and Company does not enforce
incompetent operators the use of standard practices

Some standard practices


Competent and experienced Operators want to be are incorrect
operators do not need viewed as experienced
standard practices and competent

Some operations do not Standard practices are


have standard practices not updated regularly

The company does not have a


defined system for creating and
updating standard practices

2005, ASQ
Standardization of practices
is not a company value

creates a negative reinforcing loop, but can be 5. Continue the process of connecting the UDEs using
changed to a positive, the entire system will be rein- if-then logic until all the UDEs are connected.
forced with a desirable effect (Dettmer 1997). Although 6. Sometimes the cause by itself may not seem to be
constructed from the top, starting with effects, then enough to create the effect. Additional dependent
working down to causes, the CRT is read from bottom causes can be shown using the and connector.
to top using if-then statements. The arrows lead
from the cause upward (Gattiker and Boyd 1999). 7. Logical relationships can be strengthened using
The procedure for constructing a CRT was first words like some, few, many, frequently, and
described by Goldratt (1994) via narrative format in sometimes.
the book Its Not Luck. Cox and Spencer (1998) later This process continues as entities are added down-
outline the paraphrased procedure: ward and chained together. At some point no other
1. List between five and 10 problems or UDEs related causes can be established or connected to the tree. The
to the situation. construction is complete when all UDEs are connected
to very few root causes, which do not have preceding
2. Test each UDE for clarity and search for a causal
causal entities (Cox et al. 1998; Dettmer 1997). The
relationship between any two UDEs.
final step in the construction of the CRT is to review all
3. Determine which UDE is the cause and which is the the connections and test the logic of the diagram.
effect. Branches that do not connect to UDEs can be pruned
4. Test the relationship using categories of legitimate or separated for later analysis.
reservation (CLRs). (These are rules for evaluating The assumptions and logic of the CRT are evaluated
assumptions and logic and are described later.) using rules called CLRs. These rules ensure rigor in

40 QMJ VOL. 12, NO. 4/ 2005, ASQ


Doggett 9/22/05 1:53 PM Page 41

Root Cause Analysis: A Framework for Tool Selection

the CRT process and are the criteria for verifying, vali- First, the physical layout of the tools is different.
dating, and agreeing upon the connections between The CED is horizontal and reads from left to right,
factors. They are also used to facilitate discussion, while the CRT is vertical and reads from bottom to top.
communicate disagreement, reduce animosity, and Second, the CED does not easily show systematic causes
foster collaboration (Scheinkopf 1999). The CLRs of an effect, while the CRT shows if-then logic more
consist of six tests or proofs: clarity, entity existence, precisely. Third, practitioners may find the strict appli-
causality existence, cause insufficiency, additional cation of the CRT logic intimidating and resent having
cause, and predicted effect (Dettmer 1997). to phrase their suggestions or objections as CLRs.
Clarity, causality existence, and entity existence are Consequently, most people view the CED as easier
the first level of reservation and are used to clarify because it requires less training and is quicker to con-
meaning and question relationships or the existence of struct. Fourth, the CED does not quickly identify the
entities. The second level of reservation includes cause root cause of the problem, while the CRT is structured
insufficiency, additional cause, and predicted effect. so that it visually points to it, which then leads more
They are secondary because they are used when ques- precisely to finding a potential permanent solution
tions remain after addressing first-level reservations. (Fredendall et al. 2002).
Second-level reservations look for missing or additional Pasquarella, Mitchell, and Suerken (1997) present
causes and additional or invalid effects (Dettmer 1997; a detailed comparison of the tools in a three-part pro-
Scheinkopf 1999). ceedings article, with each author writing a section.
Variations are the use of the CRT to identify busi- Suerken does not compare the tools, but recommends
ness constraints as part of TOC or to persuade others to using the TP tools, including the CRT, in educational
take a particular course of action (Cox et al. 1998; settings. Pasquarellas section compares the TP tools to
Goldratt 1990; Lepore and Cohen 1999; Smith 2000). 10 quality control tools (adding three more tools to the
When used as a persuasion tool, it is known as the 7QC tools), including the CED. Pasquarella also com-
communication CRT. When used to identify business pares the TP tools to the 7MP tools, including the ID.
constraints, it becomes one of the five TP tools used in In comparing both sets of tools to the TP tools,
the TOC process (Scheinkopf 1999). Pasquarella comes to three conclusions. First, organi-
A particular concern of the CRT is its complexity of zational managers will choose simple methods when
construction and rigorous logic system. Practitioners confronted with too many tools or if they perceive a
may find the application of the CRT too difficult or tool as too complex. Thus, most managers will choose
time consuming. Conversely, the strength of the CRT is the CED because it fits their perception of a simple
the rigor of the CLR mechanism that encourages analysis tool. Second, simple methods are heavily
attention to detail, ongoing evaluation, and integrity influenced by the emotions of the people using them.
of output. Conversely, complicated methods require a degree of
expertise and facilitation. Therefore, managers will
PREVIOUS COMPARISONS OF again choose the CED despite its subjective nature
because they are reluctant to assign groups complex
THE TOOLS methods. Third, most tools do not address systemwide
Fredendall et al. (2002), in a comparison of the CED problems unless they can be integrated and rigorously
with the CRT, declare that they use much of the same applied. In other words, most tools cannot be used in
causal logic and can be used in tandem. For example, isolation to solve larger systemic problems.
a group may use the CED to brainstorm possible causes Consequently, organization managers tend to use
and then use the CED output to develop a list of UDEs simple tools that do not solve systematic problems.
for the CRT. There are, however, some critical differ- Pasquarella claims the TP tools superior for the
ences between the two approaches. following reasons:

www.asq.org 41
Doggett 9/22/05 1:53 PM Page 42

Root Cause Analysis: A Framework for Tool Selection

1. They are logical, simple, and there are less of them readability, as it was easier to read at a glance, and the
to consider. CED was most the difficult to read.
2. The TP tools capitalize on intuition and emotion Mitchells students concluded that the CRT was the
without skewing the process because the CLRs force best of the three tools because it was able to pinpoint
rigor into the process. root causes while identifying causal interdependencies.
The common weakness of the CED and ID was their
3. Each TP tool is clearly identified for a specific func-
inability to identify causal interdependencies. Mitchell
tion so it can be used as a stand-alone application
offers the opinion that a clear understanding of causal
as well as collectively for systematic problems. As a
interdependency is critical to successful problem-solving
result, Pasquarella declares that the TP tools (and
efforts. Without this understanding, overlooked negative
the CRT) produce the best results because they are effects will creep back into a system and create recurrent
more robust, powerful, and intuitive than the problems that will eventually need attention.
other tools. Using a repeated measures design with several sec-
Mitchells section reports the results of a qualitative tions of students from team building and leadership
study that measured the effectiveness of the CED, the ID courses, Doggett (2004) found statistically significant
matrix, and the CRT. Mitchell asked students from an differences between the tools with regard to perceptions
advanced quality management course to find the root of usability (F (1.881, 74) = 9.156, p < .001) that was
cause of an airline transport accident. The students driven primarily by ease or difficulty of use. Large effect
applied each of the three root cause analysis tools and sizes (1.15 and 1.18) between the CRT and the other
then drew comparisons. tools indicated that the CRT was perceived as more
Mitchells students found that the CRT pinpointed difficult. In terms of identifying cause categories, the
a root cause of the airline accident while the CED did CED was perceived better than either the ID or CRT
not. Mitchell does not indicate whether the students (F (2, 74) = 7.839, p = .001). None of the students,
found a root cause using the ID matrix, but he states however, perceived any differences between the tools
that the matrix was a good tool for keeping the group with regard to finding root causes, identifying factor
organized and focused. Mitchells students also relationships, or developing group discussion and
reported that the CRT was the only tool that displayed contribution. In terms of the process, the CRT was the
interdependencies between causes. While the ID most time consuming, with the ID and CED taking
matrix showed interrelationships, it did not show the same amount of time on average.
whether the effect resulted from multiple related Of greater interest in Doggetts study was an appar-
causes. The CRT was the only tool to show both inter- ent incongruence between the statistical perceptions of
relationships and intermediate factors. Both the CED participants and the quality of the tool outputs. While
and the CRT were effective in grouping cause cate- participants perceived few differences between the tools,
gories. Mitchell reports that the CRT created more the characteristics of the tool outputs varied greatly.
discussion than the CED, but did not compare the ID The technical accuracy of both the CED and the ID
matrix. All three tools were deemed effective for were high, whereas the technical accuracy of the CRT
focusing problem-solving activity. was mixed. Students using the CED were seldom able to
In terms of the process, Mitchells students found identify a specific root cause, however, the students
the CED easiest and least time consuming, followed by using the ID found root causes more often. Because the
the CRT and ID matrix. In this study, the ID matrix students using the CED could not identify specific root
required extra process time to clarify and correct causes, the integrity and reasonableness of their selec-
incomplete relationships after initial construction. tions also suffered. While the ID groups found a root
Mitchells students rated the CRT highest for readability cause most of the time, the integrity and reasonable-
because the root cause was easy to locate at the bottom ness of their root causes was mixed. In contrast, CRT
of the diagram. The ID matrix was rated second for groups identified a root cause most of the time with

42 QMJ VOL. 12, NO. 4/ 2005, ASQ


Doggett 9/22/05 1:53 PM Page 43

Root Cause Analysis: A Framework for Tool Selection

high integrity more than half the time. In addition, the Table 1 Head-to-head comparison of root cause
CRT groups were able to do this using fewer factors and analysis tools.
relationships than the other tools.
Performance criteria CED ID CRT
Doggett postulates that the incongruence between
perceptions and actual performance is due to the nature Ability to find a specific root cause No Yes Yes
of group dynamics that tends to avoid creating tension. Ability to find reasonable root cause No Mixed Yes
Because the students were involved in the complexity of
Ability to show systematic causes No No Yes
building the CRT, they did not take the time to assess or of effect
reflect on the meaning of their outputs. Their reflection
was impaired by the emotionally laden group process. Shows causal interdependency No No Yes

Thus, students perceived the tension generated by the Identifies factor relationships No Yes Yes
CRT as an added degree of difficulty. Although the
Shows intermediate factors No No Yes
majority of the CRT groups were uncomfortable during
the process, the quality of their outputs was better. Identifies cause categories Yes No ?

Stimulates dialogue and discussion ? ? Yes

SUMMARY OF THE LITERATURE Focuses activities Yes Yes Yes

The literature indicates that the CED is an easy-to-use Has mechanism for testing logic No No Yes
tool for developing and classifying root cause cate- Construction process time Low Low High
gories. It assumes the existence of enough knowledge
Construction accuracy required High Medium Low
to be able to isolate and identify probable root causes,
but the identified causes may not be specific or Extent of subjective influence on High High Low
reasonable. The CED has the potential to highlight output

information that is lacking or inadequate through the Amount of problem knowledge High ? ?
lack of identified causes in certain categories; however, required

it does not identify relationships between factors, has Ease of use High High Low
no formal mechanism for selecting and evaluating root
Overall readability Low Low High

2005, ASQ
causes, and may be influenced by group bias.
The literature indicates that the ID is an easy-to-use Number of factors to analyze Many ? Few
relative to the problem
tool to help clarify intertwined relationships between
multiple factors, although the factors may not be
causal. The ID is used to identify, analyze, and classify Experts (tool practitioners) rarely look for root causes
possible relationships among critical issues using a moving from symptoms backwards along possible
nonlinear structured method. Authors view the ID as a causal links. In this respect, the CRT is unique. Of the
borderline tool for cause-and-effect analysis because of three root cause tools, the CRT is the only method that
its mixed performance in identifying root causes. The has a mechanism for testing logic. Groups may find
ID does not have a mechanism for evaluating the the logic and construction rules of the CRT intimidat-
integrity of the output, and may rely too heavily on ing, difficult, and time consuming. While it is not clear
subjective judgments of factor relationships. that all of the tools stimulate dialogue and discussion,
The literature indicates that the CRT is a complex the CRT provides opportunities for groups to dialogue
tool for pinpointing root causes and identifying causal using the CLRs.
interdependencies. The CRT builds chains of cause and A synthesis of the literature reviewed in this article
effect, starting with effects, to guide the verbalization of is shown in Table 1. If the reviewed literature does not
intuition in a logical fashion leading to the identifica- specifically address a performance criterion for the
tion of a core problem. Khaimovich (1999, 53) writes, specific tool, it is not indicated.

www.asq.org 43
Doggett 9/22/05 1:53 PM Page 44

Root Cause Analysis: A Framework for Tool Selection

If the selected root cause is trustworthy, it produces a


CONCLUSION clear managerial decision for an action. Each analy-
Most of the literature describes the three tools inde- sis tool has distinguishing characteristics that can
pendently. Only three studies compare the CED, ID, potentially affect group output. Therefore, reliable
and CRT to each other. Two of the studies are qualita- decision making requires that managers have a
tive and one study is mixed. Problem solvers and working knowledge of root cause analysis tools, their
decision makers continue to have little data regard- processes, and their likely outcomes.
ing the actual effectiveness of root cause analysis The complexities of modern business require
tools. Thus, it appears that there is an opportunity to approaches that are more sophisticated. A popular
gain a better understanding the ability of these tools view is that if enough minds are put to the task, an
to find actual root causes the most important answer to the problem will be found. Bhote (1988)
characteristic of a root cause analysis tool. There are criticizes unstructured processes because they put too
also the relational and causal factors that exist much emphasis on opinions, take too long, and dont
around or close to the problem. If managers use tools produce lasting results. Leaders need to establish
that find causal relationships and categories close to standards and policies for problem-solving training,
where the problem resides, they can focus improve- and group facilitation and practice using structured
ment efforts more precisely and accurately in areas of root cause analysis tools. The alternative is to contin-
greatest potential. ue to assume that existing efforts will somehow
Alternatively, root cause analysis tools must also produce different results. Assuming that groups can
have the characteristics to promote collaboration, work together on a problem without a tool, standard,
stimulate discussion, be readable or understandable, and method for critical evaluation is a policy doomed
and have mechanisms for evaluating integrity. The to fail.
influence of group dynamics on process outcomes is
a common theme in research but beyond the scope of REFERENCES
this article. Self-motivated groups can probably over- Andersen, B., and T. Fagerhaug. 2000. Root cause analysis:
come many root cause analysis tool limitations. Simplified tools and techniques. Milwaukee: ASQ Quality Press.
Conversely, a dysfunctional group is probably not Arcaro, J. S. 1997. TQM facilitators guide. Boca Raton, Fla.:
capable of producing good results using even the best St. Lucie Press.
root cause analysis tool. Teams that use dialogue and
Bhote, K. R. 1988. World class quality: Design of experiments
discussion effectively within a supportive context made easier, more cost effective than SPC. New York: AMA.
might overcome the restrictions of a mediocre tool,
Brassard, M., and D. Ritter. 1994. The memory jogger II: A pocket
but even the best analytical tool cannot turn a guide of tools for continuous improvement and effective planning.
mediocre team into a great problem-solving group. Salem, N.H.: GOAL/QPC.
The limitation of this type of research is the inability Brassard, M. 1996. The memory jogger plus+: Featuring the seven
to isolate aptitude-treatment interactions. If man- management and planning tools. Salem, N.H.: GOAL/QPC.
agers use tools that effectively focus effort on finding Cox, J. F. III, R. H. Draman, L. H. Boyd, and M. S. Spencer.
root causes rather than conflicting personalities, they 1998. A cause and effect approach to analyzing performance
unleash the capability of the organization to learn measures: Part 2 internal plant operations. Production and
and address systemwide issues. Inventory Management Journal, 39, no. 4:25-33.

The implications for management are that effec- Cox, J. F. III, and M. S. Spencer. 1998. The constraints management
tive problem solving requires the identification of handbook. Boca Raton, Fla.: St. Lucie Press.
specific and reasonable root causes. Several methods Dettmer, H. W. 1997. Goldratts theory of constraints. Milwaukee:
exist for identifying root causes, but their effective- ASQ Quality Press.
ness is dependant on the rigorous application of the Dew, J. R. 1991. In search of the root cause. Quality Progress 24,
group and the integrity of the selected root cause. no. 3:97-107.

44 QMJ VOL. 12, NO. 4/ 2005, ASQ


Doggett 9/22/05 1:53 PM Page 45

Root Cause Analysis: A Framework for Tool Selection

Doggett, A. M. 2004. A statistical comparison of three root Scheinkopf, L. J. 1999. Thinking for a change: Putting the TOC
cause analysis tools. Journal of Industrial Technology 20, no. 2. thinking processes to use. Boca Raton, Fla.: St. Lucie Press.

Fredendall, L. D., J. W. Patterson, C. Lenhartz, and B. C. Mitchell. Scholtes, P. 1988. The team handbook: How to use teams to
2002. What should be changed? Quality Progress 35, no. 1:50-59. improve quality. Madison, Wis.: Joiner.

Gattiker, T. F., and L. H. Boyd. 1999. A cause-and-effect Schragenheim, E. 1998. Management dilemmas: The theory of
approach to analyzing continuous improvement at an electronics constraints approach to problem identification and solutions.
manufacturing facility. Production and Inventory Management Boca Raton, Fla.: St. Lucie Press.
Journal 40 no. 2:26-31.
Smith, D. 2000. The measurement nightmare: How the theory of
Goldratt, E. M. 1990. What is this thing called theory of con- constraints can resolve conflicting strategies, policies, and meas-
straints and how should it be implemented? New York: North ures. Boca Raton, Fla.: St. Lucie Press.
River Press.
Sproull, B. 2001. Process problem solving: A guide for mainte-
Goldratt, E. M. 1994. Its not luck. Great Barrington, Mass.: nance and operations teams. Portland: Productivity Press.
North River Press.
Wilson, P. F., L. D. Dell, and G. F. Anderson. 1993. Root cause
Ishikawa, K. 1982. Guide to quality control, second edition. analysis: A tool for total quality management. Milwaukee: ASQ
Tokyo: Asian Productivity Organization. Quality Press.
Khaimovich, L. 1999. Toward a truly dynamic theory of problem-
solving group effectiveness: Cognitive and emotional processes BIOGRAPHY
during the root cause analysis performed by a business process
re-engineering team. Ph.D. diss., University of Pittsburgh. Mark Doggett is the chair of the Department of Industrial
Abstract in Dissertation Abstracts International 60:04B: 1915. Technology at Humboldt State University. He is currently working
to revitalize the study of technology on his campus and improve
Lepore, D., and O. Cohen. 1999. Deming and Goldratt: The theory
the technological literacy of the local community. His interests are
of constraints and the system of profound knowledge. Great
Barrington, Mass.: North River Press. quality management practices, lean manufacturing, theory of
constraints, and systems thinking. He has also performed
Mizuno, S., ed. 1988. Management for quality improvement: The
research in various decision-making and problem-solving strate-
seven new QC tools. Cambridge: Productivity Press.
gies used by students, managers, and policy makers. His areas of
Moran, J. W., R. P. Talbot, and R. M. Benson. 1990. A guide to expertise include leadership, process management, and manu-
graphical problem-solving processes. Milwaukee: ASQ Quality Press. facturing technology with more than 20 years of experience in

Pasquarella, M., B. Mitchell, and K. Suerken. 1997. A compari- business and industr y. Doggett received his doctorate at
son on thinking processes and total quality management tools. Colorado State University in interdisciplinary studies and holds
1997 APICS constraints management proceedings: Make common bachelors and masters degrees in Industrial Technology. He can
sense a common practice. Falls Church, Va.: APICS. be reached by e-mail at Mark.Doggett@humboldt.edu.

www.asq.org 45

You might also like