A Statisticians Favorite Answer: It Depends, Part 1

Page 1 of 4

Published on Quality Digest (http://www.qualitydigest.com)

Home > Content

A Statisticians Favorite Answer: It Depends, Part 1

By: Davis Balestracci When should I use what chart? Quality improvement people sure love those tools. A particular favorite, of course, is the control chart, of which, I think, seven are usually taught. Two questions Im always asked are, Which chart do I use for which situation? and When and how often should I recalculate my limits? Wrong questions!

ADVERTISEMENT

Regarding the first (well deal with second question in part 2), Ive seen many flowcharts in books to help you determine which chart to use for which situation. I find them far too confusing for the average user. (They even give me sweaty palms.) I dont even teach this in my work. As my respected colleague Donald Wheeler likes to say, The purpose is not to have charts. The purpose is to use the charts. You get no credit for computing the right numberonly for

http://www.qualitydigest.com/print/14243

3/24/2011

A Statisticians Favorite Answer: It Depends, Part 1

Page 2 of 4

taking the right action. Without the follow-through of taking the right action, the computation of the right number is meaningless.

So lets get back to basics again

As I said in my Feb. 21 newsletter [1], Making Variation Disappear on Paper Doesnt Make It Disappear in Reality, after you know how your data were defined and collected, the next step is to assess the process that produced the data. This is done via a run chart (or as I like to say, filter No. 1) and most of the time, a subsequent control chart (filter No. 2). This rationale was explained in my Jan. 24 newsletter [2], What Part of Never Dont People Understand? Because the data are in a time sequence (or should be), the control chart of choice with which to start is the individuals chart; it uses the moving range (MR) between consecutive points to determine the limits. The individuals chart is the Swiss army knife of control charts. (In some of the figures in the newsletters mentioned above, it is advertised as an I-MR chart combination. Dont worry too much about the MR chart for the moment; I will address this in a future column.) It usually approximates the correct chart under most conditions. I can hear the chorus, So, what are the conditions when it isnt correct? Remember Dr. Donald M. Berwicks recommendation, If you follow only one piece of advice from this lecture when you get home, pick a measurement you care about and begin to plot it regularly over time. Note that he doesnt say, Plot a control chart of that data. The bottom line is that before you ask, Which chart should I use for which situation? or challenge me with a what if doomsday scenario (Im truly amazed at the creative hypothetical situations thrown at me during my teaching), let me request: Could you please show me the data (or describe an actual situation) that are making you ask me this question? Please tell me why this situation is important. Please show me a run chart of these data plotted over time. What ultimate actions would you like to take with these data?

If you have the patience to answer these and follow them through with a data set to an appropriate action, you will have probably answered the question yourselfsolving a major problem in the processand saved yourself a major side trip into the swamp of calculation minutiae.

Lets consider the various charts

X-bar/R chart and X-bar/S chart. Since a lot of readers are in health care, Ill tell you right now: You virtually never use these. They were designed for manufacturing processes where thousands of parts are made per day, and its no big deal to grab, say, four to five parts consecutively produced every hour (which takes seconds). People, even at manufacturing facilities, seem to find these confusing and hard to use because the limits are based on averages. In health care clinical applications, you dont have patients coming through in numbers similar to an assembly line. I literally cannot remember the last time Ive used these charts in my health care work. They might lend themselves to high-volume administrative processes, but once again, it depends, and people still find them confusing.

http://www.qualitydigest.com/print/14243

3/24/2011

A Statisticians Favorite Answer: It Depends, Part 1

Page 3 of 4

So I never formally teach them and would do so only if needed in the context of solving an issue. C-chart (for counts). These are easily approximated by the individuals chart, especially if the average is at least five. Remember, the processs stability is the key question and determines whether you subsequently use a common- or special-cause strategy. Small numbers (and rare events) get very tricky and usually require guidance by a statistical expert to get the right number. Regardless, the run chart and individuals chart will generally lead you to the right initial action. P-chart and u-chart. When p-charts (percentages) and u-charts (rates) are plotted over time, pretty much everyone gets confused by the stair-step limits caused by the varying denominator sizes. This confusion only escalates by well-meaning attempts to explain them. Occasionally, the chart might come in handy for finding an individual outlier. More important, these also become especially problematical, especially for p-charts, when data are aggregated monthly, quarterly, or even annually. The resulting large denominators (as in hundreds or thousands) create many artificial out-of-control signals (i.e., above or below the limits). Donald J. Wheeler, Ph.D., whose books are very practical, well-written, and offer good examples (you can peruse them at www.spcpress.com [3]), is of the opinion that true independence of occurrence of events in reality is rarely encountered. So, he feels its correct to use only the individuals chart. My experience has pretty much borne this out. But, it depends, and gets tricky with small denominators. Np chart. As far as the np chart goes, its a marginal pedagogical classroom exerciseand thats about it. I virtually never use it because having equal sample sizes in the denominator is a rare luxury indeed. Or the machinations to create equal denominators then explain the resulting chart to ones puzzled audience far outweigh any benefits.

In defense of p-charts and u-charts

I have found p-charts and u-charts to be helpful in stratification (a common-cause strategy). One uses them to compare, statistically, individual rates that each have been obtained by: Plotting a run chart Following up with a control chart Determining the most recent stable history, and only then, Aggregating the data from No. 3 into summed numerators and denominators for statistical comparison

In these cases, the horizontal axis is not time. It could be, for example, individual doctors or locations. Many of you have no doubt encountered these via the fancy euphemism funnel plots, where the results are sorted horizontally by increasing denominator size.

Always start with process data gathered over time and plot a run chart
First, find out what youre perfectly designed to get, and second, see whether common or special-cause strategies are needed to further solve the problem. This gives you a baseline with which to assess the current state as well as your subsequent intervention efforts.

http://www.qualitydigest.com/print/14243

3/24/2011

A Statisticians Favorite Answer: It Depends, Part 1

Page 4 of 4

Many projects fail because they lack a baseline. So you see, theres never an escape from plotting your process data over time. As Berwick says at the end of his quote, You wont be sorry. Part 2 will look at the question that drives me nuts and explode some common myths about control charts.

About The Author

Davis Balestracci is a member of the American Society for Quality and past chair of its statistics division. He would love to wake up your conferences with his dynamic style and unique, entertaining insights into the places where process, statistics, and quality meet. Visit his web site at www.dbharmony.com. Be sure to read his latest book Data Sanity. You can order Data Sanity at www5.mgma.com/ecom/Default.aspx? action=INVProductDetails&args=3785&tabid=138. Quality Insider Column Twitter Ed 2011 Quality Digest Magazine. All Rights Reserved. Home the Insider Videos Magazine Privacy Policy Resources Search Subscribe Advertise About Us
Source URL (retrieved on 03/23/2011): http://www.qualitydigest.com/inside/quality-insider-column/statistician-s -favorite-answer-it-depends-part-1.html Links: [1] http://www.aweber.com/b/1QcoN [2] http://clicks.aweber.com/y/ct/?l=KoIqO&m=1eykdc.0jy9Il8&b=_m1nB7_Pa3BtcLs5uzd1CA [3] http://www.spcpress.com/Merchant2/merchant.mvc? Screen=PROD&Store_Code=SPI&Product_Code=_68-5&Category_Code=BOOKS

http://www.qualitydigest.com/print/14243

3/24/2011