Curious Cat Management Improvement Blog: Deming, lean thinking, innovation, customer focus, continual improvement, six sigma.
May 9, 2007
Be Careful What You Measure

Be Careful What You Measure by Mike Wroblewski:

Although this recalculation of productivity had a positive affect, it is not what I would consider a triumph. Ongoing efforts are still required to truly increase productivity, so it’s back to gemba. However, I am modifying the lesson to “Be careful what and how you measure, measurements drive action and behavior”

Excellent points. Behavior can be changed by what is measured. The problems with arbitrary numerical targets (to take one measurement related example) is not that attempts to achieve those targets won’t have an affect. They very well may have an affect. However they may not have the desired result. When focused on improving a number (which can happen when focused on measures - especially as the focus on those measures is tied to bonuses, favorable treatment…) the focus is not necessarily on on improving the system. Often distorting the system is the result.

Measures need to be used with a conscience effort to remember the data is merely a proxy to quantify the results (not the end themselves). Taking care in choosing the measures is one necessary step to assure the best improvement results. One strategy is to include some measures that are outcome measures. Often those measures are difficult to pin to specific process improvements tightly so you will also want to include specific process measures. The outcome measures help make sure you maintain a focus on the important system level results. Process measures will help you test and improve processes (as well as monitor and react, when necessary to ongoing processes).

Often improving the process measures can be mistaken for the aim. Care needs to be taken to underscore the role of process measures (process management). Also measures should be re-examined periodically to determine if they are still the correct measures. Systems with people are heavily influenced by what is measured. People will often react to what is measured and make adjustments to how the work is done to make the numbers better. The danger is that those attempts to make the measures look better can actually harm the overall system (when poor measures are used).

Related: Targets Distorting the System - Understanding Data - Operational Definitions and Data Collection - Dangers of Forgetting the Proxy Nature of Data

2 Responses to “Be Careful What You Measure”

  1. CuriousCat: The Problem with Targets Says:

    most often targets results in distortion of the data (faulty data) or distortion of the system (meet target by shifting resources and effort from other parts of the system). Both of those actions are harmful to the system…

  2. Curious Cat Management Improvement Blog » Better Meetings Says:

    If there are no desired outcomes, why are you meeting?

Leave a Reply



Curious Cat Management Improvement Blog © curiouscat.com 2005-2008 powered by WordPress

Internal Links

Author

John Hunter

Tags


Full tag could

Other

Search Blog

Web Search

Management Improvement web search

Recent Comments

  • Anonymous: It’s amazing to think that something as simple as a checklist could save 8 lives. With what is...
  • Trish Anne Murphy: I believe dress and clothes DO make a difference in the majority of job interviews. Arriving at an...
  • Jurgen Appelo: I’m a CIO and I don’t think dress is important. However, I *do* think it’s important...
  • t jefferson: Sure I would take a cut in hours. To save one job with with 10 workers you would have to give up appx 4...
  • Dian Rosse: Your really great. Thank you very much! I learned a lot by reading this website. There are inspiring...
  • Ryan: You know, that’s pretty cool. Really, if you think about it, it’s the same concept steam engines...
  • Tom: Very humble, imagine the psychological impact on the workers(motivation) But that cafeteria scene is very...
  • Anonymous: Yes, I agree it seems that now a days, companies forget that the customer, more than a customer, is a...

Archives

May 2007
M T W T F S S
« Apr   Jun »
 123456
78910111213
14151617181920
21222324252627
28293031