Tag Archives: Data

All Data is Wrong, Some is Useful

From my first blog post on this blog – Dangers of Forgetting the Proxy Nature of Data

we often fail to explore whether changes in the numbers (which we call results) are representative of the “true results” of the system or if the data is misleading.

Data is meant to provide us insight into a more complex reality. We need to understand the limitations when we look at “results” and understand data isn’t really the results but a representation we hope is close to reality so we can successfully use the data to make decisions.

But we need to apply thought to how we use data. Lab results are not the same are what happens in the field. It is cheaper and faster to examine results in a lab. But relying on lab results involves risk. That doesn’t mean relying on lab results is bad, we have to balance the costs and benefits of getting more accurate data.

But relying on lab results and not understanding the risk is dangerous. This is the same idea of going to the gemba to get an accurate understanding instead of relying on your ability to imagine reality based upon some data and ideas of what it is probably like.

photo of a Modified Yellow VW Beetle

VW Beetle (in Bangkok, Thailand) has some sort of modification along the back bumper but I don’t know what it is meant to do. Any ideas? More of my photos from Bangkok.

Volkswagen Drops 23% After Admitting Diesel Emissions Cheat

Volkswagen AG lost almost a quarter of its market value after it admitted to cheating on U.S. air pollution tests for years

During normal driving, the cars with the software — known as a “defeat device” — would pollute 10 times to 40 times the legal limits, the EPA estimated. The discrepancy emerged after the International Council on Clean Transportation commissioned real-world emissions tests of diesel vehicles including a Jetta and Passat, then compared them to lab results.

Obviously VW was managing-to-test-result instead of real world value. It seems they were doing so intentionally to provide misleading data. Obviously one of the risks with lab test results (medical trials etc.) is that those with an interest in showing better results could manipulate the data and lab procedures (or systems) to have the data show their product in the most favorable light.

Continue reading

Transforming a Management System – A Case Study From the Madison Wisconsin Police Department

This post in an excerpt from The Quality Leadership Workbook for Police by Chief David Couper and Captain Sabine Lobitz (buy via Amazon).

cover image of the New Quality Leadership Workbook for Police

The New Quality Leadership Workbook for Police

Transformational Steps
A Case Study Madison, Wisconsin (1981-1993)

Step 1: Educate and inform everyone in the organization about the vision, the goals, and Quality Leadership. This step must be passionately led by the top leader.

  • Begin discussion with top management team and train them.
  • Discuss and ask employees; get feedback from them.
  • Share feedback with the chief and his management team.
  • Get buy-in from top department managers.
  • Survey external customers—citizens; those who live and work in the community.
  • Create an employee’s advisory council; ask, listen, inform, and keep them up to date on what’s going on.
  • The chief keeps on message; tells, sells, and persuades, newsletters, meetings and all available media.

Step 2: Prepare for the transformation. Before police services to the community can be improved, it is essential to prepare the inside first — to cast a bold vision and to have leaders that would “walk the talk.”

  • Appoint a top-level, full-time coordinator to train, coach, and assist in the transformation.
  • Form another employee council to work through problems and barriers encountered during implementation of the transformation and Quality Leadership.
  • Require anyone who seeks to be a leader to have the knowledge and ability to practice Quality Leadership.

Step 3: Teach Quality Leadership. This begins at the top with the chief and the chief’s management team.

  • Train all organizational leaders in Quality Leadership.
  • Train all employees as to what Quality Leadership is, why the transformation is necessary, and what it means for them.

Step 4: Start practicing Quality Leadership. If top managers within the organization are not authentically practicing Quality Leadership neither will anyone else.

Continue reading

Manufacturing Outlook and History In the USA and Globally

I write primarily about management improvement on this blog – which makes sense given the title. In the very early days I had more on investing, economic data, science, engineering and travel. Then I created three new blogs (Curious Cat Investment and Economics Blog, Curious Cat Science and Engineering Blog, Curious Cat Travel Photos blog) and that made this blog more focused.

Even so the lines of what fits where can be a bit fuzzy and I continue to write about manufacturing, and health care, with a focus on economic data, occasionally. And that is what I am doing today while touching on management related to manufacturing a bit.

As I have written before the story of manufacturing in the USA, and globally, is greatly increased quality of processes and output as well as greatly improved productivity over the last few decades. Manufacturing output also increased, including in the USA, as I have written consistently for a decade now. For example: (Top 10 Countries for Manufacturing Production from 1980 to 2010.

Still many people have the notion that USA manufacturing has been declining, which hasn’t been true, and certainly isn’t true now (the last couple of years have been especially strong and even the general public seems to realize the idea of the USA losing manufacturing is a myth).

Chart of Manufacturing Output fro 1992 to 2012 - USA, China, Japan and Germany

Based on data from the UN. See my blog post on my economics for more details on the data (to be posted next week).

The chart is impressive and illustrates the point I have been hammering home for years. The USA manufacturing base is growing and far from crumbling (job losses are deceiving as they are global and not an indication of a USA manufacturing decline). China’s manufacturing growth is incredible. China and the USA are far away the top 2 manufacturing countries. Japan and Germany make out the top 4 before a large gap which then is followed by a group of countries that are very close (Korea is 5th with less than half the production of Germany).

Continue reading

The Art of Discovery

Quality and The Art of Discovery by Professor George Box (1990):

Quotes by George Box in the video:

“I think of statistical methods as the use of science to make sense of numbers”

“The scientific method is how we increase the rate at which we find things out.”

“I think the quality revolution is nothing more, or less, than the dramatic expansion of the of scientific problem solving using informed observation and directed experimentation to find out more about the process, the product and the customer.”

“It really amounts to this, if you know more about what it is you are doing then you can do it better and you can do it cheaper.”

“We are talking about involving the whole workforce in the use of the scientific method and retraining our engineers and scientists in a more efficient way to run experiments.”

“Tapping into resources:

  1. Every operating system generates information that can be used to improve it.
  2. Everyone has creativity.
  3. Designed experiments can greatly increase the efficiency of experimentation.

An informed observer and directed experimentation are necessary for the scientific method to be applied. He notes that the control chart is used to notify an informed observer to explain what is special about the conditions when a result falls outside the control limits. When the chart indicates a special cause is likely present (something not part of the normal system) an informed observer should think about what special cause could lead to the result that was measured. And it is important this is done quickly as the ability of the knowledgable observer to determine what is special is much greater the closer in time to the result was created.

The video was posted by Wiley (with the permission of George’s family), Wiley is the publisher of George’s recent autobiography, An Accidental Statistician: The Life and Memories of George E. P. Box, and many of his other books.

Related: Two resources, largely untapped in American organizations, are potential information and employee creativityStatistics for Experimenters (book on directed experimentation by Box, Hunter and Hunter)Highlights from 2009 George Box SpeechIntroductory Videos on Using Design of Experiments to Improve Results (with Stu Hunter)

Management Improvement Blog Carnival #190

The Curious Cat Management Carnival is published twice each month. The posts selected for the carnival focus on the areas of management improvement I have focused on in the Curious Cat Management Improvement Guide since 1996: Deming, evidence based management, systems thinking, respect for people, applied statistics, etc..

photo of George Box, John Hunter and Peter Scholtesphoto of (from right to left) Peter Scholtes, John Hunter and George Box in Madison, Wisconsin at the 2008 Deming Conference
  • George Box (1919 to 2013) by John Hunter – George Box was a very kind, smart, caring and fun person. He was a gifted storyteller and writer. He was also one of the most important statisticians of the last 100 years. He had the ability to present ideas so they were easy to comprehend and appreciate…
  • George Box: A remembrance by Bradley Jones – “His greatest contribution to my life was the wonderful book, Statistics for Experimenters, which he wrote with William G. Hunter and Stu Hunter and published in 1978, the same year he served as president of the American Statistical Association. I remember the excitement I felt on reading the description of how the attainment of knowledge is an endless spiral proceeding alternately from deduction to induction and back. Even now, I recall with pleasure the discussion of the randomization distribution early in the book.”
  • Getting Started with Factorial Design of Experiments by Eston Martz – “When I talk to quality professionals about how they use statistics, one tool they mention again and again is design of experiments, or DOE. I’d never even heard the term before I started getting involved in quality improvement efforts, but now that I’ve learned how it works, I wonder why I didn’t learn about it sooner. If you need to find out how several factors are affecting a process outcome, DOE is the way to go.”
  • Brian Joiner Podcast on Management, Sustainability and the Health Care System – Recently Brian has shifted his focus to the health care system (while maintaining a focus on quality principles and sustainability). “Our health care system is an economic tsunami that is about to overwhelm us if we don’t do something very significant, very soon.”
  • Continue reading

George Box

I would most likely not exist if it were not for George Box. My father took a course from George while my father was a student at Princeton. George agreed to start the Statistics Department at the University of Wisconsin – Madison, and my father followed him to Madison, to be the first PhD student. Dad graduated, and the next year was a professor there, where he and George remained for the rest of their careers.

George died today, he was born in 1919. He recently completed An Accidental Statistician: The Life and Memories of George E. P. Box which is an excellent book that captures his great ability to tell stories. It is a wonderful read for anyone interested in statistics and management improvement or just great stories of an interesting life.

photo of George EP Box

George Box by Brent Nicastro.

George Box was a fantastic statistician. I am not the person to judge, but from what I have read one of the handful of most important applied statisticians of the last 100 years. His contributions are enormous. Several well know statistical methods are known by his name, including:

George was elected a member of the American Academy of Arts and Sciences in 1974 and a Fellow of the Royal Society in 1979. He also served as president of the American Statistics Association in 1978. George is also an honorary member of ASQ.

George was a very kind, caring and fun person. He was a gifted storyteller and writer. He had the ability to present ideas so they were easy to comprehend and appreciate. While his writing was great, seeing him in person added so much more. Growing up I was able to enjoy his stories often, at our house or his. The last time I was in Madison, my brother and I visited with him and again listened to his marvelous stories about Carl Pearson, Ronald Fisher and so much more. He was one those special people that made you very happy whenever you were near him.

George Box, Stuart Hunter and Bill Hunter (my father) wrote what has become a classic text for experimenters in scientific and business circles, Statistics for Experimenters. I am biased but I think this is acknowledged as one of (if not the) most important books on design of experiments.

George also wrote other classic books: Time series analysis: Forecasting and control (1979, with Gwilym Jenkins) and Bayesian inference in statistical analysis. (1973, with George C. Tiao).

George Box and Bill Hunter co-founded the Center for Quality and Productivity Improvement at the University of Wisconsin-Madison in 1984. The Center develops, advances and communicates quality improvement methods and ideas.

The Box Medal for Outstanding Contributions to Industrial Statistics recognizes development and the application of statistical methods in European business and industry in his honor.

All models are wrong but some are useful” is likely his most famous quote. More quotes By George Box

A few selected articles and reports by George Box

Continue reading

Podcast Discussion on Management Matters

I continue to record podcasts as I promote my new book – Management Matters: Building Enterprise Capability. This the second part, of 2, of my podcast with Joe Dager, Business 901: Management Matters to a Curious Cat. The first part featured a discussion of 2 new deadly diseases facing companies.

image of the cover of Managmenet Matters by John Hunter

Management Matters by John Hunter

Listen to this podcast.

Links to more information on some of the topics I mention in the podcast:

More podcasts: Process Excellence Network Podcast with John HunterBusiness 901 Podcast with John Hunter: Deming’s Management Ideas Today (2012)Leanpub Podcast on Management Matters: Building Enterprise Capability

Leanpub Podcast on My Book – Management Matters: Building Enterprise Capability

image of the cover of Managmenet Matters by John Hunter

Management Matters by John Hunter

I recently was interviewed for a podcast by Len Epp with Leanpub: Leanpub Podcast Interview #9: John Hunter. I hope you enjoy the podcast (download the mp3 of the podcast).

In the podcast we cover quite a bit of ground quickly, so the details are limited (transcript of the interview). These links provide more details on items I mention in the podcast. They are listed below in the same order as they are raised in the podcast:

The last 15 minutes of the podcast I talk about some details of working with Leanpub; I used Leanpub to publish Management Matters. I recommend Leanpub for other authors. They don’t just have lean in their name, they actual apply lean principles (focusing on the value chain, eliminating complexity, customer focus, etc.) to operating Leanpub. It is extremely easy to get started and publish your book.

Leanpub also offers an excellent royalty plan: authors take home 90% of the revenue minus 50 cents per book. They publish without “digital rights management” crippling purchasers use of the books. Buyers have access to pdf, kindle (mobi) and epub (iPad, nook) format books and get access to all updates to the book. All purchases include a 45 day full money back guaranty.

Related: Business 901 Podcast with John Hunter: Deming’s Management Ideas TodayInterviews for Management Matters: Building Enterprise Capability

Special Cause Signal Isn’t Proof A Special Cause Exists

One of my pet peeves is when people say that a point outside the control limits is a special cause. It is not. It is an indication that it likely a special cause exists, and that special cause thinking is the correct strategy to use to seek improvement. But that doesn’t mean there definitely was a special cause – it could be a false signal.

This post relies on an understand of control charts and common and special causes (review these links if you need some additional context).

Similarly, a result that doesn’t signal a special cause (inside the control limits without raising some other flag, say a run of continually increasing points) does not mean a special cause is not present.

The reason control charts are useful is to help us maximize our effectiveness. We are biased toward using special cause thinking when it is not the most effective approach. So the control chart is a good way to keep us focused on common cause thinking for improvement. It is also very useful in flagging when it is time to immediately start using special cause thinking (since timing is key to effective special cause thinking).

However, if there is result that is close to the control limit (but inside – so no special cause is indicated) and the person that works on the process everyday thinks, I noticed x (some special cause) earlier, they should not just ignore that. It very well could be a special cause that, because of other common cause variation, resulted in a data point that didn’t quite reach the special cause signal. Where the dot happened to land (just above or just below the control limit – does not determine if a special cause existed).

The signal is just to help us systemically make the best choice of common cause or special cause thinking. The signal does not define whether a special cause (an assignable cause) exists of not. The control chart tool helps guide us to use the correct type of improvement strategy (common cause or special cause). But it is just a signaling device, it isn’t some arbiter of whether a special cause actually exists.

Continue reading

My New Book: Management Matters

Image of the book cover of Management Matters by John Hunter

Management Matters by John Hunter is now available.

I have a new book in progress: Management Matters. It is now available in “pre-release format” via leanpub. The idea I am experimenting with (supported by leanpub) is pre-publishing the book online. The ebook is available for purchase now, and comes with free access to the updates.

My plan is to continue working on the book for the next few months and have it “release ready” by October, 2012. One of the advantages of this method is that I can incorporate ideas based on feedback from the early readers of the book.

There are several other interesting aspects to publishing in this way. Leanpub allows a suggested retail price, and a minimum price. So I can set a suggested price and a minimum price and the purchaser gets to decide what price to pay (they can even pay over suggested retail price – which does happen). The leanpub model provides nearly all the revenue to the author (unlike traditional models) – the author gets 90% of the price paid, less 50 cents per book (so $8.50 of a $10 purchase).

They provide the book in pdf, mobi (Kindle) and epub (iPad, Nook, etc.) formats. And the books do not have any Digital Rights Management (DRM) entanglements.

Management Matters covers topics familiar to those who have been reading this blog for years. It is an attempt to put in one place the overall management system that is most valuable (which as you know, based on the blog, is largely based upon Dr. Deming’s ideas – which means lean manufacturing are widely covered too).

I hope the book is now in a state where those who are interested would find it useful, but it is in what I consider draft format. I still have much editing to do and content to add.

Leanpub also provides a sample book (where a portion of the content can be downloaded to decide if you want to buy). If you are interested please give it a try and let me know your thoughts.