Tag Archives: experiments

Learn by Seeking Knowledge – Not Just from Mistakes

Posted on March 7, 2011 by John Hunter

Being open to new ideas and new knowledge is what is needed to learn. Experimenting, seeking out new knowledge is even better. You can be successful and see an even better way to do things and learn from it. This seems the best way to learn to me – not to just learn from mistakes. Of course this means your goal has to be improvement not just avoiding more mistakes than before. Your actions are based on theories (often unconsciously): … Continue reading →

Posted in Career, Creativity, Deming, Innovation, Process improvement, Psychology, Systems thinking | Tagged Career, continual improvement, Creativity, Deming, experiments, fear, Innovation, learning, Process improvement, Psychology, Systems thinking, theory of knowledge | 6 Comments

Problems With Student Evaluations as Measures of Teacher Performance

Posted on June 16, 2010 by John Hunter

Dr. Deming was, among other things a professor. He found the evaluation of professors by students an unimportant (and often counterproductive measure) – used in some places for awards and performance appraisal. He said for such a measure to be useful it should survey students 20 years later to see which professors made a difference to the students. Here is an interesting paper that explored some of these ideas. Does Professor Quality Matter? Evidence from Random Assignment of Students to … Continue reading →

Posted in Deming, Education, Performance Appraisal, Psychology, Science | Tagged Customer focus, Data, Deming, Education, experiments, Performance Appraisal, Psychology, Science, system thinking | 2 Comments

Extrinsic Incentives Kill Creativity

Posted on September 21, 2009 by John Hunter

If you read this blog, you know I believe extrinsic motivation is a poor strategy. This TED webcast Dan Pink discusses studies showing extrinsic rewards failing. This is a great webcast, definitely worth 20 minutes of your time. “you’ve got an incentive designed to sharpen thinking and accelerate creativity and it does just the opposite. It dulls thinking and blocks creativity… This has been replicated over and over and over again for nearly 40 years. These contingent motivators, if you … Continue reading →

Posted in Creativity, Deming, Management, Performance Appraisal, Psychology, quote, Science | Tagged Creativity, curiouscat, experiments, extrinsic motivation, management, management research, management webcast, Performance Appraisal, Popular, Psychology, Science, TED | 5 Comments

YouTube Uses Multivariate Experiment To Improve Sign-ups 15%

Posted on August 17, 2009 by John Hunter

Google does a great job of using statistical and engineering principles to improve. It is amazing how slow we are to adopt new ideas but because we are it provides big advantages to companies like Google that use concepts like design of experiments, experimenting quickly and often… while others don’t. Look Inside a 1,024 Recipe Multivariate Experiment A few weeks ago, we ran one of the largest multivariate experiments ever: a 1,024 recipe experiment on 100% of our US-English homepage. … Continue reading →

Posted in Customer focus, Data, Design of Experiments, Google, IT, Management, Process improvement, Quality tools, quote, Science, Software Development, Statistics | Tagged curiouscat, Customer focus, Data, Design of Experiments, experiments, Google, Innovation, internet, management, Science, Software Development, Statistics | 2 Comments

Statistics for Experimenters in Spanish

Posted on January 5, 2009 by John Hunter

Statistics for Experimenters, second edition, by George E. P. Box, J. Stuart Hunter and William G. Hunter (my father) is now available in Spanish. Read a bit more can find a bit more on the Spanish edition, in Spanish. EstadÃstica para Investigadores DiseÃ±o, innovaciÃ³n y descubrimiento Segunda ediciÃ³n. Statistics for Experimenters – Second Edition: Catalyzing innovation, problem solving, and discovery, the Second Edition provides experimenters with the scientific and statistical tools needed to maximize the knowledge gained from research data, … Continue reading →

Posted in Books, Data, Design of Experiments, Statistics | Tagged Bill Hunter, Books, Data, Design of Experiments, engineering, experiments, George Box, Madison, Statistics, Statistics for Experimenters

What’s the Value of a Big Bonus?

Posted on November 21, 2008 by John Hunter

What’s the Value of a Big Bonus? by Dan Ariely To look at this question, three colleagues and I conducted an experiment. We presented 87 participants with an array of tasks that demanded attention, memory, concentration and creativity. We asked them, for instance, to fit pieces of metal puzzle into a plastic frame, to play a memory game that required them to reproduce a string of numbers and to throw tennis balls at a target. We promised them payment if … Continue reading →

Posted in Data, Deming, Management, Psychology, Respect, Systems thinking | Tagged bonus, Data, executive pay, experiments, extrinsic motivation, Psychology

Systemic Workplace Experiments

Posted on March 6, 2008 by John Hunter

Workplace Experiments At our company-wide get together last December we decided that 2008 was going to be a year of workplace experiments. Among other things, we discussed how we could make 37signals one of the best places in the world to work, learn, and generally be happy. … Last summer we experimented with 4-day work weeks. People should enjoy the weather in the summer. We found that just about the same amount of work gets done in four days vs. … Continue reading →

Posted in Creativity, Deming, Management, Psychology, Respect, Software Development, Systems thinking | Tagged Deming, Education, experiments, management, Software Development, workplace improvement | 1 Comment

Google Website Optimizer

Posted on April 7, 2007 by John Hunter

Google’s Website Optimizer allows for multivariate testing of your website. Website Optimizer, Google’s free multivariate testing application, helps online marketers increase visitor conversion rates and overall visitor satisfaction by continually testing different combinations of site content (text and images). Rather than sitting in a room and arguing over what will work better, you can save time and eliminate the guesswork by simply letting your visitors tell you what works best. We’ll guide you through the process of designing and implementing … Continue reading →

Posted in Design of Experiments, Google, IT, Management | Tagged Design of Experiments, experiments | 3 Comments

Experiment and Learn

Posted on March 18, 2007 by John Hunter

Experimenting with milkshakes? I have been on a mission to convince firms to do simple experiments that will give them feedback regarding the decisions that they make. Just as with people (as Anders Ericsson studies), firms cannot learn with feedback. It turns out, however, that it is not easy for people in companies to see the wisdom in experiments. Experiments are useful and underused. PDSA and design of experiments are two concepts that aid in experimenting successfully. Related: Google: Experiment … Continue reading →

Posted in Customer focus, Deming, Design of Experiments, Management, Quality tools | Tagged experiments, iteration, management

All Models Are Wrong But Some Are Useful

Posted on March 4, 2007 by John Hunter

“All Models Are Wrong But Some Are Useful” -George Box A great quote. Here is the source: George E.P. Box, Robustness in the strategy of scientific model building, page 202 of Robustness in Statistics, R.L. Launer and G.N. Wilkinson, Editors. 1979. See more quotes by George Box. Related: Dangers of Forgetting the Proxy Nature of Data – articles by George Box – Quotes by Dr. W. Edwards Deming

Posted in Fun, quote | Tagged critical thinking, experiments, George Box, prediction, quote, Statistics | 6 Comments

Using Design of Experiments

Posted on March 17, 2006 by John Hunter

How to Institute DOE in Your Company (link broken – removed) by Davis Balestracci: DOE works, but I don’t need to sell that to the readers of this newsletter. But as certain as we all are, no one can deny that design of experiments faces resistance even in environments where it is a proven tool. Every research scientist or engineer who has had a major success from DOE can tell you story after story of how management still wanted problems … Continue reading →

Posted in Design of Experiments, Management, Quality tools, Six sigma | Tagged Data, Design of Experiments, experiments, Process improvement, process thinking, Six sigma, Statistics | 6 Comments

Google: Experiment Quickly and Often

Posted on November 25, 2005 by John Hunter

Google Thinks Small by Quentin Hardy, Forbes: Brin and Page have created a corporate organism that tackles most big projects in small, tightly focused teams, setting them up in an instant and breaking them down weeks later without remorse. “Their view is that there is much greater progress if you have many small teams going out at once,” Schmidt says. The mission overall: to collect “all the world’s information” and make it accessible to everyone. “It’s a cause.” … Hundreds … Continue reading →

Posted in Creativity, Data, Google, Innovation, Management, Process improvement, quote, Software Development | Tagged experiments, Google, iteration | 12 Comments