Tag Archives: software testing

In Praise of Data-Driven Management (AKA “Why You Should be Skeptical of HiPPO’s”)

Posted on July 7, 2025 by Curiouscat

Guest post by Justin Hunter, originally published 18 August 2009. Jeff Fry recently linked to a fantastic webcast in Controlled Experiments To Test For Bugs In Our Mental Models. I would highly recommend it to anyone without any reservations. Ron Kohavi, of Microsoft Research does a superb job of using interesting real-world examples to explain the benefits of conducting small experiments with web site content and the advantages of making data-driven decisions. I firmly believe that the power of applied … Continue reading →

Posted in Data, Design of Experiments, IT, Management, Psychology, Quality tools, Software Development, Statistics | Tagged , , , ,

Interviews on Software Testing

Posted on March 20, 2017 by John Hunter

I haven’t added a new post here recently. One of the things that has been keeping me busy is putting together some interviews on software testing. Here are excerpts from 3 of the interviews: Testing Smarter with Alan Page Hexawise: During your 20 years at Microsoft you have been involved in hiring many software testers. What do you look for when choosing software testers? What suggestions do you have for those looking to advance in their in software testing career? … Continue reading →

Posted in Software Development | Tagged , ,

Software Testing and the Impact on Quality

Posted on May 9, 2016 by John Hunter

My response to a question on Reddit. “Software quality does not come from testing” Does anybody have any thoughts on the validity of the above statement? That statement is similar to the idea you can’t inspect in quality. Basically “Inspection is too late. The quality, good or bad, is already in the product.” W. Edwards Deming I agree with those ideas. Software testing is a bit different (at least some of it is) from the inspection mentioned above. You are … Continue reading →

Posted in IT, Software Development | Tagged , , , , | 2 Comments

Combinatorial Testing – The Quadrant of Massive Efficiency Gains

Posted on May 17, 2010 by John Hunter

My brother, Justin Hunter, gives a lightning talk on Combinatorial Testing – The Quadrant of Doom and The Quadrant of Massive Efficiency Gains in the video above. The following text is largely directly quoted from the talk – with a bit of editing by me. When you have a situation that has many many many possible parameters and each time only a few possible choices (a few items you are trying to vary and test – in his example in … Continue reading →

Posted in Quality tools, Software Development | Tagged , , , , | 3 Comments

Improving Software Development with Automated Tests

Posted on March 8, 2010 by John Hunter

Automated software testing is a mistake proofing (poka-yoke) solution for software development. The way automated testing works is that software code is written that tests the software code of the application. This automated testing code test that business rules are correctly being followed by the code in the application. So for example, a user should not be able to create a new account without entering password. Then you create code that does not allow an account to be created without … Continue reading →

Posted in IT, Lean thinking, Management, Process improvement, Quality tools, Software Development | Tagged , , , , , , , , , , | 8 Comments

Baking in Quality to Software Development

Posted on August 15, 2009 by John Hunter

One of the reasons my organizations switched to Ruby on Rails for software development was the great integration with automated testing. We always wanted to have good test coverage on our software applications (which are web applications – some used only inside our organization) but didn’t actually find the time to do so. Since we adopted Ruby we have been doing much better in this regard. It isn’t just the switch to Ruby, of course, but the switch to Ruby … Continue reading →

Posted in Deming, IT, Lean thinking, Management, Process improvement, Quality tools, Software Development | Tagged , , , , , , , | 2 Comments

Combinatorial Testing for Software

Posted on March 26, 2009 by John Hunter

Combinatorial testing of software is very similar to the design of experiments work my father was involved in, and which I have a special interest in. Combinatorial testing looks at binary interaction effects (success or failure), since it is seeking to find bugs in software, while design of experiments captures the magnitude of interaction effects on performance. In the last several years my brother, Justin Hunter, has been working on using combinatorial testing to improve software development practices. He visited … Continue reading →

Posted in Design of Experiments, Process improvement, Quality tools, Software Development | Tagged , , , , , | 9 Comments