Tag Archives: Performance Appraisal

My Willing Worker Award

Here is an image of the employee of the quarter award I received from Bill Scherkenbach.

award certificate - employee of the quarter

I took part in the Deming Red Bead Experiment and earned this award for my exceptional performance.

I have received other awards and I don’t think those awards were given with any more understanding of the contributions to results due to the management systems in those cases than was shown when giving me this award. Even knowing how little impact I could make on the results I was still happy to receive this award: psychology is not always (often? ever?) sensible.

Read some of the lessons from the Red Bead Experiment from my post on The W. Edwards Deming Institute blog:

Data very similar to that provided by the Red Bed Experiment is used everyday in businesses to reward and punish people. Data is used to blame those who fall short of expectations and reward those who have good numbers. In the Red Bead Experiment we know the numbers are not a sensible measure of value provided by the employee. But in our organizations we accept numbers that are just as unrelated to the value provided by the employe to rate and reward employees.

There is a powerful need to improve the numeracy (literacy with numbers) in our organizations. It isn’t a matter of complex math. The concepts are fairly simple…

Annual Performance Reviews Are Obsolete

Sam Goodner, the CEO of Catapult Systems, wrote about his decision to eliminate the annual performance appraisal.

the most critical flaw of our old process was that the feedback itself was too infrequent and too far removed from the actual behavior to have any measurable impact on employee performance.
…
I decided to completely eliminate of our annual performance review process and replace it with a real-time performance feedback dashboard.”

I think this is a good move in the right direction. I personally think it is a mistake to make the measures focused on the person. There should be performance dashboards (with in-process and outcome measures) that provide insight into the state of the processes in the company. Let those working in those processes see, in real time, the situation, weaknesses, strengths… and take action as appropriate (short term quick fixes, longer term focus on areas for significant improvement…). It could be the company is doing this, the quick blog post is hardly a comprehensive look at their strategies. It does provide some interesting ideas.

I also worry about making too much of the feedback without an understanding of variation (and the “performance” results attributed to people due merely to variation) and systems thinking. I applaud the leadership to make a change and the creative attempt, I just also worry a bit about how this would work in many organizations. But that is not really what matters. What matters is how it works for their organization, and I certainly believe this could work well in the right organization.

Problems With Student Evaluations as Measures of Teacher Performance

Dr. Deming was, among other things a professor. He found the evaluation of professors by students an unimportant (and often counterproductive measure) – used in some places for awards and performance appraisal. He said for such a measure to be useful it should survey students 20 years later to see which professors made a difference to the students. Here is an interesting paper that explored some of these ideas. Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors by Scott E. Carrell, University of California, Davis and National Bureau of Economic Research; and James E. West, U.S. Air Force Academy:

our results indicate that professors who excel at promoting contemporaneous student achievement, on average, harm the subsequent performance of their students in more advanced classes. Academic rank, teaching experience, and terminal degree status of professors are negatively correlated with contemporaneous value”added but positively correlated with follow”on course value”added. Hence, students of less experienced instructors who do not possess a doctorate perform significantly better in the contemporaneous course but perform worse in the follow”on related curriculum.

Student evaluations are positively correlated with contemporaneous professor value”added and negatively correlated with follow”on student achievement. That is, students appear to reward higher grades in the introductory course but punish professors who increase deep learning (introductory course professor value”added in follow”on courses). Since many U.S. colleges and universities use student evaluations as a measurement of teaching quality for academic promotion and tenure decisions, this latter finding draws into question the value and accuracy of this practice.

These findings have broad implications for how students should be assessed and teacher quality measured.

Get Rid of the Performance Review

How Much Do You Hate Performance Reviews? by Bob Sutton

Deming emphasized that forced rankings and other merit ratings that breed internal competition are bad management because they undermine motivation and breed contempt for management among people who, at least at first, were doing good work.
…
If you want to read the most compelling and complete case against the traditional performance evaluation, however,I suggest that you pre-order UCLA Professor Sam Culbert’s new book Get Rid of the Performance Review. He first made this argument in the Wall Street Journal, but the book digs into this argument in far more detail and offers solutions for managers and companies who want to replace the traditional review — or at least reduce the damage that they do. To help spread the word about the book, and to find out if as many people despise the performance review as Sam (and I) believe, he has — a bit like the ARSE — designed a ten-item test called How Much Do You Hate Performance Reviews? I just took it and scored a 36, which means I really hate them.

Extrinsic Incentives Kill Creativity

If you read this blog, you know I believe extrinsic motivation is a poor strategy. This TED webcast Dan Pink discusses studies showing extrinsic rewards failing. This is a great webcast, definitely worth 20 minutes of your time.

“you’ve got an incentive designed to sharpen thinking and accelerate creativity and it does just the opposite. It dulls thinking and blocks creativity… This has been replicated over and over and over again for nearly 40 years. These contingent motivators, if you do this then you get that, work in some circumstances but in a lot of tasks they actually either don’t work or, often, they do harm.”
“there is a mismatch between what science knows and what business does“
“This is a fact.”

What does Dan Pink recommend based on the research? Management should focus on providing workplaces where people have autonomy, mastery and purpose to build on intrinsic motivation.

via: Everything You Think about Pay for Performance Could Be Wrong [the broken link was removed]

An Introduction to Deming’s Management Ideas by Peter Scholtes (webcast)

An Introduction to Deming’s Management Teaching and Philosophy by Peter Scholtes – webcast from the Annual W. Edwards Deming Institute conference in Madison, Wisconsin, November 9th, 2008. My previous post on this speech: 6 Leadership Competencies.

Next month, the Annual Deming Institute conference will be held at Purdue on Oct 10th, 2009.

Dr. Deming Webcast on the 5 Deadly Diseases

The W. Edwards Deming Institute has posted Dr. Deming’s 1984 video on the 5 deadly diseases of western management.

Lack of constancy of purpose
Emphasis on short term profits – “creative” accounting, focus on quarterly profits
Annual Performance Appraisals – management by objective, management by fear
Mobility of management – [see Toyota for a great example of a company that operates on different principles – where the leadership has been with Toyota for decades]
Running a company on visible figures alone – many important factors are “unknown and unknowable.”

Dr. Deming added 2 diseases to reach his famous 7 deadly diseases: excessive medical care costs and excessive legal damage awards swelled by lawyers working on contingency fees.

Personally I believe all 7 of those diseases are still prevalent and causing damage. I do think some progress has been made on longer term thinking but far too many organizations still are extremely short term focused. And I would add two new deadly diseases of management: excessive executive compensation and an outdated intellectual property system.

The Trouble with Performance Reviews by Jeffrey Pfeffer

The Trouble with Performance Reviews [the broken link was removed] by Jeffrey Pfeffer

Managers don’t like giving appraisals, and employees don’t like getting them. Perhaps they’re not liked because both parties suspect what the evidence has proved for decades: Traditional performance appraisals don’t work. But as my colleague and fellow Stanford professor Bob Sutton and I pointed out in our book, Hard Facts, Dangerous Half-Truths, and Total Nonsense: Profiting from Evidence-Based Management, belief and conventional wisdom often trump the facts. And when it comes to performance evaluations, companies ranging from HR consulting firms to providers of software that automate the process have a big stake in their continued use.

The most basic problem is that performance appraisals often don’t accurately assess performance. More than two decades ago research done by professor David Schoorman showed that whether or not the supervisor had hired or inherited her employees was a better predictor of evaluation results than actual job performance.
…
Possibly the biggest issue, however, is that performance appraisals focus managers’ attention on precisely the wrong thing: individual people. As W. Edwards Deming, the father of the quality movement, taught a long time ago, company performance often results more from variations in systems than from the individuals doing the work. One of the reasons Toyota Motor has been so successful for decades—even as leaders have come and gone and the automobile market has changed—is that the fundamentals of the Toyota management system, which emphasizes quality, continuous improvement, and standardized tasks, provide the advantage. By focusing on the presumed deficiencies or strengths of people, individual performance reviews divert attention from the important task of eliminating the systemic causes, such as inferior technology, behind poor performance.

Another good article pointing out the harm of annual performance reviews. As I have said many times managers need to do better. See chapter 9 of the Leader’s Handbook and previous posts: Don’t Use Performance Appraisals – – Deming and Performance Appraisal – Find the Root Cause Instead of the Person to Blame – Performance Without Appraisal

Toyota Develops Thought-controlled Wheelchair

Toyota has developed a thought-controlled wheelchair (along with Japanese government research institute, RIKEN, and Genesis Research Institute). Honda has also developed a system that allows a person to control a robot through thoughts. Both companies continue to invest in innovation and science and engineering. The story of a bad economy and bad sales for a year or two is what you read in most newspapers. In my opinion the more important story is why Toyota and Honda will be dominant companies 20 years from now. And that story is based on their superior management and focus on long term success instead of short term quarterly results.

Yes Toyota can improve their performance, based on the last few years. Does management understand what they need to do? I think so. Does management understand that the system needs to be improved rather than the numbers on the spreadsheets of various managers have to be made better? I think so. Do I think most companies today, with bad results, understand the difference between bad numbers on spreadsheets that are used to judge various managers and a system that needs to be improved? No.

I do not believe the bad earnings for the last year for Toyota are indicative of a failed system. The results do show a weakness in the Toyota system that allowed them to perform this poorly during this credit crisis. The risk to Toyota’s future is that they become too focused on short term results, mistakenly thinking the problem to be fixed in the bad quarterly results recently. They need to focus on improving the system for the long term. And the recent experience likely shows some areas that need to be improved. But in no way do the fundamental tenants of the management system need to be changed. For many other companies today, changing fundamental aspects of their management is what is needed.

Red Bead Experiment Webcast

Dr. Deming used the red bead experiment to present a view into management practices and his management philosophy. The experiment provides insight into all four aspects of Dr. Deming’s management system: understanding variation, understanding psychology, systems thinking and the theory of knowledge.

Red Bead Experiment by Steve Prevette

Various techniques are used to ensure a quality (no red bead) product. There are quality control inspectors, feedback to the workers, merit pay for superior performance, performance appraisals, procedure compliance, posters and quality programs. The foreman, quality control, and the workers all put forth their best efforts to produce a quality product. The experiment allows the demonstration of the effectiveness (or ineffectiveness) of the various methods.