Category Archives: Performance Appraisal

My Willing Worker Award

Here is an image of the employee of the quarter award I received from Bill Scherkenbach.

award certificate - employee of the quarter

I took part in the Deming Red Bead Experiment and earned this award for my exceptional performance.

I have received other awards and I don’t think those awards were given with any more understanding of the contributions to results due to the management systems in those cases than was shown when giving me this award. Even knowing how little impact I could make on the results I was still happy to receive this award: psychology is not always (often? ever?) sensible.

Read some of the lessons from the Red Bead Experiment from my post on The W. Edwards Deming Institute blog:

Data very similar to that provided by the Red Bed Experiment is used everyday in businesses to reward and punish people. Data is used to blame those who fall short of expectations and reward those who have good numbers. In the Red Bead Experiment we know the numbers are not a sensible measure of value provided by the employee. But in our organizations we accept numbers that are just as unrelated to the value provided by the employe to rate and reward employees.

There is a powerful need to improve the numeracy (literacy with numbers) in our organizations. It isn’t a matter of complex math. The concepts are fairly simple…

Related: Guest Post by Bill Scherkenbach – Analysis Must be Implemented by People to Provide ValueRighter Performance AppraisalExperience Teaches Nothing Without Theory

Motivation, Rewards, Performance Appraisals and Your Career

In this interview Dan Pink again makes some great points relating to psychology, managing people and managing your career.

Q. What kinds of programs can managers and companies put into place to motivate their workforce?

Assuming companies are paying people fairly, they should do what they can to foster autonomy, mastery, and purpose. One of my favorite specific ideas is this: The Australian company Atlassian conducts what they call “FedEx Days” in which people work on anything they want for 24 hours and then show the results to the company the following day. These one-day bursts of autonomy have produced a whole array of fixes for existing products, ideas for new ones, and improvements to internal processes that would have otherwise never emerged. For creative tasks, the best approach is often just to hire great people and get out of their way.

I agree. Focusing on motivation is wrong, as Douglas McGregor detailed in the Human Side of Enterprise over 50 years ago. The problems with theory x management (motivation through fear and rewards) has been detailed over and over again decade after decade. I get tired of us ignoring very well done work to help us manage better for decades 🙁

Q. Are you suggesting that offering someone a 50 per cent raise won’t motivate him or her to work harder?

…most organizations dangle what I call “if-then” rewards — as in, “If you do this, then you get that” — bonuses, commissions, and like. Fifty years of social science tells us that “if-then” rewards are great for simple, routine, algorithmic work [but not creative work]… The best use of money as a motivator is to hire great people and then pay them enough to take the issue of money off the table.

By the way, even that juicy, non-contingent 50 per cent raise has some serious limits. People will be thrilled in the short-run, but over the long term (say, the third paycheck) the thrill will become the status quo…

Again I agree: When Performance-related Pay Backfires, Righter Incentivization, Build an Environment Where Intrinsic Motivation Flourishes.

Continue reading

Annual Performance Reviews Are Obsolete

Sam Goodner, the CEO of Catapult Systems, wrote about his decision to eliminate the annual performance appraisal.

the most critical flaw of our old process was that the feedback itself was too infrequent and too far removed from the actual behavior to have any measurable impact on employee performance.

I decided to completely eliminate of our annual performance review process and replace it with a real-time performance feedback dashboard.”

I think this is a good move in the right direction. I personally think it is a mistake to make the measures focused on the person. There should be performance dashboards (with in-process and outcome measures) that provide insight into the state of the processes in the company. Let those working in those processes see, in real time, the situation, weaknesses, strengths… and take action as appropriate (short term quick fixes, longer term focus on areas for significant improvement…). It could be the company is doing this, the quick blog post is hardly a comprehensive look at their strategies. It does provide some interesting ideas.

I also worry about making too much of the feedback without an understanding of variation (and the “performance” results attributed to people due merely to variation) and systems thinking. I applaud the leadership to make a change and the creative attempt, I just also worry a bit about how this would work in many organizations. But that is not really what matters. What matters is how it works for their organization, and I certainly believe this could work well in the right organization.

Related: Righter Performance AppraisalWhen Performance-related Pay BackfiresThe Defect Black Marketarticles, books, posts on performance appraisal

Problems With Student Evaluations as Measures of Teacher Performance

Dr. Deming was, among other things a professor. He found the evaluation of professors by students an unimportant (and often counterproductive measure) – used in some places for awards and performance appraisal. He said for such a measure to be useful it should survey students 20 years later to see which professors made a difference to the students. Here is an interesting paper that explored some of these ideas. Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors by Scott E. Carrell, University of California, Davis and National Bureau of Economic Research; and James E. West, U.S. Air Force Academy:

our results indicate that professors who excel at promoting contemporaneous student achievement, on average, harm the subsequent performance of their students in more advanced classes. Academic rank, teaching experience, and terminal degree status of professors are negatively correlated with contemporaneous value”added but positively correlated with follow”on course value”added. Hence, students of less experienced instructors who do not possess a doctorate perform significantly better in the contemporaneous course but perform worse in the follow”on related curriculum.

Student evaluations are positively correlated with contemporaneous professor value”added and negatively correlated with follow”on student achievement. That is, students appear to reward higher grades in the introductory course but punish professors who increase deep learning (introductory course professor value”added in follow”on courses). Since many U.S. colleges and universities use student evaluations as a measurement of teaching quality for academic promotion and tenure decisions, this latter finding draws into question the value and accuracy of this practice.

These findings have broad implications for how students should be assessed and teacher quality measured.

Related: Applying Lean Tools to University CoursesK-12 Educational ReformImproving Education with Deming’s IdeasLearning, Systems and ImprovementHow We Know What We Know

Get Rid of the Performance Review

How Much Do You Hate Performance Reviews? by Bob Sutton

Deming emphasized that forced rankings and other merit ratings that breed internal competition are bad management because they undermine motivation and breed contempt for management among people who, at least at first, were doing good work.

If you want to read the most compelling and complete case against the traditional performance evaluation, however,I suggest that you pre-order UCLA Professor Sam Culbert’s new book Get Rid of the Performance Review. He first made this argument in the Wall Street Journal, but the book digs into this argument in far more detail and offers solutions for managers and companies who want to replace the traditional review — or at least reduce the damage that they do. To help spread the word about the book, and to find out if as many people despise the performance review as Sam (and I) believe, he has — a bit like the ARSE — designed a ten-item test called How Much Do You Hate Performance Reviews? I just took it and scored a 36, which means I really hate them.

Related: The Trouble with Performance Reviews by Jeffrey PfefferDeming and Performance AppraisalPerformance Appraisals, Good Execution is not the Solution?

The Trouble with Incentives: They Work

Gipsie B. Ranney has a great new article – The Trouble with Incentives: They Work

I have wondered whether the escalation of pay, perks and parachutes for CEOs actually tends to attract individuals who are primarily extrinsically motivated, rather than individuals who are seriously interested in creating value. Several recent examples appear to be consistent with this view.

An important issue with regard to incentives is possible effects on teamwork and cooperation. If the incentive system is set up as a zero-sum game, then for me to win, you have to lose. This is a very effective way to ensure that there is little or no teamwork or cooperation. Interactions between individuals and groups are likely to become negative, to the detriment of the organization as a whole. When incentives are based on narrow functional objectives, achieving those objectives may guarantee that the system as a whole will be suboptimized.

the Mayo Clinic, “which is among the highest-quality, lowest-cost healthcare systems in the country.” He reports that “decades ago Mayo recognized that the first thing it needed to do was eliminate the financial barriers. It pooled all the money the doctors and the hospital system received and began paying everyone a salary, so that the doctors’ goal in patient care couldn’t be increasing their income. Mayo promoted leaders who focused first on what was best for patients, and then on how to make this financially possible.” He goes on to say, “the core tenet of the Mayo Clinic is ‘The needs of the patient come first’ – not the convenience of the doctors, not their revenues. The doctors and nurses, and even the janitors, sat in meetings almost weekly, working on ideas to make the service and the care better, not to get more money out of patients.”

Could it be that physicians, insurers, drug companies, and patients are simply acting rational to the system? The players are incentivized to behave as they do. The system delivers what it is designed to deliver.

She sums it up very well:

There may be cases in which incentives work only as intended, but I suspect they are relatively rare. The trouble is that we are usually dealing with complex systems (people and organizations) that may behave not at all like our myths would predict. The best policy may be to avoid incentives altogether and focus instead on creating systems in which intrinsic motivation, cooperation, ethical behavior, trust, creativity, and joy in work can flourish.

Find more articles on management improvement in the Curious Cat Management Improvement Library, including: An Interim Report on Motivation in the Workplace by Gipsie Ranney, Remembering NUMMI by Gipsie Ranney and Improving Problem Solving by Ian Bradbury and Gipsie Ranney.

When you can’t prevent arbitrary targets and rewards based on meeting them the strategy I attempt to put in place is figure out how the system will be distorted in order to meet those targets and then put in measures that will discourage such distortions. It isn’t perfect but can help prevent some of the worst distortions (and degradation of system-wide performance they cause).

Related: Righter IncentivizationThe Defect Black MarketDr. Deming on the problems with managing with targets (and incentives based on them)Extrinsic Incentives Kill Creativity

No More Executive Bonuses!

Henry Mintzberg, wrote an excellent article for the Wall Street Journal today, No More Executive Bonuses!

Don’t pay any bonuses. Nothing.

This may sound extreme. But when you look at the way the compensation game is played – and the assumptions that are made by those who want to reform it – you can come to no other conclusion. The system simply can’t be fixed. Executive bonuses – especially in the form of stock and option grants—represent the most prominent form of legal corruption that has been undermining our large corporations and bringing down the global economy. Get rid of them and we will all be better off for it.

So, again, there is but one solution: Eliminate bonuses. Period. Pay people, including the CEO, fairly. As an executive, if you want a bonus, buy the stock, like everyone else. Bet on your company for real, personally.

All this compensation madness is not about markets or talents or incentives, but rather about insiders hijacking established institutions for their personal benefit.

Too many large corporations today are starved for leadership – true leadership, meaning engaged leadership embedded in concerned management. And the global economy desperately needs renewed enterprise, embedded in the belief that companies are communities. Getting rid of executive bonuses, and the gambling games that accompany them, is the place to start.

It is an great article on bad pay systems that let a few top executives (and their hand picked board members) in many companies to loot the treasury of the company. I have written about this problem many times, including: CEOs Plundering Corporate CoffersExcessive Executive Pay (2005)Narcissistic Cadre of Senior ExecutivesThe Best Leadership Is Good ManagementAnother Year of CEO’s Taking Hugely Excessive PayMore on Obscene CEO PayMore on Failed Executives

There are executives that don’t act like corrupt dictators looting their country, unfortunately they are less common than those that act like looters. And they all seem to have built cultures that taking respect for people is more important that feeding a few bloated egos. Akio Toyoda’s Message Shows Real Leadership, Tony Hsieh, the Zappo’s CEOWarren BuffettHonda has Never had Layoffs and has been Profitable Every Year

The obscene pay is not just a matter of people taking a tens of millions of dollars they don’t deserve. Companies whole management systems are distorted in ways that lead the company to risk all the other stakeholders future for the potential gain of a few senior executives.

Extrinsic Incentives Kill Creativity

If you read this blog, you know I believe extrinsic motivation is a poor strategy. This TED webcast Dan Pink discusses studies showing extrinsic rewards failing. This is a great webcast, definitely worth 20 minutes of your time.

  • “you’ve got an incentive designed to sharpen thinking and accelerate creativity and it does just the opposite. It dulls thinking and blocks creativity… This has been replicated over and over and over again for nearly 40 years. These contingent motivators, if you do this then you get that, work in some circumstances but in a lot of tasks they actually either don’t work or, often, they do harm.”
  • there is a mismatch between what science knows and what business does
  • “This is a fact.”

What does Dan Pink recommend based on the research? Management should focus on providing workplaces where people have autonomy, mastery and purpose to build on intrinsic motivation.

via: Everything You Think about Pay for Performance Could Be Wrong [the broken link was removed]

Related: Righter IncentivizationWhat’s the Value of a Big Bonus?Dangers of Extrinsic MotivationMotivate or Eliminate De-MotivationGreat Marissa Mayer Webcast on Google Innovation

An Introduction to Deming’s Management Ideas by Peter Scholtes (webcast)

An Introduction to Deming’s Management Teaching and Philosophy by Peter Scholtes – webcast from the Annual W. Edwards Deming Institute conference in Madison, Wisconsin, November 9th, 2008. My previous post on this speech: 6 Leadership Competencies.

Next month, the Annual Deming Institute conference will be held at Purdue on Oct 10th, 2009.

Related: Peter Scholtes’ LifeCurious Cat’s Deming on ManagementThe Leader’s HandbookPerformance without Appraisal

Dr. Deming Webcast on the 5 Deadly Diseases

The W. Edwards Deming Institute has posted Dr. Deming’s 1984 video on the 5 deadly diseases of western management.

  • Lack of constancy of purpose
  • Emphasis on short term profits – “creative” accounting, focus on quarterly profits
  • Annual Performance Appraisals – management by objective, management by fear
  • Mobility of management – [see Toyota for a great example of a company that operates on different principles – where the leadership has been with Toyota for decades]
  • Running a company on visible figures alone – many important factors are “unknown and unknowable.”

Dr. Deming added 2 diseases to reach his famous 7 deadly diseases: excessive medical care costs and excessive legal damage awards swelled by lawyers working on contingency fees.

Personally I believe all 7 of those diseases are still prevalent and causing damage. I do think some progress has been made on longer term thinking but far too many organizations still are extremely short term focused. And I would add two new deadly diseases of management: excessive executive compensation and an outdated intellectual property system.

Related: Deming CompaniesPurpose of an OrganizationContinual ImprovementCreating JobsNew Management Truths Sometimes Started as Heresies