scientific selection homescientific selection header
scientific selection background Overview supplemental reading testing pricing
stripes
measure twice
Feel lucky
technical manual download
testing and assessment
testing manual
superselection
uniform guidelines
contact us
aha report
"Aha! Report Archives

ss sidebar image headerpic
January  2008 | Issue 30

The "Aha!" Report

What's the "AHA!" REPORT all about?
This series of newsletters contains AHA! information to help people and organizations hire the best employees, make the best promotion decisions, retain the most qualified people, maintain the widest applicant pool, follow best practices, and (if you are subject to US law) remain aware of EEOC hot-spots.

Pigeons, bowling balls, and HR
A few years back, experimental psychologists were trying to learn the effects of feedback on performance. They designed an experiment that involved two sets of pigeons, a miniature bowling alley, and some corn. The more bowling pins the pigeons knocked down, the more corn they received (just like some of the corporate incentive programs in which we all have participated).

Group 1 pigeons could not see the pins because their view was blocked with a curtain (the experimenters tried tying little blindfolds over their eyes, but the pigeons kept peeking). Group 2 pigeons were allowed to see how many pins they knocked down.

Guess which group improved? Correct, Group 2. Even animals with pigeon-sized brains improved their performance when they could associate actions with consequences. The same goes for organizations: no feedback, no improvement.

Behind-the-Curtain Recruiting
Curtains also block our "view of the pins" when measuring recruiting effectiveness. That is why the wrong applicant is hired about half the time.
Of course, nothing can be done about the recruiter who doesn't care about doing a good job. If his or her only goals – and basis for compensation – for recruiting are to avoid paying guarantees, minimize the number of people screened, fill open slots, or reduce time-to-fill, then hiring accuracy is incidental. These folks actually work very hard to maintain their feedback curtains.

But even responsible recruiters have a very hard time seeing the consequences of hiring decisions. After all, no one knowingly hires or promotes someone into a position in which they will fail.

Improving processes requires that recruiters systematically follow up with placements to evaluate the critical performance areas they were supposed to measure (I would recommend mental ability, planning ability, interpersonal skills, and attitudes, interests and motivations). How can you do a better job if you do not know whether you were right or not?

Behind-the-Curtain Management
Hiring managers also have plenty of incentive to hide behind curtains. Many astute leaders probe each candidate's background, asking sage questions like, "What's your golf handicap?" "You aren't going to get pregnant while you're here, are you?" or "What are your greatest strengths and weaknesses?" They continue this process until they are outsmarted by the first applicant who has the ability to second-guess all the answers. Then they publicly proclaim, "Yea, verily, this is The Chosen One!"

Now down the road, if this person turns out to be a low performer, what politically savvy manager is going to admit being outsmarted by this loser?

Behind-the-Curtain HR
What happens when something goes wrong in the production department? Managers carefully isolate and define the problem. They search through historical quality records, examine production reports, tour the facility, look for cause and effect, and gather experts to discuss ways to resolve the issue.

What happens when HR is faced with employee turnover or productivity issues? They do a wage and benefits survey.

I have yet to see many HR departments, large or small, look inward to examine the effectiveness of their hiring processes (that is, what's working for them and what's not). Instead of taking the lead in human performance, they tend to isolate themselves from anything except advertising, screening, and paperwork. Imagine a production department that takes no responsibility for manufacturing quality, or an auditing department that takes no responsibility for accurate reporting. Now, tell me again why HR gets no respect from line managers?

Can you imagine how different things would be if HR...

  • Actually did a job analysis on each critical job family to determine "how to" competencies?
  • Kept accurate records of hiring scores?
  • Used a combination of hiring tools, depending on whether they wanted to measure attitudes, mental ability, planning ability, or interpersonal skills?
  • Measured the effectiveness of each hiring tool by comparing application performance with job performance?
  • Studied the relationship between biographical data and turnover?
  • Made ongoing improvements and corrections as necessary?

Fun With Numbers
If an organization is unwilling or unable to step out from behind the curtain, it is possible to make a few curtains more transparent.

For example, one can use analytical techniques to conduct post-mortem analyses. This means comparing data on each applicant from the hiring process, such as interview scores and background information, with productivity data such as turnover, attendance, and performance. HR doesn't even have to know how to spell "competency." Just capture data and let someone else analyze it.

Once we have data, we can use statistical analytical techniques to find cause and effect relationships (e.g., correlation coefficients to explore straightforward relationships, regression analysis to find combined correlations, or AI to evaluate complex interactions). The details are unimportant. The point is there are a variety of tools that can find hidden relationships between applicant data and job performance.

Job Types
However, these analytical methods work best with large numbers of employees and straightforward jobs such as retailing, warehousing, food services, or customer service – that is, jobs that are fairly easy to learn or do not require special knowledge or training.

In this type of position, if we can find relationships between a few hiring variables and perfromance variables (and we most always can), we can use that information to evaluate how applicants will perform. Think of it as predicting performance reviews. The beautiful thing is, we can build a predictive system that gets "smarter" without threatening any egos.

The Early Bird Gets the Job
You might be asking yourself, "Self, what is this egghead trying to tell me?" And I will reply:

  • It takes systematic feedback to get better.
  • The only people who cannot benefit from feedback are the dead.
  • Curtains can only be pulled down by people who want to see daylight.
  • Analytical techniques can be used to reduce turnover and increase productivity.

The moral of the story: Watch out for pigeons wearing little bowling shirts. Tomorrow they could be running corporate HR!

 

 



ss sidebar art
ss background art