April 2007 | Issue 23
The "Aha!" Report
What's the "AHA!" REPORT all about?
This series of newsletters contains AHA! information to help people and organizations hire the best employees, make the best promotion decisions, retain the most qualified people, maintain the widest applicant pool, follow best practices, and (if you are subject to US law) remain aware of EEOC hot-spots.
Help! I am a prisoner in a fortune cookie factory…
If you’ve been reading this newsletter for a while, you’ve probably noticed a some recurring themes in my messages to the staffing world. If I had to summarize my entire professional philosophy to fit inside a fortune cookie, it might read something like this: “Apply personality testing early and often. Use meaningful data to bring your hiring organization prosperity and happiness.”
So far, so good. But as you may also have gathered from my writings, not all personality testing is created equal. “So exactly what kind of personality testing works best for hiring?” I hear you ask. “And can you back that up with some proof?” says someone else, from the back of the room. Good questions both. I’ll answer them – but only if you promise not to skip the numbers later on. (Funny how some people who claim to want the unvarnished truth can’t be bothered to read a few statistics…)
Critical Personality Factors
Over the years I’ve taken what I find to be the most useful elements from different theories of job performance and combined them into a single set of critical personality factors which I call “attitudes, interests, and motivations” or AIMs. They don’t fit cleanly into any single definition of personality, but they do correspond to job fit and job performance. There are ten factors:
Problem solving. This scale represents the applicant's attitude toward solving complicated problems. A high score means he or she prefers jobs requiring a mental challenge and solving complex problems. Low scores mean he or she prefers to avoid mentally challenging positions.
Idea generation/innovation. This scale represents the applicant's attitude toward free thinking and creativity. High scores indicate that he or she enjoys suggesting new ideas and creative processes. Low scores indicate a preference for systematic, traditional work.
Administration. This scale represents the applicant's preference for following rules and procedures. High scores mean he or she likes to follow precedent and established processes. Low scores indicate a tendency to break rules and work without structure or guidelines.
Resistance to change. This scale represents the applicant's willingness to adapt and change. High scores represent resistance to change and a desire for stability and consistency. Low scores indicate readiness to change and adapt to whatever conditions might be.
Teamwork. This scale indicates whether he or she prefers to work alone or with others. High scores indicate a preference for working in close-knit teams. Low scores indicate he or she likes solitary work.
Expressiveness. This scale represents the applicant's interest in public contact. People who score high on expressiveness label themselves as outgoing and having many social contacts. Low scores indicate the person may not have an interest in being sociable.
Impulsiveness. Impulsiveness is a measure of how fast a person likes to make decisions. High scores indicate an interest in making fast decisions and quick responses. Low scores mean a preference for slow response and postponed decisions.
Perfectionism. This scale represents the person's attitude toward producing a perfect product. A little perfectionism goes a long way; people with high perfection scores may never be satisfied with the final product, causing unnecessary delays and reductions in output, while people with too little perfectionism may be sloppy and unconcerned with quality.
Attitude toward work. This scale represents how an applicant feels about working for an organization. Some people, for example, see the office as a battleground between good (themselves) and evil (everyone else). People with low scores sap energy and become destructive to both morale and productivity. People with high scores tend to see the organization as a positive place to work and contribute.
Self-centeredness. This scale represents how much the candidate looks out for him or herself. High scores indicate someone who spends much of their time thinking about themselves and the impact of decisions on them personally. People with low scores on this scale indicate that they focus more on what other people feel than on what they consider important.
Truthfulness. This scale shows whether the person was truthful or not. Scores at either end of the scale indicate whether the person was trying to make him or herself look good. Exceptionally low or high scores mean that all of the applicant's scores should be very carefully scrutinized.
Of course, scores on any self-reported test are just that – self-reported. Hard skills must also be measured using other methods, such as behavioral interviews, ability tests, work samples, or simulations. To make matters even more complicated, some of these scores are linear (i.e., more is better) and some are bell-shaped (too little, too much, just right). It all depends on the job.
Determining Which Factors Are Important
The only way to identify which factors are important for a job in your organization is to break out the statistics book, crank up the old computer, give the test to jobholders, develop rating criteria, have managers rate the performance of each jobholder, and analyze the results. Before your study can be considered trustworthy, you will also need to determine which performance criteria can be trusted, and how many people to use in the sample. Plus you will need to examine minority groups for adverse impact.
Too much trouble? Sorry, no shortcuts here. No study = hiring mistakes and the possibility of legal challenges. You’ll need to use statistics, which is a great way to identify important relationships, as well as a wonderful cure for insomnia. Like it or not, stats are the only game in town. (The good news, for both you and me, is that you can hire a consultant to do some of the heavy lifting.)
Testing in the Real World: Yours
Now for some real, live data. (Stick with it; you promised!) We conducted two studies to gather AIMs data from employees in two call centers. The first call center specialized in making outbound market survey calls. Their agents contacted people via phone, persuaded them to participate in an interview, asked prepared questions, and entered the responses. Managers provided one overall, three-point rating of job performance on 139 agents. We divided people into three groups (i.e., the ones, the twos, and the threes) and examined the groups for differences.
We found no differences between the low-rated and mid-rated group. However, the high-rated group had higher, statistically significant resistance-to-change scores, higher expressiveness scores, and higher teamwork scores. Out of ten possible factors, these three factors made the greatest difference in performance.
The second call center study involved 45 people who take inbound sales calls. The managers provided three ratings for this job: 1) a measure of acquired skills, 2) a performance rating, and 3) an overall summary rating. Acquired skills turned out to be strongly related to interest in problem solving (+.33), perfectionism (+.28) and resistance to change (+.27). This means that people who were motivated to acquire more job skills were likely have higher AIM scores in those three areas.
When actual performance was analyzed, low scores in idea generation (-.41) and high scores in attitude towards work (+.39) were strongly correlated. The negative relationship with idea generation suggested that people who wanted to "think outside the box" would probably not do very well in this job. Finally, the third manager rating (the overall summary) showed idea generation (-.36), resistance to change (+.31) and attitude towards work (+.30) were important. Taken together, this means that people rated as being "high performers" tended to score high in problem solving, perfectionism, resisting change, and attitude toward work, but low on idea generation.
These are important findings because they show:
- Personality factors have different relevance depending on the nature of the job.
- Personality factors often have very strong correlations with manager ratings.
- Personality factors can be a valuable source of hiring information.
- It takes a formal study to identify personality factors important to hiring decisions.
Conclusion
Dozens of studies have shown that personality is exceptionally stable and slow to change. Twin studies (identical twins separated at birth and raised in different families) suggest that about 50% of personality is genetically influenced. Psychologists debate exactly what influences the other half, but nearly all of it is probably determined before entering the workforce. This means that information gathered from a hiring personality test has plenty of usefulness for screening and placement, but limited use for coaching or training. What you see is what you get – like it or not.
By examining patterns among personality scores, the hiring manager can gain valuable insight into applicants' attitudes, interests, and motivations. A testing program provides the capability for building personality diversity (among non-critical factors) while maintaining personality consistency (among performance-critical factors).
Please note that personality testing does not provide "evidence" of job skills. Personality scores and skills are only slightly related. You should still use simulations or work samples to measure technical or interpersonal skills, and case studies involving problem solving or planning to measure cognitive ability.
What personality test scores can do is allow hiring managers to make inferences about future employee performance. They are reasonably accurate predictors of "will do, " not "can do." Provided that the employee has sufficient job skills, independent research shows matching personality to job personality can roughly double individual productivity – so think hard about your organization’s attitudes and interests regarding personality testing!
|