One of the common practices when it comes to 360 appraisals is that confidential surveys are conducted, so that people can rate their peers and supervisors. The organization promises confidentiality in these matters so that employees can comment in secret about their peer’s job performance, and sometimes even their managers. All this data is collected and forwarded to the employee in question, then this data is used to rate that employee. In spite of the significant research in evidence that shows the risk linked with peer evaluation and how the chances of it being legitimate are very low, anyone’s concern with this process, based speculation is justified.
How accurate is the 360 Degree appraisal?
A recent study performed on the patterns of accuracy of raters shows that “length of time that a rater has known the person being rated has the most significant effect on the accuracy of a 360-degree review.” This study also shows that “subjects in the group (known for one to three years) are the most accurate, followed by (known for less than one year), followed by (known for three to five years) and the least accurate being (known for more than five years). The study concludes that the most accurate ratings come from knowing the person long enough to get past first impressions, but not so long as to begin to generalize favorably.” (Eichinger, 2004)
What do results suggest?
[adsense1]Several studies (Hazucha et al., 1993; London & Wohlers, 1991; Walker & Smither, 1999) indicate that the use of 360-degree feedback helps people improve performance. In a 5-year Walker and Smither (1999) study, no improvement in overall ratings was found between the 1st and 2nd year, but higher scores were noted between 2nd and 3rd and 3rd and 4th years. A study by Reilly et al. (1996) found that performance increased between the 1st and 2nd administrations, and sustained this improvement 2 years later. Additional studies show that 360 feedbacks may be predictive of future performance (Maylett & Riboldi, 2007).
According to some authors, “360 processes are much too complex to make blanket generalizations about their effectiveness” (Bracken, “et al,” 2005). Whereas Smither et al. suggests, “We therefore think that it is time for researchers and practitioners to ask, ‘Under what conditions and for whom is multisource feedback likely to be beneficial?’ rather than asking ‘Does multisource feedback work?” (p.60, 2005)
“It has been suggested that multi-rater assessments often generate conflicting opinions and that there may be no way to determine whose feedback is accurate” (Vinson, 1996). Recent studies also indicate that “self-ratings are generally significantly higher than the ratings of others” (Lublin, 1994; Yammarino & Atwater, 1993; Nowack, 1992).
[linkunit]It has come to a point that many organizations that shop for performance appraisals, or 360 feedbacks take a step in the wrong direction the minute they think about such things. They forget their real needs, and how to identify them. Before starting the 360 appraisal process, organizations need to ask themselves, if they really need it, it doesn’t need to be done if there is no need; also it is important to understand the validity of such a process in your organization and the effect it may have on your organizations values and customs. The most common reason that organizations give today, for using the 360 appraisal is that everyone else is doing it, that is not reason enough to adopt such a practice, since no where in research does it show that it is completely accurate or even an important part of the performance appraisal, is reason enough to avoid the 360 appraisal. If such appraisals seem to be unavoidable, it is better to conduct other more employee and organizational friendly reviews, as the 360 appraisal only tends to being a nightmare and a superfluous expense.