Every year, thousands of organisations invest time, money and political capital in launching 360° assessments. They define competencies, choose raters, generate reports and hand them out, expecting that something, somewhere in the organisation, will change. Far too often, nothing does.
The problem is rarely the instrument. It is what happens, or does not happen, before, during and after it is used.
Three decades of empirical research in organisational psychology have pinned down which conditions decide whether a 360° assessment produces real development or just produces data. What follows is what that evidence says.
Anonymity is not declared. It is designed.
Most organisations add a line to their internal communications promising that the process is confidential. Few ask whether that promise is credible to the people answering.
Bracken, Rose and Church, in their 2016 review published in Industrial and Organizational Psychology, identified the structural tension underneath this problem: anonymity protects raters from reprisals and makes their answers more candid, but removing accountability altogether can undermine the accuracy of the ratings. There is no perfect solution; there are design decisions that have to be made deliberately.
Brett and Atwater (2001), in the Journal of Applied Psychology, add a further dimension: how accurate the people being rated believe the feedback to be largely determines whether they are willing to act on it. A process that breeds distrust cancels itself out, even when the data are technically sound. Confidentiality, in that sense, is not only an ethical matter. It is a driver of effectiveness.
Without a debrief, the report is just paper.
There is a systematic gap between receiving a 360° report and knowing what to do with it. That gap does not close on its own.
Seifert, Yukl and McDonald showed this in a controlled field study published in 2003 in the Journal of Applied Psychology: managers who received their feedback in a facilitated session showed significantly greater behavioural change than those who only received the printed report. The difference was not in the data, since both groups received the same results, but in the support they had to interpret them.
Walker and Smither added the long view. Following 252 managers over five consecutive years, in a study published in Personnel Psychology in 1999, they found that those who actively discussed their results with their teams kept improving over time. Their conclusion is one of the most cited in the field: what managers do with their feedback predicts their development more strongly than the content of the report itself.
Timing matters. And almost nobody takes it into account.
In 1996, Avi Kluger and Angelo DeNisi published in Psychological Bulletin one of the most influential meta-analyses in organisational psychology. Looking at more than 600 effect sizes from feedback interventions, they found that in over a third of cases feedback lowered performance. The deciding factor was not the quality of the instrument. It was the context in which the feedback was delivered.
When feedback triggers a defensive reaction, when the person receiving it sees it as a threat rather than as information, learning shuts down. Bracken and Rose (2011), in the Journal of Business and Psychology, spelled out which organisational conditions produce that effect: an ongoing restructuring, a punitive evaluation culture, low institutional trust, or a process tied directly to pay decisions.
Launching a 360° under those conditions is not neutral. It backfires.
Raters get it wrong too. And something can be done about it.
The halo effect, systematic leniency, central tendency: these are not character flaws in the raters. They are predictable cognitive patterns that appear when people are asked to make complex judgements without a clear reference for what they are measuring.
Woehr and Huffcutt (1994), in a meta-analysis published in the Journal of Occupational and Organizational Psychology, compared four types of rater training. Frame-of-reference (FOR) training, which gives raters concrete behavioural anchors for each point on the scale, had the largest effect on rating accuracy, with an effect size of d = 0.83. That is not a marginal difference. Roch, Woehr and colleagues replicated and updated the finding in 2012, in the same journal, with consistent results.
The investment is small: a short guide before the process starts. The return, in data quality, is significant.
A single 360° is not a strategy. It is the start of one.
The meta-analysis by Smither, London and Reilly, published in Personnel Psychology in 2005, brought together 24 longitudinal studies on the impact of multi-source feedback. Its conclusion was precise: a 360° assessment on its own produces modest improvement. The effect grows substantially when it is combined with specific goal setting, development planning and structured follow-up. As we explore in What every MBA student should learn from 360 feedback (in Spanish), this is especially relevant in executive leadership programmes.
In 2003, Smither and his team published a quasi-experimental study of 1,361 senior managers, also in Personnel Psychology. Managers who worked with an executive coach after receiving their 360° showed greater improvement in their ratings a year later. The mechanism was clear: it was not the coaching itself, but the fact that those managers set more specific goals and actively sought feedback from their supervisors. They knew what to change and how to tell whether they were getting there.
A 360° with no follow-up is a snapshot. Connected to a development plan, it becomes a film.
What the evidence, taken together, is saying
360° assessment works. But not automatically, and not everywhere. Three decades of research have identified the conditions under which it produces real development: credible confidentiality, a structured debrief, the right organisational context, prepared raters, and a link to concrete development plans.
These are not generic good-practice tips. They are variables with empirical evidence behind them. Ignoring them does not remove their effects; it just leaves them unmanaged.
If you are looking for a 360° assessment built on that evidence, with these effectiveness factors designed in from the start, LeaderApp 360 by Pro Evaluation System brings them together: confidentiality designed into the process, facilitated feedback, care for the organisational context and built-in development plans. More than 40,000 executives around the world already rely on it. It was developed with IESE Business School.
References
- Bracken, D. W., & Rose, D. S. (2011). Journal of Business and Psychology, 26(2), 183–192.
- Bracken, D. W., Rose, D. S., & Church, A. H. (2016). Industrial and Organizational Psychology, 9(4), 761–794.
- Brett, J. F., & Atwater, L. E. (2001). Journal of Applied Psychology, 86(5), 930–942.
- Kluger, A. N., & DeNisi, A. (1996). Psychological Bulletin, 119(2), 254–284.
- Roch, S. G., Woehr, D. J., Mishra, V., & Kieszczynska, U. (2012). Journal of Occupational and Organizational Psychology, 85(2), 370–395.
- Seifert, C. F., Yukl, G., & McDonald, R. A. (2003). Journal of Applied Psychology, 88(3), 561–569.
- Smither, J. W., London, M., Flautt, R., Vargas, Y., & Kucine, I. (2003). Personnel Psychology, 56(1), 23–44.
- Smither, J. W., London, M., & Reilly, R. R. (2005). Personnel Psychology, 58(1), 33–66.
- Walker, A. G., & Smither, J. W. (1999). Personnel Psychology, 52(2), 393–428.
- Woehr, D. J., & Huffcutt, A. I. (1994). Journal of Occupational and Organizational Psychology, 67(3), 189–205.
