When scores all move together: halo effects, bias, and what to do with student feedback

This week, Dr Stuart Grey discusses what to do when student evaluation scores all move together. Halo effects and bias change what the data can tell you, but they do not make student feedback useless. The episode covers correlated evaluation scores, gender stereotypes in teaching recognition, joined-up wellbeing survey practice and Glasgow's MyGrades rollout. In This Episode - What halo effects mean in student evaluations. - Why correlated scores make fine-grained diagnosis risky. - How comments and operational data can make broad score signals more useful. - How gender stereotypes shape who gets recognised for teaching excellence. - Why King's wellbeing survey and Glasgow's MyGrades point towards more joined-up student feedback systems. - Why coding consistency matters when small teams analyse thousands of comments. Student Voice Practice The episode reflects on the challenge of keeping student comment analysis consistent when a small team is coding large volumes of feedback across cycles. Research Spotlight Halo effects in student evaluations: what correlated scores are actually telling you: https://www.studentvoice.ai/blog/halo-effects-in-the-student-voice/ Gender stereotypes shape who gets recognised for teaching excellence: https://www.studentvoice.ai/blog/gender-stereotypes-and-perceived-teaching-excellence/ Sector Watch King's launches a wellbeing survey positioned alongside NSS and PTES: https://www.studentvoice.ai/blog/kings-wellbeing-survey-joined-up-student-feedback-system/ Glasgow rolls out MyGrades university-wide after acting on student feedback: https://www.studentvoice.ai/blog/university-of-glasgow-mygrades-student-feedback-system/ From the Archive Are adult nursing students' workloads manageable?: https://www.studentvoice.ai/blog/the-challenges-of-workload-for-adult-nursing-students/ Oral examination as an online assessment tool: https://www.studentvoice.ai/blog/oral-examination-as-an-online-assessment-tool/ Can online psychology match the on-campus experience?: https://www.studentvoice.ai/blog/studying-psychology-online-a-detailed-examination/ Practical Takeaway Treat small differences between evaluation items with caution. Use comments to check whether a low score reflects one specific issue, a broader experience problem or a general halo effect. Full episode page: https://www.studentvoice.ai/podcast/episodes/004-when-scores-all-move-together-halo-effects-bias-and-what-to-do-with-student-feedback/ Subscribe to Student Voice Weekly: https://www.studentvoice.ai/blog/newsletter/