EPISODE · Oct 21, 2020 · 29 MIN
How 2 predict grades badly...
from How 2 rob a bank · host Bia and Zoey
Zoey and Bia discuss some of the mistakes that Ofqual made in their algorithm, how using “complicated” maths is not necessarily better, and share some anecdotes of their experiences with teachers and dealing with (un)conscious bias. Timestamps 00:20 – Introduction 01:54 – Initial thoughts 02:42 – Mistake #1 – Their approach 04:43 – Mistake #2 – Data leakage 05:15 – Mistake #3 – Emphasis on the rank 06:57 – Mistake #4 – Ignoring outliers 08:31 – Mistake # 5 – No peer review 09:16 – Mistake #6 – Too precise 11:14 - Mistake #7 –Disregarded unconscious bias. 12:53 – Mistake #8: Education system in the UK. 13:30 – Ofqual considered edge cases – (almost a positive thing!) 15:00 – How we might have handled this situation 17:39 – Another example of algorithmic bias – Accounting system the Post Office used. 18:53 – Challenge: “Prison Break”. This based on “Liar’s paradox” attributed to Epimenides (amongst many other philosophers). For more challenges, presented in a more visual manner, check out our Instagram. 25:52 – Anecdotes of experiencing bias from teachers. Useful links: Ofqual’s report Bristol University's study on unconscious bias - http://www.bris.ac.uk/media-library/sites/cmpo/migrated/documents/wp221.pdf Tom SF Haines’ post (Lecturer in Machine Learning at Bath University) - http://thaines.com/post/alevels2020
What this episode covers
Zoey and Bia discuss some of the mistakes that Ofqual made in their algorithm, how using “complicated” maths is not necessarily better, and share some anecdotes of their experiences with teachers and dealing with (un)conscious bias. Timestamps 00:20 – Introduction 01:54 – Initial thoughts 02:42 – Mistake #1 – Their approach 04:43 – Mistake #2 – Data leakage 05:15 – Mistake #3 – Emphasis on the rank 06:57 – Mistake #4 – Ignoring outliers 08:31 – Mistake # 5 – No peer review 09:16 – Mistake #6 – Too precise 11:14 - Mistake #7 –Disregarded unconscious bias. 12:53 – Mistake #8: Education system in the UK. 13:30 – Ofqual considered edge cases – (almost a positive thing!) 15:00 – How we might have handled this situation 17:39 – Another example of algorithmic bias – Accounting system the Post Office used. 18:53 – Challenge: “Prison Break”. This based on “Liar’s paradox” attributed to Epimenides (amongst many other philosophers). For more challenges, presented in a more visual manner, check out our Instagram. 25:52 – Anecdotes of experiencing bias from teachers. Useful links: Ofqual’s report Bristol University's study on unconscious bias - http://www.bris.ac.uk/media-library/sites/cmpo/migrated/documents/wp221.pdf Tom SF Haines’ post (Lecturer in Machine Learning at Bath University) - http://thaines.com/post/alevels2020
NOW PLAYING
How 2 predict grades badly...
No transcript for this episode yet
Similar Episodes
Oct 3, 2025 ·28m
Sep 16, 2025 ·29m
Sep 16, 2025 ·47m
Sep 12, 2025 ·37m
Sep 11, 2025 ·40m
Sep 10, 2025 ·40m