Skip to content
Actionable Auditing — Raji & Buolamwini (2019) episode artwork

Sep 10, 2026 3 min

Actionable Auditing — Raji & Buolamwini (2019)

from 1 More Paper (Brief)

Although algorithmic auditing has emerged as a key strategy to expose systematic biases embedded in soft- ware platforms, we struggle to understand the real- world impact of these audits, as scholarship on the impact of algorithmic audits on increasing algorith- mic fairness and transparency in commercial systems is nascent. To analyze the impact of publicly naming and disclosing performance results of biased AI sys- tems, we investigate the commercial impact of Gender Shades, the first algorithmic audit of gender and skin type performance disparities in commercial facial anal- ysis models. This paper 1) outlines the audit design and structured disclosure procedure used in the Gen- der Shades study, 2) presents new performance metrics from targeted companies IBM, Microsoft and Megvii (Face++) on the Pilot Parliaments Benchmark (PPB) as of August 2018, 3) provides performance results on PPB by non-target companies Amazon and Kairos and, Authors: Inioluwa Deborah Raji, Joy Buolamwini Published in: Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society Publication date: 2019-01-27 Read the paper The authors and publisher do not sponsor or endorse this recording.

Episode details come from the podcast's RSS feed.

Embed this episode

Ready to play

Actionable Auditing — Raji & Buolamwini (2019)

0:00 3:25

No transcript yet.

Requests help us decide what to transcribe next.

Frequently asked questions

How long is this episode of 1 More Paper (Brief)?

This episode is 3 minutes long.

When was this 1 More Paper (Brief) episode published?

This episode was published on September 10, 2026.

Can I download this 1 More Paper (Brief) episode?

Yes. Use the download control on the episode player to save the publisher-provided media file.