Spotlight
in
Workshop: Algorithmic Fairness through the lens of Metrics and Evaluation
The Intersectionality Problem for Algorithmic Fairness
Johannes Himmelreich · Arbie Hsu · Kristian Lum · Ellen Veomett
Keywords: [ Audits ] [ Novel fairness metrics ] [ Metrics ] [ Ethical considerations ]
Sat 14 Dec 9 a.m. PST — 5:30 p.m. PST
A yet unmet challenge in algorithmic fairness is the problem of intersectionality, that is, achieving fairness across the intersection of multiple groups — and verifying that such fairness has been attained. Because intersectional groups tend to be small, verifying whether a model is fair raises statistical as well as moral-methodological challenges. This paper (1) elucidates the problem of intersectionality in algorithmic fairness, (2) develops desiderata to clarify the challenges underlying the problem and guide the search for potential solutions, (3) illustrates the desiderata and potential solutions by sketching a proposal using simple hypothesis testing, and (4) evaluates, partly empirically, this proposal against the proposed desiderata.