Research Outputs from External Evaluation of Discrimination Mitigation Efforts in Meta's Ad Delivery

This webpage documents a paper and dataset related to our 2025 study “External Evaluation of Discrimination Mitigation Efforts in Meta’s Ad Delivery”.

Paper

Our methodology is described in the following paper:

Title: External Evaluation of Discrimination Mitigation Efforts in Meta’s Ad Delivery
Authors: Basileal Imana, Zeyu Shen, John Heidemann, and Aleksandra Korolova
Venue: In Proceedings of ACM FAccT 2025, June 23-26, 2025, Athens, Greece.
Links: PDF, Bibtex

Data for Figures in the Paper

Experiments comparing ad delivery variance and cost of delivery with and without VRS (for RACE) (Figure 3, Figure 5, Figure 6)

Experiments comparing ad delivery variance and cost of delivery with and without VRS (for GENDER) (Figure 3, Figure 5, Figure 6)

Experiments using our budget-splitting approach (Figure 6):

Experiments comparing VRS’s performance when an ad is declared as a housing, job, or credit ad (Figure 4):

Experiment Data

Contact Authors

See also our related prior papers on “Auditing for Discrimination in Job Ad Delivery” (WWW, 2021), and on “Auditing for Racial Discrimination in the Delivery of Education Ads” (FAccT, 2024).