Unmasking Nationality Bias: A Study of Human Perception of Nationalities in AI-Generated Articles

Pranav Narayanan Venkit, Sanjana Gautam, Ruchi Panchanadikar, Ting Hao Huang, Shomir Wilson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

We investigate the potential for nationality biases in natural language processing (NLP) models using human evaluation methods. Biased NLP models can perpetuate stereotypes and lead to algorithmic discrimination, posing a significant challenge to the fairness and justice of AI systems. Our study employs a two-step mixed-methods approach that includes both quantitative and qualitative analysis to identify and understand the impact of nationality bias in a text generation model. Through our human-centered quantitative analysis, we measure the extent of nationality bias in articles generated by AI sources. We then conduct open-ended interviews with participants, performing qualitative coding and thematic analysis to understand the implications of these biases on human readers. Our findings reveal that biased NLP models tend to replicate and amplify existing societal biases, which can translate to harm if used in a sociotechnical setting. The qualitative analysis from our interviews offers insights into the experience readers have when encountering such articles, highlighting the potential to shift a reader's perception of a country. These findings emphasize the critical role of public perception in shaping AI's impact on society and the need to correct biases in AI systems.

Original languageEnglish (US)
Title of host publicationAIES 2023 - Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society
PublisherAssociation for Computing Machinery, Inc
Pages554-565
Number of pages12
ISBN (Electronic)9798400702310
DOIs
StatePublished - Aug 8 2023
Event2023 AAAI / ACM Conference on Artificial Intelligence, Ethics, and Society, AIES 2023 - Montreal, Canada
Duration: Aug 8 2023Aug 10 2023

Publication series

NameAIES 2023 - Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society

Conference

Conference2023 AAAI / ACM Conference on Artificial Intelligence, Ethics, and Society, AIES 2023
Country/TerritoryCanada
CityMontreal
Period8/8/238/10/23

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Cite this