Premium
Bias in data‐driven artificial intelligence systems—An introductory survey
Author(s) -
Ntoutsi Eirini,
Fafalios Pavlos,
Gadiraju Ujwal,
Iosifidis Vasileios,
Nejdl Wolfgang,
Vidal MariaEsther,
Ruggieri Salvatore,
Turini Franco,
Papadopoulos Symeon,
Krasanakis Emmanouil,
Kompatsiaris Ioannis,
KinderKurlanda Katharina,
Wagner Claudia,
Karimi Fariba,
Fernandez Miriam,
Alani Harith,
Berendt Bettina,
Kruegel Tina,
Heinze Christian,
Broelemann Klaus,
Kasneci Gjergji,
Tiropanis Thanassis,
Staab Steffen
Publication year - 2020
Publication title -
wiley interdisciplinary reviews: data mining and knowledge discovery
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.506
H-Index - 47
eISSN - 1942-4795
pISSN - 1942-4787
DOI - 10.1002/widm.1356
Subject(s) - big data , software deployment , ethical issues , computer science , multidisciplinary approach , artificial intelligence , data science , engineering ethics , management science , political science , engineering , law , data mining , operating system
Artificial Intelligence (AI)‐based systems are widely employed nowadays to make decisions that have far‐reaching impact on individuals and society. Their decisions might affect everyone, everywhere, and anytime, entailing concerns about potential human rights issues. Therefore, it is necessary to move beyond traditional AI algorithms optimized for predictive performance and embed ethical and legal principles in their design, training, and deployment to ensure social good while still benefiting from the huge potential of the AI technology. The goal of this survey is to provide a broad multidisciplinary overview of the area of bias in AI systems, focusing on technical challenges and solutions as well as to suggest new research directions towards approaches well‐grounded in a legal frame. In this survey, we focus on data‐driven AI, as a large part of AI is powered nowadays by (big) data and powerful machine learning algorithms. If otherwise not specified, we use the general term bias to describe problems related to the gathering or processing of data that might result in prejudiced decisions on the bases of demographic features such as race, sex, and so forth. This article is categorized under: Commercial, Legal, and Ethical Issues > Fairness in Data Mining Commercial, Legal, and Ethical Issues > Ethical Considerations Commercial, Legal, and Ethical Issues > Legal Issues