
Human evaluations of machine translation in an ethically charged situation
Author(s) -
Omri Asscher,
Ella Glikson
Publication year - 2021
Publication title -
new media and society
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 3.501
H-Index - 109
eISSN - 1461-7315
pISSN - 1461-4448
DOI - 10.1177/14614448211018833
Subject(s) - reliability (semiconductor) , disadvantaged , translation (biology) , perception , product (mathematics) , psychology , immigration , social psychology , computer science , power (physics) , cognitive psychology , sociology , political science , mathematics , biochemistry , physics , chemistry , geometry , quantum mechanics , neuroscience , messenger rna , law , gene
Despite the immense influence of machine translation (MT) on cross-cultural communication worldwide, little is known about end users’ predispositions toward MT. Our online experiment ( N = 284) compares people’s perceptions of MT and human translation in an ethically charged situation, in which the translation serves an immigrant worker in an interaction defined by power imbalance. Using hierarchical linear regression, we found that an otherwise identical translation was evaluated differently when it was attributed to MT or human translation. Results reveal that translators and non-translators alike exhibit a negative bias toward the MT product when asked to assess its accuracy and reliability, its ability to convey cultural and emotional otherness, and its potential effectiveness in helping the disadvantaged immigrant in need of the translation. We also demonstrate how lower evaluations of the MT product lead to a stronger wish to intervene in the translation by introducing changes to the original message. Our results suggest that predispositions toward MT must be taken into account in any consideration of MT-mediated communication, as these predispositions may shape the communicative act itself.