English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

Toxicity detection algorithms, originally designed with reactive contentmoderation in mind, are increasingly being deployed into proactive end-userinterventions to moderate content. Through a socio-technical lens and focusingon contexts in which they are applied, we explore the use of these algorithmsin proactive moderation systems. Placing a toxicity detection algorithm in animagined virtual mobile keyboard, we critically explore how such algorithmscould be used to proactively reduce the sending of toxic content. We presentfindings from design workshops conducted with four distinct stakeholder groupsand find concerns around how contextual complexities may exasperateinequalities around content moderation processes. Whilst only specific usergroups are likely to directly benefit from these interventions, we highlightthe potential for other groups to misuse them to circumvent detection, validateand gamify hate, and manipulate algorithmic models to exasperate harm.

A Critical Reflection on the Use of Toxicity Detection Algorithms in Proactive Content Moderation Systems