Creative Commons source reading · Platform governance and the Digital Services Act
Integrating Content Moderation Systems with Large Language Models
Mirko Franco; Ombretta Gaggi; Claudio E. Palazzi
Originally published in ACM Transactions on the Web · 2025-05-24
From the article
Selected source text. JournalOS removes markup and shortens excerpts where indicated. The full article provides the complete context.
Abstract
Online Social Networks (OSNs) rely on content moderation systems to ensure platform and user safety by preventing malicious activities such as the spread of harmful content. However, there is a growing consensus suggesting that such systems are unfair to historically marginalized individuals, fragile users, and minorities. Additionally, OSN policies are often hardcoded in artificial intelligence–based violation classifiers, making personalized content moderation challenging. In addition, there is a need for more communication between users and platform administrators, especially in the case of disagreement about a moderation decision. To address these issues, we propose integrating content moderation systems with Large Language Models (LLMs) to enhance support for personal content moderation and improve user–platform communication. We also evaluate the content moderation capabilities of GPT 3.5 and LLaMa 2, comparing them with commercial products, as well as discuss the limitations of our approach and the open research directions.
Editorial reading guide
- Which actor has a duty or a decision to make, and how is responsibility allocated?
- Which conclusions come from observed practice, and which are proposals for policy or professional standards?
