Abstract
Despite the considerable efforts being made to monitor and regulate user-generated content on social media platforms, the pervasiveness of offensive language, such as hate speech or cyberbullying, in the digital space remains a significant challenge. Given the importance of maintaining a civilized and respectful online environment, there is an urgent and growing need for automatic systems capable of detecting offensive speech in real time. However, developing effective systems for processing languages such as Chinese presents a significant challenge, owing to the language's complex and nuanced nature, which makes it difficult to process automatically. This paper provides a comprehensive overview of offensive language detection in Chinese, examining current benchmarks and approaches and highlighting specific models and tools for addressing the unique challenges of detecting offensive language in this complex language. The primary objective of this survey is to explore the existing techniques and identify potential avenues for further research that can address the cultural and linguistic complexities of Chinese.
Abstract (translated)
尽管在社交媒体平台上对用户生成内容的监测和管理已经取得了很大的努力,但数字空间中不良言论(如仇恨言论或网络欺凌)的普遍性仍然是一个重要的挑战。考虑到维护文明和尊重的在线环境的重要性,需要开发能够实时检测不良言论的自动系统。然而,由于汉语复杂的语言特点,开发有效的汉语处理系统仍然是一个巨大的挑战。本文全面回顾了汉语中的不良言论检测,探讨了当前的基准和解决方案,并强调了用于解决这种复杂语言中检测不良言论独特挑战的特定模型和工具。本次调查的主要目标是探索现有技术和途径,以解决汉语中的文化和社会语言复杂性。
URL
https://arxiv.org/abs/2403.18314