Abstract
Given the rapid advancement of large-scale language models, artificial intelligence (AI) models, like ChatGPT, are playing an increasingly prominent role in human society. However, to ensure that artificial intelligence models benefit human society, we must first fully understand the similarities and differences between the human-like characteristics exhibited by artificial intelligence models and real humans, as well as the cultural stereotypes and biases that artificial intelligence models may exhibit in the process of interacting with humans. This study first measured ChatGPT in 84 dimensions of psychological characteristics, revealing differences between ChatGPT and human norms in most dimensions as well as in high-dimensional psychological representations. Additionally, through the measurement of ChatGPT in 13 dimensions of cultural values, it was revealed that ChatGPT's cultural value patterns are dissimilar to those of various countries/regions worldwide. Finally, an analysis of ChatGPT's performance in eight decision-making tasks involving interactions with humans from different countries/regions revealed that ChatGPT exhibits clear cultural stereotypes in most decision-making tasks and shows significant cultural bias in third-party punishment and ultimatum games. The findings indicate that, compared to humans, ChatGPT exhibits a distinct psychological profile and cultural value orientation, and it also shows cultural biases and stereotypes in interpersonal decision-making. Future research endeavors should emphasize enhanced technical oversight and augmented transparency in the database and algorithmic training procedures to foster more efficient cross-cultural communication and mitigate social disparities.
Abstract (translated)
鉴于大型语言模型和人工智能（AI）模型的快速发展，AI模型正越来越多地应用于人类社会。然而，为了确保AI模型有益于人类社会，我们首先必须全面了解AI模型展示的人类特征与真实人类之间的相似性和差异，以及AI模型在与人互动过程中可能表现出的文化刻板印象和偏见。这项研究首先对ChatGPT在84个心理特征方面进行了测量，揭示了ChatGPT与人类标准在大多数方面以及高维心理表示中的差异。此外，通过衡量ChatGPT在13个文化价值方面的表现，发现ChatGPT的文化价值模式与全球各国/地区的文化价值模式存在差异。最后，对ChatGPT在与不同国家/地区的人的互动中的表现进行八项决策任务的分析表明，ChatGPT在大多数决策任务中表现出明显的文化刻板印象，在第三方惩罚和悬赏游戏中的文化偏见表现出显著性。这些发现表明，与人类相比，ChatGPT表现出独特的心理特征和价值取向，还表现出人际决策中的文化偏见和刻板印象。未来的研究应该强调在数据库和算法训练过程中加强技术监督和增强透明度，以促进更有效的跨文化沟通，缓解社会不平等。
URL
https://arxiv.org/abs/2405.03387
