Abstract
Speech Emotion Recognition (SER) presents a significant yet persistent challenge in human-computer interaction. While deep learning has advanced spoken language processing, achieving high performance on limited datasets remains a critical hurdle. This paper confronts this issue by developing and evaluating a suite of machine learning models, including Support Vector Machines (SVMs), Long Short-Term Memory networks (LSTMs), and Convolutional Neural Networks (CNNs), for automated emotion classification in human speech. We demonstrate that by strategically employing transfer learning and innovative data augmentation techniques, our models can achieve impressive performance despite the constraints of a relatively small dataset. Our most effective model, a ResNet34 architecture, establishes a new performance benchmark on the combined RAVDESS and SAVEE datasets, attaining an accuracy of 66.7% and an F1 score of 0.631. These results underscore the substantial benefits of leveraging pre-trained models and data augmentation to overcome data scarcity, thereby paving the way for more robust and generalizable SER systems.
Abstract (translated)
语音情感识别（SER）在人机交互中面临着一个重大且持久的挑战。虽然深度学习已经推动了口语处理技术的进步，但在有限的数据集上实现高性能仍然是一个重要障碍。本文通过开发和评估一系列机器学习模型来应对这一问题，这些模型包括支持向量机（SVM）、长短时记忆网络（LSTM）和卷积神经网络（CNN），以进行人类语音情感的自动分类。我们证明，通过战略性地采用迁移学习和创新的数据增强技术，我们的模型能够在数据集相对较小的情况下实现令人印象深刻的性能表现。 最有效的模型是我们采用的ResNet34架构，在结合RAVDESS和SAVEE数据集后建立了一个新的性能基准，达到了66.7%的准确率和0.631的F1分数。这些结果强调了利用预训练模型和数据增强技术克服数据不足的重要性，并为构建更强大、更具通用性的SER系统铺平了道路。
URL
https://arxiv.org/abs/2509.00077
