Abstract
Emotion-driven melody harmonization aims to generate diverse harmonies for a single melody to convey desired emotions. Previous research found it hard to alter the perceived emotional valence of lead sheets only by harmonizing the same melody with different chords, which may be attributed to the constraints imposed by the melody itself and the limitation of existing music representation. In this paper, we propose a novel functional representation for symbolic music. This new method takes musical keys into account, recognizing their significant role in shaping music's emotional character through major-minor tonality. It also allows for melodic variation with respect to keys and addresses the problem of data scarcity for better emotion modeling. A Transformer is employed to harmonize key-adaptable melodies, allowing for keys determined in rule-based or model-based manner. Experimental results confirm the effectiveness of our new representation in generating key-aware harmonies, with objective and subjective evaluations affirming the potential of our approach to convey specific valence for versatile melody.
Abstract (translated)
情感驱动旋律和声化旨在为单首旋律生成多样化的和声，以传达所需的情感。之前的研究发现仅通过改变同一旋律与不同和弦的协奏来调整引人注目的旋律情绪并不容易，这可能是因为旋律本身及其现有音乐表示能力的限制。本论文提出了一个对符号音乐进行功能表示的新方法。该新方法考虑了音乐中的调性角色，认识到调性和主次音调通过主要-次要体系塑造音乐的情感特征的重要性。它还允许根据调性的变化以及尊重调性的变奏，并解决了数据稀缺问题以更好地进行情感建模。Transformer被用来调整适应性旋律的和声，使其能够根据规则或模型决定关键。实验结果证实了我们的新表示在生成键感知和声方面的有效性，客观和主观评价确认了通过赋予特定情绪价值来传达多样化的旋律的能力的可能性。 Emotion-driven melody harmonization aims to generate diverse harmonies for a single melody to convey desired emotions. Previous research found it hard to alter the perceived emotional valence of lead sheets only by harmonizing the same melody with different chords, which may be attributed to the constraints imposed by the melody itself and the limitation of existing music representation. In this paper, we propose a novel functional representation for symbolic music. This new method takes musical keys into account, recognizing their significant role in shaping music's emotional character through major-minor tonality. It also allows for melodic variation with respect to keys and addresses the problem of data scarcity for better emotion modeling. A Transformer is employed to harmonize key-adaptable melodies, allowing for keys determined in rule-based or model-based manner. Experimental results confirm the effectiveness of our new representation in generating key-aware harmonies, with objective and subjective evaluations affirming the potential of our approach to convey specific valence for versatile melody.
URL
https://arxiv.org/abs/2407.20176
