Abstract
Singing voice conversion aims to transform a source singing voice into that of a target singer while preserving the original lyrics, melody, and various vocal techniques. In this paper, we propose a high-fidelity singing voice conversion system. Our system builds upon the SVCC T02 framework and consists of three key components: a feature extractor, a voice converter, and a post-processor. The feature extractor utilizes the ContentVec and Whisper models to derive F0 contours and extract speaker-independent linguistic features from the input singing voice. The voice converter then integrates the extracted timbre, F0, and linguistic content to synthesize the target speaker's waveform. The post-processor augments high-frequency information directly from the source through simple and effective signal processing to enhance audio quality. Due to the lack of a standardized professional dataset for evaluating expressive singing conversion systems, we have created and made publicly available a specialized test set. Comparative evaluations demonstrate that our system achieves a remarkably high level of naturalness, and further analysis confirms the efficacy of our proposed system design.
Abstract (translated)
歌声转换技术旨在将原唱者的演唱声音转换成目标歌手的声音，同时保留原始歌词、旋律及各种发声技巧。本文提出了一种高保真的歌声转换系统。我们的系统基于SVCC T02框架构建，并包含三个关键组件：特征提取器、声乐转换器和后处理模块。 - **特征提取器**利用ContentVec和Whisper模型来获取F0（基频）曲线并从输入的歌声中提取出与说话人无关的语言特征。 - **声乐转换器**将提取到的声音特质、F0以及语言内容整合，以合成目标歌手的声音波形。 - **后处理模块**通过简单的有效信号处理方法直接从源音频增加高频信息，以此提升音质。 由于缺乏用于评估表现力歌声转换系统的标准化专业数据集，我们创建并公开提供了一个专门的测试集。比较性评测表明，我们的系统在自然度方面达到了非常高的水平，并且进一步分析确认了所提出的设计方案的有效性。
URL
https://arxiv.org/abs/2501.02953
