Paper Reading AI Learner

Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription

2025-09-28 13:36:33
Wei Zeng, Junchuan Zhao, Ye Wang

Abstract

Expressive performance rendering (EPR) and automatic piano transcription (APT) are fundamental yet inverse tasks in music information retrieval: EPR generates expressive performances from symbolic scores, while APT recovers scores from performances. Despite their dual nature, prior work has addressed them independently. In this paper we propose a unified framework that jointly models EPR and APT by disentangling note-level score content and global performance style representations from both paired and unpaired data. Our framework is built on a transformer-based sequence-to-sequence architecture and is trained using only sequence-aligned data, without requiring fine-grained note-level alignment. To automate the rendering process while ensuring stylistic compatibility with the score, we introduce an independent diffusion-based performance style recommendation module that generates style embeddings directly from score content. This modular component supports both style transfer and flexible rendering across a range of expressive styles. Experimental results from both objective and subjective evaluations demonstrate that our framework achieves competitive performance on EPR and APT tasks, while enabling effective content-style disentanglement, reliable style transfer, and stylistically appropriate rendering. Demos are available at this https URL

Abstract (translated)

以下是该段落的中文翻译: 表现性表演渲染(EPR)和自动钢琴转录(APT)是音乐信息检索中的基本且互为逆向的任务:EPR 从符号乐谱生成具有表现力的演奏,而 APT 则是从演奏中恢复乐谱。尽管它们的本质相反,之前的研究工作分别独立地处理这些问题。在本文中,我们提出了一种统一框架,通过分离配对和非配对数据中的音符级乐谱内容和全局表演风格表示来共同建模 EPR 和 APT。我们的框架基于转换器(transformer)的序列到序列架构,并仅使用序列对齐的数据进行训练,无需精细的音符级别对齐。为了在确保与乐谱风格一致的情况下自动化渲染过程,我们引入了一个独立的基于扩散模型的表演风格推荐模块,该模块直接从乐谱内容生成风格嵌入。这一模块化组件支持跨多种表现性风格的内容转换和灵活渲染。实验结果表明,在客观评估和主观评估中,我们的框架在 EPR 和 APT 任务上实现了具有竞争力的表现,并且能够有效地实现内容与风格的分离、可靠的风格转移以及符合风格的渲染。演示可在该链接查看:[此链接处应填写实际提供的演示网址]

URL

https://arxiv.org/abs/2509.23878

PDF

https://arxiv.org/pdf/2509.23878.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot