Paper Reading AI Learner

Tune It Up: Music Genre Transfer and Prediction

2025-03-27 21:55:57
Fidan Samet, Oguz Bakir, Adnan Fidan

Abstract

Deep generative models have been used in style transfer tasks for images. In this study, we adapt and improve CycleGAN model to perform music style transfer on Jazz and Classic genres. By doing so, we aim to easily generate new songs, cover music to different music genres and reduce the arrangements needed in those processes. We train and use music genre classifier to assess the performance of the transfer models. To that end, we obtain 87.7% accuracy with Multi-layer Perceptron algorithm. To improve our style transfer baseline, we add auxiliary discriminators and triplet loss to our model. According to our experiments, we obtain the best accuracies as 69.4% in Jazz to Classic task and 39.3% in Classic to Jazz task with our developed genre classifier. We also run a subjective experiment and results of it show that the overall performance of our transfer model is good and it manages to conserve melody of inputs on the transferred outputs. Our code is available at this https URL fidansamet/tune-it-up

Abstract (translated)

深度生成模型已被应用于图像风格转换任务中。在本研究中,我们对CycleGAN模型进行了适应和改进,以实现爵士乐和古典音乐之间的风格转移。通过这种方式,我们的目标是轻松地生成新歌曲、将音乐改编为不同的音乐流派,并减少这些过程中的编曲需求。为了评估风格迁移模型的性能,我们训练并使用了音乐流派分类器。基于此,我们利用多层感知机算法达到了87.7%的准确率。 为了提高我们的风格转移基线,我们在模型中添加了辅助鉴别器和三元组损失函数。根据我们的实验结果,在爵士乐到古典音乐的任务中,我们获得了69.4%的最佳准确性;而在古典音乐到爵士乐的任务中,则是39.3%的最高准确率,这些成绩都是通过使用我们开发的流派分类器得到的。 此外,我们也进行了一项主观实验。该实验的结果表明,我们的转移模型的整体性能良好,并且能够保持输入旋律在转换输出中的完整性。 我们的代码可以在以下链接中找到:https://github.com/fidansamet/tune-it-up 请注意,上述URL是示例性的,在实际使用时需要替换为正确的GitHub地址或相应的开源平台地址。

URL

https://arxiv.org/abs/2503.22008

PDF

https://arxiv.org/pdf/2503.22008.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot