Abstract
Learning music theory not only has practical benefits for musicians to write, perform, understand, and express music better, but also for both non-musicians to improve critical thinking, math analytical skills, and music appreciation. However, current external tools applicable for learning music theory through writing when human instruction is unavailable are either limited in feedback, lacking a written modality, or assuming already strong familiarity of music theory concepts. In this paper, we describe Maestoso, an educational tool for novice learners to learn music theory through sketching practice of quizzed music structures. Maestoso first automatically recognizes students' sketched input of quizzed concepts, then relies on existing sketch and gesture recognition techniques to automatically recognize the input, and finally generates instructor-emulated feedback. From our evaluations, we demonstrate that Maestoso performs reasonably well on recognizing music structure elements and that novice students can comfortably grasp introductory music theory in a single session.
Abstract (translated)
学习音乐理论不仅对音乐家在写作、表演、理解及表达音乐方面具有实际益处，而且对于非音乐人士来说也能提高批判性思维能力、数学分析能力和音乐鉴赏力。然而，当前可用的外部工具，在没有人类指导的情况下通过书写来学习音乐理论时，要么提供的反馈有限，要么缺少书面形式的教学方式，或者假设用户已经熟悉了音乐理论的概念。在本文中，我们介绍了Maestoso这款教育工具，它能让初学者通过绘制练习的方式来学习音乐理论。 Maestoso首先自动识别学生对测验概念的手绘输入，然后依靠现有的手写和手势识别技术来自动识别这些输入，并最终生成类似导师提供的反馈。我们的评估表明，Maestoso在识别音乐结构元素方面表现良好，而且初学者能够在一个会话中轻松掌握基础的音乐理论知识。
URL
https://arxiv.org/abs/2504.13889
