Abstract
This paper introduces NeoLightning, a modern reinterpretation of the Buchla Lightning. NeoLightning preserves the innovative spirit of Don Buchla's "Buchla Lightning" (introduced in the 1990s) while making its gesture-based interaction accessible to contemporary users. While the original Buchla Lightning and many other historical instruments were groundbreaking in their time, they are now largely unsupported, limiting user interaction to indirect experiences. To address this, NeoLightning leverages MediaPipe for deep learning-based gesture recognition and employs Max/MSP and Processing for real-time multimedia processing. The redesigned system offers precise, low-latency gesture recognition and immersive 3D interaction. By merging the creative spirit of the original Lightning with modern advancements, NeoLightning redefines gesture-based musical interaction, expanding possibilities for expressive performance and interactive sound design.
Abstract (translated)
本文介绍了NeoLightning，这是对Buchla Lightning的现代重新诠释。NeoLightning保留了唐·布查拉（Don Buchla）于上世纪90年代推出的"Buchla Lightning"创新精神的同时，使其基于手势的操作方式更适合当代用户使用。尽管原始的Buchla Lightning和其他许多历史乐器在其时代具有开创性意义，但由于目前缺乏支持，这些设备如今已限制了用户的直接互动体验。为解决这一问题，NeoLightning利用MediaPipe进行深度学习驱动的手势识别，并采用Max/MSP和Processing技术实现实时多媒体处理。重新设计的系统提供了精确且低延迟的手势识别功能以及沉浸式的3D交互体验。通过将原始闪电装置的创意精神与现代技术进步相结合，NeoLightning重新定义了基于手势的音乐互动方式，扩展了表演表现力及交互声音设计的可能性。
URL
https://arxiv.org/abs/2505.10686
