Paper Reading AI Learner

ReactEMG: Zero-Shot, Low-Latency Intent Detection via sEMG

2025-06-24 17:28:43
Runsheng Wang, Xinyue Zhu, Ava Chen, Jingxi Xu, Lauren Winterbottom, Dawn M. Nilsen, Joel Stein, Matei Ciocarlie

Abstract

Surface electromyography (sEMG) signals show promise for effective human-computer interfaces, particularly in rehabilitation and prosthetics. However, challenges remain in developing systems that respond quickly and reliably to user intent, across different subjects and without requiring time-consuming calibration. In this work, we propose a framework for EMG-based intent detection that addresses these challenges. Unlike traditional gesture recognition models that wait until a gesture is completed before classifying it, our approach uses a segmentation strategy to assign intent labels at every timestep as the gesture unfolds. We introduce a novel masked modeling strategy that aligns muscle activations with their corresponding user intents, enabling rapid onset detection and stable tracking of ongoing gestures. In evaluations against baseline methods, considering both accuracy and stability for device control, our approach surpasses state-of-the-art performance in zero-shot transfer conditions, demonstrating its potential for wearable robotics and next-generation prosthetic systems. Our project page is available at: this https URL

Abstract (translated)

表面肌电图(sEMG)信号在人机接口方面显示出巨大的潜力,尤其是在康复和假肢领域。然而,在不同用户间快速且可靠地响应用户意图的系统开发仍面临挑战,特别是在不需要耗时校准的情况下。为此,我们提出了一种基于EMG的意图检测框架,旨在解决这些问题。 与传统的手势识别模型等待完整的手势完成后再进行分类不同,我们的方法采用了一种分段策略,在每个时间点上随着手势的发展分配意图标签。我们引入了一种新颖的掩码建模策略,该策略将肌肉激活与相应的用户意图对齐,从而实现快速起始检测和正在进行的手势的稳定跟踪。 在与基线方法进行评估时,我们的方法在零样本迁移条件下(即无需特定于每个用户的校准)实现了设备控制的准确性和稳定性方面的性能超越。这表明了其在可穿戴机器人技术和下一代假肢系统中的巨大潜力。 项目页面在此网址: [this https URL] (请将方括号内的内容替换为实际链接)

URL

https://arxiv.org/abs/2506.19815

PDF

https://arxiv.org/pdf/2506.19815.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot