Paper Reading AI Learner

MEBM-Speech: Multi-scale Enhanced BrainMagic for Robust MEG Speech Detection

2026-02-27 13:15:42
Li Songyi, Zheng Linze, Liang Jinghua, Zhang Zifeng

Abstract

We propose MEBM-Speech, a multi-scale enhanced neural decoder for speech activity detection from non-invasive magnetoencephalography (MEG) signals. Built upon the BrainMagic backbone, MEBM-Speech integrates three complementary temporal modeling mechanisms: a multi-scale convolutional module for short-term pattern extraction, a bidirectional LSTM (BiLSTM) for long-range context modeling, and a depthwise separable convolutional layer for efficient cross-scale feature fusion. A lightweight temporal jittering strategy and average pooling further improve onset robustness and boundary stability. The model performs continuous probabilistic decoding of MEG signals, enabling fine-grained detection of speech versus silence states - an ability crucial for both cognitive neuroscience and clinical applications. Comprehensive evaluations on the LibriBrain Competition 2025 Track1 benchmark demonstrate strong performance, achieving an average F1 macro of 89.3% on the validation set and comparable results on the official test leaderboard. These findings highlight the effectiveness of multi-scale temporal representation learning for robust MEG-based speech decoding.

Abstract (translated)

我们提出了MEBM-Speech,这是一种用于从非侵入性脑磁图(MEG)信号中检测语音活动的多尺度增强神经解码器。基于BrainMagic骨干网络,MEBM-Speech集成了三种互补的时间建模机制:一个多尺度卷积模块用于短期模式提取,一个双向长短时记忆网络(BiLSTM)用于长距离上下文建模,以及一个深度可分离卷积层用于高效的跨尺度特征融合。一种轻量级的时间抖动策略和平均池化进一步提高了起始点的鲁棒性和边界稳定性。该模型对MEG信号进行连续的概率解码,能够精细地检测语音与静默状态——这一能力对于认知神经科学和临床应用都至关重要。在LibriBrain Competition 2025 Track1基准上的全面评估显示了其强大的性能,在验证集上平均F1宏评分达到了89.3%,并在官方测试排行榜上取得了类似的结果。这些发现突显了多尺度时间表示学习对于基于MEG的语音解码的有效性。

URL

https://arxiv.org/abs/2603.02255

PDF

https://arxiv.org/pdf/2603.02255.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot