Paper Reading AI Learner

ParaRevSNN: A Parallel Reversible Spiking Neural Network for Efficient Training and Inference

2025-08-02 06:40:59
Changqing Xu, Guoqing Sun, Yi Liu, Xinfang Liao, Yintang Yang

Abstract

Reversible Spiking Neural Networks (RevSNNs) enable memory-efficient training by reconstructing forward activations during backpropagation, but suffer from high latency due to strictly sequential computation. To overcome this limitation, we propose ParaRevSNN, a parallel reversible SNN architecture that decouples sequential dependencies between reversible blocks while preserving reversibility. This design enables inter-block parallelism, significantly accelerating training and inference while retaining the memory-saving benefits of reversibility. Experiments on CIFAR10, CIFAR100, CIFAR10-DVS, and DVS128 Gesture demonstrate that ParaRevSNN matches or exceeds the accuracy of standard RevSNNs, while reducing training time by up to 35.2\% and inference time to 18.15\%, making it well-suited for deployment in resource-constrained scenarios.

Abstract (translated)

可逆脉冲神经网络(RevSNN)通过在反向传播过程中重构前向激活来实现高效的内存训练,但因其严格遵循的顺序计算导致了较高的延迟。为克服这一限制,我们提出了ParaRevSNN,这是一种并行的可逆SNN架构,在解耦各个可逆块之间的顺序依赖性的同时保留了可逆性。这种设计使跨块并行化成为可能,显著加速了训练和推理过程,同时保持了可逆性的内存节约优势。在CIFAR10、CIFAR100、CIFAR10-DVS以及DVS128手势数据集上的实验表明,ParaRevSNN的精度与标准RevSNN相当或更优,并且将训练时间减少了高达35.2%,推理时间缩短至18.15%,使其非常适合在资源受限场景中部署。

URL

https://arxiv.org/abs/2508.01223

PDF

https://arxiv.org/pdf/2508.01223.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot