Paper Reading AI Learner

A biologically inspired separable learning vision model for real-time traffic object perception in Dark

2025-09-05 11:22:52
Hulin Li, Qiliang Ren, Jun Li, Hanbing Wei, Zheng Liu, Linfang Fan

Abstract

Fast and accurate object perception in low-light traffic scenes has attracted increasing attention. However, due to severe illumination degradation and the lack of reliable visual cues, existing perception models and methods struggle to quickly adapt to and accurately predict in low-light environments. Moreover, there is the absence of available large-scale benchmark specifically focused on low-light traffic scenes. To bridge this gap, we introduce a physically grounded illumination degradation method tailored to real-world low-light settings and construct Dark-traffic, the largest densely annotated dataset to date for low-light traffic scenes, supporting object detection, instance segmentation, and optical flow estimation. We further propose the Separable Learning Vision Model (SLVM), a biologically inspired framework designed to enhance perception under adverse lighting. SLVM integrates four key components: a light-adaptive pupillary mechanism for illumination-sensitive feature extraction, a feature-level separable learning strategy for efficient representation, task-specific decoupled branches for multi-task separable learning, and a spatial misalignment-aware fusion module for precise multi-feature alignment. Extensive experiments demonstrate that SLVM achieves state-of-the-art performance with reduced computational overhead. Notably, it outperforms RT-DETR by 11.2 percentage points in detection, YOLOv12 by 6.1 percentage points in instance segmentation, and reduces endpoint error (EPE) of baseline by 12.37% on Dark-traffic. On the LIS benchmark, the end-to-end trained SLVM surpasses Swin Transformer+EnlightenGAN and ConvNeXt-T+EnlightenGAN by an average of 11 percentage points across key metrics, and exceeds Mask RCNN (with light enhancement) by 3.1 percentage points. The Dark-traffic dataset and complete code is released at this https URL.

Abstract (translated)

在低光照交通场景中,快速而准确的对象感知吸引了越来越多的关注。然而,由于严重的照明退化和缺乏可靠视觉线索,现有的感知模型和方法难以迅速适应并准确预测在这种环境下的表现。此外,目前还没有专注于低光交通场景的大规模基准数据集可用。为了填补这一空白,我们引入了一种基于物理原理的光照退化方法,并针对现实世界的低光设置构建了Dark-traffic,这是迄今为止最大的密集标注的低光交通场景数据集,支持目标检测、实例分割和光流估计。我们进一步提出了分离学习视觉模型(SLVM),这是一种生物启发式的框架,旨在增强在恶劣照明条件下的感知能力。SLVM整合了四个关键组成部分:一种光照适应性的瞳孔机制,用于提取对光照敏感的特征;一种有效的表示策略——基于特征级别的可分离学习方法;针对特定任务解耦分支,进行多任务可分离学习;以及一种空间错位意识融合模块,实现精确的多特征对齐。广泛的实验表明,SLVM在保持较低计算开销的同时达到了最先进的性能。值得注意的是,在Dark-traffic数据集上,它比RT-DETR的目标检测性能高出11.2个百分点,比YOLOv12的实例分割性能高出6.1个百分点,并将基准线模型的端点误差(EPE)降低了12.37%。在LIS基准测试中,全卷积训练后的SLVM在关键指标上平均超过了Swin Transformer+EnlightenGAN和ConvNeXt-T+EnlightenGAN 11个百分点,比带光照增强功能的Mask RCNN高出3.1个百分点。Dark-traffic数据集及完整代码已在此网址发布。

URL

https://arxiv.org/abs/2509.05012

PDF

https://arxiv.org/pdf/2509.05012.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot