Paper Reading AI Learner

Simultaneous Motion And Noise Estimation with Event Cameras

2025-04-05 02:47:40
Shintaro Shiba, Yoshimitsu Aoki, Guillermo Gallego

Abstract

Event cameras are emerging vision sensors, whose noise is challenging to characterize. Existing denoising methods for event cameras consider other tasks such as motion estimation separately (i.e., sequentially after denoising). However, motion is an intrinsic part of event data, since scene edges cannot be sensed without motion. This work proposes, to the best of our knowledge, the first method that simultaneously estimates motion in its various forms (e.g., ego-motion, optical flow) and noise. The method is flexible, as it allows replacing the 1-step motion estimation of the widely-used Contrast Maximization framework with any other motion estimator, such as deep neural networks. The experiments show that the proposed method achieves state-of-the-art results on the E-MLB denoising benchmark and competitive results on the DND21 benchmark, while showing its efficacy on motion estimation and intensity reconstruction tasks. We believe that the proposed approach contributes to strengthening the theory of event-data denoising, as well as impacting practical denoising use-cases, as we release the code upon acceptance. Project page: this https URL

Abstract (translated)

事件相机是一种新兴的视觉传感器,其噪声特征难以表征。现有的事件相机去噪方法通常将运动估计等其他任务与去噪过程分开处理(即,在去噪后依次进行)。然而,运动是事件数据的一个内在组成部分,因为如果没有物体或摄像机自身的移动,场景边缘无法被感知到。本工作提出了一种据我们所知首次同时估计各种形式的运动(例如自运动、光流)和噪声的方法。该方法具有灵活性,可以在广泛应用的对比最大化框架中替换1步运动估计算法,并可采用包括深度神经网络在内的其他运动估算器。 实验结果表明,在E-MLB去噪基准测试上,所提方法达到了当前最佳性能;在DND21基准测试上也取得了有竞争力的结果。同时,它还在运动估计和强度重建任务中证明了其有效性。我们认为该提出的办法有助于加强事件数据去噪理论,并且通过发布代码,将对实际应用中的去噪案例产生影响。 项目页面:[此链接](https://this-url)(请根据实际情况填写URL)。

URL

https://arxiv.org/abs/2504.04029

PDF

https://arxiv.org/pdf/2504.04029.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot