Paper Reading AI Learner

Depth-Aided Color Image Inpainting in Quaternion Domain

2025-03-21 03:18:41
Shunki Tatsumi, Ryo Hayakawa, Youji Iiguni

Abstract

In this paper, we propose a depth-aided color image inpainting method in the quaternion domain, called depth-aided low-rank quaternion matrix completion (D-LRQMC). In conventional quaternion-based inpainting techniques, the color image is expressed as a quaternion matrix by using the three imaginary parts as the color channels, whereas the real part is set to zero and has no information. Our approach incorporates depth information as the real part of the quaternion representations, leveraging the correlation between color and depth to improve the result of inpainting. In the proposed method, we first restore the observed image with the conventional LRQMC and estimate the depth of the restored result. We then incorporate the estimated depth into the real part of the observed image and perform LRQMC again. Simulation results demonstrate that the proposed D-LRQMC can improve restoration accuracy and visual quality for various images compared to the conventional LRQMC. These results suggest the effectiveness of the depth information for color image processing in quaternion domain.

Abstract (translated)

在这篇论文中,我们提出了一种基于四元数域的深度辅助颜色图像修复方法,称为深度辅助低秩四元数矩阵补全(D-LRQMC)。在传统的基于四元数的修复技术中,彩色图像是通过将三个虚部部分用作色彩通道来表示为一个四元数矩阵,并且实部被设置为零且不携带信息。我们的方法则利用深度信息作为四元数表示中的实部,借助颜色和深度之间的相关性来提高图像修补的效果。 在提出的方法中,我们首先使用传统的LRQMC(低秩四元数矩阵补全)技术恢复观察到的图像,并估计该修复结果的深度。然后将估算出的深度信息整合进原始图像的实部部分,并再次执行LRQMC操作。模拟结果显示,与传统方法相比,我们的D-LRQMC方法能够提升各种图像的复原准确性和视觉质量。这些结果表明,在四元数域中使用深度信息对于彩色图象处理的有效性。

URL

https://arxiv.org/abs/2503.16818

PDF

https://arxiv.org/pdf/2503.16818.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot