Paper Reading AI Learner

Accurate Planar Tracking With Robust Re-Detection

2026-02-23 09:13:55
Jonas Serych, Jiri Matas

Abstract

We present SAM-H and WOFTSAM, novel planar trackers that combine robust long-term segmentation tracking provided by SAM 2 with 8 degrees-of-freedom homography pose estimation. SAM-H estimates homographies from segmentation mask contours and is thus highly robust to target appearance changes. WOFTSAM significantly improves the current state-of-the-art planar tracker WOFT by exploiting lost target re-detection provided by SAM-H. The proposed methods are evaluated on POT-210 and PlanarTrack tracking benchmarks, setting the new state-of-the-art performance on both. On the latter, they outperform the second best by a large margin, +12.4 and +15.2pp on the p@15 metric. We also present improved ground-truth annotations of initial PlanarTrack poses, enabling more accurate benchmarking in the high-precision p@5 metric. The code and the re-annotations are available at this https URL

Abstract (translated)

我们介绍了SAM-H和WOFTSAM,这两种是结合了由SAM 2提供的稳健长期分割跟踪与8自由度单应性姿态估计的新型平面追踪器。SAM-H通过从分割掩模轮廓中估算出单应矩阵,因此对目标外观变化具有高度鲁棒性。WOFTSAM通过利用SAM-H提供的丢失目标重新检测功能,显著提升了当前最先进的平面追踪器WOFT的表现。 我们提出的这些方法在POT-210和PlanarTrack追踪基准测试上进行了评估,并在这两个基准测试中均设立了新的性能标杆。特别是在后者中,它们超越了第二名一大截,在p@15指标上分别高出+12.4和+15.2个百分点。 此外,我们还提供了改进后的初始PlanarTrack姿态的地面真实注释,这使得在高精度的p@5度量标准下进行更准确的基准测试成为可能。代码以及重新标注的数据可在以下网址获得:[此处应提供链接](请根据实际情况填写具体URL)。

URL

https://arxiv.org/abs/2602.19624

PDF

https://arxiv.org/pdf/2602.19624.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot