Paper Reading AI Learner

Finding Optimal Video Moment without Training: Gaussian Boundary Optimization for Weakly Supervised Video Grounding

2026-02-03 04:01:12
Sunoh Kim, Kimin Yun, Daeho Um

Abstract

Weakly supervised temporal video grounding aims to localize query-relevant segments in untrimmed videos using only video-sentence pairs, without requiring ground-truth segment annotations that specify exact temporal boundaries. Recent approaches tackle this task by utilizing Gaussian-based temporal proposals to represent query-relevant segments. However, their inference strategies rely on heuristic mappings from Gaussian parameters to segment boundaries, resulting in suboptimal localization performance. To address this issue, we propose Gaussian Boundary Optimization (GBO), a novel inference framework that predicts segment boundaries by solving a principled optimization problem that balances proposal coverage and segment compactness. We derive a closed-form solution for this problem and rigorously analyze the optimality conditions under varying penalty regimes. Beyond its theoretical foundations, GBO offers several practical advantages: it is training-free and compatible with both single-Gaussian and mixture-based proposal architectures. Our experiments show that GBO significantly improves localization, achieving state-of-the-art results across standard benchmarks. Extensive experiments demonstrate the efficiency and generalizability of GBO across various proposal schemes. The code is available at \href{this https URL}{this https URL}.

Abstract (translated)

弱监督视频时间定位的目标是在未裁剪的视频中仅使用视频-句子对来定位与查询相关的片段,而不需依赖明确指定具体时间边界的地面真实标注。最近的研究方法通过利用基于高斯分布的时间提案来表示与查询相关的片段。然而,这些方法的推理策略依赖于从高斯参数到段落边界之间的启发式映射,这导致了次优的时间定位性能。为了解决这个问题,我们提出了高斯边界优化(GBO),这是一种新的推断框架,它通过解决一个平衡提案覆盖范围和片段紧实度的原则性优化问题来预测片段边界。我们为该问题导出了闭合形式的解决方案,并严格分析了在不同惩罚制度下的最优条件。 除了其理论基础外,GBO还提供了许多实用优势:它是无须训练且与单个高斯和混合型提案架构兼容的。我们的实验表明,GBO显著提高了定位性能,在标准基准测试中取得了最先进的结果。广泛的实验证明了GBO在各种提案方案中的效率和泛化能力。代码可在[此处](this https URL)获取。 原文的意思是介绍了一种新的弱监督视频时间定位方法——高斯边界优化(Gaussian Boundary Optimization, GBO),这种方法通过解决一个平衡提案覆盖范围与片段紧实度的原则性优化问题,提高了定位的准确性,并且无须额外训练。这项技术在标准基准测试中取得了领先的成绩,并展示了其在多种提案方案中的高效性和泛化能力。

URL

https://arxiv.org/abs/2602.03071

PDF

https://arxiv.org/pdf/2602.03071.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot