Paper Reading AI Learner

Stop Walking in Circles! Bailing Out Early in Projected Gradient Descent

2025-03-25 04:51:44
Philip Doldo, Derek Everett, Amol Khanna, Andre T Nguyen, Edward Raff

Abstract

Projected Gradient Descent (PGD) under the $L_\infty$ ball has become one of the defacto methods used in adversarial robustness evaluation for computer vision (CV) due to its reliability and efficacy, making a strong and easy-to-implement iterative baseline. However, PGD is computationally demanding to apply, especially when using thousands of iterations is the current best-practice recommendation to generate an adversarial example for a single image. In this work, we introduce a simple novel method for early termination of PGD based on cycle detection by exploiting the geometry of how PGD is implemented in practice and show that it can produce large speedup factors while providing the \emph{exact} same estimate of model robustness as standard PGD. This method substantially speeds up PGD without sacrificing any attack strength, enabling evaluations of robustness that were previously computationally intractable.

Abstract (translated)

基于$L_\infty$球的投影梯度下降(Projected Gradient Descent,PGD)方法由于其可靠性和有效性,在计算机视觉(CV)领域的对抗鲁棒性评估中已经成为了一种事实上的标准方法。然而,这种方法在计算上非常耗费资源,尤其是在当前最佳实践建议使用数千次迭代来为单张图像生成一个对抗样本时更是如此。在这项工作中,我们提出了一种简单的新方法,通过利用实际实现PGD的几何特性来进行循环检测以提前终止PGD,并展示了该方法能够在不牺牲模型鲁棒性评估准确性的前提下产生显著的速度提升。具体来说,它能够提供与标准PGD完全相同的模型鲁棒性估计结果,但速度却快得多。这种方法极大地加快了PGD的执行速度,同时没有削弱攻击力度,使得之前由于计算资源限制而无法进行的对抗鲁棒性评估成为可能。

URL

https://arxiv.org/abs/2503.19347

PDF

https://arxiv.org/pdf/2503.19347.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot