Paper Reading AI Learner

Contextual Distributionally Robust Optimization with Causal and Continuous Structure: An Interpretable and Tractable Approach

2026-01-16 06:18:22
Fenglin Zhang, Jie Wang

Abstract

In this paper, we introduce a framework for contextual distributionally robust optimization (DRO) that considers the causal and continuous structure of the underlying distribution by developing interpretable and tractable decision rules that prescribe decisions using covariates. We first introduce the causal Sinkhorn discrepancy (CSD), an entropy-regularized causal Wasserstein distance that encourages continuous transport plans while preserving the causal consistency. We then formulate a contextual DRO model with a CSD-based ambiguity set, termed Causal Sinkhorn DRO (Causal-SDRO), and derive its strong dual reformulation where the worst-case distribution is characterized as a mixture of Gibbs distributions. To solve the corresponding infinite-dimensional policy optimization, we propose the Soft Regression Forest (SRF) decision rule, which approximates optimal policies within arbitrary measurable function spaces. The SRF preserves the interpretability of classical decision trees while being fully parametric, differentiable, and Lipschitz smooth, enabling intrinsic interpretation from both global and local perspectives. To solve the Causal-SDRO with parametric decision rules, we develop an efficient stochastic compositional gradient algorithm that converges to an $\varepsilon$-stationary point at a rate of $O(\varepsilon^{-4})$, matching the convergence rate of standard stochastic gradient descent. Finally, we validate our method through numerical experiments on synthetic and real-world datasets, demonstrating its superior performance and interpretability.

Abstract (translated)

在这篇论文中,我们提出了一种框架用于上下文分布鲁棒优化(DRO),该框架通过开发可解释且易于处理的决策规则来考虑潜在分布的因果和连续结构。这些决策规则使用协变量来制定决定。 首先,我们引入了因果Sinkhorn偏差(CSD),这是一种带熵正则化的因果Wasserstein距离,它鼓励连续的运输计划同时保持因果一致性。然后,我们提出了一种基于CSD不确定性集的上下文DRO模型,并将其命名为因果Sinkhorn DRO(Causal-SDRO)。我们推导了其强对偶重构形式,在其中最坏情况下的分布被描述为吉布斯分布的混合体。 为了求解相应的无限维策略优化问题,我们提出了软回归森林(SRF)决策规则。该规则可以在任意可测量的功能空间中逼近最优政策。与经典的决策树相比,SRF保持了其解释性的同时,也具有完全参数化、可微和Lipschitz光滑的特点,从而可以实现全局和局部视角的内在解释。 为了解决带有参数决策规则的Causal-SDRO问题,我们开发了一种高效的随机合成梯度算法。该算法以$O(\varepsilon^{-4})$的速度收敛到$\varepsilon$次平稳点,其速度与标准随机梯度下降一致。 最后,通过在合成和实际数据集上的数值实验验证了我们的方法的有效性和解释性,展示了它的优越性能。

URL

https://arxiv.org/abs/2601.11016

PDF

https://arxiv.org/pdf/2601.11016.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot