Paper Reading AI Learner

ARiADNE: A Reinforcement learning approach using Attention-based Deep Networks for Exploration

2023-01-27 07:49:59
Yuhong Cao, Tianxiang Hou, Yizhuo Wang, Xian Yi, Guillaume Sartoretti

Abstract

In autonomous robot exploration tasks, a mobile robot needs to actively explore and map an unknown environment as fast as possible. Since the environment is being revealed during exploration, the robot needs to frequently re-plan its path online, as new information is acquired by onboard sensors and used to update its partial map. While state-of-the-art exploration planners are frontier- and sampling-based, encouraged by the recent development in deep reinforcement learning (DRL), we propose ARiADNE, an attention-based neural approach to obtain real-time, non-myopic path planning for autonomous exploration. ARiADNE is able to learn dependencies at multiple spatial scales between areas of the agent's partial map, and implicitly predict potential gains associated with exploring those areas. This allows the agent to sequence movement actions that balance the natural trade-off between exploitation/refinement of the map in known areas and exploration of new areas. We experimentally demonstrate that our method outperforms both learning and non-learning state-of-the-art baselines in terms of average trajectory length to complete exploration in hundreds of simplified 2D indoor scenarios. We further validate our approach in high-fidelity Robot Operating System (ROS) simulations, where we consider a real sensor model and a realistic low-level motion controller, toward deployment on real robots.

Abstract (translated)

在自主机器人探索任务中,一个移动机器人需要尽可能快地积极探索并绘制一个未知的环境。由于在探索过程中环境会发生变化,机器人需要经常在线重新规划路径,因为体内的传感器会获取新信息并用于更新其部分地图。虽然最先进的探索规划方法是基于 Frontier 和采样的,但最近的 Deep Reinforcement Learning (DRL) 发展鼓励我们提出 ARiADNE,它是一种基于注意力的神经网络方法,以获取实时的非直觉路径规划,为自主探索服务。ARiADNE能够在 agent 部分地图的区域之间的多个空间尺度上学习依赖关系,并隐含地预测探索这些区域的潜在收益。这使机器人能够顺序执行运动行动,平衡已知区域地图的利用/完善和探索新区域的自然权衡。我们实验结果表明,我们的方法和学习和非学习的最新基准在平均路径长度上相比,能够完成在数百个简化的 2D 室内场景的探索。我们进一步验证我们的方法在高保真机器人操作系统(ROS)模拟中,考虑了一个真实的传感器模型和一个现实的低级别运动控制器,以部署在真实机器人上。

URL

https://arxiv.org/abs/2301.11575

PDF

https://arxiv.org/pdf/2301.11575.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot