Abstract
Videos from fleets of ground robots can advance public safety by providing scalable situational awareness and reducing professionals' burden. Yet little is known about how to design and integrate multi-robot videos into public safety workflows. Collaborating with six police agencies, we examined how such videos could be made practical. In Study 1, we presented the first testbed for multi-robot ground video sensemaking. The testbed includes 38 events-of-interest (EoI) relevant to public safety, a dataset of 20 robot patrol videos (10 day/night pairs) covering EoI types, and 6 design requirements aimed at improving current video sensemaking practices. In Study 2, we built MRVS, a tool that augments multi-robot patrol video streams with a prompt-engineered video understanding model. Participants reported reduced manual workload and greater confidence with LLM-based explanations, while noting concerns about false alarms and privacy. We conclude with implications for designing future multi-robot video sensemaking tools. The testbed is available at this https URL\_VideoSensemaking
Abstract (translated)
地面机器人车队的视频可以通过提供可扩展的情境感知和减轻专业人员负担来提升公共安全。然而,关于如何设计并整合多机器人视频到公共安全管理流程中的知识还很少。与六家警察机构合作,我们研究了此类视频如何变得实用。 在第一项研究中,我们展示了第一个用于多机器人地面视频理解的测试平台。该测试平台包括38个与公共安全相关的事件(EoI),以及一个包含20段巡逻机器人视频的数据集(10组昼夜视频),这些数据涵盖了各种类型的事件,并确定了6个旨在改进当前视频理解和分析实践的设计要求。 在第二项研究中,我们构建了MRVS工具,该工具使用经过提示工程优化的视频理解模型来增强多机器人的巡逻视频流。参与者报告说,基于LLM(大型语言模型)解释的帮助减少了手动工作量,并且提高了他们的信心,同时他们也表达了对误报和隐私问题的关注。 我们的研究总结指出,在设计未来的多机器人视频理解和分析工具时,应当考虑这些发现的启示作用。测试平台可以在以下链接找到:https://this.is.URL\_VideoSensemaking (注:上述URL只是一个占位符,请用实际提供的有效网址替换)
URL
https://arxiv.org/abs/2602.08882