Abstract
Ubiquitous robotic systems often lack traditional visual interfaces, making natural language interaction important for maintenance and repair. This paper presents a goal-oriented agentic AI architecture that enables non-expert users to complete technical repair tasks through situated dialogue. The architecture separates pre-interaction goal decomposition, persistent state tracking, strategic goal management, and real-time conversational execution. We evaluated the system in a physical hardware repair task with twenty participants. Nineteen participants completed the task, corresponding to a 95% completion rate. Participants rated the system as helpful and competent, and the agent remained robust to conversational diversions such as meta-queries and code-switching. A comparison with a prior online baseline showed that physical interaction significantly reduced perceived social presence, (p=.0005), and trust and competence, (p=.037), while perceived helpfulness remained high.
Abstract (translated)
URL
https://arxiv.org/abs/2609.26155
