Abstract
This paper presents a novel concept for intuitive end-user programming of robots, inspired by natural interaction between humans. Natural language and supportive gestures are translated into robot programs using large language models (LLMs) and computer vision (CV). Through equally natural system feedback in the form of clarification questions and visual representations, the generated program can be reviewed and adjusted, thereby ensuring safety, transparency, and user acceptance.
Abstract (translated)
本文提出了一种受人类自然交互启发的、面向终端用户的机器人直观编程新概念。通过大语言模型（LLM）与计算机视觉（CV）技术，自然语言与辅助手势可被转换为机器人程序。系统通过自然的澄清性提问与视觉呈现提供反馈，使用户能够审查并调整所生成的程序，从而确保安全性、透明性与用户接受度。
URL
https://arxiv.org/abs/2604.05978
