Abstract
Diminished reality (DR) refers to the digital removal of real-world objects by compositing background content in their place. This thesis presents a real-time, inpainting-based DR system designed to enable privacy control in shared-space mixed reality (MR) meetings. The system allows a primary headset user to selectively remove personal or sensitive items from their environment, ensuring that those objects are no longer visible to other participants. Removal is achieved through semantic segmentation and precise object selection, followed by real-time inpainting from the viewpoint of a secondary observer, implemented using a mobile ZED 2i depth camera. The solution is designed to be portable and robust, requiring neither a fixed secondary viewpoint nor prior 3D scanning of the environment. The system utilises YOLOv11 for object detection and a modified Decoupled Spatial-Temporal Transformer (DSTT) model for high-quality video inpainting. At 720p resolution, the pipeline sustains frame rates exceeding 20 fps, demonstrating the feasibility of real-time diminished reality for practical privacy-preserving MR applications.
Abstract (translated)
虚化现实（DR）是指通过合成背景内容来实现从数字空间中移除真实世界物体的技术。本论文介绍了一种基于实时修复的虚化现实系统，旨在为共享空间中的混合现实（MR）会议提供隐私控制功能。该系统允许头戴设备的主要用户选择性地移除个人或敏感物品，确保其他参与者无法看到这些物品。 移除过程通过语义分割和精确的对象选择实现，并且在次要观察者的视角下进行实时修复，使用移动的ZED 2i深度相机来实施。此解决方案具有便携性和鲁棒性的特点，无需固定的次要视点或环境的先验三维扫描数据即可运行。 系统利用YOLOv11模型进行物体检测，并采用修改后的解耦空间-时间变换器（DSTT）模型来进行高质量视频修复。在720p分辨率下，该系统的处理流程能够保持每秒超过20帧的帧率，展示了实时虚化现实技术在实际隐私保护混合现实应用中的可行性。
URL
https://arxiv.org/abs/2509.10466
