Abstract
This paper presents Negative Shanshui, a real-time interactive AI synthesis approach that reinterprets classical Chinese landscape ink painting, i.e., shanshui, to engage with ecological crises in the Anthropocene. Negative Shanshui optimizes a fine-tuned Stable Diffusion model for real-time inferences and integrates it with gaze-driven inpainting, frame interpolation; it enables dynamic morphing animations in response to the viewer's gaze and presents as an interactive virtual reality (VR) experience. The paper describes the complete technical pipeline, covering the system framework, optimization strategies, gaze-based interaction, and multimodal deployment in an art festival. Further analysis of audience feedback collected during its public exhibition highlights how participants variously engaged with the work through empathy, ambivalence, and critical reflection.
Abstract (translated)
本文介绍了Negative Shanshui，这是一种实时互动AI合成方法，它重新诠释了中国古典山水画（即山水），以应对人类世时期的生态危机。Negative Shanshui 优化了一个经过微调的Stable Diffusion模型，使其能够进行实时推断，并将其与注视驱动的图像修复技术和帧插值技术相结合；该方法使得作品可以根据观众的目光动态生成变形动画，并以互动虚拟现实（VR）体验的形式呈现。文章详细描述了整个技术流程，包括系统框架、优化策略、基于注视的交互以及在艺术节上的多模态部署情况。此外，通过对其公开展览期间收集到的观众反馈进行进一步分析，展示了参与者们如何通过同情、矛盾和批判性反思等各种方式与作品互动。
URL
https://arxiv.org/abs/2508.16612
