Abstract
Artificial Intelligence-Generated Content (AIGC) has made significant strides, with high-resolution text-to-image (T2I) generation becoming increasingly critical for improving users' Quality of Experience (QoE). Although resource-constrained edge computing adequately supports fast low-resolution T2I generations, achieving high-resolution output still faces the challenge of ensuring image fidelity at the cost of latency. To address this, we first investigate the performance of super-resolution (SR) methods for image enhancement, confirming a fundamental trade-off that lightweight learning-based SR struggles to recover fine details, while diffusion-based SR achieves higher fidelity at a substantial computational cost. Motivated by these observations, we propose an end-edge collaborative generation-enhancement framework. Upon receiving a T2I generation task, the system first generates a low-resolution image based on adaptively selected denoising steps and super-resolution scales at the edge side, which is then partitioned into patches and processed by a region-aware hybrid SR policy. This policy applies a diffusion-based SR model to foreground patches for detail recovery and a lightweight learning-based SR model to background patches for efficient upscaling, ultimately stitching the enhanced ones into the high-resolution image. Experiments show that our system reduces service latency by 33% compared with baselines while maintaining competitive image quality.
Abstract (translated)
人工智能生成内容(AIGC)取得了显著进展,其中高分辨率的文本到图像(T2I)生成变得越来越重要,以提升用户的体验质量(QoE)。尽管资源受限的边缘计算能够支持快速生成低分辨率的T2I输出,但要实现高质量的高分辨率图像仍面临延迟和图像保真度之间的权衡。为了解决这一问题,我们首先研究了超分辨率(SR)方法在图像增强方面的性能,发现了一个基本的折中:轻量级学习型SR难以恢复精细细节,而基于扩散的SR虽然能够达到更高的图像保真度,但计算成本较高。 鉴于这些观察结果,我们提出了一种端边协作生成与增强框架。当系统收到一个T2I生成任务时,在边缘侧根据自适应选择的去噪步骤和超分辨率尺度先生成一张低分辨率图片。接着将该图片分割成多个补丁,并采用一种区域感知混合SR策略进行处理:此策略使用基于扩散的SR模型对前景补丁进行细节恢复,同时利用轻量级学习型SR模型快速扩大背景补丁尺寸,最终将其拼接为高分辨率图像。 实验表明,与基准系统相比,我们的框架在保持竞争性图像质量的同时,能够将服务延迟降低33%。
URL
https://arxiv.org/abs/2601.14741