Paper Reading AI Learner

Enhancing Text-to-Image Generation via End-Edge Collaborative Hybrid Super-Resolution

2026-01-21 07:55:37
Chongbin Yi, Yuxin Liang, Ziqi Zhou, Peng Yang

Abstract

Artificial Intelligence-Generated Content (AIGC) has made significant strides, with high-resolution text-to-image (T2I) generation becoming increasingly critical for improving users' Quality of Experience (QoE). Although resource-constrained edge computing adequately supports fast low-resolution T2I generations, achieving high-resolution output still faces the challenge of ensuring image fidelity at the cost of latency. To address this, we first investigate the performance of super-resolution (SR) methods for image enhancement, confirming a fundamental trade-off that lightweight learning-based SR struggles to recover fine details, while diffusion-based SR achieves higher fidelity at a substantial computational cost. Motivated by these observations, we propose an end-edge collaborative generation-enhancement framework. Upon receiving a T2I generation task, the system first generates a low-resolution image based on adaptively selected denoising steps and super-resolution scales at the edge side, which is then partitioned into patches and processed by a region-aware hybrid SR policy. This policy applies a diffusion-based SR model to foreground patches for detail recovery and a lightweight learning-based SR model to background patches for efficient upscaling, ultimately stitching the enhanced ones into the high-resolution image. Experiments show that our system reduces service latency by 33% compared with baselines while maintaining competitive image quality.

Abstract (translated)

人工智能生成内容(AIGC)取得了显著进展,其中高分辨率的文本到图像(T2I)生成变得越来越重要,以提升用户的体验质量(QoE)。尽管资源受限的边缘计算能够支持快速生成低分辨率的T2I输出,但要实现高质量的高分辨率图像仍面临延迟和图像保真度之间的权衡。为了解决这一问题,我们首先研究了超分辨率(SR)方法在图像增强方面的性能,发现了一个基本的折中:轻量级学习型SR难以恢复精细细节,而基于扩散的SR虽然能够达到更高的图像保真度,但计算成本较高。 鉴于这些观察结果,我们提出了一种端边协作生成与增强框架。当系统收到一个T2I生成任务时,在边缘侧根据自适应选择的去噪步骤和超分辨率尺度先生成一张低分辨率图片。接着将该图片分割成多个补丁,并采用一种区域感知混合SR策略进行处理:此策略使用基于扩散的SR模型对前景补丁进行细节恢复,同时利用轻量级学习型SR模型快速扩大背景补丁尺寸,最终将其拼接为高分辨率图像。 实验表明,与基准系统相比,我们的框架在保持竞争性图像质量的同时,能够将服务延迟降低33%。

URL

https://arxiv.org/abs/2601.14741

PDF

https://arxiv.org/pdf/2601.14741.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot