Paper Reading AI Learner

CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble

2018-08-10 05:33:23
Chenyu You, Yi Zhang, Xiaoliu Zhang, Guang Li, Shenghong Ju, Zhen Zhao, Zhuiyang Zhang, Wenxiang Cong, Punam K. Saha, Ge Wang

Abstract

Computed tomography (CT) is a popular medical imaging modality for screening, diagnosis, and image-guided therapy. However, CT has its limitations, especially involved ionizing radiation dose. Practically, it is highly desirable to have ultrahigh quality CT imaging for fine structural details at a minimized radiation dosage. In this paper, we propose a semi-supervised deep learning approach to recover high-resolution (HR) CT images from low-resolution (LR) counterparts. Especially, with the generative adversarial network (GAN) as the basic component, we enforce the cycle-consistency in terms of the Wasserstein distance to establish a nonlinear end-to-end mapping from noisy LR input images to denoised HR outputs. In this deep imaging process, we incorporate deep convolutional neural network (CNNs), residual learning, and network in network techniques for feature extraction and restoration. In contrast to the current trend of increasing network depth and complexity to boost the CT imaging performance, which limit its real-world applications by imposing considerable computational and memory overheads, we apply a parallel 1x1 CNN to reduce the dimensionality of the output of the hidden layer. Furthermore, we optimize the number of layers and the number of filters for each CNN layer. Quantitative and qualitative evaluations demonstrate that our proposed model is accurate, efficient and robust for SR image restoration from noisy LR input images. In particular, we validate our composite SR networks on two large-scale CT datasets, and obtain very encouraging results as compared to the other state-of-the-art methods.

Abstract (translated)

计算机断层扫描(CT)是一种用于筛查,诊断和图像引导治疗的流行医学成像模式。然而,CT有其局限性,尤其涉及电离辐射剂量。实际上,非常希望在最小化的辐射剂量下具有超高质量的CT成像以获得精细的结构细节。在本文中,我们提出了一种半监督深度学习方法,用于从低分辨率(LR)对应物恢复高分辨率(HR)CT图像。特别是,以生成对抗网络(GAN)为基本组件,我们根据Wasserstein距离强制执行循环一致性,以建立从噪声LR输入图像到去噪HR输出的非线性端到端映射。在这个深度成像过程中,我们将深度卷积神经网络(CNN),残差学习和网络技术结合到网络技术中进行特征提取和恢复。与当前增加网络深度和复杂性以提高CT成像性能的趋势形成对比,后者通过施加可观的计算和内存开销来限制其实际应用,我们应用并行1x1 CNN来减少隐藏输出的维数层。此外,我们优化每个CNN层的层数和过滤器数量。定量和定性评估表明,我们提出的模型对于从嘈杂的LR输入图像恢复SR图像是准确,有效和稳健的。特别是,我们在两个大型CT数据集上验证了我们的复合SR网络,与其他最先进的方法相比,获得了非常令人鼓舞的结果。

URL

https://arxiv.org/abs/1808.04256

PDF

https://arxiv.org/pdf/1808.04256.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot