Paper Reading AI Learner

Functional Imaging Constrained Diffusion for Brain PET Synthesis from Structural MRI

2024-05-03 22:33:46
Minhui Yu, Mengqi Wu, Ling Yue, Andrea Bozoki, Mingxia Liu

Abstract

Magnetic resonance imaging (MRI) and positron emission tomography (PET) are increasingly used in multimodal analysis of neurodegenerative disorders. While MRI is broadly utilized in clinical settings, PET is less accessible. Many studies have attempted to use deep generative models to synthesize PET from MRI scans. However, they often suffer from unstable training and inadequately preserve brain functional information conveyed by PET. To this end, we propose a functional imaging constrained diffusion (FICD) framework for 3D brain PET image synthesis with paired structural MRI as input condition, through a new constrained diffusion model (CDM). The FICD introduces noise to PET and then progressively removes it with CDM, ensuring high output fidelity throughout a stable training phase. The CDM learns to predict denoised PET with a functional imaging constraint introduced to ensure voxel-wise alignment between each denoised PET and its ground truth. Quantitative and qualitative analyses conducted on 293 subjects with paired T1-weighted MRI and 18F-fluorodeoxyglucose (FDG)-PET scans suggest that FICD achieves superior performance in generating FDG-PET data compared to state-of-the-art methods. We further validate the effectiveness of the proposed FICD on data from a total of 1,262 subjects through three downstream tasks, with experimental results suggesting its utility and generalizability.

Abstract (translated)

磁共振成像(MRI)和正电子发射断层扫描(PET)在多模态分析神经退行性疾病方面越来越受到欢迎。尽管MRI在临床环境中得到了广泛应用,但PET却不太易获取。许多研究试图使用深度生成模型从MRI扫描中合成PET,但这些模型往往在训练过程中不稳定,并且不能很好地保留PET中传递给大脑的功能信息。为此,我们提出了一个功能成像约束扩散(FICD)框架,用于使用成对结构MRI生成3D脑PET图像,并通过一个新的约束扩散模型(CDM)实现。FICD引入了噪声到PET,然后通过CDM逐步去除它,确保在稳定的训练阶段具有高输出保真度。CDM学会了通过引入功能成像约束来预测去噪PET,以确保每个去噪PET与其实际对照之间进行逐个像素对齐。对293名成对T1加权MRI和18F-氟代葡萄糖(FDG)-PET扫描的受试者的定量定性分析结果表明,FICD在生成FDG-PET数据方面具有比现有方法更卓越的性能。我们还通过三个下游任务验证了所提出的FICD在总1262个受试者数据上的有效性,实验结果表明了其效用和可扩展性。

URL

https://arxiv.org/abs/2405.02504

PDF

https://arxiv.org/pdf/2405.02504.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot