Paper Reading AI Learner

Super-resolution of biomedical volumes with 2D supervision

2024-04-15 02:41:55
Cheng Jiang, Alexander Gedeon, Yiwei Lyu, Eric Landgraf, Yufeng Zhang, Xinhai Hou, Akhil Kondepudi, Asadur Chowdury, Honglak Lee, Todd Hollon

Abstract

Volumetric biomedical microscopy has the potential to increase the diagnostic information extracted from clinical tissue specimens and improve the diagnostic accuracy of both human pathologists and computational pathology models. Unfortunately, barriers to integrating 3-dimensional (3D) volumetric microscopy into clinical medicine include long imaging times, poor depth / z-axis resolution, and an insufficient amount of high-quality volumetric data. Leveraging the abundance of high-resolution 2D microscopy data, we introduce masked slice diffusion for super-resolution (MSDSR), which exploits the inherent equivalence in the data-generating distribution across all spatial dimensions of biological specimens. This intrinsic characteristic allows for super-resolution models trained on high-resolution images from one plane (e.g., XY) to effectively generalize to others (XZ, YZ), overcoming the traditional dependency on orientation. We focus on the application of MSDSR to stimulated Raman histology (SRH), an optical imaging modality for biological specimen analysis and intraoperative diagnosis, characterized by its rapid acquisition of high-resolution 2D images but slow and costly optical z-sectioning. To evaluate MSDSR's efficacy, we introduce a new performance metric, SliceFID, and demonstrate MSDSR's superior performance over baseline models through extensive evaluations. Our findings reveal that MSDSR not only significantly enhances the quality and resolution of 3D volumetric data, but also addresses major obstacles hindering the broader application of 3D volumetric microscopy in clinical diagnostics and biomedical research.

Abstract (translated)

体积生物医学显微镜具有从临床组织样本中提取更多诊断信息并提高人病理学家和计算病理学模型的诊断准确性的潜力。然而,将3维(3D)体积显微镜整合到临床医学中存在一些障碍,包括成像时间长、深度/z轴分辨率低和优质体积数据不足。利用高分辨率2D显微镜数据的丰富性,我们引入了遮罩切片扩散(MSDSR)用于超分辨率(MSDSR),该技术利用生物组织样本中所有空间维度数据生成分布的内在等价性。这种固有特性使得在同一平面上(例如XY)训练的具有高分辨率图像的超级分辨率模型能够有效地推广到其他方向(例如XZ和YZ),克服了传统依赖 orientation 的限制。我们将重点放在MSDSR在刺激 Raman 组织学(SRH)中的应用上,这是一种用于生物组织样品分析和术中诊断的光学成像模式,具有快速获取高分辨率2D图像的特点,但成像速度较慢、成本较高。为了评估MSDSR的效力,我们引入了一个新的性能指标——切片FID,并通过广泛的评估展示了MSDSR在基线模型上的优越性能。我们的研究结果表明,MSDSR不仅显著提高了3D体积数据的质量和分辨率,而且解决了阻碍3D体积显微镜在临床诊断和研究中的应用的主要障碍。

URL

https://arxiv.org/abs/2404.09425

PDF

https://arxiv.org/pdf/2404.09425.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot