Paper Reading AI Learner

Towards Segmenting the Invisible: An End-to-End Registration and Segmentation Framework for Weakly Supervised Tumour Analysis

2026-02-05 08:55:26
Budhaditya Mukhopadhyay, Chirag Mandal, Pavan Tummala, Naghmeh Mahmoodian, Andreas N\"urnberger, Soumick Chatterjee

Abstract

Liver tumour ablation presents a significant clinical challenge: whilst tumours are clearly visible on pre-operative MRI, they are often effectively invisible on intra-operative CT due to minimal contrast between pathological and healthy tissue. This work investigates the feasibility of cross-modality weak supervision for scenarios where pathology is visible in one modality (MRI) but absent in another (CT). We present a hybrid registration-segmentation framework that combines MSCGUNet for inter-modal image registration with a UNet-based segmentation module, enabling registration-assisted pseudo-label generation for CT images. Our evaluation on the CHAOS dataset demonstrates that the pipeline can successfully register and segment healthy liver anatomy, achieving a Dice score of 0.72. However, when applied to clinical data containing tumours, performance degrades substantially (Dice score of 0.16), revealing the fundamental limitations of current registration methods when the target pathology lacks corresponding visual features in the target modality. We analyse the "domain gap" and "feature absence" problems, demonstrating that whilst spatial propagation of labels via registration is feasible for visible structures, segmenting truly invisible pathology remains an open challenge. Our findings highlight that registration-based label transfer cannot compensate for the absence of discriminative features in the target modality, providing important insights for future research in cross-modality medical image analysis. Code an weights are available at: this https URL

Abstract (translated)

肝脏肿瘤消融在临床上是一个重大的挑战:尽管术前MRI图像上可以清晰地看到肿瘤,但在术中CT图像上由于病理组织和健康组织之间的对比度极低,这些肿瘤往往变得几乎不可见。这项研究探讨了跨模式弱监督方法的可行性,在这种方法中,一种成像方式(如MRI)能显示病理性结构,而另一种成像方式(如CT)则无法显示。我们提出了一种结合MSCGUNet进行跨模态图像配准与基于UNet的分割模块的混合框架,该框架能够生成注册辅助伪标签以供CT图像使用。 我们在CHAOS数据集上的评估表明,该流程可以成功地对健康肝脏解剖结构进行配准和分割,达到Dice分数为0.72的成绩。然而,在包含肿瘤的实际临床数据中应用时,性能显著下降(Dice分数为0.16),这揭示了现有注册方法在目标病理性特征缺乏相应视觉特性时的固有限制。 我们分析了“领域差距”和“特征缺失”的问题,表明尽管通过配准可以在可视结构间传播标签,但分割真正不可见的病理仍然是一个开放性的挑战。我们的研究结果强调,基于注册的标签转移不能弥补目标模态中缺乏区分性特征的问题,并为未来跨模式医学图像分析的研究提供了重要的见解。 代码和权重可在以下网址获得:[链接](此处应插入具体URL)

URL

https://arxiv.org/abs/2602.05453

PDF

https://arxiv.org/pdf/2602.05453.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot