Paper Reading AI Learner

SE-GSL: A General and Effective Graph Structure Learning Framework through Structural Entropy Optimization

2023-03-17 05:20:24
Dongcheng Zou, Hao Peng, Xiang Huang, Renyu Yang, Jianxin Li, Jia Wu, Chunyang Liu, Philip S. Yu

Abstract

Graph Neural Networks (GNNs) are de facto solutions to structural data learning. However, it is susceptible to low-quality and unreliable structure, which has been a norm rather than an exception in real-world graphs. Existing graph structure learning (GSL) frameworks still lack robustness and interpretability. This paper proposes a general GSL framework, SE-GSL, through structural entropy and the graph hierarchy abstracted in the encoding tree. Particularly, we exploit the one-dimensional structural entropy to maximize embedded information content when auxiliary neighbourhood attributes are fused to enhance the original graph. A new scheme of constructing optimal encoding trees is proposed to minimize the uncertainty and noises in the graph whilst assuring proper community partition in hierarchical abstraction. We present a novel sample-based mechanism for restoring the graph structure via node structural entropy distribution. It increases the connectivity among nodes with larger uncertainty in lower-level communities. SE-GSL is compatible with various GNN models and enhances the robustness towards noisy and heterophily structures. Extensive experiments show significant improvements in the effectiveness and robustness of structure learning and node representation learning.

Abstract (translated)

图形神经网络(GNNs)实际上是结构数据学习的实际上的解决方案。然而,它容易被低质量和可靠的结构所影响,这在现实世界的图形中已成为一种常态,而不是一个例外。现有的图形结构学习框架(GSL)框架仍然缺乏稳定性和解释性。本文提出了一个通用的GSL框架,即SE-GSL,通过在编码树中抽象结构的熵和图形级数来实现。特别地,我们利用一维结构的熵来最大化嵌入信息 content,当辅助邻域属性融合以增强原始图形时。我们提出了一种新的方式来构建最优编码树,以最小化图形中的不确定和噪声,同时确保适当的社区分区在Hierarchical抽象中。我们提出了一种基于样本的结构熵分布机制,通过节点结构熵分布来恢复图形结构。它增加了高层次社区中节点之间的连通性。SE-GSL与各种GNN模型兼容,并增强对噪声和异质结构的鲁棒性。广泛的实验表明,结构学习和节点表示学习的有效性和鲁棒性得到了显著改善。

URL

https://arxiv.org/abs/2303.09778

PDF

https://arxiv.org/pdf/2303.09778.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot