.png){kind=icon}
返回
Structure-Aware DropEdge Toward Deep Graph Convolutional Networks
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2023.3288484.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
It has been discovered that graph convolutional networks (GCNs) encounter a remarkable drop in performance when multiple layers are piled up. The main factor that accounts for why deep GCNs fail lies in oversmoothing, which isolates the network output from the input with the increase of network depth, weakening expressivity and trainability. In this article, we start by investigating refined measures upon DropEdge-an existing simple yet effective technique to relieve oversmoothing. We term our method as DropEdge $++$ for its two structure-aware samplers in contrast to DropEdge: layer-dependent (LD) sampler and feature-dependent (FD) sampler. Regarding the LD sampler, we interestingly find that increasingly sampling edges from the bottom layer yields superior performance than the decreasing counterpart as well as DropEdge. We theoretically reveal this phenomenon with mean-edge-number (MEN), a metric closely related to oversmoothing. For the FD sampler, we associate the edge sampling probability with the feature similarity of node pairs and prove that it further correlates the convergence subspace of the output layer with the input features. Extensive experiments on several node classification benchmarks, including both full-and semi-supervised tasks, illustrate the efficacy of DropEdge $++$ and its compatibility with a variety of backbones by achieving generally better performance over DropEdge and the no-drop version.
Keyword:
DropEdge plus plus
feature-dependent (FD) sampler
graph convolutional network (GCN)
layer-dependent (LD) sam-pler
mean-edge-number (MEN)
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
A prospective study of surgical margin status in oral squamous cell carcinoma: A preliminary report
.png){kind=icon}
PREAI
分享收藏Deep Feature Aggregation Framework Driven by Graph Convolutional Network for Scene Classification in Remote Sensing图卷积网络驱动的遥感场景深度特征聚合框架
PREAI
分享收藏Convergence Analysis of Single Latent Factor-Dependent, Nonnegative, and Multiplicative Update-Based Nonnegative Latent Factor Models基于单个潜在因素依赖，非负和乘法更新的非负潜在因素模型的收敛性分析
OAAI
OAAI分享收藏
查看更多内容