.png){kind=icon}
返回
Learning Regularized Noise Contrastive Estimation for Robust Network Embedding
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2022.3148284.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Skip-gram models are popular in large-scale network embedding for their cost-effectiveness. The objectives of many skip-gram based methods relate to the word2vec model which closely relates to Noise Contrastive Estimation (NCE). Among existing embedding methods, the differences mostly lie in how the node neighborhood is modeled e.g., by different ways of random walk, which leads to different learning strategies. Orthogonal to these efforts, we take a unified view that the NCE based methods commonly involve two basic NCE components in the learning objective. This perspective allows a natural generalization of the objectives by taking different forms of scoring function in the NCE components. We theoretically analyze how the vanilla NCE-based objectives suffer from the slow convergence speed and challenge in first-/second-order proximity preservation. We also prove the fundamental difficulty for NCE methods to capture non-linearity of complex networks. To mitigate such issues, we devise a general distance-based term added to the used NCE term, inspired by its physical meaning. The distance functions include Wasserstein-$k$k distance and Laplacian/Gaussian kernel functions, with relatively little additional time overhead. The effectiveness of our approach is verified both by prototype examples as well as real-world datasets, for the task of node classification and network reconstruction.
Keyword:
Estimation
Convergence
Linearity
Kernel
Task analysis
Predictive models
Data models
Network embedding
noise-contrastive estimation
score function
期刊
IF:
10.4
论文数:
6.9K
被引数:
3.2W
机构
引用论文
Insurance activity and economic performance: Fresh evidence from asymmetric panel causality tests
OAAI
OAAI分享收藏Passive signal propagation and membrane properties in median photoreceptors of the giant barnacleOAAI
OAAI分享收藏The prognostic analysis of different metastatic patterns in advanced liver cancer patients: A population based analysis.png)
PLOS ONEOAAI
PLOS ONEIF0
OAAI分享收藏Treatment with L-Valine Ameliorates Liver Fibrosis and Restores Thrombopoiesis in Rats Exposed to Carbon TetrachlorideL-缬氨酸治疗可改善暴露于四氯化碳的大鼠的肝纤维化并恢复血栓形成OAAI
OAAI分享收藏
查看更多内容