.png){kind=icon}
返回
Multi-Faceted Knowledge-Driven Pre-Training for Product Representation Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TKDE.2022.3200921.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
As a key component of e-commerce computing, product representation learning (PRL) provides benefits for a variety of applications, including product matching, search, and categorization. The existing PRL approaches have poor language understanding ability due to their inability to capture contextualized semantics. In addition, the learned representations by existing methods are not easily transferable to new products. Inspired by the recent advance of pre-trained language models (PLMs), we make the attempt to adapt PLMs for PRL to mitigate the above issues. In this article, we develop KINDLE, a Knowledge-drIven pre-trainiNg framework for proDuct representation LEarning, which can preserve the contextual semantics and multi-faceted product knowledge robustly and flexibly. Specifically, we first extend traditional one-stage pre-training to a two-stage pre-training framework, and exploit a deliberate knowledge encoder to ensure a smooth knowledge fusion into PLM. In addition, we propose a multi-objective heterogeneous embedding method to represent thousands of knowledge elements. This helps KINDLE calibrate knowledge noise and sparsity automatically by replacing isolated classes as training targets in knowledge acquisition tasks. Furthermore, an input-aware gating network is proposed to select the most relevant knowledge for different downstream tasks. Finally, extensive experiments have demonstrated the advantages of KINDLE over the state-of-the-art baselines across three downstream tasks.
Keyword:
Task analysis
Monitoring
Semantics
Pediatrics
Representation learning
Electronic publishing
Electronic commerce
Product representation learning
product search
product matching
product classification
pre-trained language models
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation开普勒: 知识嵌入和预训练语言表示的统一模型
OAAI
OAAI分享收藏Insurance activity and economic performance: Fresh evidence from asymmetric panel causality tests
OAAI
OAAI分享收藏分享收藏Spatial variations of microbial communities in abyssal and hadal sediments across the Challenger Deep.png)
PeerJOAAI
PeerJIF0
OAAI分享收藏
查看更多内容