arrow
Return

LLMs-based machine translation for E-commerce

delete2024-12-01
delete1
PRE
AI
D
Dehong Gao
K
Kaidi Chen
B
Ben Chen
H
Huangyu Dai
L
Linbo Jin
W
Wen Jiang
W
Wei Ning
S
Shanqing Yu
Q
Qi Xuan
X
Xiaoyan Cai *
L
Libin Yang
王
王祯 (Zhen Wang)
DOI:10.1016/j.eswa.2024.125087delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Large language models(LLMs) have shown promising performance for various downstream tasks, especially machine translation. However, LLMs and Specialized Translation Models (STMs) are designed to handle general translation needs, they are not well-suited for domains with specialized terms and writing styles, such as e-commerce, legal, and medicine. In the e-commerce domain, the text often contains many domain-specific terms and keyword-stacked structures, leading to poor translation quality with existing NMT methods. To tackle these problems, we have collected two resources specifically for the e-commerce domain, including aligned Chinese-English bilingual terms and parallel corpus from real e-commerce scenarios for model finetuning. We propose an LLMs-based E-commerce machine translation approach(LEMT) which includes LLMs utilization, e-commerce resources collection, and tokenizer optimization. We conduct two-stage fine-tuning and self-contrastive enhancement based on general LLMs to enable the model to learn translation features in the e-commerce domain. Through comprehensive evaluations on real e-commerce titles, our LEMT methodology demonstrates superior translation quality and robustness, outperforming leading NMT models such as NLLB, LLaMA, and even GPT-4.
Keywords:
Neural machine translation
Large language models
E-commerce domain
Fine-tuning
Self-contrastive

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

A
alibaba group
Scholars:
1.1K
Papers: 789
Citations: 0
Z
zhejiang university of technology
Scholars:
3.3W
Papers: 2.0W
Citations: 22
N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
researcher View more organizations
Cited Papers

Cited Papers

University students’ intention to use search engines for research purposes: A structural equation modeling approach
err2019-12-10
err0
PREAI
errKonstantinos Lavidas; Anthi Achriani; Stavros Athanassopoulos; Ioannis Messinis; Sotiris Kotsiantis
errShare
errSave
Sustainability and education 1
err2017-04-21
err0
PREAI
errGerd Michelsen; Daniel Fischer
errShare
errSave
Rheumatoid arthritis–associated DNA methylation sites in peripheral blood mononuclear cells
err2019-01-01
err0
PREAI
errHong Zhu; Long-Fei Wu; Xing-Bo Mo; Xin Lu; Hui Tang; Xiao-Wei Zhu; Wei Xia; Yu-Fan Guo; Ming-Jun Wang; Ke-Qin Zeng; Jian Wu; Ying-Hua Qiu; Xiang Lin; Yong-Hong Zhang; Yao-Zhong Liu; Neng-Jun Yi; Fei-Yan Deng; Shu-Feng Lei
errShare
errSave
Multilingual Denoising Pre-training for Neural Machine Translation
err2020-12-01
err649
errOAAI
errLiu, Yinhan; Gu, Jiatao; Goyal, Naman; Li, Xian; Edunov, Sergey; Ghazvininejad, Marjan; Lewis, Mike; Zettlemoyer, Luke
errShare
errSave
Influence of North-Easterly Monsoon on Carbonaceous Particles and Polycyclic Aromatic Hydrocarbons in PM2.5 in the City of Kuala Lumpur, Malaysia
err
IF0
err2021-01-18
err0
errOAAI
errHamidah Suradi; Md Firoz Khan; Nor Asrina Sairi; Haasyimah Ab Rahim; Sumiani Yusoff; Yusuke Fujii; Kai Qin; Md. Aynul Bari; Murnira Othman; Mohd Talib Latif
errShare
errSave
Mimicking Infants' Bilingual Language Acquisition for Domain Specialized Neural Machine Translation
err2022-01-01
err4
errOAAI
errPark, Chanjun; Go, Woo-Young; Eo, Sugyeong; Moon, Hyeonseok; Lee, Seolhwa; Lim, Heuiseok
errShare
errSave
no more