arrow
Return

A Fuzzy Training Framework for Controllable Sequence-to-Sequence Generation

delete2022-01-01
delete1
delete
OA
AI
J
Jiajia Li
王平 cover
王平 (Ping Wang)
Z
Zuchao Li *
X
Xi Liu
M
Masao Utiyama
E
Eiichiro Sumita
H
Hai Zhao
艾浩军 cover
艾浩军 (Haojun Ai)
DOI:10.1109/ACCESS.2022.3202010delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The generation of music lyrics by artificial intelligence (AI) is frequently modeled as a language-targeted sequence-to-sequence generation task. Formally, if we convert the melody into a word sequence, we can consider the lyrics generation task to be a machine translation task. Traditional machine translation tasks involve translating between cross-lingual word sequences, whereas music lyrics generation tasks involve translating between music and natural language word sequences. The theme or key words of the generated lyrics are usually limited to meet the needs of the users when they are generated. This requirement can be thought of as a restricted translation problem. In this paper, we propose a fuzzy training framework that allows a model to simultaneously support both unrestricted and restricted translation by adopting an additional auxiliary training process without constraining the decoding process. This maintains the benefits of restricted translation but greatly reduces the extra time overhead of constrained decoding, thus improving its practicality. The experimental results show that our framework is well suited to the Chinese lyrics generation and restricted machine translation tasks, and that it can also generate language sequence under the condition of given restricted words without training multiple models, thereby achieving the goal of green AI.
Keywords:
Artificial intelligence
Decoding
Machine translation
Training data
Music
Natural languages
Computational modeling
Time factors
Fuzzy systems
Task analysis
Music lyrics generation
controllable generation
music understanding
constrained decoding
fuzzy training

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

H
Hankou University
Scholars:
27
Papers: 25
Citations: 278
S
shanghai jiao tong university
Scholars:
15.5W
Papers: 11.6W
Citations: 159
Wuhan Conservatory of Music cover
Wuhan Conservatory of Music
Scholars:
4
Papers: 4
Citations: 1
W
wuhan university
Scholars:
8.0W
Papers: 5.8W
Citations: 70
researcher View more organizations