arrow
Return

KADEL: Knowledge-Aware Denoising Learning for Commit Message Generation

delete2024-06-04
delete2
delete
OA
AI
W
Wei Tao
Y
Yucheng Zhou
Y
Yanlin Wang *
张
张宏玉 (Hongyu Zhang)
H
Haofen Wang
W
Wenqiang Zhang *
DOI:10.1145/3643675delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Commit messages are natural language descriptions of code changes, which are important for software evolution such as code understanding and maintenance. However, previous methods are trained on the entire dataset without considering the fact that a portion of commit messages adhere to good practice (i.e., good-practice commits), while the rest do not. On the basis of our empirical study, we discover that training on good-practice commits significantly contributes to the commit message generation. Motivated by this finding, we propose a novel knowledge-aware denoising learning method called KADEL. Considering that goodpractice commits constitute only a small proportion of the dataset, we align the remaining training samples with these good-practice commits. To achieve this, we propose a model that learns the commit knowledge by training on good-practice commits. This knowledge model enables supplementing more information for training samples that do not conform to good practice. However, since the supplementary information may contain noise or prediction errors, we propose a dynamic denoising training method. This method composes a distribution-aware confidence function and a dynamic distribution list, which enhances the effectiveness of the training process. Experimental results on the whole MCMD dataset demonstrate that our method overall achieves state-of-the-art performance compared with previous methods.
Keywords:
Commit message generation
knowledge introducing
denoising training

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

F
fudan university
Scholars:
11.8W
Papers: 7.7W
Citations: 121
C
Chongqing University
Scholars:
5.1W
Papers: 4.1W
Citations: 6.0W
S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
T
tongji university
Scholars:
7.9W
Papers: 6.0W
Citations: 98
U
University of Macau
Scholars:
1.1W
Papers: 1.3W
Citations: 2.0W
researcher View more organizations
Cited Papers

Cited Papers

SCALING WITH KNOWN UNCERTAINTY: A SYNTHESIS
err2006-01-01
err0
PREAI
errJIANGUO WU; HARBIN LI; K. BRUCE JONES; ORIE L. LOUCKS
errShare
errSave
Experimental carinal autotransplantation and allotransplantation
err1995-09-01
err0
errOAAI
errToshirou Takachi; Takayuki Shirakusa; Takeshi Shiraishi; Kan Okabayashi; Koji Inutsuka; Katsunobu Kawahara; Ryoichi Nakanishi
errShare
errSave
HTK versus UW Solution for Myocardial Protection during Moderate Hypothermia
err1997-01-01
err0
PREAI
errI.M. Kober; R.P. Obermayr; N. Ehsani; B. Schneider; P.G. Spieckermann
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Coherence Preservation of a Single Neutral Atom Qubit Transferred between Magic-Intensity Optical Traps
err2016-09-14
err0
errOAAI
errJiaheng Yang; Xiaodong He; Ruijun Guo; Peng Xu; Kunpeng Wang; Cheng Sheng; Min Liu; Jin Wang; Andrei Derevianko; Mingsheng Zhan
errShare
errSave
CoreGen: Contextualized Code Representation Learning for Commit Message Generation
err2021-10-01
err25
errOAAI
errNie, Lun Yiu; Gao, Cuiyun; Zhong, Zhicong; Lam, Wai; Liu, Yang; Xu, Zenglin
errShare
errSave
Chromatin Accessibility Profiling Reveals Cis-Regulatory Heterogeneity and Novel Transcription Factor Dependencies in Multiple Myeloma
err2018-11-29
err0
errOAAI
errChristopher J. Ott; Raphael Szalat; Matthew Lawlor; Mehmet Kemal Samur; Yan Xu; Charles B Epstein; Charles Y Lin; Rao Prabhala; Nina Farrell; Lauren D Walter; Logan Schwartz; Kenneth Wen; Yu-Tzu Tai; Mariateresa Fulciniti; Jinhua Wang; Nathanael Gray; Kenneth Anderson; Richard A. Young; Nikhil Munshi
errShare
errSave
researcher View more