arrow
返回

Building a Coding Assistant via the Retrieval-Augmented Language Model

delete2025-01-17
delete1
PRE
AI
X
Xinze Li *
H
Hanbin Wang
Z
Zhenghao Liu
S
Shi Yu
S
Shuo Wang
Y
Yukun Yan
Y
Yu-Kai Fu
Y
Yu Gu
G
Ge Yu
DOI:10.1145/3695868delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Pretrained language models have shown strong effectiveness in code-related tasks, such as code retrieval, code generation, code summarization, and code completion tasks. In this article, we propose COde assistaNt viA retrieval-augmeNted language model (CONAN), which aims to build a code assistant by mimicking the knowledge-seeking behaviors of humans during coding. Specifically, it consists of a code structure- aware retriever (CONAN-R) and a dual-view code representation-based retrieval-augmented generation model (CONAN-G). CONAN-R pretrains CodeT5 using Code-Documentation Alignment and Masked Entity Prediction tasks to make language models code structure-aware and learn effective representations for code snippets and documentation. Then CONAN-G designs a dual-view code representation mechanism for implementing a retrieval-augmented code generation model. CONAN-G regards the code documentation

期刊

ACM Transactions on Information Systems 封面图
ACM Transactions on Information Systems
IF:
9.1
论文数:
1.2K
被引数:
4.7K

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
N
northeastern university - china
学者数:
3.1W
论文数: 2.7W
被引数: 37
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Human-sized anthropomorphic robot hand with detachable mechanism at the wrist
err2011-01-01
err0
PREAI
errYuichi Kurita; Yasuhiro Ono; Atsutoshi Ikeda; Tsukasa Ogasawara
err分享
err收藏
Osteoporotic Fractures After Kidney Transplantation肾移植后的骨质疏松性骨折
err2025-04-01
err0
PREAI
errTorres, Pablo Antonio Urena; Pimentel, Ana P. N.; Cohen-Solal, Martine
err分享
err收藏
Meta-analysis of bariatric surgery versus non-surgical treatment for type 2 diabetes mellitus
err2016-09-10
err0
errOAAI
errGuo-zhong Wu; Bing Cai; Feng Yu; Zheng Fang; Xing-li Fu; Hai-sen Zhou; Wen Zhang; Zhi-qiang Tian
err分享
err收藏
Sparse, Dense, and Attentional Representations for Text Retrieval
err2021-04-26
err135
errOAAI
errLuan, Yi; Eisenstein, Jacob; Toutanova, Kristina; Collins, Michael
err分享
err收藏
Acid catalysis in hydrolytic reactions水解反应中的酸催化
err1929-01-01
err0
PREAI
errJ. N. Brönsted; W. F. K. Wynne-Jones
err分享
err收藏
Morphological basis of glossy red plumage colours
err2016-05-14
err0
errOAAI
errJean-Pierre Iskandar; Chad M. Eliason; Tim Astrop; Branislav Igic; Rafael Maia; Matthew D. Shawkey
err分享
err收藏
Urinary Diversion: Adjunctive Tube Gastrostomy
err1976-01-01
err0
PREAI
errDavid L. Fromang; David M. Drylie
err分享
err收藏
学者 查看更多内容