A mutual embedded self-attention network model for code search?

doi:10.1016/j.jss.2022.111591

A mutual embedded self-attention network model for code search?

2023-04-01

4

PRE

AI

DOI：10.1016/j.jss.2022.111591

Original

Original request for help

Save

Abstract

En 中文

To improve the efficiency of program implementation, developers can selectively reuse the previously written code by searching the open-source codebase. To date, many code search methods have been proposed to actively push the limit of code search accuracy, where the methods designed using SelfAttention mechanism are particularly promising. However, while existing methods can improve the efficiency to capture textual semantics by attending significant words in the code component unit, they typically fail to capture the structural dependencies between the code components which may produce suboptimal search accuracy. In this paper, we propose a novel Self-Attention model termed MESN-CS which considers both word-level attention and code unit-level attention for code search. MESN-CS not only the attention weight of each word in the code component unit is calculated, but also the weight of the embedding between the code combination units is calculated. To verify the effectiveness of the proposed model, three benchmark models were compared on a large-scale code data and CodesearchNet. The experimental results show that the MESN-CS has better Recall@k, NDCG and MRR performance than baseline methods. the experiments also show that the semantic syntactic information between sequences can be effectively characterized in MESN-CS. (c) 2022 Elsevier Inc. All rights reserved.

Keywords:

Code search

Code segments

Machine learning

Self-attention

MESN-CS

A mutual embedded self-attention network model for code search?

Abstract

Journal

Organization