Prompting Large Language Models for Automatic Question Tagging

Nuojia Xu

doi:10.1007/s11633-024-1509-1

Prompting Large Language Models for Automatic Question Tagging

2025-01-16

0

PRE

AI

钱胜胜 (Shengsheng Qian) *

DOI：10.1007/s11633-024-1509-1

Original

Original request for help

Save

Abstract

En 中文

Automatic question tagging (AQT) represents a crucial task in community question answering (CQA) websites. Its pivotal role lies in substantially augmenting user experience through the optimization of question-answering efficiency. Existing question tagging models focus on the features of questions and tags, ignoring the external knowledge of the real world. Large language models can work as knowledge engines for incorporating real-world facts for different tasks. However, it is difficult for large language models to output tags in the database of CQA websites. To address this challenge, we propose a large language model enhanced question tagging method called LLMEQT to perform the question tagging task. In LLMEQT, a traditional question tagging method is first applied to pre-retrieve tags for questions. Then prompts are formulated for LLMs to comprehend the task and select more suitable tags from the candidate tags for questions. Results of our experiments on two real-world datasets demonstrate that LLMEQT significantly enhances the automatic question tagging performance for CQA, surpassing the performance of state-of-the-art methods.

Keywords:

Community question answering

machine learning

large language model

prompt learning

question tagging

Prompting Large Language Models for Automatic Question Tagging

Abstract

Journal

Organization