Data Discovery Using LLMs - A Study of Data User Behaviour

doi:10.1007/978-3-032-05409-8_3

Data Discovery Using LLMs - A Study of Data User Behaviour

2026-01-01

0

PRE

AI

C

Christin Katharina Kreutz *

DOI：10.1007/978-3-032-05409-8_3

Original

Original request for help

Save

Abstract

En 中文

Data search for scientific research is more complex than a simple web search. The emergence of large language models (LLMs) and their applicability for scientific tasks offers new opportunities for researchers who are looking for data, e.g., to freely express their data needs instead of fitting them into restrictions of data catalogues and portals. However, this also creates uncertainty about whether LLMs are suitable for this task.To answer this question, we conducted a user study with 32 researchers. We qualitatively and quantitatively analysed participants' information interaction behaviour while searching for data using LLMs in two data search tasks, one in which we prompted the LLM to behave as a persona. We found that participants interact with LLMs in natural language, but LLMs remain a tool for them rather than an equal conversational partner. This changes slightly when the LLM is prompted to behave as a persona, but the prompting only affects participants' user experience when they are already experienced in LLM use.

Keywords:

User study

Information interaction

Data discovery

Large Language Models

Data Discovery Using LLMs - A Study of Data User Behaviour

Abstract

Journal

Organization