Human-Centered LLM-Agent User Interface: A Position Paper

Daniel Chin

doi:10.1007/978-3-031-97254-6_18

2026-01-01

PRE

Daniel Chin *

Yu‐Xuan Wang

Gus Xia

DOI：10.1007/978-3-031-97254-6_18

原文链接

原文求助

摘要

En 中文

大型语言模型（LLM）-in-the-loop应用已被证明能够有效解释人类用户的指令，制定计划，并相应地操作外部工具/系统。然而，LLM代理的操作范围仅限于被动跟随用户，需要用户根据底层工具/系统来表述其需求。我们注意到LLM-Agent用户界面（LAUI）的潜力要大得多。一个对底层工具/系统几乎不了解的用户应该能够通过LAUI来发现一种新兴的工作流程。与设计可探索的图形用户界面（GUI）来教导用户预定义的系统使用方式的传统方法不同，在理想的LAUI中，LLM代理被初始化为精通该系统，主动研究用户及其需求，并向用户提出新的交互方案。为了说明LAUI，我们介绍了Flute X GPT，一个具体的例子，它使用LLM代理、提示管理器和长笛教学多模态软硬件系统，以促进学习吹奏长笛的复杂、实时用户体验。

Keyword:

llm agent

user interface

LLM-in-the-loop

human-computer interaction

期刊

ARTSIT, INTERACTIVITY AND GAME CREATION, ARTSIT 2024, PT I

IF:

论文数:

被引数:

机构

new york university

学者数:

6.2K

论文数: 3.0K

被引数: 1

NYU Shanghai

学者数:

502

论文数: 578

被引数: 11

引用论文

Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech

ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

IF0

2021-06-06

OAAI

Chung-Ming Chien; Jheng-Hao Lin; Chien-yu Huang; Po-chun Hsu; Hung-yi Lee

IF0

PREAI

IF0

PREAI

IF0

PREAI

GPT-4 Technical Report GPT-4技术报告

IF0

2023-03-15

OAAI

OpenAI; Josh Achiam; Steven Adler; Sandhini Agarwal; Lama Ahmad; Ilge Akkaya; Florencia Leoni Aleman; Diogo Almeida; Janko Altenschmidt; Sam Altman; Shyamal Anadkat; Red Avila; Igor Babuschkin; Suchir Balaji; Valerie Balcom; Paul Baltescu; Haiming Bao; Mohammad Bavarian; Jeff Belgum; Irwan Bello; Jake Berdine; Gabriel Bernadett-Shapiro; Christopher Berner; Lenny Bogdonoff; Oleg Boiko; Madelaine Boyd; Anna-Luisa Brakman; Greg Brockman; Tim Brooks; Miles Brundage; Kevin Button; Trevor Cai; Rosie Campbell; Andrew Cann; Brittany Carey; Chelsea Carlson; Rory Carmichael; Brooke Chan; Che Chang; Fotis Chantzis; Derek Chen; Sully Chen; Ruby Chen; Jason Chen; Mark Chen; Ben Chess; Chester Cho; Casey Chu; Hyung Won Chung; Dave Cummings; Jeremiah Currier; Yunxing Dai; Cory Decareaux; Thomas Degry; Noah Deutsch; Damien Deville; Arka Dhar; David Dohan; Steve Dowling; Sheila Dunning; Adrien Ecoffet; Atty Eleti; Tyna Eloundou; David Farhi; Liam Fedus; Niko Felix; Simón Posada Fishman; Juston Forte; Isabella Fulford; Leo Gao; Elie Georges; Christian Gibson; Vik Goel; Tarun Gogineni; Gabriel Goh; Rapha Gontijo-Lopes; Jonathan Gordon; Morgan Grafstein; Scott Gray; Ryan Greene; Joshua Gross; Shixiang Shane Gu; Yufei Guo; Chris Hallacy; Jesse Han; Jeff Harris; Yuchen He; Mike Heaton; Johannes Heidecke; Chris Hesse; Alan Hickey; Wade Hickey; Peter Hoeschele; Brandon Houghton; Kenny Hsu; Shengli Hu; Xin Hu; Joost Huizinga; Shantanu Jain; Shawn Jain ; Joanne Jang; Angela Jiang; Roger Jiang; Haozhun Jin; Denny Jin; Shino Jomoto; Billie Jonn; Heewoo Jun; Tomer Kaftan; Łukasz Kaiser; Ali Kamali; Ingmar Kanitscheider; Nitish Shirish Keskar; Tabarak Khan; Logan Kilpatrick; Jong Wook Kim; Christina Kim; Yongjik Kim; Jan Hendrik Kirchner; Jamie Kiros; Matt Knight; Daniel Kokotajlo; Łukasz Kondraciuk; Andrew Kondrich; Aris Konstantinidis; Kyle Kosic; Gretchen Krueger; Vishal Kuo; Michael Lampe; Ikai Lan; Teddy Lee; Jan Leike; Jade Leung; Daniel Levy; Chak Ming Li; Rachel Lim; Molly Lin; Stephanie Lin; Mateusz Litwin; Theresa Lopez; Ryan Lowe; Patricia Lue; Anna Makanju; Kim Malfacini; Sam Manning; Todor Markov; Yaniv Markovski; Bianca Martin; Katie Mayer; Andrew Mayne; Bob McGrew; Scott Mayer McKinney; Christine McLeavey; Paul McMillan; Jake McNeil; David Medina; Aalok Mehta; Jacob Menick; Luke Metz; Andrey Mishchenko; Pamela Mishkin; Vinnie Monaco; Evan Morikawa; Daniel Mossing; Tong Mu; Mira Murati; Oleg Murk; David Mély; Ashvin Nair; Reiichiro Nakano; Rajeev Nayak; Arvind Neelakantan; Richard Ngo; Hyeonwoo Noh; Long Ouyang; Cullen O'Keefe; Jakub Pachocki; Alex Paino; Joe Palermo; Ashley Pantuliano; Giambattista Parascandolo; Joel Parish; Emy Parparita; Alex Passos; Mikhail Pavlov; Andrew Peng; Adam Perelman; Filipe de Avila Belbute Peres; Michael Petrov; Henrique Ponde de Oliveira Pinto; Michael (Rai)Pokorny; Michelle Pokrass; Vitchyr H. Pong; Tolly Powell; Alethea Power; Boris Power; Elizabeth Proehl; Raul Puri; Alec Radford; Jack Rae; Aditya Ramesh; Cameron Raymond; Francis Real; Kendra Rimbach; Carl Ross; Bob Rotsted; Henri Roussez; Nick Ryder; Mario Saltarelli; Ted Sanders; Shibani Santurkar; Girish Sastry; Heather Schmidt; David Schnurr; John Schulman; Daniel Selsam; Kyla Sheppard; Toki Sherbakov; Jessica Shieh; Sarah Shoker; Pranav Shyam; Szymon Sidor; Eric Sigler; Maddie Simens; Jordan Sitkin; Katarina Slama; Ian Sohl; Benjamin Sokolowsky; Yang Song; Natalie Staudacher; Felipe Petroski Such; Natalie Summers; Ilya Sutskever; Jie Tang; Nikolas Tezak; Madeleine B. Thompson; Phil Tillet; Amin Tootoonchian; Elizabeth Tseng; Preston Tuggle; Nick Turley; Jerry Tworek; Juan Felipe Cerón Uribe; Andrea Vallone; Arun Vijayvergiya; Chelsea Voss; Carroll Wainwright; Justin Jay Wang; Alvin Wang; Ben Wang; Jonathan Ward; Jason Wei; CJ Weinmann; Akila Welihinda; Peter Welinder; Jiayi Weng; Lilian Weng; Matt Wiethoff; Dave Willner; Clemens Winter; Samuel Wolrich; Hannah Wong; Lauren Workman; Sherwin Wu; Jeff Wu; Michael Wu; Kai Xiao; Tao Xu; Sarah Yoo; Kevin Yu; Qiming Yuan; Wojciech Zaremba; Rowan Zellers; Chong Zhang; Marvin Zhang; Shengjia Zhao; Tianhao Zheng; Juntang Zhuang; William Zhuk; Barret Zoph

IF0

PREAI

IF0

PREAI

IF0

PREAI

IF0

PREAI

IF0

OAAI

查看更多内容