arrow
Return

Tool Learning with Foundation Models

delete2024-12-24
delete0
delete
OA
AI
Y
Yujia Qin
S
Shengding Hu
Y
Yankai Lin
W
Weize Chen
N
Ning Ding
G
Ganqu Cui
Z
Zheni Zeng
X
Xuanhe Zhou
Y
Yufei Huang
C
Chaojun Xiao
C
Chi Han
Y
Yi R. Fung
Y
Yusheng Su
H
Huadong Wang
C
Cheng Qian
R
Runchu Tian
K
Kunlun Zhu
S
Shihao Liang
X
Xingyu Shen
B
Bokai Xu
Y
Yining Ye
B
Bowen Li
Z
Ziwei Tang
J
Jing Yi
Y
Yuzhang Zhu
Z
Zhenning Dai
Y
Yan Lan
X
Xin Cong
Y
Yaxi Lu
W
Weilin Zhao
Y
Yuxiang Huang
J
Junxi Yan
X
Xu Han
X
Xian Sun
D
Dahai Li
J
Jason Phang
C
Cheng Yang
T
Tongshuang Wu
H
Heng Ji
G
Guoliang Li
Zhiyuan Liu cover
Zhiyuan Liu (Zhiyuan Liu)
S
Sun, MS
DOI:10.1145/3704435delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Humans possess an extraordinary ability to create and utilize tools. With the advent of foundation models, artificial intelligence systems have the potential to be equally adept in tool use as humans. This paradigm, which is dubbed as tool learning with foundation models, combines the strengths of tools and foundation models to achieve enhanced accuracy, efficiency, and automation in problem-solving. This article presents a systematic investigation and comprehensive review of tool learning. We first introduce the background of tool learning, including its cognitive origins, the paradigm shift of foundation models, and the complementary roles of tools and models. Then we recapitulate existing tool learning research and formulate a general framework: starting from understanding the user instruction, models should learn to decompose a complex task into several subtasks, dynamically adjust their plan through reasoning, and effectively conquer each sub- task by selecting appropriate tools. We also discuss how to train models for improved tool-use capabilities and facilitate generalization in tool learning. Finally, we discuss several open problems that require further investigation, such as ensuring trustworthy tool use, enabling tool creation with foundation models, and addressing personalization challenges. Overall, we hope this article could inspire future research in integrating tools with foundation models.
Keywords:
Tool use
foundation models
literature survey

Journal

ACM Computing Surveys cover
ACM Computing Surveys
IF:
28
Papers:
2.5K
Citations:
3.5W

Organization

B
Beijing Univ Posts and Telecommun
Scholars:
719
Papers: 311
Citations: 55
O
OpenBMB Inc
Scholars:
2
Papers: 1
Citations: 1
U
Univ Illinois
Scholars:
3.2K
Papers: 2.2K
Citations: 419
Z
Zhihu Inc
Scholars:
2
Papers: 1
Citations: 1
R
Renmin Univ China
Scholars:
637
Papers: 392
Citations: 126
researcher View more organizations
Cited Papers

Cited Papers

Evidence of synergy between Thy-1 and CD3/TCR complex in signal delivery to murine thymocytes for cell death.
err1991-08-15
err0
errOAAI
errI Nakashima; Y H Zhang; S M Rahman; T Yoshida; K Isobe; L N Ding; T Iwamoto; M Hamaguchi; H Ikezawa; R Taguchi
errShare
errSave
errShare
errSave
errShare
errSave
S1-Leitlinie Post-COVID/Long-COVID
err2021-09-02
err0
errOAAI
errAndreas Rembert Koczulla; Tobias Ankermann; Uta Behrends; Peter Berlit; Sebastian Böing; Folke Brinkmann; Christian Franke; Rainer Glöckl; Christian Gogoll; Thomas Hummel; Juliane Kronsbein; Thomas Maibaum; Eva M. J. Peters; Michael Pfeifer; Thomas Platz; Matthias Pletz; Georg Pongratz; Frank Powitz; Klaus F. Rabe; Carmen Scheibenbogen; Andreas Stallmach; Michael Stegbauer; Hans Otto Wagner; Christiane Waller; Hubert Wirtz; Andreas Zeiher; Ralf Harun Zwick
errShare
errSave
A mobile robotic chemist
errNATURE
IF48.5
err2020-07-08
err766
PREAI
errBurger, Benjamin; Maffettone, Phillip M.; Gusev, Vladimir V.; Aitchison, Catherine M.; Bai, Yang; Wang, Xiaoyan; Li, Xiaobo; Alston, Ben M.; Li, Buyi; Clowes, Rob; Rankin, Nicola; Harris, Brandon; Sprick, Reiner Sebastian; Cooper, Andrew I.
errShare
errSave
errShare
errSave
researcher View more