arrow
Return

Tensor decomposition for multi-agent predictive state representation

delete2022-03-01
delete1
delete
OA
AI
B
Biyang Ma
B
Bilian Chen *
Y
Yifeng Zeng *
唐静 (Jing Tang)
L
Langcai Cao
DOI:10.1016/j.eswa.2021.115969delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Predictive state representation (PSR) uses a vector of action-observation sequence to represent the system dynamics and subsequently predicts the probability of future events. It is a concise knowledge representation that is well studied in a single-agent planning problem domain. To the best of our knowledge, there is no existing work on using PSR to solve multi-agent planning problems. Learning a multi-agent PSR model is quite difficult especially with the increasing number of agents, not to mention the complexity of a problem domain. In this paper, we resort to tensor techniques to tackle the challenging task of multi-agent PSR model development problems. By first focusing on a two-agent setting, we construct the system dynamics matrix as a high order tensor for a PSR model, learn the prediction parameters and deduce state vectors directly through two different tensor decomposition methods respectively, and derive the transition parameters via linear regression. Subsequently we generalize the PSR learning approaches in a multi-agent setting. Experimental results show that our methods can effectively solve multi-agent PSR modelling problems in multiple problem domains.
Keywords:
Predictive state representations
Tensor optimization
Learning approaches
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

N
newcastle university - uk
Scholars:
2.9W
Papers: 2.6W
Citations: 39
N
Northumbria University
Scholars:
5.6K
Papers: 6.8K
Citations: 9.5K
X
xiamen university
Scholars:
5.8W
Papers: 3.8W
Citations: 67
researcher View more organizations