Empirical evaluation methods for multiobjective reinforcement learning algorithms

doi:10.1007/s10994-010-5232-5

Empirical evaluation methods for multiobjective reinforcement learning algorithms

2010-12-22

162

OA

AI

DOI：10.1007/s10994-010-5232-5

Original

Original request for help

Save

Abstract

En 中文

While a number of algorithms for multiobjective reinforcement learning have been proposed, and a small number of applications developed, there has been very little rigorous empirical evaluation of the performance and limitations of these algorithms. This paper proposes standard methods for such empirical evaluation, to act as a foundation for future comparative studies. Two classes of multiobjective reinforcement learning algorithms are identified, and appropriate evaluation metrics and methodologies are proposed for each class. A suite of benchmark problems with known Pareto fronts is described, and future extensions and implementations of this benchmark suite are discussed. The utility of the proposed evaluation methods are demonstrated via an empirical comparison of two example learning algorithms.

Keywords:

Multiobjective reinforcement learning

Multiple objectives

Empirical methods

Pareto fronts

Pareto optimal policies

Empirical evaluation methods for multiobjective reinforcement learning algorithms

Abstract

Journal

Organization