arrow
Return

Algorithmic trading using combinational rule vector and deep reinforcement learning

delete2023-11-01
delete5
PRE
AI
Z
Zhen Huang
N
Ning Li
W
Wenyong Gong *
DOI:10.1016/j.asoc.2023.110802delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Algorithmic trading rules are widely used in financial markets as technical analysis tools for security trading. However, traditional trading rules are not sufficient to make a trading decision. In this paper, we propose a new algorithmic trading method called CR-DQN, which incorporates deep Q-learning with two popular trading rules: moving average (MA) and trading range break-out (TRB). The input of deep Q-learning is combinational rule vectors, whose component is a linear combination of 140 rules produced by MA and TRB with different parameters. Due to non-stationary characteristics, we devise a reward driven combination weight updating scheme to generate combinational rule vectors, which can capture intrinsic features of financial data. Since the sparse reward exists in CR-DQN, we design a piecewise reward function which shows great potential in the experiments. Taking combinational rule vectors as input, the LSTM based Deep Q-learning network is used to learn an optimal algorithmic trading strategy. We apply our model to both Chinese and non-Chinese stock markets, and CR-DQN exhibits the best performance on a variety of evaluation criteria compared to many other approaches, demonstrating the effectiveness of the proposed method.(c) 2023 Elsevier B.V. All rights reserved.
Keywords:
Algorithmic trading
Combinational rule vectors
Deep reinforcement learning

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

J
jinan university
Scholars:
4.3W
Papers: 2.7W
Citations: 38
Cited Papers

Cited Papers

errShare
errSave
Electrophysiological Correlates of Infant Recognition Memory
err1986-12-01
err0
PREAI
errCharles A. Nelson; Philip Salapatek
errShare
errSave
Securing Hardware Accelerators: A New Challenge for High-Level Synthesis
err2018-09-01
err0
errOAAI
errChristian Pilato; Siddharth Garg; Kaijie Wu; Ramesh Karri; Francesco Regazzoni
errShare
errSave
errShare
errSave
Biomonitoring of the environmental genotoxic potential of emissions from a complex of ceramic industries in Monte Carmelo, Minas Gerais, Brazil, usingTradescantia pallida
err2016-01-28
err0
PREAI
errCarlos Fernando Campos; Edimar Olegário de Campos Júnior; Henrique Nazareth Souto; Eduardo de Freitas Sousa; Boscolli Barbosa Pereira
errShare
errSave
researcher View more