.png){kind=icon}
Return
DeeP-Mod: Deep Dynamic Programming Based Environment Modelling Using Feature Extraction
.png){kind=icon}
PRE
AI
DOI：10.1007/978-981-95-1233-1_3.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The DeeP-Mod framework builds an environment model using features from a Deep Dynamic Programming Network (DDPN), trained via a Deep Q-Network (DQN). While Deep Q-Learning is effective in decision-making, state information is lost in deeper DQN layers due to mixed state-action representations. We address this by using Dynamic Programming (DP) to train a DDPN, where value iteration ensures the output represents state values, not state-action pairs. Extracting features from the DDPN preserves state information, enabling task and action set independence. We show that a reduced DDPN can be trained using features extracted from the original DDPN trained on an identical problem. This reduced DDPN achieves faster convergence under noise and outperforms the original DDPN. Finally, we introduce the DeeP-Mod framework, which creates an environment model using the evolution of features extracted from a DDPN in response to actions. A second DDPN, which learns directly from this feature model rather than raw states, can learn an effective feature-value representation and thus optimal policy. A key advantage of DeeP-Mod is that an externally defined environment model is not needed at any stage, making DDPN applicable to a wide range of environments.
Keywords:
Deep dynamic programming network
Neural network
Dynamic programming
Feature extraction
Feature-based model
Environmental modelling
Deep Q-Learning
Journal
A
IF:
0
Papers:
37
Citations:
0
Organization
No organization information available
Cited Papers
.png){kind=icon}
ShareSaveShareSaveShareSave