.png){kind=icon}
.png){kind=icon}
Return
Dual memory model for experience-once task-incremental lifelong learning✩
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2023.07.009.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Experience replay (ER) is a widely-adopted neuroscience-inspired method to perform lifelong learning. Nonetheless, existing ER-based approaches consider very coarse memory modules with simple memory and rehearsal mechanisms that cannot fully exploit the potential of memory replay. Evidence from neuroscience has provided fine-grained memory and rehearsal mechanisms, such as the dual-store memory system consisting of PFC-HC circuits. However, the computational abstraction of these processes is still very challenging. To address these problems, we introduce the Dual-Memory (DuAL-MEM) model emulating the memorization, consolidation, and rehearsal process in the PFC-HC dual-store memory circuit. DuAL-MEM maintains an incrementally updated short-term memory to benefit current-task learning. At the end of the current task, short-term memories will be consolidated into long-term ones for future rehearsal to alleviate forgetting. For the DuAL-MEM optimization, we propose two learning policies that emulate different memory retrieval strategies: Direct Retrieval Learning and Mixup Retrieval Learning. Extensive evaluations on eight benchmarks demonstrate that DuAL-MEM delivers compelling performance while maintaining high learning and memory utilization efficiencies under the challenging experience-once setting.& COPY; 2023 Elsevier Ltd. All rights reserved.
Keywords:
Experience-once lifelong learning
Task-incremental lifelong learning
Continual learning
Catastrophic forgetting
Dual-store memory model