arrow
Return

Machine Intelligence on the Edge: Interpretable Cardiac Pattern Localization Using Reinforcement Learning

delete2026-09-17
delete0
delete
OA
AI
H
Haozhe Tian *
N
Nina Moutonnet
P
Pietro Ferraro
D
Danilo P. Mandic
DOI:10.1007/s11633-026-1661-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Matched filters are widely used to localize signal patterns due to their high efficiency and interpretability. However, their effectiveness deteriorates for low signal-to-noise ratio (SNR) signals, such as those recorded on edge devices, where prominent noise patterns can closely resemble the target within the limited length of the filter. One example is the ear-electrocardiogram (ear-ECG), where the cardiac signal is attenuated and heavily corrupted by artifacts. To address this, we propose the sequential matched filter (SMF), a paradigm that replaces the conventional single matched filter with a sequence of filters designed by a reinforcement learning agent. By formulating filter design as a sequential decision-making process, SMF adaptively designs signal-specific filter sequences that remain fully interpretable by revealing key patterns driving the decision-making process. The proposed SMF framework has strong potential for reliable and interpretable clinical decision support, as demonstrated by its state-of-the-art R-peak detection and physiological state classification performance on three challenging real-world ECG datasets. The proposed formulation can also be extended to a broad range of applications that require accurate pattern localization from noise-corrupted signals.
Keywords:
Reinforcement learning
filter design
matched filter
ECG R-peak detection
wearable sensors

Journal

Machine Intelligence Research cover
Machine Intelligence Research
IF:
8.7
Papers:
303
Citations:
882

Organization

D
Dyson School of Design Engineering
Scholars:
21
Papers: 10
Citations: 0
Cited Papers

Cited Papers

Pathophysiology of coronary artery disease
err2005-06-28
err1.5K
errOAAI
errLibby, P; Theroux, P
errShare
errSave
Heart Rate Variability: Measurement and Clinical Utility
err2005-01-13
err0
errOAAI
errRobert E. Kleiger; Phyllis K. Stein; J. Thomas Bigger
errShare
errSave
The Deep-Match Framework: R-Peak Detection in Ear-ECG
err
IF0
err2024-07-01
err0
PREAI
errHarry J. Davies; Ghena Hammour; Marek Zylinski; Amir Nassibi; Ljubiša Stanković; Danilo P. Mandic
errShare
errSave
Earable Multimodal Sensing and Stimulation: A Prospective Toward Unobtrusive Closed-Loop Biofeedback
err2025-01-01
err0
PREAI
errYuchen Xu; Abhinav Uppal; Min Suk Lee; Kuldeep Mahato; Brian L. Wuerstle; Muyang Lin; Omeed Djassemi; Tao Chen; Rui Lin; Akshay Paul; Soumil Jain; Florian Chapotot; Esra Tasali; Patrick Mercier; Sheng Xu; Joseph Wang; Gert Cauwenberghs
errShare
errSave
errShare
errSave
errShare
errSave
errShare
errSave
Human-level control through deep reinforcement learning
err2015-02-25
err0
PREAI
errVolodymyr Mnih; Koray Kavukcuoglu; David Silver; Andrei A. Rusu; Joel Veness; Marc G. Bellemare; Alex Graves; Martin Riedmiller; Andreas K. Fidjeland; Georg Ostrovski; Stig Petersen; Charles Beattie; Amir Sadik; Ioannis Antonoglou; Helen King; Dharshan Kumaran; Daan Wierstra; Shane Legg; Demis Hassabis
errShare
errSave
researcher View more