EEGCiD: EEG Condensation Into Diffusion Model

Junfu Chen

doi:10.1109/TASE.2024.3486203

EEGCiD: EEG Condensation Into Diffusion Model

2024-01-01

0

PRE

AI

DOI：10.1109/TASE.2024.3486203

原文链接

原文求助

摘要

En 中文

Electroencephalography (EEG)-based applications in Brain-Computer Interfaces (BCIs), neurological disease diagnosis, rehabilitation, and other areas rely on the utilization of extensive data for model development. Nevertheless, this raises concerns regarding storage and privacy, since model development needs a significant amount of data, and EEG sharing discloses sensitive information such as identity and health. To address this challenging problem, we provide the paradigm of EEG condensation, aiming to generate a synthetic sample set that is highly information-concentrated yet not visually similar. Correspondingly, we propose a novel dataset condensation framework where the knowledge of the original EEG dataset is condensed into diffusion models, named EEGCiD. Specifically, EEGCiD first utilizes a deterministic denoising diffusion implicit model (DDIM) to store the information of the original dataset and optimizes the condensation latent codes z to obtain the EEG condensation dataset. Further, to enhance the modeling of EEG knowledge in DDIM, we design a transformer architecture incorporating the spatial and temporal self-attention block (STSA) to replace the traditional U-Net backbone. In the condensation phase, EEGCiD randomly initializes a subset of samples from the original dataset to obtain the condensation latent codes z through the forward process in DDIM. Then, it optimizes z by matching the feature distributions in multiple EEG decoding models between the synthetic samples and the original dataset. Extensive experiments across three EEG datasets demonstrate that the condensation dataset from the proposed model not only achieves superior classification performance with limited sample sizes, but also effectively prevents membership inference attacks (MIA).

Keyword:

Electroencephalography

Brain modeling

Diffusion models

Data models

Data privacy

Training

Protection

Decoding

Codes

Transformers

EEG

denoising diffusion model

dataset condensation

privacy protection

EEGCiD: EEG Condensation Into Diffusion Model

摘要

期刊

机构

引用论文