.png){kind=icon}
返回
Cross-Subject EEG Feedback for Implicit Image Generation
.png){kind=icon}
OA
AI
DOI：10.1109/TCYB.2024.3406159.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Generative models are powerful tools for producing novel information by learning from example data. However, the current approaches require explicit manual input to steer generative models to match human goals. Furthermore, how these models would integrate implicit, diverse feedback and goals of multiple users remains largely unexplored. Here, we present a first-of-its-kind system that produces novel images of faces by inferring human goals directly from cross-subject brain signals while study subjects are looking at example images. We report on an experiment where brain responses to images of faces were recorded using electroencephalography in 30 subjects, focusing on specific salient visual features (VFs). Preferences toward VFs were decoded from subjects' brain responses and used as implicit feedback for a generative adversarial network (GAN), which generated new images of faces. The results from a follow-up user study evaluating the presence of the target salient VFs show that the images generated from brain feedback represent the goal of the study subjects and are comparable to images generated with manual feedback. The methodology provides a stepping stone toward humans-in-the-loop image generation.
Keyword:
Brain modeling
Electroencephalography
Visualization
Faces
Task analysis
Image synthesis
Manuals
Brain-computer interfaces
electroencephalography (EEG)
generative models
image generation
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
ARVino - outdoor augmented reality visualisation of viticulture GIS dataARVino-葡萄栽培GIS数据的户外增强现实可视化
OAAI
OAAI分享收藏Heterogeneous Heck reaction catalysed by silica gel-supported 1,2-diaminocyclohexane–Pd complex
PREAI
分享收藏分享收藏The effect of the morpholinium ionic liquid anion on the catalytic activity of Rh (or Pt) complex–ionic liquid systems in hydrosilylation processes.png)
RSC AdvancesOAAI
RSC AdvancesIF0
OAAI分享收藏
查看更多内容