arrow
返回

Multimodal AutoML via Representation Evolution

delete2022-12-23
delete1
delete
OA
AI
B
Blaž Škrlj
M
Matej Bevec
N
Nada Lavrač *
DOI:10.3390/make5010001delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the increasing amounts of available data, learning simultaneously from different types of inputs is becoming necessary to obtain robust and well-performing models. With the advent of representation learning in recent years, lower-dimensional vector-based representations have become available for both images and texts, while automating simultaneous learning from multiple modalities remains a challenging problem. This paper presents an AutoML (automated machine learning) approach to automated machine learning model configuration identification for data composed of two modalities: texts and images. The approach is based on the idea of representation evolution, the process of automatically amplifying heterogeneous representations across several modalities, optimized jointly with a collection of fast, well-regularized linear models. The proposed approach is benchmarked against 11 unimodal and multimodal (texts and images) approaches on four real-life benchmark datasets from different domains. It achieves competitive performance with minimal human effort and low computing requirements, enabling learning from multiple modalities in automated manner for a wider community of researchers.
Keyword:
AutoML
representation learning
evolution
multimodal learning

期刊

M
Machine Learning and Knowledge Extraction
IF:
6
论文数:
821
被引数:
1.8K

机构

S
slovenian academy of sciences & arts (sasa)
学者数:
5.3K
论文数: 5.5K
被引数: 5
引用论文

引用论文

The resource theory of stabilizer quantum computation
err2014-01-09
err0
errOAAI
errVictor Veitch; S A Hamed Mousavian; Daniel Gottesman; Joseph Emerson
err分享
err收藏
The 11q terminal deletion disorder: A prospective study of 110 cases11q末端缺失障碍: 110例前瞻性研究
err2004-07-15
err0
PREAI
errPaul D. Grossfeld; Teresa Mattina; Zona Lai; Remi Favier; Ken Lyons Jones; Finbarr Cotter; Christopher Jones
err分享
err收藏
Effect of the electrical double layer on voltammetry at microelectrodes
err2002-05-01
err0
PREAI
errJohn D. Norton; Henry S. White; Stephen W. Feldberg
err分享
err收藏
Identification of salinity-related genes in ENO2 mutant (eno2) of Arabidopsis thaliana
err2018-01-01
err0
errOAAI
errYong-hua ZHANG; Chao CHEN; Zi-han SHI; Hui-mei CHENG; Jie BING; Xiao-feng MA; Chao-xing ZHENG; Hong-jie LI; Gen-fa ZHANG
err分享
err收藏
学者 查看更多内容