arrow
Return

Domain Generalization with Small Data

delete2024-03-06
delete0
delete
OA
AI
K
Kecheng Chen
E
Elena Gal
Hong Yan cover
Hong Yan (Hong Yan)
H
Haoliang Li *
DOI:10.1007/s11263-024-02028-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this work, we propose to tackle the problem of domain generalization in the context of insufficient samples. Instead of extracting latent feature embeddings based on deterministic models, we propose to learn a domain-invariant representation based on the probabilistic framework by mapping each data point into probabilistic embeddings. Specifically, we first extend empirical maximum mean discrepancy (MMD) to a novel probabilistic MMD that can measure the discrepancy between mixture distributions (i.e., source domains) consisting of a series of latent distributions rather than latent points. Moreover, instead of imposing the contrastive semantic alignment (CSA) loss based on pairs of latent points, a novel probabilistic CSA loss encourages positive probabilistic embedding pairs to be closer while pulling other negative ones apart. Benefiting from the learned representation captured by probabilistic models, our proposed method can marriage the measurement on the distribution over distributions (i.e., the global perspective alignment) and the distribution-based contrastive semantic alignment (i.e., the local perspective alignment). Extensive experimental results on three challenging medical datasets show the effectiveness of our proposed method in the context of insufficient data compared with state-of-the-art methods.
Keywords:
Domain generalization
Healthcare
Small data
Medical imaging

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
4.0K
Citations:
2.8W

Organization

C
City University of Hong Kong
Scholars:
1.5K
Papers: 779
Citations: 0
U
University of Oxford
Scholars:
2.1K
Papers: 863
Citations: 0
Cited Papers

Cited Papers

Structural characterization of [Crypt221-Na] 2 [H2Ru4 (CO) 12][Crypt222-K] 2 [Ru4 (CO) 13]
err1998-08-01
err0
PREAI
errRobert Suter; Alak A. Bhattacharyya; L.-Y. Hsu; Jeanette A.Krause Bauer; Sheldon G. Shore
errShare
errSave
Substituent effects on 2-aza-5-hexynyl radical cyclization regiochemistry
err1982-01-01
err0
PREAI
errJoong-Kwon Choi; David J. Hart; Yeun-Min Tsai
errShare
errSave
Genomics of disease risk in globally diverse populations
err2019-06-24
err203
PREAI
errGurdasani, Deepti; Barroso, Ines; Zeggini, Eleftheria; Sandhu, Manjinder S.
errShare
errSave
A study on the challenges and opportunities of speech recognition for Bengali language
err2021-11-05
err11
PREAI
errMridha, M. F.; Ohi, Abu Quwsar; Hamid, Md Abdul; Monowar, Muhammad Mostafa
errShare
errSave
researcher View more