arrow
Return

Robust angle-based transfer learning in high dimensions

delete2025-07-01
delete4
delete
OA
AI
T
Tian Gu
Y
Yi Han
R
Rui Duan *
DOI:10.1093/jrsssb/qkae111delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Transfer learning improves target model performance by leveraging data from related source populations, especially when target data are scarce. This study addresses the challenge of training high-dimensional regression models with limited target data in the presence of heterogeneous source populations. We focus on a practical setting where only parameter estimates of pretrained source models are available, rather than individual-level source data. For a single source model, we propose a novel angle-based transfer learning (angleTL) method that leverages concordance between source and target model parameters. AngleTL adapts to the signal strength of the target model, unifies several benchmark methods, and mitigates negative transfer when between-population heterogeneity is large. We extend angleTL to incorporate multiple source models, accounting for varying levels of relevance among them. Our high-dimensional asymptotic analysis provides insights into when a source model benefits the target model and demonstrates the superiority of angleTL over other methods. Extensive simulations validate these findings and highlight the feasibility of applying angleTL to transfer genetic risk prediction models across multiple biobanks.
Keywords:
high-dimensional asymptotics
model aggregation
risk prediction
transfer learning

Journal

J
Journal of the Royal Statistical Society Series B-Statistical Methodology
IF:
3.6
Papers:
1.5K
Citations:
3.2W

Organization

C
columbia university
Scholars:
5.8K
Papers: 2.5K
Citations: 2
H
harvard university
Scholars:
2.5K
Papers: 1.0K
Citations: 1
Cited Papers

Cited Papers

Assessing Prostate Cancer Risk: Results from the Prostate Cancer Prevention Trial
err2006-04-19
err0
PREAI
errIan M. Thompson; Donna Pauler Ankerst; Chen Chi; Phyllis J. Goodman; Catherine M. Tangen; M. Scott Lucia; Ziding Feng; Howard L. Parnes; Charles A. Coltman
errShare
errSave
Polygenic Risk Scores Derived From Varying Definitions of Depression and Risk of Depression
err2021-10-01
err0
errOAAI
errBrittany L. Mitchell; Jackson G. Thorp; Yeda Wu; Adrian I. Campos; Dale R. Nyholt; Scott D. Gordon; David C. Whiteman; Catherine M. Olsen; Ian B. Hickie; Nicholas G. Martin; Sarah E. Medland; Naomi R. Wray; Enda M. Byrne
errShare
errSave
Joint Analysis of Psychiatric Disorders Increases Accuracy of Risk Prediction for Schizophrenia, Bipolar Disorder, and Major Depressive Disorder
err2015-02-01
err194
errOAAI
errMaier, Robert; Moser, Gerhard; Chen, Guo-Bo; Ripke, Stephan; Coryell, William; Potash, James B.; Scheftner, William A.; Shi, Jianxin; Weissman, Myrna M.; Hultman, Christina M.; Landen, Mikael; Levinson, Douglas F.; Kendler, Kenneth S.; Smoller, Jordan W.; Wray, Naomi R.; Lee, S. Hong
errShare
errSave
errShare
errSave
researcher View more