arrow
Return

Improving antibody language models with native pairing

delete2024-05-01
delete2
delete
OA
AI
S
Sarah M. Burbach
B
Bryan Briney *
DOI:10.1016/j.patter.2024.100967delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Existing antibody language models are limited by their use of unpaired antibody sequence data. A recently published dataset of -1.6 3 10 6 natively paired human antibody sequences offers a unique opportunity to evaluate how antibody language models are improved by training with native pairs. We trained three baseline antibody language models (BALM), using natively paired (BALM -paired), randomly -paired (BALM -shuffled), or unpaired (BALM -unpaired) sequences from this dataset. To address the paucity of paired sequences, we additionally fine-tuned ESM (evolutionary scale modeling) -2 with natively paired antibody sequences (ftESM). We provide evidence that training with native pairs allows the model to learn immunologically relevant features that span the light and heavy chains, which cannot be simulated by training with random pairs. We additionally show that training with native pairs improves model performance on a variety of metrics, including the ability of the model to classify antibodies by pathogen specificity.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Patterns cover
Patterns
IF:
7.4
Papers:
935
Citations:
3.6K

Organization

S
Scripps Research Institute
Scholars:
1.1W
Papers: 8.3K
Citations: 2.3W