arrow
Return

Protein sequence modelling with Bayesian flow networks

delete2025-04-03
delete0
delete
OA
AI
T
Timothy Atkinson
T
Thomas D. Barrett *
S
Scott Cameron
G
Greenig, Matthew
T
Tan, Charlie B.
R
Robinson, Louis
G
Graves, Alex
C
Copoiu, Liviu
A
Alexandre Laterre
DOI:10.1038/s41467-025-58250-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Exploring the vast and largely uncharted territory of amino acid sequences is crucial for understanding complex protein functions and the engineering of novel therapeutic proteins. Whilst generative machine learning has advanced protein sequence modelling, no existing approach is proficient in both unconditional and conditional generation. In this work, we propose that Bayesian Flow Networks (BFNs), a recently introduced framework for generative modelling, can address these challenges. We present ProtBFN, a 650M parameter model trained on protein sequences curated from UniProtKB, which generates natural-like, diverse, structurally coherent, and novel protein sequences, significantly outperforming leading autoregressive and discrete diffusion models. Further, we fine-tune ProtBFN on heavy chains from the Observed Antibody Space to obtain an antibody-specific model, AbBFN, which we use to evaluate zero-shot conditional generation capabilities. AbBFN is found to be competitive with or better than antibody-specific BERT-style models when applied to predicting individual framework or complimentary determining regions.
Keywords:
ANTIBODIES

Journal

Nature Communications cover
Nature Communications
IF:
15.7
Papers:
9.4W
Citations:
91.2W

Organization

No organization information available
Cited Papers

Cited Papers

The Origin of CDR H3 Structural Diversity
err2015-02-01
err0
errOAAI
errBrian D. Weitzner; Roland L. Dunbrack; Jeffrey J. Gray
errShare
errSave
The H3 loop of antibodies shows unique structural characteristics
err2017-04-06
err88
errOAAI
errRegep, Cristian; Georges, Guy; Shi, Jiye; Popovic, Bojana; Deane, Charlotte M.
errShare
errSave
Antibody optimization enabled by artificial intelligence predictions of binding affinity and naturalness
err
IF0
err2022-08-17
err0
PREAI
errSharrol Bachas; Goran Rakocevic; David Spencer; Anand V. Sastry; Robel Haile; John M. Sutton; George Kasun; Andrew Stachyra; Jahir M. Gutierrez; Edriss Yassine; Borka Medjo; Vincent Blay; Christa Kohnert; Jennifer T. Stanton; Alexander Brown; Nebojsa Tijanic; Cailen McCloskey; Rebecca Viazzo; Rebecca Consbruck; Hayley Carter; Simon Levine; Shaheed Abdulhaqq; Jacob Shaul; Abigail B. Ventura; Randal S. Olson; Engin Yapici; Joshua Meier; Sean McClain; Matthew Weinstock; Gregory Hannum; Ariel Schwartz; Miles Gander; Roberto Spreafico
errShare
errSave
ProteinGLUE multi-task benchmark suite for self-supervised protein modeling
err2022-09-26
err7
errOAAI
errCapel, Henriette; Weiler, Robin; Dijkstra, Maurits; Vleugels, Reinier; Bloem, Peter; Feenstra, K. Anton
errShare
errSave
errShare
errSave
Role of framework mutations and antibody flexibility in the evolution of broadly neutralizing antibodies
err2018-02-14
err78
errOAAI
errOvchinnikov, Victor; Louveau, Joy E.; Barton, John P.; Karplus, Martin; Chakraborty, Arup K.
errShare
errSave
errShare
errSave
researcher View more